Sep 18 21:58:14.757839 ip-10-0-141-99 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 18 21:58:14.757852 ip-10-0-141-99 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 18 21:58:14.757862 ip-10-0-141-99 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 18 21:58:14.758066 ip-10-0-141-99 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 18 21:58:24.888840 ip-10-0-141-99 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 18 21:58:24.888861 ip-10-0-141-99 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 7988b0e2cb6c4ad0a4204fbaf76126ff --
Sep 18 22:00:20.572713 ip-10-0-141-99 systemd[1]: Starting Kubernetes Kubelet...
Sep 18 22:00:20.934200 ip-10-0-141-99 kubenswrapper[2577]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 18 22:00:20.934200 ip-10-0-141-99 kubenswrapper[2577]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 18 22:00:20.934200 ip-10-0-141-99 kubenswrapper[2577]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 18 22:00:20.934200 ip-10-0-141-99 kubenswrapper[2577]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 18 22:00:20.934200 ip-10-0-141-99 kubenswrapper[2577]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 18 22:00:20.936502 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.936400    2577 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 18 22:00:20.939220 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.939204    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 18 22:00:20.939220 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.939220    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 18 22:00:20.939284 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.939224    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 18 22:00:20.939284 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.939227    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 18 22:00:20.939284 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.939230    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 18 22:00:20.939284 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.939233    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 18 22:00:20.939284 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.939235    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 18 22:00:20.939284 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.939240    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 18 22:00:20.939284 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.939243    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 18 22:00:20.939284 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.939246    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 18 22:00:20.939284 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.939249    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 18 22:00:20.939284 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.939251    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 18 22:00:20.939284 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.939254    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 18 22:00:20.939284 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.939256    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 18 22:00:20.939284 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.939260    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 18 22:00:20.939284 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.939264    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 18 22:00:20.939284 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.939267    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 18 22:00:20.939284 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.939270    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 18 22:00:20.939284 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.939272    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 18 22:00:20.939284 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.939275    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 18 22:00:20.939284 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.939277    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 18 22:00:20.939752 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.939280    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 18 22:00:20.939752 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.939282    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 18 22:00:20.939752 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.939285    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 18 22:00:20.939752 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.939287    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 18 22:00:20.939752 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.939290    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 18 22:00:20.939752 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.939293    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 18 22:00:20.939752 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.939296    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 18 22:00:20.939752 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.939299    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 18 22:00:20.939752 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.939301    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 18 22:00:20.939752 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.939303    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 18 22:00:20.939752 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.939306    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 18 22:00:20.939752 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.939308    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 18 22:00:20.939752 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.939311    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 18 22:00:20.939752 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.939313    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 18 22:00:20.939752 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.939316    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 18 22:00:20.939752 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.939318    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 18 22:00:20.939752 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.939320    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 18 22:00:20.939752 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.939323    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 18 22:00:20.939752 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.939325    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 18 22:00:20.939752 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.939328    2577 feature_gate.go:328] unrecognized feature gate: Example2
Sep 18 22:00:20.940236 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.939330    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 18 22:00:20.940236 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.939333    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 18 22:00:20.940236 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.939335    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 18 22:00:20.940236 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.939338    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 18 22:00:20.940236 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.939340    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 18 22:00:20.940236 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.939343    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 18 22:00:20.940236 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.939345    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 18 22:00:20.940236 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.939347    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 18 22:00:20.940236 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.939350    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 18 22:00:20.940236 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.939352    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 18 22:00:20.940236 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.939354    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 18 22:00:20.940236 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.939357    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 18 22:00:20.940236 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.939359    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 18 22:00:20.940236 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.939363    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 18 22:00:20.940236 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.939367    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 18 22:00:20.940236 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.939370    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 18 22:00:20.940236 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.939372    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 18 22:00:20.940236 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.939375    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 18 22:00:20.940236 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.939378    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 18 22:00:20.940236 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.939381    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 18 22:00:20.940750 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.939383    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 18 22:00:20.940750 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.939385    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 18 22:00:20.940750 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.939388    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 18 22:00:20.940750 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.939390    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 18 22:00:20.940750 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.939393    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 18 22:00:20.940750 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.939395    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 18 22:00:20.940750 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.939398    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 18 22:00:20.940750 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.939400    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 18 22:00:20.940750 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.939403    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 18 22:00:20.940750 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.939405    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 18 22:00:20.940750 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.939420    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 18 22:00:20.940750 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.939423    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 18 22:00:20.940750 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.939427    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 18 22:00:20.940750 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.939430    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 18 22:00:20.940750 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.939433    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 18 22:00:20.940750 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.939435    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 18 22:00:20.940750 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.939438    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 18 22:00:20.940750 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.939440    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 18 22:00:20.940750 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.939443    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 18 22:00:20.940750 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.939445    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 18 22:00:20.941237 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.939448    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 18 22:00:20.941237 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.939451    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 18 22:00:20.941237 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.939453    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 18 22:00:20.941237 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.939456    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 18 22:00:20.941237 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.939459    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 18 22:00:20.941237 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.939462    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 18 22:00:20.941237 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.939465    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 18 22:00:20.941237 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.939467    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 18 22:00:20.941237 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.939471    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 18 22:00:20.941237 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.939475    2577 feature_gate.go:328] unrecognized feature gate: Example
Sep 18 22:00:20.941237 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.939479    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 18 22:00:20.941237 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.939482    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 18 22:00:20.941237 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.939485    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 18 22:00:20.941237 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.939488    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 18 22:00:20.941237 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.939491    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 18 22:00:20.941237 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.939493    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 18 22:00:20.941237 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.939495    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 18 22:00:20.941237 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.939498    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 18 22:00:20.941237 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941090    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 18 22:00:20.941708 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941100    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 18 22:00:20.941708 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941104    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 18 22:00:20.941708 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941108    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 18 22:00:20.941708 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941111    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 18 22:00:20.941708 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941114    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 18 22:00:20.941708 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941116    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 18 22:00:20.941708 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941120    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 18 22:00:20.941708 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941123    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 18 22:00:20.941708 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941125    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 18 22:00:20.941708 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941128    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 18 22:00:20.941708 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941130    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 18 22:00:20.941708 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941133    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 18 22:00:20.941708 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941135    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 18 22:00:20.941708 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941138    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 18 22:00:20.941708 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941141    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 18 22:00:20.941708 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941144    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 18 22:00:20.941708 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941146    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 18 22:00:20.941708 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941149    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 18 22:00:20.941708 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941152    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 18 22:00:20.941708 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941155    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 18 22:00:20.942235 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941157    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 18 22:00:20.942235 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941160    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 18 22:00:20.942235 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941162    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 18 22:00:20.942235 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941164    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 18 22:00:20.942235 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941167    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 18 22:00:20.942235 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941169    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 18 22:00:20.942235 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941172    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 18 22:00:20.942235 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941174    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 18 22:00:20.942235 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941177    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 18 22:00:20.942235 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941179    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 18 22:00:20.942235 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941183    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 18 22:00:20.942235 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941187    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 18 22:00:20.942235 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941190    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 18 22:00:20.942235 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941192    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 18 22:00:20.942235 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941195    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 18 22:00:20.942235 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941198    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 18 22:00:20.942235 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941200    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 18 22:00:20.942235 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941203    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 18 22:00:20.942235 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941206    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 18 22:00:20.942235 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941209    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 18 22:00:20.942730 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941212    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 18 22:00:20.942730 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941214    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 18 22:00:20.942730 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941217    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 18 22:00:20.942730 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941219    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 18 22:00:20.942730 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941222    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 18 22:00:20.942730 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941225    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 18 22:00:20.942730 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941227    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 18 22:00:20.942730 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941230    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 18 22:00:20.942730 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941232    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 18 22:00:20.942730 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941235    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 18 22:00:20.942730 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941238    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 18 22:00:20.942730 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941241    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 18 22:00:20.942730 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941244    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 18 22:00:20.942730 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941247    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 18 22:00:20.942730 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941250    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 18 22:00:20.942730 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941255    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 18 22:00:20.942730 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941258    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 18 22:00:20.942730 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941261    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 18 22:00:20.942730 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941264    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 18 22:00:20.943193 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941266    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 18 22:00:20.943193 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941269    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 18 22:00:20.943193 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941272    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 18 22:00:20.943193 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941274    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 18 22:00:20.943193 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941278    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 18 22:00:20.943193 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941282    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 18 22:00:20.943193 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941285    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 18 22:00:20.943193 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941290    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 18 22:00:20.943193 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941293    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 18 22:00:20.943193 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941295    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 18 22:00:20.943193 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941298    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 18 22:00:20.943193 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941300    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 18 22:00:20.943193 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941303    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 18 22:00:20.943193 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941308    2577 feature_gate.go:328] unrecognized feature gate: Example2
Sep 18 22:00:20.943193 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941310    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 18 22:00:20.943193 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941313    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 18 22:00:20.943193 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941316    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 18 22:00:20.943193 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941319    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 18 22:00:20.943193 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941321    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 18 22:00:20.943660 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941323    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 18 22:00:20.943660 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941326    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 18 22:00:20.943660 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941329    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 18 22:00:20.943660 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941331    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 18 22:00:20.943660 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941335    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 18 22:00:20.943660 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941337    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 18 22:00:20.943660 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941340    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 18 22:00:20.943660 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941342    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 18 22:00:20.943660 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941345    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 18 22:00:20.943660 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941347    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 18 22:00:20.943660 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941350    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 18 22:00:20.943660 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941352    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 18 22:00:20.943660 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941354    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 18 22:00:20.943660 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941357    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 18 22:00:20.943660 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941359    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 18 22:00:20.943660 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941362    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 18 22:00:20.943660 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941364    2577 feature_gate.go:328] unrecognized feature gate: Example
Sep 18 22:00:20.943660 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941366    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 18 22:00:20.943660 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941369    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 18 22:00:20.943660 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941371    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 18 22:00:20.944155 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941746    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 18 22:00:20.944155 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941751    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 18 22:00:20.944155 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941754    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 18 22:00:20.944155 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941756    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 18 22:00:20.944155 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941759    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 18 22:00:20.944155 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941761    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 18 22:00:20.944155 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941764    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 18 22:00:20.944155 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941767    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 18 22:00:20.944155 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941770    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 18 22:00:20.944155 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941772    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 18 22:00:20.944155 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941775    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 18 22:00:20.944155 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941777    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 18 22:00:20.944155 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941780    2577 feature_gate.go:328] unrecognized feature gate: Example
Sep 18 22:00:20.944155 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941783    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 18 22:00:20.944155 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941785    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 18 22:00:20.944155 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941788    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 18 22:00:20.944155 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941791    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 18 22:00:20.944155 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941794    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 18 22:00:20.944155 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941796    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 18 22:00:20.944642 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941798    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 18 22:00:20.944642 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941801    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 18 22:00:20.944642 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941803    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 18 22:00:20.944642 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941806    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 18 22:00:20.944642 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941808    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 18 22:00:20.944642 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941811    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 18 22:00:20.944642 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941813    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 18 22:00:20.944642 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941816    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 18 22:00:20.944642 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941818    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 18 22:00:20.944642 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941820    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 18 22:00:20.944642 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941823    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 18 22:00:20.944642 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941826    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 18 22:00:20.944642 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941830    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 18 22:00:20.944642 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941833    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 18 22:00:20.944642 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941836    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 18 22:00:20.944642 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941838    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 18 22:00:20.944642 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941841    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 18 22:00:20.944642 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941843    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 18 22:00:20.944642 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941846    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 18 22:00:20.945102 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941848    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 18 22:00:20.945102 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941851    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 18 22:00:20.945102 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941854    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 18 22:00:20.945102 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941857    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 18 22:00:20.945102 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941859    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 18 22:00:20.945102 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941862    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 18 22:00:20.945102 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941866    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 18 22:00:20.945102 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941869    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 18 22:00:20.945102 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941872    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 18 22:00:20.945102 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941875    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 18 22:00:20.945102 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941878    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 18 22:00:20.945102 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941880    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 18 22:00:20.945102 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941882    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 18 22:00:20.945102 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941885    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 18 22:00:20.945102 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941887    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 18 22:00:20.945102 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941889    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 18 22:00:20.945102 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941892    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 18 22:00:20.945102 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941894    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 18 22:00:20.945102 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941897    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 18 22:00:20.945102 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941900    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 18 22:00:20.945586 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941902    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 18 22:00:20.945586 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941905    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 18 22:00:20.945586 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941908    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 18 22:00:20.945586 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941910    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 18 22:00:20.945586 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941912    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 18 22:00:20.945586 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941915    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 18 22:00:20.945586 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941917    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 18 22:00:20.945586 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941920    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 18 22:00:20.945586 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941923    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 18 22:00:20.945586 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941925    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 18 22:00:20.945586 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941927    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 18 22:00:20.945586 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941930    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 18 22:00:20.945586 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941932    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 18 22:00:20.945586 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941935    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 18 22:00:20.945586 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941937    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 18 22:00:20.945586 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941940    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 18 22:00:20.945586 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941942    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 18 22:00:20.945586 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941946    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 18 22:00:20.945586 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941948    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 18 22:00:20.945586 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941950    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 18 22:00:20.946078 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941953    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 18 22:00:20.946078 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941955    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 18 22:00:20.946078 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941958    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 18 22:00:20.946078 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941960    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 18 22:00:20.946078 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941964    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 18 22:00:20.946078 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941967    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 18 22:00:20.946078 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941970    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 18 22:00:20.946078 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941973    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 18 22:00:20.946078 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941976    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 18 22:00:20.946078 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941979    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 18 22:00:20.946078 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941981    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 18 22:00:20.946078 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941984    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 18 22:00:20.946078 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941987    2577 feature_gate.go:328] unrecognized feature gate: Example2
Sep 18 22:00:20.946078 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941990    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 18 22:00:20.946078 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941993    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 18 22:00:20.946078 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941995    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 18 22:00:20.946078 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.941998    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 18 22:00:20.946078 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.942000    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 18 22:00:20.946078 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.942002    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 18 22:00:20.946078 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.942005    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 18 22:00:20.946575 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.942007    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 18 22:00:20.946575 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942082    2577 flags.go:64] FLAG: --address="0.0.0.0"
Sep 18 22:00:20.946575 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942129    2577 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 18 22:00:20.946575 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942136    2577 flags.go:64] FLAG: --anonymous-auth="true"
Sep 18 22:00:20.946575 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942141    2577 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 18 22:00:20.946575 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942145    2577 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 18 22:00:20.946575 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942149    2577 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 18 22:00:20.946575 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942156    2577 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 18 22:00:20.946575 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942160    2577 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 18 22:00:20.946575 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942163    2577 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 18 22:00:20.946575 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942166    2577 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 18 22:00:20.946575 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942170    2577 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 18 22:00:20.946575 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942173    2577 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 18 22:00:20.946575 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942176    2577 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 18 22:00:20.946575 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942179    2577 flags.go:64] FLAG: --cgroup-root=""
Sep 18 22:00:20.946575 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942182    2577 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 18 22:00:20.946575 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942185    2577 flags.go:64] FLAG: --client-ca-file=""
Sep 18 22:00:20.946575 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942188    2577 flags.go:64] FLAG: --cloud-provider="external"
Sep 18 22:00:20.946575 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942191    2577 flags.go:64] FLAG: --cluster-dns="[]"
Sep 18 22:00:20.946575 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942194    2577 flags.go:64] FLAG: --cluster-domain=""
Sep 18 22:00:20.946575 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942197    2577 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 18 22:00:20.946575 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942200    2577 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 18 22:00:20.946575 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942203    2577 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 18 22:00:20.946575 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942207    2577 flags.go:64] FLAG: --container-log-max-files="5"
Sep 18 22:00:20.947191 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942210    2577 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 18 22:00:20.947191 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942213    2577 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 18 22:00:20.947191 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942216    2577 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 18 22:00:20.947191 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942219    2577 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 18 22:00:20.947191 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942222    2577 flags.go:64] FLAG: --contention-profiling="false"
Sep 18 22:00:20.947191 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942225    2577 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 18 22:00:20.947191 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942228    2577 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 18 22:00:20.947191 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942231    2577 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 18 22:00:20.947191 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942233    2577 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 18 22:00:20.947191 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942237    2577 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 18 22:00:20.947191 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942241    2577 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 18 22:00:20.947191 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942243    2577 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 18 22:00:20.947191 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942246    2577 flags.go:64] FLAG: --enable-load-reader="false"
Sep 18 22:00:20.947191 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942249    2577 flags.go:64] FLAG: --enable-server="true"
Sep 18 22:00:20.947191 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942253    2577 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 18 22:00:20.947191 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942257    2577 flags.go:64] FLAG: --event-burst="100"
Sep 18 22:00:20.947191 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942262    2577 flags.go:64] FLAG: --event-qps="50"
Sep 18 22:00:20.947191 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942264    2577 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 18 22:00:20.947191 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942268    2577 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 18 22:00:20.947191 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942270    2577 flags.go:64] FLAG: --eviction-hard=""
Sep 18 22:00:20.947191 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942274    2577 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 18 22:00:20.947191 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942277    2577 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 18 22:00:20.947191 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942281    2577 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 18 22:00:20.947191 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942284    2577 flags.go:64] FLAG: --eviction-soft=""
Sep 18 22:00:20.947191 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942287    2577 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 18 22:00:20.947807 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942290    2577 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 18 22:00:20.947807 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942293    2577 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 18 22:00:20.947807 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942296    2577 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 18 22:00:20.947807 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942299    2577 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 18 22:00:20.947807 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942301    2577 flags.go:64] FLAG: --fail-swap-on="true"
Sep 18 22:00:20.947807 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942304    2577 flags.go:64] FLAG: --feature-gates=""
Sep 18 22:00:20.947807 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942308    2577 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 18 22:00:20.947807 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942311    2577 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 18 22:00:20.947807 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942315    2577 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 18 22:00:20.947807 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942318    2577 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 18 22:00:20.947807 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942322    2577 flags.go:64] FLAG: --healthz-port="10248"
Sep 18 22:00:20.947807 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942325    2577 flags.go:64] FLAG: --help="false"
Sep 18 22:00:20.947807 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942328    2577 flags.go:64] FLAG: --hostname-override="ip-10-0-141-99.ec2.internal"
Sep 18 22:00:20.947807 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942331    2577 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 18 22:00:20.947807 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942334    2577 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 18 22:00:20.947807 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942337    2577 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 18 22:00:20.947807 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942340    2577 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 18 22:00:20.947807 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942343    2577 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 18 22:00:20.947807 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942346    2577 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 18 22:00:20.947807 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942349    2577 flags.go:64] FLAG: --image-service-endpoint=""
Sep 18 22:00:20.947807 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942352    2577 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 18 22:00:20.947807 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942354    2577 flags.go:64] FLAG: --kube-api-burst="100"
Sep 18 22:00:20.947807 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942357    2577 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 18 22:00:20.948526 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942360    2577 flags.go:64] FLAG: --kube-api-qps="50"
Sep 18 22:00:20.948526 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942364    2577 flags.go:64] FLAG: --kube-reserved=""
Sep 18 22:00:20.948526 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942366    2577 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 18 22:00:20.948526 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942369    2577 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 18 22:00:20.948526 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942372    2577 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 18 22:00:20.948526 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942375    2577 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 18 22:00:20.948526 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942379    2577 flags.go:64] FLAG: --lock-file=""
Sep 18 22:00:20.948526 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942381    2577 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 18 22:00:20.948526 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942384    2577 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 18 22:00:20.948526 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942387    2577 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 18 22:00:20.948526 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942392    2577 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 18 22:00:20.948526 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942395    2577 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 18 22:00:20.948526 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942398    2577 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 18 22:00:20.948526 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942400    2577 flags.go:64] FLAG: --logging-format="text"
Sep 18 22:00:20.948526 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942403    2577 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 18 22:00:20.948526 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942406    2577 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 18 22:00:20.948526 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942422    2577 flags.go:64] FLAG: --manifest-url=""
Sep 18 22:00:20.948526 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942427    2577 flags.go:64] FLAG: --manifest-url-header=""
Sep 18 22:00:20.948526 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942431    2577 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 18 22:00:20.948526 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942434    2577 flags.go:64] FLAG: --max-open-files="1000000"
Sep 18 22:00:20.948526 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942438    2577 flags.go:64] FLAG: --max-pods="110"
Sep 18 22:00:20.948526 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942441    2577 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 18 22:00:20.948526 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942444    2577 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 18 22:00:20.948526 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942446    2577 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 18 22:00:20.948526 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942449    2577 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 18 22:00:20.949134 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942452    2577 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 18 22:00:20.949134 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942455    2577 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 18 22:00:20.949134 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942458    2577 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 18 22:00:20.949134 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942465    2577 flags.go:64] FLAG: --node-status-max-images="50"
Sep 18 22:00:20.949134 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942468    2577 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 18 22:00:20.949134 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942471    2577 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 18 22:00:20.949134 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942474    2577 flags.go:64] FLAG: --pod-cidr=""
Sep 18 22:00:20.949134 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942477    2577 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a6abe77af61c5f2e3985a83e7d43538aefc38b1b0444127da14ee0e8cf8f76fc"
Sep 18 22:00:20.949134 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942482    2577 flags.go:64] FLAG: --pod-manifest-path=""
Sep 18 22:00:20.949134 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942485    2577 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 18 22:00:20.949134 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942489    2577 flags.go:64] FLAG: --pods-per-core="0"
Sep 18 22:00:20.949134 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942491    2577 flags.go:64] FLAG: --port="10250"
Sep 18 22:00:20.949134 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942494    2577 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 18 22:00:20.949134 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942499    2577 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0c94d20ebaae91dac"
Sep 18 22:00:20.949134 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942502    2577 flags.go:64] FLAG: --qos-reserved=""
Sep 18 22:00:20.949134 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942505    2577 flags.go:64] FLAG: --read-only-port="10255"
Sep 18 22:00:20.949134 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942508    2577 flags.go:64] FLAG: --register-node="true"
Sep 18 22:00:20.949134 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942510    2577 flags.go:64] FLAG: --register-with-taints=""
Sep 18 22:00:20.949134 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942514    2577 flags.go:64] FLAG: --registry-burst="10"
Sep 18 22:00:20.949134 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942517    2577 flags.go:64] FLAG: --registry-qps="5"
Sep 18 22:00:20.949134 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942519    2577 flags.go:64] FLAG: --reserved-cpus=""
Sep 18 22:00:20.949134 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942522    2577 flags.go:64] FLAG: --reserved-memory=""
Sep 18 22:00:20.949134 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942525    2577 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 18 22:00:20.949134 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942528    2577 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 18 22:00:20.949134 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942531    2577 flags.go:64] FLAG: --rotate-certificates="false"
Sep 18 22:00:20.949772 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942535    2577 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 18 22:00:20.949772 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942538    2577 flags.go:64] FLAG: --runonce="false"
Sep 18 22:00:20.949772 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942541    2577 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 18 22:00:20.949772 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942544    2577 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 18 22:00:20.949772 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942547    2577 flags.go:64] FLAG: --seccomp-default="false"
Sep 18 22:00:20.949772 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942550    2577 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 18 22:00:20.949772 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942553    2577 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 18 22:00:20.949772 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942556    2577 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 18 22:00:20.949772 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942558    2577 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 18 22:00:20.949772 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942561    2577 flags.go:64] FLAG: --storage-driver-password="root"
Sep 18 22:00:20.949772 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942564    2577 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 18 22:00:20.949772 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942567    2577 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 18 22:00:20.949772 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942569    2577 flags.go:64] FLAG: --storage-driver-user="root"
Sep 18 22:00:20.949772 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942572    2577 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 18 22:00:20.949772 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942575    2577 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 18 22:00:20.949772 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942578    2577 flags.go:64] FLAG: --system-cgroups=""
Sep 18 22:00:20.949772 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942580    2577 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 18 22:00:20.949772 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942586    2577 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 18 22:00:20.949772 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942589    2577 flags.go:64] FLAG: --tls-cert-file=""
Sep 18 22:00:20.949772 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942591    2577 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 18 22:00:20.949772 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942597    2577 flags.go:64] FLAG: --tls-min-version=""
Sep 18 22:00:20.949772 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942600    2577 flags.go:64] FLAG: --tls-private-key-file=""
Sep 18 22:00:20.949772 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942602    2577 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 18 22:00:20.949772 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942605    2577 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 18 22:00:20.949772 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942608    2577 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 18 22:00:20.950496 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942611    2577 flags.go:64] FLAG: --v="2"
Sep 18 22:00:20.950496 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942615    2577 flags.go:64] FLAG: --version="false"
Sep 18 22:00:20.950496 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942618    2577 flags.go:64] FLAG: --vmodule=""
Sep 18 22:00:20.950496 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942622    2577 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 18 22:00:20.950496 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.942625    2577 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 18 22:00:20.950496 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.942741    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 18 22:00:20.950496 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.942745    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 18 22:00:20.950496 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.942750    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 18 22:00:20.950496 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.942753    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 18 22:00:20.950496 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.942756    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 18 22:00:20.950496 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.942758    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 18 22:00:20.950496 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.942761    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 18 22:00:20.950496 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.942764    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 18 22:00:20.950496 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.942766    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 18 22:00:20.950496 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.942769    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 18 22:00:20.950496 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.942772    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 18 22:00:20.950496 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.942774    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 18 22:00:20.950496 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.942777    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 18 22:00:20.950496 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.942779    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 18 22:00:20.950496 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.942781    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 18 22:00:20.950496 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.942784    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 18 22:00:20.951380 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.942786    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 18 22:00:20.951380 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.942789    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 18 22:00:20.951380 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.942792    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 18 22:00:20.951380 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.942794    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 18 22:00:20.951380 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.942797    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 18 22:00:20.951380 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.942801    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 18 22:00:20.951380 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.942805    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 18 22:00:20.951380 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.942808    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 18 22:00:20.951380 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.942811    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 18 22:00:20.951380 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.942814    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 18 22:00:20.951380 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.942816    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 18 22:00:20.951380 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.942819    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 18 22:00:20.951380 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.942821    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 18 22:00:20.951380 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.942824    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 18 22:00:20.951380 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.942826    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 18 22:00:20.951380 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.942828    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 18 22:00:20.951380 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.942831    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 18 22:00:20.951380 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.942833    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 18 22:00:20.951380 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.942837    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 18 22:00:20.951960 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.942840    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 18 22:00:20.951960 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.942842    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 18 22:00:20.951960 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.942845    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 18 22:00:20.951960 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.942847    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 18 22:00:20.951960 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.942850    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 18 22:00:20.951960 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.942853    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 18 22:00:20.951960 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.942857    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 18 22:00:20.951960 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.942861    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 18 22:00:20.951960 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.942864    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 18 22:00:20.951960 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.942868    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 18 22:00:20.951960 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.942871    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 18 22:00:20.951960 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.942874    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 18 22:00:20.951960 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.942877    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 18 22:00:20.951960 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.942879    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 18 22:00:20.951960 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.942882    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 18 22:00:20.951960 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.942885    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 18 22:00:20.951960 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.942887    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 18 22:00:20.951960 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.942889    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 18 22:00:20.951960 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.942893    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 18 22:00:20.951960 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.942896    2577 feature_gate.go:328] unrecognized feature gate: Example2
Sep 18 22:00:20.951960 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.942898    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 18 22:00:20.952519 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.942901    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 18 22:00:20.952519 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.942903    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 18 22:00:20.952519 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.942906    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 18 22:00:20.952519 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.942909    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 18 22:00:20.952519 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.942912    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 18 22:00:20.952519 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.942914    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 18 22:00:20.952519 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.942917    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 18 22:00:20.952519 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.942919    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 18 22:00:20.952519 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.942922    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 18 22:00:20.952519 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.942924    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 18 22:00:20.952519 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.942929    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 18 22:00:20.952519 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.942933    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 18 22:00:20.952519 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.942936    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 18 22:00:20.952519 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.942939    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 18 22:00:20.952519 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.942942    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 18 22:00:20.952519 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.942944    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 18 22:00:20.952519 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.942947    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 18 22:00:20.952519 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.942949    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 18 22:00:20.952519 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.942952    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 18 22:00:20.952993 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.942954    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 18 22:00:20.952993 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.942957    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 18 22:00:20.952993 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.942960    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 18 22:00:20.952993 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.942963    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 18 22:00:20.952993 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.942966    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 18 22:00:20.952993 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.942969    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 18 22:00:20.952993 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.942972    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 18 22:00:20.952993 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.942974    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 18 22:00:20.952993 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.942977    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 18 22:00:20.952993 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.942979    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 18 22:00:20.952993 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.942982    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 18 22:00:20.952993 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.942985    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 18 22:00:20.952993 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.942988    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 18 22:00:20.952993 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.942990    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 18 22:00:20.952993 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.942993    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 18 22:00:20.952993 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.942995    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 18 22:00:20.952993 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.942998    2577 feature_gate.go:328] unrecognized feature gate: Example
Sep 18 22:00:20.952993 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.943000    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 18 22:00:20.952993 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.943003    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 18 22:00:20.953470 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.943005    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 18 22:00:20.953470 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.943008    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 18 22:00:20.953470 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.943010    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 18 22:00:20.953470 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.943013    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 18 22:00:20.953470 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.943016    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 18 22:00:20.953470 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.943022    2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 18 22:00:20.953470 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.951650    2577 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 18 22:00:20.953470 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.951664    2577 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 18 22:00:20.953470 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.951685    2577 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 18 22:00:20.953470 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.951691    2577 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 18 22:00:20.953470 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.951746    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 18 22:00:20.953470 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.951751    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 18 22:00:20.953470 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.951755    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 18 22:00:20.953470 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.951758    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 18 22:00:20.953817 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.951761    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 18 22:00:20.953817 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.951764    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 18 22:00:20.953817 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.951767    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 18 22:00:20.953817 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.951769    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 18 22:00:20.953817 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.951772    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 18 22:00:20.953817 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.951775    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 18 22:00:20.953817 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.951777    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 18 22:00:20.953817 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.951780    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 18 22:00:20.953817 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.951784    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 18 22:00:20.953817 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.951788    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 18 22:00:20.953817 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.951791    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 18 22:00:20.953817 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.951794    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 18 22:00:20.953817 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.951797    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 18 22:00:20.953817 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.951800    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 18 22:00:20.953817 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.951803    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 18 22:00:20.953817 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.951805    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 18 22:00:20.953817 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.951808    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 18 22:00:20.953817 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.951810    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 18 22:00:20.953817 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.951813    2577 feature_gate.go:328] unrecognized feature gate: Example2
Sep 18 22:00:20.953817 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.951816    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 18 22:00:20.954295 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.951818    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 18 22:00:20.954295 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.951821    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 18 22:00:20.954295 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.951823    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 18 22:00:20.954295 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.951827    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 18 22:00:20.954295 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.951829    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 18 22:00:20.954295 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.951832    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 18 22:00:20.954295 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.951834    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 18 22:00:20.954295 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.951838    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 18 22:00:20.954295 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.951841    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 18 22:00:20.954295 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.951845    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 18 22:00:20.954295 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.951847    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 18 22:00:20.954295 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.951850    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 18 22:00:20.954295 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.951853    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 18 22:00:20.954295 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.951855    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 18 22:00:20.954295 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.951858    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 18 22:00:20.954295 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.951860    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 18 22:00:20.954295 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.951863    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 18 22:00:20.954295 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.951866    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 18 22:00:20.954295 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.951868    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 18 22:00:20.954295 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.951870    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 18 22:00:20.954857 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.951873    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 18 22:00:20.954857 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.951875    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 18 22:00:20.954857 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.951879    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 18 22:00:20.954857 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.951882    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 18 22:00:20.954857 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.951884    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 18 22:00:20.954857 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.951887    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 18 22:00:20.954857 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.951889    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 18 22:00:20.954857 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.951892    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 18 22:00:20.954857 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.951894    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 18 22:00:20.954857 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.951896    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 18 22:00:20.954857 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.951899    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 18 22:00:20.954857 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.951901    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 18 22:00:20.954857 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.951905    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 18 22:00:20.954857 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.951909    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 18 22:00:20.954857 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.951912    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 18 22:00:20.954857 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.951915    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 18 22:00:20.954857 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.951918    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 18 22:00:20.954857 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.951921    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 18 22:00:20.954857 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.951923    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 18 22:00:20.955312 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.951926    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 18 22:00:20.955312 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.951928    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 18 22:00:20.955312 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.951931    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 18 22:00:20.955312 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.951933    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 18 22:00:20.955312 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.951935    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 18 22:00:20.955312 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.951938    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 18 22:00:20.955312 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.951940    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 18 22:00:20.955312 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.951943    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 18 22:00:20.955312 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.951945    2577 feature_gate.go:328] unrecognized feature gate: Example
Sep 18 22:00:20.955312 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.951947    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 18 22:00:20.955312 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.951950    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 18 22:00:20.955312 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.951952    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 18 22:00:20.955312 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.951955    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 18 22:00:20.955312 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.951957    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 18 22:00:20.955312 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.951960    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 18 22:00:20.955312 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.951962    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 18 22:00:20.955312 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.951965    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 18 22:00:20.955312 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.951968    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 18 22:00:20.955312 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.951970    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 18 22:00:20.955312 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.951973    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 18 22:00:20.955872 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.951976    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 18 22:00:20.955872 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.951978    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 18 22:00:20.955872 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.951981    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 18 22:00:20.955872 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.951983    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 18 22:00:20.955872 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.951986    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 18 22:00:20.955872 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.951989    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 18 22:00:20.955872 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.951991    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 18 22:00:20.955872 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.951993    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 18 22:00:20.955872 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.951996    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 18 22:00:20.955872 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.951998    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 18 22:00:20.955872 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.952001    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 18 22:00:20.955872 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.952003    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 18 22:00:20.955872 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.952006    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 18 22:00:20.955872 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.952008    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 18 22:00:20.955872 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.952011    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 18 22:00:20.955872 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.952013    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 18 22:00:20.956277 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.952018    2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 18 22:00:20.956277 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.952124    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 18 22:00:20.956277 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.952129    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 18 22:00:20.956277 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.952132    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 18 22:00:20.956277 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.952135    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 18 22:00:20.956277 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.952139    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 18 22:00:20.956277 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.952143    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 18 22:00:20.956277 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.952154    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 18 22:00:20.956277 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.952158    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 18 22:00:20.956277 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.952161    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 18 22:00:20.956277 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.952164    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 18 22:00:20.956277 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.952167    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 18 22:00:20.956277 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.952172    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 18 22:00:20.956277 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.952176    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 18 22:00:20.956729 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.952179    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 18 22:00:20.956729 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.952182    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 18 22:00:20.956729 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.952184    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 18 22:00:20.956729 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.952187    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 18 22:00:20.956729 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.952190    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 18 22:00:20.956729 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.952192    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 18 22:00:20.956729 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.952195    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 18 22:00:20.956729 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.952198    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 18 22:00:20.956729 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.952200    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 18 22:00:20.956729 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.952203    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 18 22:00:20.956729 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.952205    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 18 22:00:20.956729 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.952208    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 18 22:00:20.956729 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.952210    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 18 22:00:20.956729 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.952213    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 18 22:00:20.956729 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.952215    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 18 22:00:20.956729 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.952218    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 18 22:00:20.956729 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.952220    2577 feature_gate.go:328] unrecognized feature gate: Example
Sep 18 22:00:20.956729 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.952223    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 18 22:00:20.956729 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.952226    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 18 22:00:20.956729 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.952228    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 18 22:00:20.957190 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.952230    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 18 22:00:20.957190 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.952233    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 18 22:00:20.957190 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.952235    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 18 22:00:20.957190 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.952238    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 18 22:00:20.957190 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.952240    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 18 22:00:20.957190 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.952242    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 18 22:00:20.957190 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.952245    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 18 22:00:20.957190 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.952247    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 18 22:00:20.957190 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.952250    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 18 22:00:20.957190 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.952252    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 18 22:00:20.957190 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.952255    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 18 22:00:20.957190 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.952257    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 18 22:00:20.957190 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.952261    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 18 22:00:20.957190 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.952263    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 18 22:00:20.957190 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.952266    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 18 22:00:20.957190 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.952268    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 18 22:00:20.957190 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.952271    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 18 22:00:20.957190 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.952273    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 18 22:00:20.957190 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.952276    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 18 22:00:20.957190 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.952278    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 18 22:00:20.957757 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.952280    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 18 22:00:20.957757 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.952283    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 18 22:00:20.957757 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.952285    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 18 22:00:20.957757 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.952288    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 18 22:00:20.957757 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.952290    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 18 22:00:20.957757 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.952292    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 18 22:00:20.957757 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.952295    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 18 22:00:20.957757 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.952297    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 18 22:00:20.957757 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.952300    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 18 22:00:20.957757 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.952302    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 18 22:00:20.957757 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.952304    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 18 22:00:20.957757 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.952307    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 18 22:00:20.957757 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.952309    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 18 22:00:20.957757 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.952312    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 18 22:00:20.957757 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.952315    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 18 22:00:20.957757 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.952318    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 18 22:00:20.957757 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.952321    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 18 22:00:20.957757 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.952323    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 18 22:00:20.957757 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.952326    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 18 22:00:20.958210 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.952329    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 18 22:00:20.958210 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.952332    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 18 22:00:20.958210 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.952334    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 18 22:00:20.958210 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.952337    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 18 22:00:20.958210 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.952339    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 18 22:00:20.958210 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.952342    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 18 22:00:20.958210 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.952344    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 18 22:00:20.958210 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.952347    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 18 22:00:20.958210 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.952350    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 18 22:00:20.958210 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.952352    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 18 22:00:20.958210 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.952355    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 18 22:00:20.958210 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.952357    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 18 22:00:20.958210 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.952360    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 18 22:00:20.958210 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.952363    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 18 22:00:20.958210 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.952365    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 18 22:00:20.958210 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.952367    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 18 22:00:20.958210 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.952370    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 18 22:00:20.958210 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.952372    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 18 22:00:20.958210 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.952375    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 18 22:00:20.958210 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.952377    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 18 22:00:20.958717 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.952380    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 18 22:00:20.958717 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.952382    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 18 22:00:20.958717 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.952384    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 18 22:00:20.958717 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.952387    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 18 22:00:20.958717 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.952389    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 18 22:00:20.958717 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.952392    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 18 22:00:20.958717 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:20.952394    2577 feature_gate.go:328] unrecognized feature gate: Example2
Sep 18 22:00:20.958717 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.952399    2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 18 22:00:20.958717 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.952542    2577 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 18 22:00:20.958717 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.954580    2577 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 18 22:00:20.958717 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.955356    2577 server.go:1019] "Starting client certificate rotation"
Sep 18 22:00:20.958717 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.955462    2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 18 22:00:20.958717 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.955501    2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 18 22:00:20.959111 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.957762    2577 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 18 22:00:20.959111 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.958895    2577 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 18 22:00:20.968679 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.968658    2577 log.go:25] "Validated CRI v1 runtime API"
Sep 18 22:00:20.970895 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.970874    2577 log.go:25] "Validated CRI v1 image API"
Sep 18 22:00:20.975351 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.975323    2577 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 18 22:00:20.978146 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.978122    2577 fs.go:135] Filesystem UUIDs: map[5e37eab0-9860-4c1b-9927-285a800ed52f:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 9d5a1b62-92b0-4c0d-8b3f-9c0ec3efd95f:/dev/nvme0n1p4]
Sep 18 22:00:20.978241 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.978142    2577 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 18 22:00:20.984109 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.983981    2577 manager.go:216] Machine: {Timestamp:2026-09-18 22:00:20.982799844 +0000 UTC m=+0.302471891 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3087772 MemoryCapacity:32812163072 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2b05cf9ff6e333295bea79d073327b SystemUUID:ec2b05cf-9ff6-e333-295b-ea79d073327b BootID:7988b0e2-cb6c-4ad0-a420-4fbaf76126ff Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406081536 Type:vfs Inodes:4005391 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406081536 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:ef:dd:81:47 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:ef:dd:81:47 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:9e:10:5d:fa:84:cf Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812163072 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 18 22:00:20.984109 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.984104    2577 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 18 22:00:20.984233 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.984190    2577 manager.go:232] Version: {KernelVersion:5.14.0-570.141.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260914-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 18 22:00:20.984806 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.984789    2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 18 22:00:20.985250 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.985223    2577 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 18 22:00:20.985387 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.985254    2577 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-99.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 18 22:00:20.985907 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.985897    2577 topology_manager.go:138] "Creating topology manager with none policy"
Sep 18 22:00:20.985939 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.985911    2577 container_manager_linux.go:309] "Creating device plugin manager"
Sep 18 22:00:20.985939 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.985918    2577 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 18 22:00:20.986561 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.986551    2577 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 18 22:00:20.986634 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.986625    2577 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 18 22:00:20.989084 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.989073    2577 state_mem.go:36] "Initialized new in-memory state store"
Sep 18 22:00:20.989203 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.989193    2577 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 18 22:00:20.989232 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.989222    2577 kubelet.go:486] "Attempting to sync node with API server"
Sep 18 22:00:20.989259 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.989233    2577 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 18 22:00:20.989259 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.989247    2577 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 18 22:00:20.989259 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.989255    2577 kubelet.go:398] "Adding apiserver pod source"
Sep 18 22:00:20.989383 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.989264    2577 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 18 22:00:20.991127 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.991103    2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 18 22:00:20.991216 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.991137    2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 18 22:00:20.994069 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.994052    2577 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.13-6.rhaos4.21.git6253162.el9" apiVersion="v1"
Sep 18 22:00:20.996120 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.996106    2577 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 18 22:00:20.996188 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.996137    2577 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 18 22:00:20.997152 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.997140    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 18 22:00:20.997206 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.997157    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 18 22:00:20.997206 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.997163    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 18 22:00:20.997206 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.997168    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 18 22:00:20.997206 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.997186    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 18 22:00:20.997206 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.997192    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 18 22:00:20.997206 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.997205    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 18 22:00:20.997396 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.997227    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 18 22:00:20.997396 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.997234    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 18 22:00:20.997396 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.997240    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 18 22:00:20.997396 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.997248    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 18 22:00:20.997396 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.997253    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 18 22:00:20.998314 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.998302    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 18 22:00:20.998314 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:20.998312    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 18 22:00:20.998486 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:20.998466    2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 18 22:00:20.998534 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:20.998479    2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-99.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 18 22:00:21.001884 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:21.001867    2577 server.go:1268] "Started kubelet"
Sep 18 22:00:21.002001 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:21.001972    2577 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 18 22:00:21.002061 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:21.002018    2577 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 18 22:00:21.002109 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:21.002075    2577 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 18 22:00:21.002884 ip-10-0-141-99 systemd[1]: Started Kubernetes Kubelet.
Sep 18 22:00:21.003049 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:21.003034    2577 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 18 22:00:21.004586 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:21.004570    2577 server.go:310] "Adding debug handlers to kubelet server"
Sep 18 22:00:21.006076 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:21.006055    2577 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 18 22:00:21.008938 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:21.008921    2577 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 18 22:00:21.008938 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:21.008933    2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 18 22:00:21.009083 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:21.009059    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-99.ec2.internal\" not found"
Sep 18 22:00:21.009639 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:21.009620    2577 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 18 22:00:21.009712 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:21.009643    2577 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 18 22:00:21.009712 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:21.009622    2577 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 18 22:00:21.009789 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:21.009739    2577 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 18 22:00:21.009789 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:21.009752    2577 factory.go:55] Registering systemd factory
Sep 18 22:00:21.009789 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:21.009760    2577 factory.go:223] Registration of the systemd container factory successfully
Sep 18 22:00:21.009789 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:21.009787    2577 reconstruct.go:97] "Volume reconstruction finished"
Sep 18 22:00:21.009955 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:21.009794    2577 reconciler.go:29] "Reconciler: start to sync state"
Sep 18 22:00:21.010042 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:21.010014    2577 factory.go:153] Registering CRI-O factory
Sep 18 22:00:21.010042 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:21.010031    2577 factory.go:223] Registration of the crio container factory successfully
Sep 18 22:00:21.010042 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:21.010048    2577 factory.go:103] Registering Raw factory
Sep 18 22:00:21.010197 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:21.010060    2577 manager.go:1196] Started watching for new ooms in manager
Sep 18 22:00:21.010383 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:21.010370    2577 manager.go:349] Starting recovery of all containers
Sep 18 22:00:21.011538 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:21.011518    2577 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-99.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 18 22:00:21.012293 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:21.012273    2577 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-99.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 18 22:00:21.012537 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:21.011571    2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-99.ec2.internal.18d6894295e257be  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-99.ec2.internal,UID:ip-10-0-141-99.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-99.ec2.internal,},FirstTimestamp:2026-09-18 22:00:21.001836478 +0000 UTC m=+0.321508524,LastTimestamp:2026-09-18 22:00:21.001836478 +0000 UTC m=+0.321508524,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-99.ec2.internal,}"
Sep 18 22:00:21.013906 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:21.013887    2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dfbvs"
Sep 18 22:00:21.020637 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:21.020616    2577 manager.go:354] Recovery completed
Sep 18 22:00:21.020880 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:21.020841    2577 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 18 22:00:21.023064 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:21.022759    2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dfbvs"
Sep 18 22:00:21.027363 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:21.027347    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 22:00:21.029246 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:21.029232    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-99.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 22:00:21.029320 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:21.029258    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-99.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 22:00:21.029320 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:21.029268    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-99.ec2.internal" event="NodeHasSufficientPID"
Sep 18 22:00:21.029770 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:21.029759    2577 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 18 22:00:21.029770 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:21.029769    2577 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 18 22:00:21.029891 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:21.029783    2577 state_mem.go:36] "Initialized new in-memory state store"
Sep 18 22:00:21.029891 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:21.029833    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 22:00:21.030604 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:21.030573    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-99.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 22:00:21.030604 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:21.030603    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-99.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 22:00:21.030686 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:21.030613    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-99.ec2.internal" event="NodeHasSufficientPID"
Sep 18 22:00:21.030833 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:21.030820    2577 policy_none.go:49] "None policy: Start"
Sep 18 22:00:21.030887 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:21.030840    2577 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 18 22:00:21.030887 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:21.030854    2577 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 18 22:00:21.031755 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:21.031743    2577 policy_none.go:47] "Start"
Sep 18 22:00:21.065997 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:21.065978    2577 manager.go:337] "Starting Device Plugin manager"
Sep 18 22:00:21.080473 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:21.066020    2577 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 18 22:00:21.080473 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:21.066030    2577 server.go:87] "Starting device plugin registration server"
Sep 18 22:00:21.080473 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:21.066384    2577 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 18 22:00:21.080473 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:21.066406    2577 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 18 22:00:21.080473 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:21.066584    2577 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 18 22:00:21.080473 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:21.066669    2577 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 18 22:00:21.080473 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:21.066681    2577 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 18 22:00:21.080473 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:21.067205    2577 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 18 22:00:21.080473 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:21.067248    2577 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-99.ec2.internal\" not found"
Sep 18 22:00:21.131504 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:21.131478    2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 18 22:00:21.132743 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:21.132726    2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 18 22:00:21.132803 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:21.132791    2577 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 18 22:00:21.132843 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:21.132822    2577 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 18 22:00:21.132882 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:21.132869    2577 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 18 22:00:21.135048 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:21.135028    2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 18 22:00:21.166968 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:21.166941    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 22:00:21.167859 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:21.167841    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-99.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 22:00:21.167949 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:21.167875    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-99.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 22:00:21.167949 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:21.167890    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-99.ec2.internal" event="NodeHasSufficientPID"
Sep 18 22:00:21.167949 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:21.167918    2577 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-99.ec2.internal"
Sep 18 22:00:21.178584 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:21.178570    2577 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-99.ec2.internal"
Sep 18 22:00:21.178631 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:21.178592    2577 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-99.ec2.internal\": node \"ip-10-0-141-99.ec2.internal\" not found"
Sep 18 22:00:21.202493 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:21.202377    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-99.ec2.internal\" not found"
Sep 18 22:00:21.234271 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:21.234245    2577 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-99.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-99.ec2.internal"]
Sep 18 22:00:21.234372 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:21.234308    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 22:00:21.235106 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:21.235092    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-99.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 22:00:21.235182 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:21.235118    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-99.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 22:00:21.235182 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:21.235128    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-99.ec2.internal" event="NodeHasSufficientPID"
Sep 18 22:00:21.237569 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:21.237556    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 22:00:21.237707 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:21.237694    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-99.ec2.internal"
Sep 18 22:00:21.237745 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:21.237721    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 22:00:21.238261 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:21.238245    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-99.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 22:00:21.238353 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:21.238265    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-99.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 22:00:21.238353 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:21.238276    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-99.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 22:00:21.238353 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:21.238284    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-99.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 22:00:21.238353 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:21.238289    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-99.ec2.internal" event="NodeHasSufficientPID"
Sep 18 22:00:21.238353 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:21.238294    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-99.ec2.internal" event="NodeHasSufficientPID"
Sep 18 22:00:21.240513 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:21.240500    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-99.ec2.internal"
Sep 18 22:00:21.240580 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:21.240522    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 22:00:21.241157 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:21.241143    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-99.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 22:00:21.241229 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:21.241172    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-99.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 22:00:21.241229 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:21.241186    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-99.ec2.internal" event="NodeHasSufficientPID"
Sep 18 22:00:21.255925 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:21.255904    2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-99.ec2.internal\" not found" node="ip-10-0-141-99.ec2.internal"
Sep 18 22:00:21.259729 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:21.259714    2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-99.ec2.internal\" not found" node="ip-10-0-141-99.ec2.internal"
Sep 18 22:00:21.303175 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:21.303156    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-99.ec2.internal\" not found"
Sep 18 22:00:21.310596 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:21.310578    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8623be5c7bd3987d529f1c61bca76121-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-99.ec2.internal\" (UID: \"8623be5c7bd3987d529f1c61bca76121\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-99.ec2.internal"
Sep 18 22:00:21.310662 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:21.310602    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1bff01dc6642f13a258c3e4f92ce231e-config\") pod \"kube-apiserver-proxy-ip-10-0-141-99.ec2.internal\" (UID: \"1bff01dc6642f13a258c3e4f92ce231e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-99.ec2.internal"
Sep 18 22:00:21.310662 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:21.310619    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8623be5c7bd3987d529f1c61bca76121-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-99.ec2.internal\" (UID: \"8623be5c7bd3987d529f1c61bca76121\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-99.ec2.internal"
Sep 18 22:00:21.403993 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:21.403966    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-99.ec2.internal\" not found"
Sep 18 22:00:21.411277 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:21.411255    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1bff01dc6642f13a258c3e4f92ce231e-config\") pod \"kube-apiserver-proxy-ip-10-0-141-99.ec2.internal\" (UID: \"1bff01dc6642f13a258c3e4f92ce231e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-99.ec2.internal"
Sep 18 22:00:21.411362 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:21.411258    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1bff01dc6642f13a258c3e4f92ce231e-config\") pod \"kube-apiserver-proxy-ip-10-0-141-99.ec2.internal\" (UID: \"1bff01dc6642f13a258c3e4f92ce231e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-99.ec2.internal"
Sep 18 22:00:21.411362 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:21.411320    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8623be5c7bd3987d529f1c61bca76121-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-99.ec2.internal\" (UID: \"8623be5c7bd3987d529f1c61bca76121\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-99.ec2.internal"
Sep 18 22:00:21.411362 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:21.411303    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8623be5c7bd3987d529f1c61bca76121-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-99.ec2.internal\" (UID: \"8623be5c7bd3987d529f1c61bca76121\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-99.ec2.internal"
Sep 18 22:00:21.411362 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:21.411347    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8623be5c7bd3987d529f1c61bca76121-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-99.ec2.internal\" (UID: \"8623be5c7bd3987d529f1c61bca76121\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-99.ec2.internal"
Sep 18 22:00:21.411515 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:21.411374    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8623be5c7bd3987d529f1c61bca76121-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-99.ec2.internal\" (UID: \"8623be5c7bd3987d529f1c61bca76121\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-99.ec2.internal"
Sep 18 22:00:21.504396 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:21.504320    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-99.ec2.internal\" not found"
Sep 18 22:00:21.560834 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:21.560810    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-99.ec2.internal"
Sep 18 22:00:21.562960 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:21.562941    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-99.ec2.internal"
Sep 18 22:00:21.605281 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:21.605255    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-99.ec2.internal\" not found"
Sep 18 22:00:21.705855 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:21.705811    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-99.ec2.internal\" not found"
Sep 18 22:00:21.806349 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:21.806269    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-99.ec2.internal\" not found"
Sep 18 22:00:21.906880 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:21.906849    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-99.ec2.internal\" not found"
Sep 18 22:00:21.955299 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:21.955271    2577 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 18 22:00:21.955746 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:21.955440    2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 18 22:00:22.007879 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:22.007853    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-99.ec2.internal\" not found"
Sep 18 22:00:22.022872 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:22.022851    2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 18 22:00:22.027100 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:22.027067    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-17 21:55:21 +0000 UTC" deadline="2028-06-17 02:19:55.482862774 +0000 UTC"
Sep 18 22:00:22.027183 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:22.027101    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15292h19m33.455765333s"
Sep 18 22:00:22.109308 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:22.109287    2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-99.ec2.internal"
Sep 18 22:00:22.143373 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:22.143351    2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 18 22:00:22.144908 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:22.144894    2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-99.ec2.internal"
Sep 18 22:00:22.165225 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:22.165197    2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 18 22:00:22.176430 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:22.176388    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bff01dc6642f13a258c3e4f92ce231e.slice/crio-04e270a2c25ec3e72d601fabc4e2cdb9383b2bc571bcf778073ef996e25b2589 WatchSource:0}: Error finding container 04e270a2c25ec3e72d601fabc4e2cdb9383b2bc571bcf778073ef996e25b2589: Status 404 returned error can't find the container with id 04e270a2c25ec3e72d601fabc4e2cdb9383b2bc571bcf778073ef996e25b2589
Sep 18 22:00:22.176676 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:22.176662    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8623be5c7bd3987d529f1c61bca76121.slice/crio-6ff74db546ccebe7a4f83724e40bf1eb881b81a46644d18d4d9d2cec65615b44 WatchSource:0}: Error finding container 6ff74db546ccebe7a4f83724e40bf1eb881b81a46644d18d4d9d2cec65615b44: Status 404 returned error can't find the container with id 6ff74db546ccebe7a4f83724e40bf1eb881b81a46644d18d4d9d2cec65615b44
Sep 18 22:00:22.181704 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:22.181690    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 18 22:00:22.263616 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:22.263590    2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 18 22:00:22.574337 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:22.574307    2577 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 18 22:00:22.990364 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:22.990276    2577 apiserver.go:52] "Watching apiserver"
Sep 18 22:00:22.996644 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:22.996607    2577 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 18 22:00:22.997185 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:22.997156    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-gb9sf","kube-system/konnectivity-agent-gwrfw","kube-system/kube-apiserver-proxy-ip-10-0-141-99.ec2.internal","openshift-cluster-node-tuning-operator/tuned-khq6l","openshift-image-registry/node-ca-w5xfs","openshift-multus/multus-9hq94","openshift-multus/multus-additional-cni-plugins-5rhzl","openshift-network-diagnostics/network-check-target-z7srk","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7vn2","openshift-dns/node-resolver-qnflp","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-99.ec2.internal","openshift-multus/network-metrics-daemon-4vmhg","openshift-network-operator/iptables-alerter-zd4wk","openshift-ovn-kubernetes/ovnkube-node-8tbzr"]
Sep 18 22:00:23.000321 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.000042    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5rhzl"
Sep 18 22:00:23.003920 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.003876    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zd4wk"
Sep 18 22:00:23.004106 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.004081    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 18 22:00:23.004695 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.004433    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 18 22:00:23.004695 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.004484    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 18 22:00:23.004695 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.004529    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 18 22:00:23.005394 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.005108    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 18 22:00:23.005394 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.005146    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-qrgll\""
Sep 18 22:00:23.007746 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.006631    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8tbzr"
Sep 18 22:00:23.008355 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.008221    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 18 22:00:23.008355 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.008236    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 18 22:00:23.008859 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.008718    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 18 22:00:23.008859 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.008723    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 18 22:00:23.008859 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.008754    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-x5rmr\""
Sep 18 22:00:23.009065 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.009046    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-cq8fn\""
Sep 18 22:00:23.009445 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.009430    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 18 22:00:23.009785 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.009766    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 18 22:00:23.009872 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.009837    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 18 22:00:23.009872 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.009852    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 18 22:00:23.010004 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.009984    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 18 22:00:23.010057 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.010039    2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 18 22:00:23.011842 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.011327    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-khq6l"
Sep 18 22:00:23.015152 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.013169    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-rmz6t\""
Sep 18 22:00:23.015152 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.014698    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-w5xfs"
Sep 18 22:00:23.016160 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.015578    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 18 22:00:23.016160 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.015808    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 18 22:00:23.016824 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.016804    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9hq94"
Sep 18 22:00:23.018593 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.018570    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1bfa364a-1dc0-4525-831c-2ec292ec087a-host-slash\") pod \"iptables-alerter-zd4wk\" (UID: \"1bfa364a-1dc0-4525-831c-2ec292ec087a\") " pod="openshift-network-operator/iptables-alerter-zd4wk"
Sep 18 22:00:23.018686 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.018609    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bd8x8\" (UniqueName: \"kubernetes.io/projected/1bfa364a-1dc0-4525-831c-2ec292ec087a-kube-api-access-bd8x8\") pod \"iptables-alerter-zd4wk\" (UID: \"1bfa364a-1dc0-4525-831c-2ec292ec087a\") " pod="openshift-network-operator/iptables-alerter-zd4wk"
Sep 18 22:00:23.018686 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.018639    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9c16bb59-78d7-4421-bffa-789677ffe031-host-run-netns\") pod \"ovnkube-node-8tbzr\" (UID: \"9c16bb59-78d7-4421-bffa-789677ffe031\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tbzr"
Sep 18 22:00:23.018686 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.018665    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9c16bb59-78d7-4421-bffa-789677ffe031-run-openvswitch\") pod \"ovnkube-node-8tbzr\" (UID: \"9c16bb59-78d7-4421-bffa-789677ffe031\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tbzr"
Sep 18 22:00:23.018913 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.018690    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9c16bb59-78d7-4421-bffa-789677ffe031-host-run-ovn-kubernetes\") pod \"ovnkube-node-8tbzr\" (UID: \"9c16bb59-78d7-4421-bffa-789677ffe031\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tbzr"
Sep 18 22:00:23.018913 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.018714    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9c16bb59-78d7-4421-bffa-789677ffe031-host-cni-bin\") pod \"ovnkube-node-8tbzr\" (UID: \"9c16bb59-78d7-4421-bffa-789677ffe031\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tbzr"
Sep 18 22:00:23.018913 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.018739    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qsgvw\" (UniqueName: \"kubernetes.io/projected/293a6c1f-7be4-4cd7-a29a-14f22e5a4aac-kube-api-access-qsgvw\") pod \"multus-additional-cni-plugins-5rhzl\" (UID: \"293a6c1f-7be4-4cd7-a29a-14f22e5a4aac\") " pod="openshift-multus/multus-additional-cni-plugins-5rhzl"
Sep 18 22:00:23.018913 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.018780    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9c16bb59-78d7-4421-bffa-789677ffe031-systemd-units\") pod \"ovnkube-node-8tbzr\" (UID: \"9c16bb59-78d7-4421-bffa-789677ffe031\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tbzr"
Sep 18 22:00:23.018913 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.018800    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9c16bb59-78d7-4421-bffa-789677ffe031-host-slash\") pod \"ovnkube-node-8tbzr\" (UID: \"9c16bb59-78d7-4421-bffa-789677ffe031\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tbzr"
Sep 18 22:00:23.018913 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.018815    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9c16bb59-78d7-4421-bffa-789677ffe031-etc-openvswitch\") pod \"ovnkube-node-8tbzr\" (UID: \"9c16bb59-78d7-4421-bffa-789677ffe031\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tbzr"
Sep 18 22:00:23.018913 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.018829    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9c16bb59-78d7-4421-bffa-789677ffe031-ovnkube-script-lib\") pod \"ovnkube-node-8tbzr\" (UID: \"9c16bb59-78d7-4421-bffa-789677ffe031\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tbzr"
Sep 18 22:00:23.018913 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.018844    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmgb2\" (UniqueName: \"kubernetes.io/projected/66277164-f820-4f58-b315-ee2bcacd20f3-kube-api-access-hmgb2\") pod \"tuned-khq6l\" (UID: \"66277164-f820-4f58-b315-ee2bcacd20f3\") " pod="openshift-cluster-node-tuning-operator/tuned-khq6l"
Sep 18 22:00:23.018913 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.018859    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9c16bb59-78d7-4421-bffa-789677ffe031-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8tbzr\" (UID: \"9c16bb59-78d7-4421-bffa-789677ffe031\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tbzr"
Sep 18 22:00:23.018913 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.018875    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9c16bb59-78d7-4421-bffa-789677ffe031-ovnkube-config\") pod \"ovnkube-node-8tbzr\" (UID: \"9c16bb59-78d7-4421-bffa-789677ffe031\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tbzr"
Sep 18 22:00:23.018913 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.018889    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/66277164-f820-4f58-b315-ee2bcacd20f3-etc-kubernetes\") pod \"tuned-khq6l\" (UID: \"66277164-f820-4f58-b315-ee2bcacd20f3\") " pod="openshift-cluster-node-tuning-operator/tuned-khq6l"
Sep 18 22:00:23.018913 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.018914    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/66277164-f820-4f58-b315-ee2bcacd20f3-etc-systemd\") pod \"tuned-khq6l\" (UID: \"66277164-f820-4f58-b315-ee2bcacd20f3\") " pod="openshift-cluster-node-tuning-operator/tuned-khq6l"
Sep 18 22:00:23.019422 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.018931    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/66277164-f820-4f58-b315-ee2bcacd20f3-sys\") pod \"tuned-khq6l\" (UID: \"66277164-f820-4f58-b315-ee2bcacd20f3\") " pod="openshift-cluster-node-tuning-operator/tuned-khq6l"
Sep 18 22:00:23.019422 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.018963    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/66277164-f820-4f58-b315-ee2bcacd20f3-lib-modules\") pod \"tuned-khq6l\" (UID: \"66277164-f820-4f58-b315-ee2bcacd20f3\") " pod="openshift-cluster-node-tuning-operator/tuned-khq6l"
Sep 18 22:00:23.019422 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.018999    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/66277164-f820-4f58-b315-ee2bcacd20f3-host\") pod \"tuned-khq6l\" (UID: \"66277164-f820-4f58-b315-ee2bcacd20f3\") " pod="openshift-cluster-node-tuning-operator/tuned-khq6l"
Sep 18 22:00:23.019422 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.019023    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/293a6c1f-7be4-4cd7-a29a-14f22e5a4aac-system-cni-dir\") pod \"multus-additional-cni-plugins-5rhzl\" (UID: \"293a6c1f-7be4-4cd7-a29a-14f22e5a4aac\") " pod="openshift-multus/multus-additional-cni-plugins-5rhzl"
Sep 18 22:00:23.019422 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.019049    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9c16bb59-78d7-4421-bffa-789677ffe031-run-systemd\") pod \"ovnkube-node-8tbzr\" (UID: \"9c16bb59-78d7-4421-bffa-789677ffe031\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tbzr"
Sep 18 22:00:23.019422 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.019072    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9c16bb59-78d7-4421-bffa-789677ffe031-run-ovn\") pod \"ovnkube-node-8tbzr\" (UID: \"9c16bb59-78d7-4421-bffa-789677ffe031\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tbzr"
Sep 18 22:00:23.019422 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.019117    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9c16bb59-78d7-4421-bffa-789677ffe031-ovn-node-metrics-cert\") pod \"ovnkube-node-8tbzr\" (UID: \"9c16bb59-78d7-4421-bffa-789677ffe031\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tbzr"
Sep 18 22:00:23.019422 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.019198    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/66277164-f820-4f58-b315-ee2bcacd20f3-etc-sysctl-d\") pod \"tuned-khq6l\" (UID: \"66277164-f820-4f58-b315-ee2bcacd20f3\") " pod="openshift-cluster-node-tuning-operator/tuned-khq6l"
Sep 18 22:00:23.019422 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.019233    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/66277164-f820-4f58-b315-ee2bcacd20f3-run\") pod \"tuned-khq6l\" (UID: \"66277164-f820-4f58-b315-ee2bcacd20f3\") " pod="openshift-cluster-node-tuning-operator/tuned-khq6l"
Sep 18 22:00:23.019422 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.019263    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9c16bb59-78d7-4421-bffa-789677ffe031-host-kubelet\") pod \"ovnkube-node-8tbzr\" (UID: \"9c16bb59-78d7-4421-bffa-789677ffe031\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tbzr"
Sep 18 22:00:23.019422 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.019294    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/293a6c1f-7be4-4cd7-a29a-14f22e5a4aac-cni-binary-copy\") pod \"multus-additional-cni-plugins-5rhzl\" (UID: \"293a6c1f-7be4-4cd7-a29a-14f22e5a4aac\") " pod="openshift-multus/multus-additional-cni-plugins-5rhzl"
Sep 18 22:00:23.019422 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.019321    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmmfs\" (UniqueName: \"kubernetes.io/projected/9c16bb59-78d7-4421-bffa-789677ffe031-kube-api-access-rmmfs\") pod \"ovnkube-node-8tbzr\" (UID: \"9c16bb59-78d7-4421-bffa-789677ffe031\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tbzr"
Sep 18 22:00:23.019422 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.019348    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/66277164-f820-4f58-b315-ee2bcacd20f3-etc-sysctl-conf\") pod \"tuned-khq6l\" (UID: \"66277164-f820-4f58-b315-ee2bcacd20f3\") " pod="openshift-cluster-node-tuning-operator/tuned-khq6l"
Sep 18 22:00:23.019422 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.019392    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/66277164-f820-4f58-b315-ee2bcacd20f3-var-lib-kubelet\") pod \"tuned-khq6l\" (UID: \"66277164-f820-4f58-b315-ee2bcacd20f3\") " pod="openshift-cluster-node-tuning-operator/tuned-khq6l"
Sep 18 22:00:23.020170 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.019554    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/66277164-f820-4f58-b315-ee2bcacd20f3-tmp\") pod \"tuned-khq6l\" (UID: \"66277164-f820-4f58-b315-ee2bcacd20f3\") " pod="openshift-cluster-node-tuning-operator/tuned-khq6l"
Sep 18 22:00:23.020170 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.019595    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/293a6c1f-7be4-4cd7-a29a-14f22e5a4aac-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5rhzl\" (UID: \"293a6c1f-7be4-4cd7-a29a-14f22e5a4aac\") " pod="openshift-multus/multus-additional-cni-plugins-5rhzl"
Sep 18 22:00:23.020170 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.019621    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9c16bb59-78d7-4421-bffa-789677ffe031-env-overrides\") pod \"ovnkube-node-8tbzr\" (UID: \"9c16bb59-78d7-4421-bffa-789677ffe031\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tbzr"
Sep 18 22:00:23.020170 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.019670    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7vn2"
Sep 18 22:00:23.020170 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.019688    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/293a6c1f-7be4-4cd7-a29a-14f22e5a4aac-cnibin\") pod \"multus-additional-cni-plugins-5rhzl\" (UID: \"293a6c1f-7be4-4cd7-a29a-14f22e5a4aac\") " pod="openshift-multus/multus-additional-cni-plugins-5rhzl"
Sep 18 22:00:23.020170 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.019722    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/293a6c1f-7be4-4cd7-a29a-14f22e5a4aac-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5rhzl\" (UID: \"293a6c1f-7be4-4cd7-a29a-14f22e5a4aac\") " pod="openshift-multus/multus-additional-cni-plugins-5rhzl"
Sep 18 22:00:23.020170 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.020072    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9c16bb59-78d7-4421-bffa-789677ffe031-var-lib-openvswitch\") pod \"ovnkube-node-8tbzr\" (UID: \"9c16bb59-78d7-4421-bffa-789677ffe031\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tbzr"
Sep 18 22:00:23.020170 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.020115    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9c16bb59-78d7-4421-bffa-789677ffe031-node-log\") pod \"ovnkube-node-8tbzr\" (UID: \"9c16bb59-78d7-4421-bffa-789677ffe031\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tbzr"
Sep 18 22:00:23.020170 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.020154    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9c16bb59-78d7-4421-bffa-789677ffe031-host-cni-netd\") pod \"ovnkube-node-8tbzr\" (UID: \"9c16bb59-78d7-4421-bffa-789677ffe031\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tbzr"
Sep 18 22:00:23.020606 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.020189    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/293a6c1f-7be4-4cd7-a29a-14f22e5a4aac-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5rhzl\" (UID: \"293a6c1f-7be4-4cd7-a29a-14f22e5a4aac\") " pod="openshift-multus/multus-additional-cni-plugins-5rhzl"
Sep 18 22:00:23.020606 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.020219    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1bfa364a-1dc0-4525-831c-2ec292ec087a-iptables-alerter-script\") pod \"iptables-alerter-zd4wk\" (UID: \"1bfa364a-1dc0-4525-831c-2ec292ec087a\") " pod="openshift-network-operator/iptables-alerter-zd4wk"
Sep 18 22:00:23.020606 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.020253    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9c16bb59-78d7-4421-bffa-789677ffe031-log-socket\") pod \"ovnkube-node-8tbzr\" (UID: \"9c16bb59-78d7-4421-bffa-789677ffe031\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tbzr"
Sep 18 22:00:23.020606 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.020308    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/66277164-f820-4f58-b315-ee2bcacd20f3-etc-modprobe-d\") pod \"tuned-khq6l\" (UID: \"66277164-f820-4f58-b315-ee2bcacd20f3\") " pod="openshift-cluster-node-tuning-operator/tuned-khq6l"
Sep 18 22:00:23.020606 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.020366    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/66277164-f820-4f58-b315-ee2bcacd20f3-etc-sysconfig\") pod \"tuned-khq6l\" (UID: \"66277164-f820-4f58-b315-ee2bcacd20f3\") " pod="openshift-cluster-node-tuning-operator/tuned-khq6l"
Sep 18 22:00:23.020606 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.020397    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/66277164-f820-4f58-b315-ee2bcacd20f3-etc-tuned\") pod \"tuned-khq6l\" (UID: \"66277164-f820-4f58-b315-ee2bcacd20f3\") " pod="openshift-cluster-node-tuning-operator/tuned-khq6l"
Sep 18 22:00:23.021444 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.021418    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 18 22:00:23.022361 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.022342    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 18 22:00:23.023579 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.022483    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 18 22:00:23.023579 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.022930    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-m8tkh\""
Sep 18 22:00:23.023579 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.022948    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-4tr6w\""
Sep 18 22:00:23.023579 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.023395    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 18 22:00:23.023836 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.023761    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 18 22:00:23.024092 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.024057    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gb9sf"
Sep 18 22:00:23.024189 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.024117    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-vks6z\""
Sep 18 22:00:23.024189 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:23.024140    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gb9sf" podUID="57c8eb94-06ca-4a20-a2d1-acc62a27e816"
Sep 18 22:00:23.024293 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.024238    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 18 22:00:23.024663 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.024640    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 18 22:00:23.026555 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.026532    2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 18 22:00:23.026718 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.026696    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gwrfw"
Sep 18 22:00:23.029527 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.029507    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qnflp"
Sep 18 22:00:23.029993 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.029975    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 18 22:00:23.030082 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.030058    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 18 22:00:23.030359 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.030343    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-t2j2c\""
Sep 18 22:00:23.032003 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.031986    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z7srk"
Sep 18 22:00:23.032088 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:23.032062    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z7srk" podUID="d2df6952-5b90-4dda-829f-62049ca10ae8"
Sep 18 22:00:23.034417 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.034397    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vmhg"
Sep 18 22:00:23.034519 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:23.034466    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vmhg" podUID="c715783a-a4e5-4cba-b189-cf2ff6eb8950"
Sep 18 22:00:23.035233 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.035013    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 18 22:00:23.035387 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.035364    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 18 22:00:23.035667 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.035650    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-4f49d\""
Sep 18 22:00:23.051859 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.051836    2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-w45bn"
Sep 18 22:00:23.062954 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.062923    2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-w45bn"
Sep 18 22:00:23.111953 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.111921    2577 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 18 22:00:23.120776 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.120742    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9c16bb59-78d7-4421-bffa-789677ffe031-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8tbzr\" (UID: \"9c16bb59-78d7-4421-bffa-789677ffe031\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tbzr"
Sep 18 22:00:23.120956 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.120789    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9c16bb59-78d7-4421-bffa-789677ffe031-ovnkube-config\") pod \"ovnkube-node-8tbzr\" (UID: \"9c16bb59-78d7-4421-bffa-789677ffe031\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tbzr"
Sep 18 22:00:23.120956 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.120817    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/66277164-f820-4f58-b315-ee2bcacd20f3-sys\") pod \"tuned-khq6l\" (UID: \"66277164-f820-4f58-b315-ee2bcacd20f3\") " pod="openshift-cluster-node-tuning-operator/tuned-khq6l"
Sep 18 22:00:23.120956 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.120841    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/66277164-f820-4f58-b315-ee2bcacd20f3-host\") pod \"tuned-khq6l\" (UID: \"66277164-f820-4f58-b315-ee2bcacd20f3\") " pod="openshift-cluster-node-tuning-operator/tuned-khq6l"
Sep 18 22:00:23.120956 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.120865    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9c16bb59-78d7-4421-bffa-789677ffe031-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8tbzr\" (UID: \"9c16bb59-78d7-4421-bffa-789677ffe031\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tbzr"
Sep 18 22:00:23.120956 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.120873    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d322c364-182a-4826-af75-bc5dcab8bf38-hosts-file\") pod \"node-resolver-qnflp\" (UID: \"d322c364-182a-4826-af75-bc5dcab8bf38\") " pod="openshift-dns/node-resolver-qnflp"
Sep 18 22:00:23.120956 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.120941    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d322c364-182a-4826-af75-bc5dcab8bf38-tmp-dir\") pod \"node-resolver-qnflp\" (UID: \"d322c364-182a-4826-af75-bc5dcab8bf38\") " pod="openshift-dns/node-resolver-qnflp"
Sep 18 22:00:23.120956 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.120943    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/66277164-f820-4f58-b315-ee2bcacd20f3-sys\") pod \"tuned-khq6l\" (UID: \"66277164-f820-4f58-b315-ee2bcacd20f3\") " pod="openshift-cluster-node-tuning-operator/tuned-khq6l"
Sep 18 22:00:23.121323 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.120966    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7a1c1140-3ecb-4c8b-9a06-cf3f32ce21d1-etc-kubernetes\") pod \"multus-9hq94\" (UID: \"7a1c1140-3ecb-4c8b-9a06-cf3f32ce21d1\") " pod="openshift-multus/multus-9hq94"
Sep 18 22:00:23.121323 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.120989    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/66277164-f820-4f58-b315-ee2bcacd20f3-host\") pod \"tuned-khq6l\" (UID: \"66277164-f820-4f58-b315-ee2bcacd20f3\") " pod="openshift-cluster-node-tuning-operator/tuned-khq6l"
Sep 18 22:00:23.121323 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.121034    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjmvz\" (UniqueName: \"kubernetes.io/projected/5c3dc850-2b4b-4093-8d91-9807b70527a2-kube-api-access-mjmvz\") pod \"aws-ebs-csi-driver-node-d7vn2\" (UID: \"5c3dc850-2b4b-4093-8d91-9807b70527a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7vn2"
Sep 18 22:00:23.121323 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.121064    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9c16bb59-78d7-4421-bffa-789677ffe031-run-systemd\") pod \"ovnkube-node-8tbzr\" (UID: \"9c16bb59-78d7-4421-bffa-789677ffe031\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tbzr"
Sep 18 22:00:23.121323 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.121100    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9c16bb59-78d7-4421-bffa-789677ffe031-ovn-node-metrics-cert\") pod \"ovnkube-node-8tbzr\" (UID: \"9c16bb59-78d7-4421-bffa-789677ffe031\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tbzr"
Sep 18 22:00:23.121323 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.121117    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9c16bb59-78d7-4421-bffa-789677ffe031-run-systemd\") pod \"ovnkube-node-8tbzr\" (UID: \"9c16bb59-78d7-4421-bffa-789677ffe031\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tbzr"
Sep 18 22:00:23.121323 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.121153    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/66277164-f820-4f58-b315-ee2bcacd20f3-run\") pod \"tuned-khq6l\" (UID: \"66277164-f820-4f58-b315-ee2bcacd20f3\") " pod="openshift-cluster-node-tuning-operator/tuned-khq6l"
Sep 18 22:00:23.121323 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.121178    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/66277164-f820-4f58-b315-ee2bcacd20f3-etc-sysctl-conf\") pod \"tuned-khq6l\" (UID: \"66277164-f820-4f58-b315-ee2bcacd20f3\") " pod="openshift-cluster-node-tuning-operator/tuned-khq6l"
Sep 18 22:00:23.121323 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.121227    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/66277164-f820-4f58-b315-ee2bcacd20f3-var-lib-kubelet\") pod \"tuned-khq6l\" (UID: \"66277164-f820-4f58-b315-ee2bcacd20f3\") " pod="openshift-cluster-node-tuning-operator/tuned-khq6l"
Sep 18 22:00:23.121323 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.121247    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/66277164-f820-4f58-b315-ee2bcacd20f3-run\") pod \"tuned-khq6l\" (UID: \"66277164-f820-4f58-b315-ee2bcacd20f3\") " pod="openshift-cluster-node-tuning-operator/tuned-khq6l"
Sep 18 22:00:23.121323 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.121272    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/66277164-f820-4f58-b315-ee2bcacd20f3-tmp\") pod \"tuned-khq6l\" (UID: \"66277164-f820-4f58-b315-ee2bcacd20f3\") " pod="openshift-cluster-node-tuning-operator/tuned-khq6l"
Sep 18 22:00:23.121323 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.121300    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7a1c1140-3ecb-4c8b-9a06-cf3f32ce21d1-host-run-k8s-cni-cncf-io\") pod \"multus-9hq94\" (UID: \"7a1c1140-3ecb-4c8b-9a06-cf3f32ce21d1\") " pod="openshift-multus/multus-9hq94"
Sep 18 22:00:23.121998 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.121361    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/66277164-f820-4f58-b315-ee2bcacd20f3-etc-sysctl-conf\") pod \"tuned-khq6l\" (UID: \"66277164-f820-4f58-b315-ee2bcacd20f3\") " pod="openshift-cluster-node-tuning-operator/tuned-khq6l"
Sep 18 22:00:23.121998 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.121389    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5c3dc850-2b4b-4093-8d91-9807b70527a2-device-dir\") pod \"aws-ebs-csi-driver-node-d7vn2\" (UID: \"5c3dc850-2b4b-4093-8d91-9807b70527a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7vn2"
Sep 18 22:00:23.121998 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.121410    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/293a6c1f-7be4-4cd7-a29a-14f22e5a4aac-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5rhzl\" (UID: \"293a6c1f-7be4-4cd7-a29a-14f22e5a4aac\") " pod="openshift-multus/multus-additional-cni-plugins-5rhzl"
Sep 18 22:00:23.121998 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.121408    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/66277164-f820-4f58-b315-ee2bcacd20f3-var-lib-kubelet\") pod \"tuned-khq6l\" (UID: \"66277164-f820-4f58-b315-ee2bcacd20f3\") " pod="openshift-cluster-node-tuning-operator/tuned-khq6l"
Sep 18 22:00:23.121998 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.121457    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9c16bb59-78d7-4421-bffa-789677ffe031-env-overrides\") pod \"ovnkube-node-8tbzr\" (UID: \"9c16bb59-78d7-4421-bffa-789677ffe031\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tbzr"
Sep 18 22:00:23.121998 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.121505    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9aea2f1a-d418-4d91-b512-3839fa148822-serviceca\") pod \"node-ca-w5xfs\" (UID: \"9aea2f1a-d418-4d91-b512-3839fa148822\") " pod="openshift-image-registry/node-ca-w5xfs"
Sep 18 22:00:23.121998 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.121576    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/293a6c1f-7be4-4cd7-a29a-14f22e5a4aac-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5rhzl\" (UID: \"293a6c1f-7be4-4cd7-a29a-14f22e5a4aac\") " pod="openshift-multus/multus-additional-cni-plugins-5rhzl"
Sep 18 22:00:23.121998 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.121587    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6dkn\" (UniqueName: \"kubernetes.io/projected/9aea2f1a-d418-4d91-b512-3839fa148822-kube-api-access-w6dkn\") pod \"node-ca-w5xfs\" (UID: \"9aea2f1a-d418-4d91-b512-3839fa148822\") " pod="openshift-image-registry/node-ca-w5xfs"
Sep 18 22:00:23.121998 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.121642    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d27d4416-7b1a-4723-8d04-9c07231b5061-agent-certs\") pod \"konnectivity-agent-gwrfw\" (UID: \"d27d4416-7b1a-4723-8d04-9c07231b5061\") " pod="kube-system/konnectivity-agent-gwrfw"
Sep 18 22:00:23.121998 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.121672    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/57c8eb94-06ca-4a20-a2d1-acc62a27e816-dbus\") pod \"global-pull-secret-syncer-gb9sf\" (UID: \"57c8eb94-06ca-4a20-a2d1-acc62a27e816\") " pod="kube-system/global-pull-secret-syncer-gb9sf"
Sep 18 22:00:23.121998 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.121672    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9c16bb59-78d7-4421-bffa-789677ffe031-ovnkube-config\") pod \"ovnkube-node-8tbzr\" (UID: \"9c16bb59-78d7-4421-bffa-789677ffe031\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tbzr"
Sep 18 22:00:23.121998 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.121706    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/293a6c1f-7be4-4cd7-a29a-14f22e5a4aac-cnibin\") pod \"multus-additional-cni-plugins-5rhzl\" (UID: \"293a6c1f-7be4-4cd7-a29a-14f22e5a4aac\") " pod="openshift-multus/multus-additional-cni-plugins-5rhzl"
Sep 18 22:00:23.121998 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.121730    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/293a6c1f-7be4-4cd7-a29a-14f22e5a4aac-cnibin\") pod \"multus-additional-cni-plugins-5rhzl\" (UID: \"293a6c1f-7be4-4cd7-a29a-14f22e5a4aac\") " pod="openshift-multus/multus-additional-cni-plugins-5rhzl"
Sep 18 22:00:23.121998 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.121795    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/293a6c1f-7be4-4cd7-a29a-14f22e5a4aac-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5rhzl\" (UID: \"293a6c1f-7be4-4cd7-a29a-14f22e5a4aac\") " pod="openshift-multus/multus-additional-cni-plugins-5rhzl"
Sep 18 22:00:23.121998 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.121851    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9c16bb59-78d7-4421-bffa-789677ffe031-node-log\") pod \"ovnkube-node-8tbzr\" (UID: \"9c16bb59-78d7-4421-bffa-789677ffe031\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tbzr"
Sep 18 22:00:23.121998 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.121885    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6c9p\" (UniqueName: \"kubernetes.io/projected/c715783a-a4e5-4cba-b189-cf2ff6eb8950-kube-api-access-v6c9p\") pod \"network-metrics-daemon-4vmhg\" (UID: \"c715783a-a4e5-4cba-b189-cf2ff6eb8950\") " pod="openshift-multus/network-metrics-daemon-4vmhg"
Sep 18 22:00:23.121998 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.121912    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7a1c1140-3ecb-4c8b-9a06-cf3f32ce21d1-host-var-lib-cni-multus\") pod \"multus-9hq94\" (UID: \"7a1c1140-3ecb-4c8b-9a06-cf3f32ce21d1\") " pod="openshift-multus/multus-9hq94"
Sep 18 22:00:23.122830 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.121940    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5c3dc850-2b4b-4093-8d91-9807b70527a2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-d7vn2\" (UID: \"5c3dc850-2b4b-4093-8d91-9807b70527a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7vn2"
Sep 18 22:00:23.122830 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.121945    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9c16bb59-78d7-4421-bffa-789677ffe031-node-log\") pod \"ovnkube-node-8tbzr\" (UID: \"9c16bb59-78d7-4421-bffa-789677ffe031\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tbzr"
Sep 18 22:00:23.122830 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.121939    2577 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 18 22:00:23.122830 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.121969    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5c3dc850-2b4b-4093-8d91-9807b70527a2-sys-fs\") pod \"aws-ebs-csi-driver-node-d7vn2\" (UID: \"5c3dc850-2b4b-4093-8d91-9807b70527a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7vn2"
Sep 18 22:00:23.122830 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.122029    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/293a6c1f-7be4-4cd7-a29a-14f22e5a4aac-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5rhzl\" (UID: \"293a6c1f-7be4-4cd7-a29a-14f22e5a4aac\") " pod="openshift-multus/multus-additional-cni-plugins-5rhzl"
Sep 18 22:00:23.122830 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.122079    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/66277164-f820-4f58-b315-ee2bcacd20f3-etc-sysconfig\") pod \"tuned-khq6l\" (UID: \"66277164-f820-4f58-b315-ee2bcacd20f3\") " pod="openshift-cluster-node-tuning-operator/tuned-khq6l"
Sep 18 22:00:23.122830 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.122103    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/66277164-f820-4f58-b315-ee2bcacd20f3-etc-tuned\") pod \"tuned-khq6l\" (UID: \"66277164-f820-4f58-b315-ee2bcacd20f3\") " pod="openshift-cluster-node-tuning-operator/tuned-khq6l"
Sep 18 22:00:23.122830 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.122139    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/57c8eb94-06ca-4a20-a2d1-acc62a27e816-original-pull-secret\") pod \"global-pull-secret-syncer-gb9sf\" (UID: \"57c8eb94-06ca-4a20-a2d1-acc62a27e816\") " pod="kube-system/global-pull-secret-syncer-gb9sf"
Sep 18 22:00:23.122830 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.122194    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1bfa364a-1dc0-4525-831c-2ec292ec087a-host-slash\") pod \"iptables-alerter-zd4wk\" (UID: \"1bfa364a-1dc0-4525-831c-2ec292ec087a\") " pod="openshift-network-operator/iptables-alerter-zd4wk"
Sep 18 22:00:23.122830 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.122219    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bd8x8\" (UniqueName: \"kubernetes.io/projected/1bfa364a-1dc0-4525-831c-2ec292ec087a-kube-api-access-bd8x8\") pod \"iptables-alerter-zd4wk\" (UID: \"1bfa364a-1dc0-4525-831c-2ec292ec087a\") " pod="openshift-network-operator/iptables-alerter-zd4wk"
Sep 18 22:00:23.122830 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.122274    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9c16bb59-78d7-4421-bffa-789677ffe031-host-run-ovn-kubernetes\") pod \"ovnkube-node-8tbzr\" (UID: \"9c16bb59-78d7-4421-bffa-789677ffe031\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tbzr"
Sep 18 22:00:23.122830 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.122303    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9c16bb59-78d7-4421-bffa-789677ffe031-host-cni-bin\") pod \"ovnkube-node-8tbzr\" (UID: \"9c16bb59-78d7-4421-bffa-789677ffe031\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tbzr"
Sep 18 22:00:23.122830 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.122323    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9c16bb59-78d7-4421-bffa-789677ffe031-env-overrides\") pod \"ovnkube-node-8tbzr\" (UID: \"9c16bb59-78d7-4421-bffa-789677ffe031\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tbzr"
Sep 18 22:00:23.122830 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.122328    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d27d4416-7b1a-4723-8d04-9c07231b5061-konnectivity-ca\") pod \"konnectivity-agent-gwrfw\" (UID: \"d27d4416-7b1a-4723-8d04-9c07231b5061\") " pod="kube-system/konnectivity-agent-gwrfw"
Sep 18 22:00:23.122830 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.122374    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7a1c1140-3ecb-4c8b-9a06-cf3f32ce21d1-multus-conf-dir\") pod \"multus-9hq94\" (UID: \"7a1c1140-3ecb-4c8b-9a06-cf3f32ce21d1\") " pod="openshift-multus/multus-9hq94"
Sep 18 22:00:23.122830 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.122399    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/66277164-f820-4f58-b315-ee2bcacd20f3-etc-sysconfig\") pod \"tuned-khq6l\" (UID: \"66277164-f820-4f58-b315-ee2bcacd20f3\") " pod="openshift-cluster-node-tuning-operator/tuned-khq6l"
Sep 18 22:00:23.122830 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.122402    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/57c8eb94-06ca-4a20-a2d1-acc62a27e816-kubelet-config\") pod \"global-pull-secret-syncer-gb9sf\" (UID: \"57c8eb94-06ca-4a20-a2d1-acc62a27e816\") " pod="kube-system/global-pull-secret-syncer-gb9sf"
Sep 18 22:00:23.123755 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.122433    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9c16bb59-78d7-4421-bffa-789677ffe031-host-slash\") pod \"ovnkube-node-8tbzr\" (UID: \"9c16bb59-78d7-4421-bffa-789677ffe031\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tbzr"
Sep 18 22:00:23.123755 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.122460    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9c16bb59-78d7-4421-bffa-789677ffe031-ovnkube-script-lib\") pod \"ovnkube-node-8tbzr\" (UID: \"9c16bb59-78d7-4421-bffa-789677ffe031\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tbzr"
Sep 18 22:00:23.123755 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.122510    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmgb2\" (UniqueName: \"kubernetes.io/projected/66277164-f820-4f58-b315-ee2bcacd20f3-kube-api-access-hmgb2\") pod \"tuned-khq6l\" (UID: \"66277164-f820-4f58-b315-ee2bcacd20f3\") " pod="openshift-cluster-node-tuning-operator/tuned-khq6l"
Sep 18 22:00:23.123755 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.122538    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7a1c1140-3ecb-4c8b-9a06-cf3f32ce21d1-multus-cni-dir\") pod \"multus-9hq94\" (UID: \"7a1c1140-3ecb-4c8b-9a06-cf3f32ce21d1\") " pod="openshift-multus/multus-9hq94"
Sep 18 22:00:23.123755 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.122591    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5c3dc850-2b4b-4093-8d91-9807b70527a2-registration-dir\") pod \"aws-ebs-csi-driver-node-d7vn2\" (UID: \"5c3dc850-2b4b-4093-8d91-9807b70527a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7vn2"
Sep 18 22:00:23.123755 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.122618    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/66277164-f820-4f58-b315-ee2bcacd20f3-etc-kubernetes\") pod \"tuned-khq6l\" (UID: \"66277164-f820-4f58-b315-ee2bcacd20f3\") " pod="openshift-cluster-node-tuning-operator/tuned-khq6l"
Sep 18 22:00:23.123755 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.122646    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/66277164-f820-4f58-b315-ee2bcacd20f3-etc-systemd\") pod \"tuned-khq6l\" (UID: \"66277164-f820-4f58-b315-ee2bcacd20f3\") " pod="openshift-cluster-node-tuning-operator/tuned-khq6l"
Sep 18 22:00:23.123755 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.122652    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/293a6c1f-7be4-4cd7-a29a-14f22e5a4aac-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5rhzl\" (UID: \"293a6c1f-7be4-4cd7-a29a-14f22e5a4aac\") " pod="openshift-multus/multus-additional-cni-plugins-5rhzl"
Sep 18 22:00:23.123755 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.122666    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/293a6c1f-7be4-4cd7-a29a-14f22e5a4aac-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5rhzl\" (UID: \"293a6c1f-7be4-4cd7-a29a-14f22e5a4aac\") " pod="openshift-multus/multus-additional-cni-plugins-5rhzl"
Sep 18 22:00:23.123755 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.122823    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/66277164-f820-4f58-b315-ee2bcacd20f3-lib-modules\") pod \"tuned-khq6l\" (UID: \"66277164-f820-4f58-b315-ee2bcacd20f3\") " pod="openshift-cluster-node-tuning-operator/tuned-khq6l"
Sep 18 22:00:23.123755 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.122672    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/66277164-f820-4f58-b315-ee2bcacd20f3-lib-modules\") pod \"tuned-khq6l\" (UID: \"66277164-f820-4f58-b315-ee2bcacd20f3\") " pod="openshift-cluster-node-tuning-operator/tuned-khq6l"
Sep 18 22:00:23.123755 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.122973    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9c16bb59-78d7-4421-bffa-789677ffe031-host-slash\") pod \"ovnkube-node-8tbzr\" (UID: \"9c16bb59-78d7-4421-bffa-789677ffe031\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tbzr"
Sep 18 22:00:23.123755 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.123063    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/66277164-f820-4f58-b315-ee2bcacd20f3-etc-kubernetes\") pod \"tuned-khq6l\" (UID: \"66277164-f820-4f58-b315-ee2bcacd20f3\") " pod="openshift-cluster-node-tuning-operator/tuned-khq6l"
Sep 18 22:00:23.123755 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.123408    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9c16bb59-78d7-4421-bffa-789677ffe031-host-cni-bin\") pod \"ovnkube-node-8tbzr\" (UID: \"9c16bb59-78d7-4421-bffa-789677ffe031\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tbzr"
Sep 18 22:00:23.123755 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.123411    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1bfa364a-1dc0-4525-831c-2ec292ec087a-host-slash\") pod \"iptables-alerter-zd4wk\" (UID: \"1bfa364a-1dc0-4525-831c-2ec292ec087a\") " pod="openshift-network-operator/iptables-alerter-zd4wk"
Sep 18 22:00:23.123755 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.123457    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/293a6c1f-7be4-4cd7-a29a-14f22e5a4aac-system-cni-dir\") pod \"multus-additional-cni-plugins-5rhzl\" (UID: \"293a6c1f-7be4-4cd7-a29a-14f22e5a4aac\") " pod="openshift-multus/multus-additional-cni-plugins-5rhzl"
Sep 18 22:00:23.123755 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.123516    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9c16bb59-78d7-4421-bffa-789677ffe031-run-ovn\") pod \"ovnkube-node-8tbzr\" (UID: \"9c16bb59-78d7-4421-bffa-789677ffe031\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tbzr"
Sep 18 22:00:23.124645 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.123543    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/66277164-f820-4f58-b315-ee2bcacd20f3-etc-sysctl-d\") pod \"tuned-khq6l\" (UID: \"66277164-f820-4f58-b315-ee2bcacd20f3\") " pod="openshift-cluster-node-tuning-operator/tuned-khq6l"
Sep 18 22:00:23.124645 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.123570    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7a1c1140-3ecb-4c8b-9a06-cf3f32ce21d1-system-cni-dir\") pod \"multus-9hq94\" (UID: \"7a1c1140-3ecb-4c8b-9a06-cf3f32ce21d1\") " pod="openshift-multus/multus-9hq94"
Sep 18 22:00:23.124645 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.123579    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9c16bb59-78d7-4421-bffa-789677ffe031-run-ovn\") pod \"ovnkube-node-8tbzr\" (UID: \"9c16bb59-78d7-4421-bffa-789677ffe031\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tbzr"
Sep 18 22:00:23.124645 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.123542    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/293a6c1f-7be4-4cd7-a29a-14f22e5a4aac-system-cni-dir\") pod \"multus-additional-cni-plugins-5rhzl\" (UID: \"293a6c1f-7be4-4cd7-a29a-14f22e5a4aac\") " pod="openshift-multus/multus-additional-cni-plugins-5rhzl"
Sep 18 22:00:23.124645 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.123597    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9c16bb59-78d7-4421-bffa-789677ffe031-host-kubelet\") pod \"ovnkube-node-8tbzr\" (UID: \"9c16bb59-78d7-4421-bffa-789677ffe031\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tbzr"
Sep 18 22:00:23.124645 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.123634    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/293a6c1f-7be4-4cd7-a29a-14f22e5a4aac-cni-binary-copy\") pod \"multus-additional-cni-plugins-5rhzl\" (UID: \"293a6c1f-7be4-4cd7-a29a-14f22e5a4aac\") " pod="openshift-multus/multus-additional-cni-plugins-5rhzl"
Sep 18 22:00:23.124645 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.123667    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmmfs\" (UniqueName: \"kubernetes.io/projected/9c16bb59-78d7-4421-bffa-789677ffe031-kube-api-access-rmmfs\") pod \"ovnkube-node-8tbzr\" (UID: \"9c16bb59-78d7-4421-bffa-789677ffe031\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tbzr"
Sep 18 22:00:23.124645 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.123869    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9aea2f1a-d418-4d91-b512-3839fa148822-host\") pod \"node-ca-w5xfs\" (UID: \"9aea2f1a-d418-4d91-b512-3839fa148822\") " pod="openshift-image-registry/node-ca-w5xfs"
Sep 18 22:00:23.124645 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.123919    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5c3dc850-2b4b-4093-8d91-9807b70527a2-etc-selinux\") pod \"aws-ebs-csi-driver-node-d7vn2\" (UID: \"5c3dc850-2b4b-4093-8d91-9807b70527a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7vn2"
Sep 18 22:00:23.124645 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.123945    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hmcn\" (UniqueName: \"kubernetes.io/projected/d322c364-182a-4826-af75-bc5dcab8bf38-kube-api-access-6hmcn\") pod \"node-resolver-qnflp\" (UID: \"d322c364-182a-4826-af75-bc5dcab8bf38\") " pod="openshift-dns/node-resolver-qnflp"
Sep 18 22:00:23.124645 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.124106    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/293a6c1f-7be4-4cd7-a29a-14f22e5a4aac-cni-binary-copy\") pod \"multus-additional-cni-plugins-5rhzl\" (UID: \"293a6c1f-7be4-4cd7-a29a-14f22e5a4aac\") " pod="openshift-multus/multus-additional-cni-plugins-5rhzl"
Sep 18 22:00:23.124645 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.124126    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9c16bb59-78d7-4421-bffa-789677ffe031-var-lib-openvswitch\") pod \"ovnkube-node-8tbzr\" (UID: \"9c16bb59-78d7-4421-bffa-789677ffe031\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tbzr"
Sep 18 22:00:23.124645 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.124167    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9c16bb59-78d7-4421-bffa-789677ffe031-host-cni-netd\") pod \"ovnkube-node-8tbzr\" (UID: \"9c16bb59-78d7-4421-bffa-789677ffe031\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tbzr"
Sep 18 22:00:23.124645 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.124196    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7a1c1140-3ecb-4c8b-9a06-cf3f32ce21d1-host-run-netns\") pod \"multus-9hq94\" (UID: \"7a1c1140-3ecb-4c8b-9a06-cf3f32ce21d1\") " pod="openshift-multus/multus-9hq94"
Sep 18 22:00:23.124645 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.124217    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/66277164-f820-4f58-b315-ee2bcacd20f3-etc-sysctl-d\") pod \"tuned-khq6l\" (UID: \"66277164-f820-4f58-b315-ee2bcacd20f3\") " pod="openshift-cluster-node-tuning-operator/tuned-khq6l"
Sep 18 22:00:23.124645 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.124222    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7a1c1140-3ecb-4c8b-9a06-cf3f32ce21d1-host-var-lib-cni-bin\") pod \"multus-9hq94\" (UID: \"7a1c1140-3ecb-4c8b-9a06-cf3f32ce21d1\") " pod="openshift-multus/multus-9hq94"
Sep 18 22:00:23.124645 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.123638    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9c16bb59-78d7-4421-bffa-789677ffe031-host-kubelet\") pod \"ovnkube-node-8tbzr\" (UID: \"9c16bb59-78d7-4421-bffa-789677ffe031\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tbzr"
Sep 18 22:00:23.125524 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.124246    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7a1c1140-3ecb-4c8b-9a06-cf3f32ce21d1-hostroot\") pod \"multus-9hq94\" (UID: \"7a1c1140-3ecb-4c8b-9a06-cf3f32ce21d1\") " pod="openshift-multus/multus-9hq94"
Sep 18 22:00:23.125524 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.124274    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1bfa364a-1dc0-4525-831c-2ec292ec087a-iptables-alerter-script\") pod \"iptables-alerter-zd4wk\" (UID: \"1bfa364a-1dc0-4525-831c-2ec292ec087a\") " pod="openshift-network-operator/iptables-alerter-zd4wk"
Sep 18 22:00:23.125524 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.124300    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9c16bb59-78d7-4421-bffa-789677ffe031-log-socket\") pod \"ovnkube-node-8tbzr\" (UID: \"9c16bb59-78d7-4421-bffa-789677ffe031\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tbzr"
Sep 18 22:00:23.125524 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.124324    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/66277164-f820-4f58-b315-ee2bcacd20f3-etc-modprobe-d\") pod \"tuned-khq6l\" (UID: \"66277164-f820-4f58-b315-ee2bcacd20f3\") " pod="openshift-cluster-node-tuning-operator/tuned-khq6l"
Sep 18 22:00:23.125524 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.124349    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c715783a-a4e5-4cba-b189-cf2ff6eb8950-metrics-certs\") pod \"network-metrics-daemon-4vmhg\" (UID: \"c715783a-a4e5-4cba-b189-cf2ff6eb8950\") " pod="openshift-multus/network-metrics-daemon-4vmhg"
Sep 18 22:00:23.125524 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.124372    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7a1c1140-3ecb-4c8b-9a06-cf3f32ce21d1-cnibin\") pod \"multus-9hq94\" (UID: \"7a1c1140-3ecb-4c8b-9a06-cf3f32ce21d1\") " pod="openshift-multus/multus-9hq94"
Sep 18 22:00:23.125524 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.124398    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7a1c1140-3ecb-4c8b-9a06-cf3f32ce21d1-cni-binary-copy\") pod \"multus-9hq94\" (UID: \"7a1c1140-3ecb-4c8b-9a06-cf3f32ce21d1\") " pod="openshift-multus/multus-9hq94"
Sep 18 22:00:23.125524 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.124424    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7a1c1140-3ecb-4c8b-9a06-cf3f32ce21d1-multus-socket-dir-parent\") pod \"multus-9hq94\" (UID: \"7a1c1140-3ecb-4c8b-9a06-cf3f32ce21d1\") " pod="openshift-multus/multus-9hq94"
Sep 18 22:00:23.125524 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.124451    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7a1c1140-3ecb-4c8b-9a06-cf3f32ce21d1-host-var-lib-kubelet\") pod \"multus-9hq94\" (UID: \"7a1c1140-3ecb-4c8b-9a06-cf3f32ce21d1\") " pod="openshift-multus/multus-9hq94"
Sep 18 22:00:23.125524 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.124478    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9c16bb59-78d7-4421-bffa-789677ffe031-host-run-netns\") pod \"ovnkube-node-8tbzr\" (UID: \"9c16bb59-78d7-4421-bffa-789677ffe031\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tbzr"
Sep 18 22:00:23.125524 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.124558    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9c16bb59-78d7-4421-bffa-789677ffe031-var-lib-openvswitch\") pod \"ovnkube-node-8tbzr\" (UID: \"9c16bb59-78d7-4421-bffa-789677ffe031\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tbzr"
Sep 18 22:00:23.125524 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.124578    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9c16bb59-78d7-4421-bffa-789677ffe031-host-run-netns\") pod \"ovnkube-node-8tbzr\" (UID: \"9c16bb59-78d7-4421-bffa-789677ffe031\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tbzr"
Sep 18 22:00:23.125524 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.124589    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9c16bb59-78d7-4421-bffa-789677ffe031-run-openvswitch\") pod \"ovnkube-node-8tbzr\" (UID: \"9c16bb59-78d7-4421-bffa-789677ffe031\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tbzr"
Sep 18 22:00:23.125524 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.124621    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5c3dc850-2b4b-4093-8d91-9807b70527a2-socket-dir\") pod \"aws-ebs-csi-driver-node-d7vn2\" (UID: \"5c3dc850-2b4b-4093-8d91-9807b70527a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7vn2"
Sep 18 22:00:23.125524 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.124659    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9c16bb59-78d7-4421-bffa-789677ffe031-log-socket\") pod \"ovnkube-node-8tbzr\" (UID: \"9c16bb59-78d7-4421-bffa-789677ffe031\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tbzr"
Sep 18 22:00:23.125524 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.124668    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9c16bb59-78d7-4421-bffa-789677ffe031-run-openvswitch\") pod \"ovnkube-node-8tbzr\" (UID: \"9c16bb59-78d7-4421-bffa-789677ffe031\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tbzr"
Sep 18 22:00:23.125524 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.124752    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/66277164-f820-4f58-b315-ee2bcacd20f3-etc-modprobe-d\") pod \"tuned-khq6l\" (UID: \"66277164-f820-4f58-b315-ee2bcacd20f3\") " pod="openshift-cluster-node-tuning-operator/tuned-khq6l"
Sep 18 22:00:23.126564 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.124790    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qsgvw\" (UniqueName: \"kubernetes.io/projected/293a6c1f-7be4-4cd7-a29a-14f22e5a4aac-kube-api-access-qsgvw\") pod \"multus-additional-cni-plugins-5rhzl\" (UID: \"293a6c1f-7be4-4cd7-a29a-14f22e5a4aac\") " pod="openshift-multus/multus-additional-cni-plugins-5rhzl"
Sep 18 22:00:23.126564 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.124831    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9c16bb59-78d7-4421-bffa-789677ffe031-systemd-units\") pod \"ovnkube-node-8tbzr\" (UID: \"9c16bb59-78d7-4421-bffa-789677ffe031\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tbzr"
Sep 18 22:00:23.126564 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.124856    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9c16bb59-78d7-4421-bffa-789677ffe031-etc-openvswitch\") pod \"ovnkube-node-8tbzr\" (UID: \"9c16bb59-78d7-4421-bffa-789677ffe031\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tbzr"
Sep 18 22:00:23.126564 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.124893    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7a1c1140-3ecb-4c8b-9a06-cf3f32ce21d1-multus-daemon-config\") pod \"multus-9hq94\" (UID: \"7a1c1140-3ecb-4c8b-9a06-cf3f32ce21d1\") " pod="openshift-multus/multus-9hq94"
Sep 18 22:00:23.126564 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.124917    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7a1c1140-3ecb-4c8b-9a06-cf3f32ce21d1-host-run-multus-certs\") pod \"multus-9hq94\" (UID: \"7a1c1140-3ecb-4c8b-9a06-cf3f32ce21d1\") " pod="openshift-multus/multus-9hq94"
Sep 18 22:00:23.126564 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.124947    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-556mb\" (UniqueName: \"kubernetes.io/projected/7a1c1140-3ecb-4c8b-9a06-cf3f32ce21d1-kube-api-access-556mb\") pod \"multus-9hq94\" (UID: \"7a1c1140-3ecb-4c8b-9a06-cf3f32ce21d1\") " pod="openshift-multus/multus-9hq94"
Sep 18 22:00:23.126564 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.124973    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbbr5\" (UniqueName: \"kubernetes.io/projected/d2df6952-5b90-4dda-829f-62049ca10ae8-kube-api-access-bbbr5\") pod \"network-check-target-z7srk\" (UID: \"d2df6952-5b90-4dda-829f-62049ca10ae8\") " pod="openshift-network-diagnostics/network-check-target-z7srk"
Sep 18 22:00:23.126564 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.125063    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9c16bb59-78d7-4421-bffa-789677ffe031-etc-openvswitch\") pod \"ovnkube-node-8tbzr\" (UID: \"9c16bb59-78d7-4421-bffa-789677ffe031\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tbzr"
Sep 18 22:00:23.126564 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.125240    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1bfa364a-1dc0-4525-831c-2ec292ec087a-iptables-alerter-script\") pod \"iptables-alerter-zd4wk\" (UID: \"1bfa364a-1dc0-4525-831c-2ec292ec087a\") " pod="openshift-network-operator/iptables-alerter-zd4wk"
Sep 18 22:00:23.126564 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.125290    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9c16bb59-78d7-4421-bffa-789677ffe031-host-cni-netd\") pod \"ovnkube-node-8tbzr\" (UID: \"9c16bb59-78d7-4421-bffa-789677ffe031\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tbzr"
Sep 18 22:00:23.126564 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.125307    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9c16bb59-78d7-4421-bffa-789677ffe031-systemd-units\") pod \"ovnkube-node-8tbzr\" (UID: \"9c16bb59-78d7-4421-bffa-789677ffe031\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tbzr"
Sep 18 22:00:23.126564 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.125441    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/66277164-f820-4f58-b315-ee2bcacd20f3-etc-systemd\") pod \"tuned-khq6l\" (UID: \"66277164-f820-4f58-b315-ee2bcacd20f3\") " pod="openshift-cluster-node-tuning-operator/tuned-khq6l"
Sep 18 22:00:23.126564 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.125450    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9c16bb59-78d7-4421-bffa-789677ffe031-host-run-ovn-kubernetes\") pod \"ovnkube-node-8tbzr\" (UID: \"9c16bb59-78d7-4421-bffa-789677ffe031\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tbzr"
Sep 18 22:00:23.126564 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.125967    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9c16bb59-78d7-4421-bffa-789677ffe031-ovnkube-script-lib\") pod \"ovnkube-node-8tbzr\" (UID: \"9c16bb59-78d7-4421-bffa-789677ffe031\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tbzr"
Sep 18 22:00:23.126564 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.126017    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/66277164-f820-4f58-b315-ee2bcacd20f3-tmp\") pod \"tuned-khq6l\" (UID: \"66277164-f820-4f58-b315-ee2bcacd20f3\") " pod="openshift-cluster-node-tuning-operator/tuned-khq6l"
Sep 18 22:00:23.126564 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.126470    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9c16bb59-78d7-4421-bffa-789677ffe031-ovn-node-metrics-cert\") pod \"ovnkube-node-8tbzr\" (UID: \"9c16bb59-78d7-4421-bffa-789677ffe031\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tbzr"
Sep 18 22:00:23.128045 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.127975    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/66277164-f820-4f58-b315-ee2bcacd20f3-etc-tuned\") pod \"tuned-khq6l\" (UID: \"66277164-f820-4f58-b315-ee2bcacd20f3\") " pod="openshift-cluster-node-tuning-operator/tuned-khq6l"
Sep 18 22:00:23.135426 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.134218    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bd8x8\" (UniqueName: \"kubernetes.io/projected/1bfa364a-1dc0-4525-831c-2ec292ec087a-kube-api-access-bd8x8\") pod \"iptables-alerter-zd4wk\" (UID: \"1bfa364a-1dc0-4525-831c-2ec292ec087a\") " pod="openshift-network-operator/iptables-alerter-zd4wk"
Sep 18 22:00:23.135555 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.135450    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmgb2\" (UniqueName: \"kubernetes.io/projected/66277164-f820-4f58-b315-ee2bcacd20f3-kube-api-access-hmgb2\") pod \"tuned-khq6l\" (UID: \"66277164-f820-4f58-b315-ee2bcacd20f3\") " pod="openshift-cluster-node-tuning-operator/tuned-khq6l"
Sep 18 22:00:23.138888 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.138393    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmmfs\" (UniqueName: \"kubernetes.io/projected/9c16bb59-78d7-4421-bffa-789677ffe031-kube-api-access-rmmfs\") pod \"ovnkube-node-8tbzr\" (UID: \"9c16bb59-78d7-4421-bffa-789677ffe031\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tbzr"
Sep 18 22:00:23.141073 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.141025    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qsgvw\" (UniqueName: \"kubernetes.io/projected/293a6c1f-7be4-4cd7-a29a-14f22e5a4aac-kube-api-access-qsgvw\") pod \"multus-additional-cni-plugins-5rhzl\" (UID: \"293a6c1f-7be4-4cd7-a29a-14f22e5a4aac\") " pod="openshift-multus/multus-additional-cni-plugins-5rhzl"
Sep 18 22:00:23.142152 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.142102    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-99.ec2.internal" event={"ID":"8623be5c7bd3987d529f1c61bca76121","Type":"ContainerStarted","Data":"6ff74db546ccebe7a4f83724e40bf1eb881b81a46644d18d4d9d2cec65615b44"}
Sep 18 22:00:23.144831 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.144804    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-99.ec2.internal" event={"ID":"1bff01dc6642f13a258c3e4f92ce231e","Type":"ContainerStarted","Data":"04e270a2c25ec3e72d601fabc4e2cdb9383b2bc571bcf778073ef996e25b2589"}
Sep 18 22:00:23.226021 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.225980    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7a1c1140-3ecb-4c8b-9a06-cf3f32ce21d1-multus-cni-dir\") pod \"multus-9hq94\" (UID: \"7a1c1140-3ecb-4c8b-9a06-cf3f32ce21d1\") " pod="openshift-multus/multus-9hq94"
Sep 18 22:00:23.226202 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.226039    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5c3dc850-2b4b-4093-8d91-9807b70527a2-registration-dir\") pod \"aws-ebs-csi-driver-node-d7vn2\" (UID: \"5c3dc850-2b4b-4093-8d91-9807b70527a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7vn2"
Sep 18 22:00:23.226202 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.226071    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7a1c1140-3ecb-4c8b-9a06-cf3f32ce21d1-system-cni-dir\") pod \"multus-9hq94\" (UID: \"7a1c1140-3ecb-4c8b-9a06-cf3f32ce21d1\") " pod="openshift-multus/multus-9hq94"
Sep 18 22:00:23.226202 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.226099    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9aea2f1a-d418-4d91-b512-3839fa148822-host\") pod \"node-ca-w5xfs\" (UID: \"9aea2f1a-d418-4d91-b512-3839fa148822\") " pod="openshift-image-registry/node-ca-w5xfs"
Sep 18 22:00:23.226202 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.226137    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5c3dc850-2b4b-4093-8d91-9807b70527a2-etc-selinux\") pod \"aws-ebs-csi-driver-node-d7vn2\" (UID: \"5c3dc850-2b4b-4093-8d91-9807b70527a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7vn2"
Sep 18 22:00:23.226202 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.226166    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hmcn\" (UniqueName: \"kubernetes.io/projected/d322c364-182a-4826-af75-bc5dcab8bf38-kube-api-access-6hmcn\") pod \"node-resolver-qnflp\" (UID: \"d322c364-182a-4826-af75-bc5dcab8bf38\") " pod="openshift-dns/node-resolver-qnflp"
Sep 18 22:00:23.226202 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.226162    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5c3dc850-2b4b-4093-8d91-9807b70527a2-registration-dir\") pod \"aws-ebs-csi-driver-node-d7vn2\" (UID: \"5c3dc850-2b4b-4093-8d91-9807b70527a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7vn2"
Sep 18 22:00:23.226202 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.226197    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7a1c1140-3ecb-4c8b-9a06-cf3f32ce21d1-host-run-netns\") pod \"multus-9hq94\" (UID: \"7a1c1140-3ecb-4c8b-9a06-cf3f32ce21d1\") " pod="openshift-multus/multus-9hq94"
Sep 18 22:00:23.226749 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.226225    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7a1c1140-3ecb-4c8b-9a06-cf3f32ce21d1-host-var-lib-cni-bin\") pod \"multus-9hq94\" (UID: \"7a1c1140-3ecb-4c8b-9a06-cf3f32ce21d1\") " pod="openshift-multus/multus-9hq94"
Sep 18 22:00:23.226749 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.226235    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9aea2f1a-d418-4d91-b512-3839fa148822-host\") pod \"node-ca-w5xfs\" (UID: \"9aea2f1a-d418-4d91-b512-3839fa148822\") " pod="openshift-image-registry/node-ca-w5xfs"
Sep 18 22:00:23.226749 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.226249    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7a1c1140-3ecb-4c8b-9a06-cf3f32ce21d1-hostroot\") pod \"multus-9hq94\" (UID: \"7a1c1140-3ecb-4c8b-9a06-cf3f32ce21d1\") " pod="openshift-multus/multus-9hq94"
Sep 18 22:00:23.226749 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.226276    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c715783a-a4e5-4cba-b189-cf2ff6eb8950-metrics-certs\") pod \"network-metrics-daemon-4vmhg\" (UID: \"c715783a-a4e5-4cba-b189-cf2ff6eb8950\") " pod="openshift-multus/network-metrics-daemon-4vmhg"
Sep 18 22:00:23.226749 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.226283    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5c3dc850-2b4b-4093-8d91-9807b70527a2-etc-selinux\") pod \"aws-ebs-csi-driver-node-d7vn2\" (UID: \"5c3dc850-2b4b-4093-8d91-9807b70527a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7vn2"
Sep 18 22:00:23.226749 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.226196    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7a1c1140-3ecb-4c8b-9a06-cf3f32ce21d1-multus-cni-dir\") pod \"multus-9hq94\" (UID: \"7a1c1140-3ecb-4c8b-9a06-cf3f32ce21d1\") " pod="openshift-multus/multus-9hq94"
Sep 18 22:00:23.226749 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.226333    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7a1c1140-3ecb-4c8b-9a06-cf3f32ce21d1-hostroot\") pod \"multus-9hq94\" (UID: \"7a1c1140-3ecb-4c8b-9a06-cf3f32ce21d1\") " pod="openshift-multus/multus-9hq94"
Sep 18 22:00:23.226749 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.226300    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7a1c1140-3ecb-4c8b-9a06-cf3f32ce21d1-cnibin\") pod \"multus-9hq94\" (UID: \"7a1c1140-3ecb-4c8b-9a06-cf3f32ce21d1\") " pod="openshift-multus/multus-9hq94"
Sep 18 22:00:23.226749 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.226377    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7a1c1140-3ecb-4c8b-9a06-cf3f32ce21d1-cni-binary-copy\") pod \"multus-9hq94\" (UID: \"7a1c1140-3ecb-4c8b-9a06-cf3f32ce21d1\") " pod="openshift-multus/multus-9hq94"
Sep 18 22:00:23.226749 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.226376    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7a1c1140-3ecb-4c8b-9a06-cf3f32ce21d1-host-var-lib-cni-bin\") pod \"multus-9hq94\" (UID: \"7a1c1140-3ecb-4c8b-9a06-cf3f32ce21d1\") " pod="openshift-multus/multus-9hq94"
Sep 18 22:00:23.226749 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.226375    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7a1c1140-3ecb-4c8b-9a06-cf3f32ce21d1-cnibin\") pod \"multus-9hq94\" (UID: \"7a1c1140-3ecb-4c8b-9a06-cf3f32ce21d1\") " pod="openshift-multus/multus-9hq94"
Sep 18 22:00:23.226749 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.226291    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7a1c1140-3ecb-4c8b-9a06-cf3f32ce21d1-system-cni-dir\") pod \"multus-9hq94\" (UID: \"7a1c1140-3ecb-4c8b-9a06-cf3f32ce21d1\") " pod="openshift-multus/multus-9hq94"
Sep 18 22:00:23.226749 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:23.226395    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 22:00:23.226749 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.226450    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7a1c1140-3ecb-4c8b-9a06-cf3f32ce21d1-host-run-netns\") pod \"multus-9hq94\" (UID: \"7a1c1140-3ecb-4c8b-9a06-cf3f32ce21d1\") " pod="openshift-multus/multus-9hq94"
Sep 18 22:00:23.226749 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.226464    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7a1c1140-3ecb-4c8b-9a06-cf3f32ce21d1-multus-socket-dir-parent\") pod \"multus-9hq94\" (UID: \"7a1c1140-3ecb-4c8b-9a06-cf3f32ce21d1\") " pod="openshift-multus/multus-9hq94"
Sep 18 22:00:23.226749 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.226404    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7a1c1140-3ecb-4c8b-9a06-cf3f32ce21d1-multus-socket-dir-parent\") pod \"multus-9hq94\" (UID: \"7a1c1140-3ecb-4c8b-9a06-cf3f32ce21d1\") " pod="openshift-multus/multus-9hq94"
Sep 18 22:00:23.226749 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:23.226496    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c715783a-a4e5-4cba-b189-cf2ff6eb8950-metrics-certs podName:c715783a-a4e5-4cba-b189-cf2ff6eb8950 nodeName:}" failed. No retries permitted until 2026-09-18 22:00:23.726474849 +0000 UTC m=+3.046146886 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c715783a-a4e5-4cba-b189-cf2ff6eb8950-metrics-certs") pod "network-metrics-daemon-4vmhg" (UID: "c715783a-a4e5-4cba-b189-cf2ff6eb8950") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 22:00:23.226749 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.226525    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7a1c1140-3ecb-4c8b-9a06-cf3f32ce21d1-host-var-lib-kubelet\") pod \"multus-9hq94\" (UID: \"7a1c1140-3ecb-4c8b-9a06-cf3f32ce21d1\") " pod="openshift-multus/multus-9hq94"
Sep 18 22:00:23.227686 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.226554    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5c3dc850-2b4b-4093-8d91-9807b70527a2-socket-dir\") pod \"aws-ebs-csi-driver-node-d7vn2\" (UID: \"5c3dc850-2b4b-4093-8d91-9807b70527a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7vn2"
Sep 18 22:00:23.227686 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.226583    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7a1c1140-3ecb-4c8b-9a06-cf3f32ce21d1-multus-daemon-config\") pod \"multus-9hq94\" (UID: \"7a1c1140-3ecb-4c8b-9a06-cf3f32ce21d1\") " pod="openshift-multus/multus-9hq94"
Sep 18 22:00:23.227686 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.226609    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7a1c1140-3ecb-4c8b-9a06-cf3f32ce21d1-host-run-multus-certs\") pod \"multus-9hq94\" (UID: \"7a1c1140-3ecb-4c8b-9a06-cf3f32ce21d1\") " pod="openshift-multus/multus-9hq94"
Sep 18 22:00:23.227686 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.226636    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-556mb\" (UniqueName: \"kubernetes.io/projected/7a1c1140-3ecb-4c8b-9a06-cf3f32ce21d1-kube-api-access-556mb\") pod \"multus-9hq94\" (UID: \"7a1c1140-3ecb-4c8b-9a06-cf3f32ce21d1\") " pod="openshift-multus/multus-9hq94"
Sep 18 22:00:23.227686 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.226660    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbbr5\" (UniqueName: \"kubernetes.io/projected/d2df6952-5b90-4dda-829f-62049ca10ae8-kube-api-access-bbbr5\") pod \"network-check-target-z7srk\" (UID: \"d2df6952-5b90-4dda-829f-62049ca10ae8\") " pod="openshift-network-diagnostics/network-check-target-z7srk"
Sep 18 22:00:23.227686 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.226689    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d322c364-182a-4826-af75-bc5dcab8bf38-hosts-file\") pod \"node-resolver-qnflp\" (UID: \"d322c364-182a-4826-af75-bc5dcab8bf38\") " pod="openshift-dns/node-resolver-qnflp"
Sep 18 22:00:23.227686 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.226696    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7a1c1140-3ecb-4c8b-9a06-cf3f32ce21d1-host-var-lib-kubelet\") pod \"multus-9hq94\" (UID: \"7a1c1140-3ecb-4c8b-9a06-cf3f32ce21d1\") " pod="openshift-multus/multus-9hq94"
Sep 18 22:00:23.227686 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.226713    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d322c364-182a-4826-af75-bc5dcab8bf38-tmp-dir\") pod \"node-resolver-qnflp\" (UID: \"d322c364-182a-4826-af75-bc5dcab8bf38\") " pod="openshift-dns/node-resolver-qnflp"
Sep 18 22:00:23.227686 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.226714    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5c3dc850-2b4b-4093-8d91-9807b70527a2-socket-dir\") pod \"aws-ebs-csi-driver-node-d7vn2\" (UID: \"5c3dc850-2b4b-4093-8d91-9807b70527a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7vn2"
Sep 18 22:00:23.227686 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.226748    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7a1c1140-3ecb-4c8b-9a06-cf3f32ce21d1-host-run-multus-certs\") pod \"multus-9hq94\" (UID: \"7a1c1140-3ecb-4c8b-9a06-cf3f32ce21d1\") " pod="openshift-multus/multus-9hq94"
Sep 18 22:00:23.227686 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.226811    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d322c364-182a-4826-af75-bc5dcab8bf38-hosts-file\") pod \"node-resolver-qnflp\" (UID: \"d322c364-182a-4826-af75-bc5dcab8bf38\") " pod="openshift-dns/node-resolver-qnflp"
Sep 18 22:00:23.227686 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.226880    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7a1c1140-3ecb-4c8b-9a06-cf3f32ce21d1-etc-kubernetes\") pod \"multus-9hq94\" (UID: \"7a1c1140-3ecb-4c8b-9a06-cf3f32ce21d1\") " pod="openshift-multus/multus-9hq94"
Sep 18 22:00:23.227686 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.226910    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjmvz\" (UniqueName: \"kubernetes.io/projected/5c3dc850-2b4b-4093-8d91-9807b70527a2-kube-api-access-mjmvz\") pod \"aws-ebs-csi-driver-node-d7vn2\" (UID: \"5c3dc850-2b4b-4093-8d91-9807b70527a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7vn2"
Sep 18 22:00:23.227686 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.226941    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7a1c1140-3ecb-4c8b-9a06-cf3f32ce21d1-host-run-k8s-cni-cncf-io\") pod \"multus-9hq94\" (UID: \"7a1c1140-3ecb-4c8b-9a06-cf3f32ce21d1\") " pod="openshift-multus/multus-9hq94"
Sep 18 22:00:23.227686 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.226966    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5c3dc850-2b4b-4093-8d91-9807b70527a2-device-dir\") pod \"aws-ebs-csi-driver-node-d7vn2\" (UID: \"5c3dc850-2b4b-4093-8d91-9807b70527a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7vn2"
Sep 18 22:00:23.227686 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.226989    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9aea2f1a-d418-4d91-b512-3839fa148822-serviceca\") pod \"node-ca-w5xfs\" (UID: \"9aea2f1a-d418-4d91-b512-3839fa148822\") " pod="openshift-image-registry/node-ca-w5xfs"
Sep 18 22:00:23.227686 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.226990    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7a1c1140-3ecb-4c8b-9a06-cf3f32ce21d1-etc-kubernetes\") pod \"multus-9hq94\" (UID: \"7a1c1140-3ecb-4c8b-9a06-cf3f32ce21d1\") " pod="openshift-multus/multus-9hq94"
Sep 18 22:00:23.227686 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.227031    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7a1c1140-3ecb-4c8b-9a06-cf3f32ce21d1-host-run-k8s-cni-cncf-io\") pod \"multus-9hq94\" (UID: \"7a1c1140-3ecb-4c8b-9a06-cf3f32ce21d1\") " pod="openshift-multus/multus-9hq94"
Sep 18 22:00:23.228375 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.227060    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7a1c1140-3ecb-4c8b-9a06-cf3f32ce21d1-cni-binary-copy\") pod \"multus-9hq94\" (UID: \"7a1c1140-3ecb-4c8b-9a06-cf3f32ce21d1\") " pod="openshift-multus/multus-9hq94"
Sep 18 22:00:23.228375 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.227066    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6dkn\" (UniqueName: \"kubernetes.io/projected/9aea2f1a-d418-4d91-b512-3839fa148822-kube-api-access-w6dkn\") pod \"node-ca-w5xfs\" (UID: \"9aea2f1a-d418-4d91-b512-3839fa148822\") " pod="openshift-image-registry/node-ca-w5xfs"
Sep 18 22:00:23.228375 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.227064    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5c3dc850-2b4b-4093-8d91-9807b70527a2-device-dir\") pod \"aws-ebs-csi-driver-node-d7vn2\" (UID: \"5c3dc850-2b4b-4093-8d91-9807b70527a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7vn2"
Sep 18 22:00:23.228375 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.227108    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d322c364-182a-4826-af75-bc5dcab8bf38-tmp-dir\") pod \"node-resolver-qnflp\" (UID: \"d322c364-182a-4826-af75-bc5dcab8bf38\") " pod="openshift-dns/node-resolver-qnflp"
Sep 18 22:00:23.228375 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.227097    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d27d4416-7b1a-4723-8d04-9c07231b5061-agent-certs\") pod \"konnectivity-agent-gwrfw\" (UID: \"d27d4416-7b1a-4723-8d04-9c07231b5061\") " pod="kube-system/konnectivity-agent-gwrfw"
Sep 18 22:00:23.228375 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.227139    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7a1c1140-3ecb-4c8b-9a06-cf3f32ce21d1-multus-daemon-config\") pod \"multus-9hq94\" (UID: \"7a1c1140-3ecb-4c8b-9a06-cf3f32ce21d1\") " pod="openshift-multus/multus-9hq94"
Sep 18 22:00:23.228375 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.227143    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/57c8eb94-06ca-4a20-a2d1-acc62a27e816-dbus\") pod \"global-pull-secret-syncer-gb9sf\" (UID: \"57c8eb94-06ca-4a20-a2d1-acc62a27e816\") " pod="kube-system/global-pull-secret-syncer-gb9sf"
Sep 18 22:00:23.228375 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.227197    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/57c8eb94-06ca-4a20-a2d1-acc62a27e816-dbus\") pod \"global-pull-secret-syncer-gb9sf\" (UID: \"57c8eb94-06ca-4a20-a2d1-acc62a27e816\") " pod="kube-system/global-pull-secret-syncer-gb9sf"
Sep 18 22:00:23.228375 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.227196    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6c9p\" (UniqueName: \"kubernetes.io/projected/c715783a-a4e5-4cba-b189-cf2ff6eb8950-kube-api-access-v6c9p\") pod \"network-metrics-daemon-4vmhg\" (UID: \"c715783a-a4e5-4cba-b189-cf2ff6eb8950\") " pod="openshift-multus/network-metrics-daemon-4vmhg"
Sep 18 22:00:23.228375 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.227220    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7a1c1140-3ecb-4c8b-9a06-cf3f32ce21d1-host-var-lib-cni-multus\") pod \"multus-9hq94\" (UID: \"7a1c1140-3ecb-4c8b-9a06-cf3f32ce21d1\") " pod="openshift-multus/multus-9hq94"
Sep 18 22:00:23.228375 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.227235    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5c3dc850-2b4b-4093-8d91-9807b70527a2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-d7vn2\" (UID: \"5c3dc850-2b4b-4093-8d91-9807b70527a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7vn2"
Sep 18 22:00:23.228375 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.227251    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5c3dc850-2b4b-4093-8d91-9807b70527a2-sys-fs\") pod \"aws-ebs-csi-driver-node-d7vn2\" (UID: \"5c3dc850-2b4b-4093-8d91-9807b70527a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7vn2"
Sep 18 22:00:23.228375 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.227269    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/57c8eb94-06ca-4a20-a2d1-acc62a27e816-original-pull-secret\") pod \"global-pull-secret-syncer-gb9sf\" (UID: \"57c8eb94-06ca-4a20-a2d1-acc62a27e816\") " pod="kube-system/global-pull-secret-syncer-gb9sf"
Sep 18 22:00:23.228375 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.227288    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d27d4416-7b1a-4723-8d04-9c07231b5061-konnectivity-ca\") pod \"konnectivity-agent-gwrfw\" (UID: \"d27d4416-7b1a-4723-8d04-9c07231b5061\") " pod="kube-system/konnectivity-agent-gwrfw"
Sep 18 22:00:23.228375 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.227304    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7a1c1140-3ecb-4c8b-9a06-cf3f32ce21d1-multus-conf-dir\") pod \"multus-9hq94\" (UID: \"7a1c1140-3ecb-4c8b-9a06-cf3f32ce21d1\") " pod="openshift-multus/multus-9hq94"
Sep 18 22:00:23.228375 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.227308    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7a1c1140-3ecb-4c8b-9a06-cf3f32ce21d1-host-var-lib-cni-multus\") pod \"multus-9hq94\" (UID: \"7a1c1140-3ecb-4c8b-9a06-cf3f32ce21d1\") " pod="openshift-multus/multus-9hq94"
Sep 18 22:00:23.228375 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.227330    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7a1c1140-3ecb-4c8b-9a06-cf3f32ce21d1-multus-conf-dir\") pod \"multus-9hq94\" (UID: \"7a1c1140-3ecb-4c8b-9a06-cf3f32ce21d1\") " pod="openshift-multus/multus-9hq94"
Sep 18 22:00:23.229094 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.227333    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/57c8eb94-06ca-4a20-a2d1-acc62a27e816-kubelet-config\") pod \"global-pull-secret-syncer-gb9sf\" (UID: \"57c8eb94-06ca-4a20-a2d1-acc62a27e816\") " pod="kube-system/global-pull-secret-syncer-gb9sf"
Sep 18 22:00:23.229094 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.227364    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5c3dc850-2b4b-4093-8d91-9807b70527a2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-d7vn2\" (UID: \"5c3dc850-2b4b-4093-8d91-9807b70527a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7vn2"
Sep 18 22:00:23.229094 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:23.227421    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 22:00:23.229094 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.227422    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5c3dc850-2b4b-4093-8d91-9807b70527a2-sys-fs\") pod \"aws-ebs-csi-driver-node-d7vn2\" (UID: \"5c3dc850-2b4b-4093-8d91-9807b70527a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7vn2"
Sep 18 22:00:23.229094 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.227426    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9aea2f1a-d418-4d91-b512-3839fa148822-serviceca\") pod \"node-ca-w5xfs\" (UID: \"9aea2f1a-d418-4d91-b512-3839fa148822\") " pod="openshift-image-registry/node-ca-w5xfs"
Sep 18 22:00:23.229094 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:23.227472    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57c8eb94-06ca-4a20-a2d1-acc62a27e816-original-pull-secret podName:57c8eb94-06ca-4a20-a2d1-acc62a27e816 nodeName:}" failed. No retries permitted until 2026-09-18 22:00:23.727454233 +0000 UTC m=+3.047126301 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/57c8eb94-06ca-4a20-a2d1-acc62a27e816-original-pull-secret") pod "global-pull-secret-syncer-gb9sf" (UID: "57c8eb94-06ca-4a20-a2d1-acc62a27e816") : object "kube-system"/"original-pull-secret" not registered
Sep 18 22:00:23.229094 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.227478    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/57c8eb94-06ca-4a20-a2d1-acc62a27e816-kubelet-config\") pod \"global-pull-secret-syncer-gb9sf\" (UID: \"57c8eb94-06ca-4a20-a2d1-acc62a27e816\") " pod="kube-system/global-pull-secret-syncer-gb9sf"
Sep 18 22:00:23.229094 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.227814    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d27d4416-7b1a-4723-8d04-9c07231b5061-konnectivity-ca\") pod \"konnectivity-agent-gwrfw\" (UID: \"d27d4416-7b1a-4723-8d04-9c07231b5061\") " pod="kube-system/konnectivity-agent-gwrfw"
Sep 18 22:00:23.230501 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.230422    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d27d4416-7b1a-4723-8d04-9c07231b5061-agent-certs\") pod \"konnectivity-agent-gwrfw\" (UID: \"d27d4416-7b1a-4723-8d04-9c07231b5061\") " pod="kube-system/konnectivity-agent-gwrfw"
Sep 18 22:00:23.248833 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:23.248783    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 22:00:23.248833 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:23.248805    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 22:00:23.248833 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:23.248820    2577 projected.go:196] Error preparing data for projected volume kube-api-access-bbbr5 for pod openshift-network-diagnostics/network-check-target-z7srk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 22:00:23.249035 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:23.248891    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d2df6952-5b90-4dda-829f-62049ca10ae8-kube-api-access-bbbr5 podName:d2df6952-5b90-4dda-829f-62049ca10ae8 nodeName:}" failed. No retries permitted until 2026-09-18 22:00:23.748873002 +0000 UTC m=+3.068545040 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-bbbr5" (UniqueName: "kubernetes.io/projected/d2df6952-5b90-4dda-829f-62049ca10ae8-kube-api-access-bbbr5") pod "network-check-target-z7srk" (UID: "d2df6952-5b90-4dda-829f-62049ca10ae8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 22:00:23.251969 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.251945    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6c9p\" (UniqueName: \"kubernetes.io/projected/c715783a-a4e5-4cba-b189-cf2ff6eb8950-kube-api-access-v6c9p\") pod \"network-metrics-daemon-4vmhg\" (UID: \"c715783a-a4e5-4cba-b189-cf2ff6eb8950\") " pod="openshift-multus/network-metrics-daemon-4vmhg"
Sep 18 22:00:23.252083 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.252031    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6dkn\" (UniqueName: \"kubernetes.io/projected/9aea2f1a-d418-4d91-b512-3839fa148822-kube-api-access-w6dkn\") pod \"node-ca-w5xfs\" (UID: \"9aea2f1a-d418-4d91-b512-3839fa148822\") " pod="openshift-image-registry/node-ca-w5xfs"
Sep 18 22:00:23.252307 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.252288    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-556mb\" (UniqueName: \"kubernetes.io/projected/7a1c1140-3ecb-4c8b-9a06-cf3f32ce21d1-kube-api-access-556mb\") pod \"multus-9hq94\" (UID: \"7a1c1140-3ecb-4c8b-9a06-cf3f32ce21d1\") " pod="openshift-multus/multus-9hq94"
Sep 18 22:00:23.252582 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.252562    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hmcn\" (UniqueName: \"kubernetes.io/projected/d322c364-182a-4826-af75-bc5dcab8bf38-kube-api-access-6hmcn\") pod \"node-resolver-qnflp\" (UID: \"d322c364-182a-4826-af75-bc5dcab8bf38\") " pod="openshift-dns/node-resolver-qnflp"
Sep 18 22:00:23.253623 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.253600    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjmvz\" (UniqueName: \"kubernetes.io/projected/5c3dc850-2b4b-4093-8d91-9807b70527a2-kube-api-access-mjmvz\") pod \"aws-ebs-csi-driver-node-d7vn2\" (UID: \"5c3dc850-2b4b-4093-8d91-9807b70527a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7vn2"
Sep 18 22:00:23.316970 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.316937    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5rhzl"
Sep 18 22:00:23.330910 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.330889    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zd4wk"
Sep 18 22:00:23.342092 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.342071    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8tbzr"
Sep 18 22:00:23.348218 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.348197    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-khq6l"
Sep 18 22:00:23.358060 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.358038    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-w5xfs"
Sep 18 22:00:23.369053 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.369023    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9hq94"
Sep 18 22:00:23.376848 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.376828    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7vn2"
Sep 18 22:00:23.386772 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.386750    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gwrfw"
Sep 18 22:00:23.394659 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.394641    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qnflp"
Sep 18 22:00:23.402848 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.402827    2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 18 22:00:23.731868 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.731825    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c715783a-a4e5-4cba-b189-cf2ff6eb8950-metrics-certs\") pod \"network-metrics-daemon-4vmhg\" (UID: \"c715783a-a4e5-4cba-b189-cf2ff6eb8950\") " pod="openshift-multus/network-metrics-daemon-4vmhg"
Sep 18 22:00:23.732074 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.731928    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/57c8eb94-06ca-4a20-a2d1-acc62a27e816-original-pull-secret\") pod \"global-pull-secret-syncer-gb9sf\" (UID: \"57c8eb94-06ca-4a20-a2d1-acc62a27e816\") " pod="kube-system/global-pull-secret-syncer-gb9sf"
Sep 18 22:00:23.732074 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:23.731995    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 22:00:23.732074 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:23.732035    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 22:00:23.732200 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:23.732077    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c715783a-a4e5-4cba-b189-cf2ff6eb8950-metrics-certs podName:c715783a-a4e5-4cba-b189-cf2ff6eb8950 nodeName:}" failed. No retries permitted until 2026-09-18 22:00:24.732056132 +0000 UTC m=+4.051728176 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c715783a-a4e5-4cba-b189-cf2ff6eb8950-metrics-certs") pod "network-metrics-daemon-4vmhg" (UID: "c715783a-a4e5-4cba-b189-cf2ff6eb8950") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 22:00:23.732200 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:23.732098    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57c8eb94-06ca-4a20-a2d1-acc62a27e816-original-pull-secret podName:57c8eb94-06ca-4a20-a2d1-acc62a27e816 nodeName:}" failed. No retries permitted until 2026-09-18 22:00:24.732087711 +0000 UTC m=+4.051759764 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/57c8eb94-06ca-4a20-a2d1-acc62a27e816-original-pull-secret") pod "global-pull-secret-syncer-gb9sf" (UID: "57c8eb94-06ca-4a20-a2d1-acc62a27e816") : object "kube-system"/"original-pull-secret" not registered
Sep 18 22:00:23.832977 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:23.832934    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbbr5\" (UniqueName: \"kubernetes.io/projected/d2df6952-5b90-4dda-829f-62049ca10ae8-kube-api-access-bbbr5\") pod \"network-check-target-z7srk\" (UID: \"d2df6952-5b90-4dda-829f-62049ca10ae8\") " pod="openshift-network-diagnostics/network-check-target-z7srk"
Sep 18 22:00:23.833171 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:23.833129    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 22:00:23.833171 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:23.833155    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 22:00:23.833171 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:23.833167    2577 projected.go:196] Error preparing data for projected volume kube-api-access-bbbr5 for pod openshift-network-diagnostics/network-check-target-z7srk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 22:00:23.833329 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:23.833245    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d2df6952-5b90-4dda-829f-62049ca10ae8-kube-api-access-bbbr5 podName:d2df6952-5b90-4dda-829f-62049ca10ae8 nodeName:}" failed. No retries permitted until 2026-09-18 22:00:24.833225288 +0000 UTC m=+4.152897342 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-bbbr5" (UniqueName: "kubernetes.io/projected/d2df6952-5b90-4dda-829f-62049ca10ae8-kube-api-access-bbbr5") pod "network-check-target-z7srk" (UID: "d2df6952-5b90-4dda-829f-62049ca10ae8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 22:00:24.066053 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:24.066012    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-17 21:55:23 +0000 UTC" deadline="2028-06-20 22:13:09.483857466 +0000 UTC"
Sep 18 22:00:24.066053 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:24.066047    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15384h12m45.417816071s"
Sep 18 22:00:24.249036 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:24.249009    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod293a6c1f_7be4_4cd7_a29a_14f22e5a4aac.slice/crio-38c77ca2ba10ad0a45951864650742e84f9973755531ee7a6a4d7dae5072483b WatchSource:0}: Error finding container 38c77ca2ba10ad0a45951864650742e84f9973755531ee7a6a4d7dae5072483b: Status 404 returned error can't find the container with id 38c77ca2ba10ad0a45951864650742e84f9973755531ee7a6a4d7dae5072483b
Sep 18 22:00:24.249860 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:24.249835    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd322c364_182a_4826_af75_bc5dcab8bf38.slice/crio-064aec3aadbe87043ca79e77bb18b203fc5de6c34af7de587950a37dbefea527 WatchSource:0}: Error finding container 064aec3aadbe87043ca79e77bb18b203fc5de6c34af7de587950a37dbefea527: Status 404 returned error can't find the container with id 064aec3aadbe87043ca79e77bb18b203fc5de6c34af7de587950a37dbefea527
Sep 18 22:00:24.256629 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:24.256213    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd27d4416_7b1a_4723_8d04_9c07231b5061.slice/crio-c3c83046fb14fdba362eaa216fd1679c11cbe4331717b12f0a753287b5d6335a WatchSource:0}: Error finding container c3c83046fb14fdba362eaa216fd1679c11cbe4331717b12f0a753287b5d6335a: Status 404 returned error can't find the container with id c3c83046fb14fdba362eaa216fd1679c11cbe4331717b12f0a753287b5d6335a
Sep 18 22:00:24.282546 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:24.282515    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c16bb59_78d7_4421_bffa_789677ffe031.slice/crio-a217d12960d4acae2cc295ee7a5ed62c2baa40401edff7195a39ebc4a8254abe WatchSource:0}: Error finding container a217d12960d4acae2cc295ee7a5ed62c2baa40401edff7195a39ebc4a8254abe: Status 404 returned error can't find the container with id a217d12960d4acae2cc295ee7a5ed62c2baa40401edff7195a39ebc4a8254abe
Sep 18 22:00:24.283390 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:24.283369    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a1c1140_3ecb_4c8b_9a06_cf3f32ce21d1.slice/crio-98df8ce3506bdea220f6f164f5cadc9dfa54c0f8fbf8ef0c923f5a8ae48cdb91 WatchSource:0}: Error finding container 98df8ce3506bdea220f6f164f5cadc9dfa54c0f8fbf8ef0c923f5a8ae48cdb91: Status 404 returned error can't find the container with id 98df8ce3506bdea220f6f164f5cadc9dfa54c0f8fbf8ef0c923f5a8ae48cdb91
Sep 18 22:00:24.286303 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:24.286249    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9aea2f1a_d418_4d91_b512_3839fa148822.slice/crio-b02217eeb54853bbadc6d6d1caddc8be6619d72ec229e747170c9035477df66c WatchSource:0}: Error finding container b02217eeb54853bbadc6d6d1caddc8be6619d72ec229e747170c9035477df66c: Status 404 returned error can't find the container with id b02217eeb54853bbadc6d6d1caddc8be6619d72ec229e747170c9035477df66c
Sep 18 22:00:24.740229 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:24.740113    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/57c8eb94-06ca-4a20-a2d1-acc62a27e816-original-pull-secret\") pod \"global-pull-secret-syncer-gb9sf\" (UID: \"57c8eb94-06ca-4a20-a2d1-acc62a27e816\") " pod="kube-system/global-pull-secret-syncer-gb9sf"
Sep 18 22:00:24.740229 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:24.740194    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c715783a-a4e5-4cba-b189-cf2ff6eb8950-metrics-certs\") pod \"network-metrics-daemon-4vmhg\" (UID: \"c715783a-a4e5-4cba-b189-cf2ff6eb8950\") " pod="openshift-multus/network-metrics-daemon-4vmhg"
Sep 18 22:00:24.740480 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:24.740302    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 22:00:24.740480 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:24.740367    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57c8eb94-06ca-4a20-a2d1-acc62a27e816-original-pull-secret podName:57c8eb94-06ca-4a20-a2d1-acc62a27e816 nodeName:}" failed. No retries permitted until 2026-09-18 22:00:26.740351785 +0000 UTC m=+6.060023820 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/57c8eb94-06ca-4a20-a2d1-acc62a27e816-original-pull-secret") pod "global-pull-secret-syncer-gb9sf" (UID: "57c8eb94-06ca-4a20-a2d1-acc62a27e816") : object "kube-system"/"original-pull-secret" not registered
Sep 18 22:00:24.740705 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:24.740307    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 22:00:24.740837 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:24.740746    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c715783a-a4e5-4cba-b189-cf2ff6eb8950-metrics-certs podName:c715783a-a4e5-4cba-b189-cf2ff6eb8950 nodeName:}" failed. No retries permitted until 2026-09-18 22:00:26.740729376 +0000 UTC m=+6.060401410 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c715783a-a4e5-4cba-b189-cf2ff6eb8950-metrics-certs") pod "network-metrics-daemon-4vmhg" (UID: "c715783a-a4e5-4cba-b189-cf2ff6eb8950") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 22:00:24.841608 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:24.841565    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbbr5\" (UniqueName: \"kubernetes.io/projected/d2df6952-5b90-4dda-829f-62049ca10ae8-kube-api-access-bbbr5\") pod \"network-check-target-z7srk\" (UID: \"d2df6952-5b90-4dda-829f-62049ca10ae8\") " pod="openshift-network-diagnostics/network-check-target-z7srk"
Sep 18 22:00:24.841845 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:24.841824    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 22:00:24.841911 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:24.841854    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 22:00:24.841911 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:24.841869    2577 projected.go:196] Error preparing data for projected volume kube-api-access-bbbr5 for pod openshift-network-diagnostics/network-check-target-z7srk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 22:00:24.842023 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:24.841931    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d2df6952-5b90-4dda-829f-62049ca10ae8-kube-api-access-bbbr5 podName:d2df6952-5b90-4dda-829f-62049ca10ae8 nodeName:}" failed. No retries permitted until 2026-09-18 22:00:26.841912179 +0000 UTC m=+6.161584221 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-bbbr5" (UniqueName: "kubernetes.io/projected/d2df6952-5b90-4dda-829f-62049ca10ae8-kube-api-access-bbbr5") pod "network-check-target-z7srk" (UID: "d2df6952-5b90-4dda-829f-62049ca10ae8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 22:00:25.066664 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:25.066596    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-17 21:55:23 +0000 UTC" deadline="2028-06-11 21:11:15.07798696 +0000 UTC"
Sep 18 22:00:25.066664 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:25.066663    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15167h10m50.011328317s"
Sep 18 22:00:25.136645 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:25.136615    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z7srk"
Sep 18 22:00:25.136818 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:25.136658    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gb9sf"
Sep 18 22:00:25.136818 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:25.136615    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vmhg"
Sep 18 22:00:25.136818 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:25.136759    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z7srk" podUID="d2df6952-5b90-4dda-829f-62049ca10ae8"
Sep 18 22:00:25.137000 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:25.136910    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vmhg" podUID="c715783a-a4e5-4cba-b189-cf2ff6eb8950"
Sep 18 22:00:25.137000 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:25.136986    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gb9sf" podUID="57c8eb94-06ca-4a20-a2d1-acc62a27e816"
Sep 18 22:00:25.158966 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:25.158930    2577 generic.go:356] "Generic (PLEG): container finished" podID="8623be5c7bd3987d529f1c61bca76121" containerID="720196f78290495505576dde2c7640fc29946e2cd5a729e6d89b9c97daadfa76" exitCode=0
Sep 18 22:00:25.159126 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:25.159042    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-99.ec2.internal" event={"ID":"8623be5c7bd3987d529f1c61bca76121","Type":"ContainerDied","Data":"720196f78290495505576dde2c7640fc29946e2cd5a729e6d89b9c97daadfa76"}
Sep 18 22:00:25.171880 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:25.171807    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-w5xfs" event={"ID":"9aea2f1a-d418-4d91-b512-3839fa148822","Type":"ContainerStarted","Data":"b02217eeb54853bbadc6d6d1caddc8be6619d72ec229e747170c9035477df66c"}
Sep 18 22:00:25.174870 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:25.174838    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gwrfw" event={"ID":"d27d4416-7b1a-4723-8d04-9c07231b5061","Type":"ContainerStarted","Data":"c3c83046fb14fdba362eaa216fd1679c11cbe4331717b12f0a753287b5d6335a"}
Sep 18 22:00:25.180416 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:25.180343    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zd4wk" event={"ID":"1bfa364a-1dc0-4525-831c-2ec292ec087a","Type":"ContainerStarted","Data":"c064851a1b8950ea73a7c0c4583f216f1a8647982b8995e163b856d3f26cf4d2"}
Sep 18 22:00:25.183021 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:25.182930    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5rhzl" event={"ID":"293a6c1f-7be4-4cd7-a29a-14f22e5a4aac","Type":"ContainerStarted","Data":"38c77ca2ba10ad0a45951864650742e84f9973755531ee7a6a4d7dae5072483b"}
Sep 18 22:00:25.198843 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:25.198380    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-99.ec2.internal" event={"ID":"1bff01dc6642f13a258c3e4f92ce231e","Type":"ContainerStarted","Data":"a6f291c12ff7c17146f58631d3f68c35584b32e7245d6882ca7d6b02c0f2693a"}
Sep 18 22:00:25.202988 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:25.202904    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9hq94" event={"ID":"7a1c1140-3ecb-4c8b-9a06-cf3f32ce21d1","Type":"ContainerStarted","Data":"98df8ce3506bdea220f6f164f5cadc9dfa54c0f8fbf8ef0c923f5a8ae48cdb91"}
Sep 18 22:00:25.217379 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:25.217343    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8tbzr" event={"ID":"9c16bb59-78d7-4421-bffa-789677ffe031","Type":"ContainerStarted","Data":"a217d12960d4acae2cc295ee7a5ed62c2baa40401edff7195a39ebc4a8254abe"}
Sep 18 22:00:25.234620 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:25.234588    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-khq6l" event={"ID":"66277164-f820-4f58-b315-ee2bcacd20f3","Type":"ContainerStarted","Data":"3cb9bdda5ec80557e15a8914b81a7719c9046bdc16125344c7f68a40c2e552a2"}
Sep 18 22:00:25.244702 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:25.244314    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qnflp" event={"ID":"d322c364-182a-4826-af75-bc5dcab8bf38","Type":"ContainerStarted","Data":"064aec3aadbe87043ca79e77bb18b203fc5de6c34af7de587950a37dbefea527"}
Sep 18 22:00:25.257231 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:25.257197    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7vn2" event={"ID":"5c3dc850-2b4b-4093-8d91-9807b70527a2","Type":"ContainerStarted","Data":"c4d81699fc82be0e4f6d8f27880c31e83f0dc0219dd83450d60fc17c173398a6"}
Sep 18 22:00:26.283701 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:26.283548    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-99.ec2.internal" event={"ID":"8623be5c7bd3987d529f1c61bca76121","Type":"ContainerStarted","Data":"d4c055144e2a1d8cab0ebb911539601a14420b848da6b1331800d8cdd3c00696"}
Sep 18 22:00:26.311511 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:26.306592    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-99.ec2.internal" podStartSLOduration=3.306570432 podStartE2EDuration="3.306570432s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 22:00:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:00:25.264865203 +0000 UTC m=+4.584537265" watchObservedRunningTime="2026-09-18 22:00:26.306570432 +0000 UTC m=+5.626242490"
Sep 18 22:00:26.759306 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:26.758754    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c715783a-a4e5-4cba-b189-cf2ff6eb8950-metrics-certs\") pod \"network-metrics-daemon-4vmhg\" (UID: \"c715783a-a4e5-4cba-b189-cf2ff6eb8950\") " pod="openshift-multus/network-metrics-daemon-4vmhg"
Sep 18 22:00:26.759306 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:26.758860    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/57c8eb94-06ca-4a20-a2d1-acc62a27e816-original-pull-secret\") pod \"global-pull-secret-syncer-gb9sf\" (UID: \"57c8eb94-06ca-4a20-a2d1-acc62a27e816\") " pod="kube-system/global-pull-secret-syncer-gb9sf"
Sep 18 22:00:26.759306 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:26.759009    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 22:00:26.759306 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:26.759080    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57c8eb94-06ca-4a20-a2d1-acc62a27e816-original-pull-secret podName:57c8eb94-06ca-4a20-a2d1-acc62a27e816 nodeName:}" failed. No retries permitted until 2026-09-18 22:00:30.759061909 +0000 UTC m=+10.078733947 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/57c8eb94-06ca-4a20-a2d1-acc62a27e816-original-pull-secret") pod "global-pull-secret-syncer-gb9sf" (UID: "57c8eb94-06ca-4a20-a2d1-acc62a27e816") : object "kube-system"/"original-pull-secret" not registered
Sep 18 22:00:26.759306 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:26.759077    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 22:00:26.759306 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:26.759149    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c715783a-a4e5-4cba-b189-cf2ff6eb8950-metrics-certs podName:c715783a-a4e5-4cba-b189-cf2ff6eb8950 nodeName:}" failed. No retries permitted until 2026-09-18 22:00:30.759130856 +0000 UTC m=+10.078802894 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c715783a-a4e5-4cba-b189-cf2ff6eb8950-metrics-certs") pod "network-metrics-daemon-4vmhg" (UID: "c715783a-a4e5-4cba-b189-cf2ff6eb8950") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 22:00:26.860738 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:26.859855    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbbr5\" (UniqueName: \"kubernetes.io/projected/d2df6952-5b90-4dda-829f-62049ca10ae8-kube-api-access-bbbr5\") pod \"network-check-target-z7srk\" (UID: \"d2df6952-5b90-4dda-829f-62049ca10ae8\") " pod="openshift-network-diagnostics/network-check-target-z7srk"
Sep 18 22:00:26.860738 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:26.860120    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 22:00:26.860738 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:26.860143    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 22:00:26.860738 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:26.860156    2577 projected.go:196] Error preparing data for projected volume kube-api-access-bbbr5 for pod openshift-network-diagnostics/network-check-target-z7srk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 22:00:26.860738 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:26.860219    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d2df6952-5b90-4dda-829f-62049ca10ae8-kube-api-access-bbbr5 podName:d2df6952-5b90-4dda-829f-62049ca10ae8 nodeName:}" failed. No retries permitted until 2026-09-18 22:00:30.860199564 +0000 UTC m=+10.179871620 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-bbbr5" (UniqueName: "kubernetes.io/projected/d2df6952-5b90-4dda-829f-62049ca10ae8-kube-api-access-bbbr5") pod "network-check-target-z7srk" (UID: "d2df6952-5b90-4dda-829f-62049ca10ae8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 22:00:27.136280 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:27.136240    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z7srk"
Sep 18 22:00:27.136473 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:27.136373    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z7srk" podUID="d2df6952-5b90-4dda-829f-62049ca10ae8"
Sep 18 22:00:27.136891 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:27.136868    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vmhg"
Sep 18 22:00:27.137003 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:27.136984    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vmhg" podUID="c715783a-a4e5-4cba-b189-cf2ff6eb8950"
Sep 18 22:00:27.137109 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:27.137053    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gb9sf"
Sep 18 22:00:27.137168 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:27.137131    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gb9sf" podUID="57c8eb94-06ca-4a20-a2d1-acc62a27e816"
Sep 18 22:00:29.136814 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:29.135948    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gb9sf"
Sep 18 22:00:29.136814 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:29.136097    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gb9sf" podUID="57c8eb94-06ca-4a20-a2d1-acc62a27e816"
Sep 18 22:00:29.136814 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:29.136511    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z7srk"
Sep 18 22:00:29.136814 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:29.136610    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z7srk" podUID="d2df6952-5b90-4dda-829f-62049ca10ae8"
Sep 18 22:00:29.136814 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:29.136663    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vmhg"
Sep 18 22:00:29.136814 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:29.136750    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vmhg" podUID="c715783a-a4e5-4cba-b189-cf2ff6eb8950"
Sep 18 22:00:30.796238 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:30.795601    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/57c8eb94-06ca-4a20-a2d1-acc62a27e816-original-pull-secret\") pod \"global-pull-secret-syncer-gb9sf\" (UID: \"57c8eb94-06ca-4a20-a2d1-acc62a27e816\") " pod="kube-system/global-pull-secret-syncer-gb9sf"
Sep 18 22:00:30.796238 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:30.795883    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 22:00:30.796238 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:30.795955    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c715783a-a4e5-4cba-b189-cf2ff6eb8950-metrics-certs\") pod \"network-metrics-daemon-4vmhg\" (UID: \"c715783a-a4e5-4cba-b189-cf2ff6eb8950\") " pod="openshift-multus/network-metrics-daemon-4vmhg"
Sep 18 22:00:30.796238 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:30.796065    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57c8eb94-06ca-4a20-a2d1-acc62a27e816-original-pull-secret podName:57c8eb94-06ca-4a20-a2d1-acc62a27e816 nodeName:}" failed. No retries permitted until 2026-09-18 22:00:38.796042086 +0000 UTC m=+18.115714120 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/57c8eb94-06ca-4a20-a2d1-acc62a27e816-original-pull-secret") pod "global-pull-secret-syncer-gb9sf" (UID: "57c8eb94-06ca-4a20-a2d1-acc62a27e816") : object "kube-system"/"original-pull-secret" not registered
Sep 18 22:00:30.796238 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:30.796159    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 22:00:30.796238 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:30.796213    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c715783a-a4e5-4cba-b189-cf2ff6eb8950-metrics-certs podName:c715783a-a4e5-4cba-b189-cf2ff6eb8950 nodeName:}" failed. No retries permitted until 2026-09-18 22:00:38.796198519 +0000 UTC m=+18.115870579 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c715783a-a4e5-4cba-b189-cf2ff6eb8950-metrics-certs") pod "network-metrics-daemon-4vmhg" (UID: "c715783a-a4e5-4cba-b189-cf2ff6eb8950") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 22:00:30.897613 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:30.896915    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbbr5\" (UniqueName: \"kubernetes.io/projected/d2df6952-5b90-4dda-829f-62049ca10ae8-kube-api-access-bbbr5\") pod \"network-check-target-z7srk\" (UID: \"d2df6952-5b90-4dda-829f-62049ca10ae8\") " pod="openshift-network-diagnostics/network-check-target-z7srk"
Sep 18 22:00:30.897613 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:30.897115    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 22:00:30.897613 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:30.897140    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 22:00:30.897613 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:30.897152    2577 projected.go:196] Error preparing data for projected volume kube-api-access-bbbr5 for pod openshift-network-diagnostics/network-check-target-z7srk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 22:00:30.897613 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:30.897210    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d2df6952-5b90-4dda-829f-62049ca10ae8-kube-api-access-bbbr5 podName:d2df6952-5b90-4dda-829f-62049ca10ae8 nodeName:}" failed. No retries permitted until 2026-09-18 22:00:38.897193915 +0000 UTC m=+18.216865949 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-bbbr5" (UniqueName: "kubernetes.io/projected/d2df6952-5b90-4dda-829f-62049ca10ae8-kube-api-access-bbbr5") pod "network-check-target-z7srk" (UID: "d2df6952-5b90-4dda-829f-62049ca10ae8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 22:00:31.135460 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:31.134558    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gb9sf"
Sep 18 22:00:31.135460 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:31.134692    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gb9sf" podUID="57c8eb94-06ca-4a20-a2d1-acc62a27e816"
Sep 18 22:00:31.135460 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:31.134763    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z7srk"
Sep 18 22:00:31.135460 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:31.134835    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z7srk" podUID="d2df6952-5b90-4dda-829f-62049ca10ae8"
Sep 18 22:00:31.135460 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:31.135265    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vmhg"
Sep 18 22:00:31.135460 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:31.135375    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vmhg" podUID="c715783a-a4e5-4cba-b189-cf2ff6eb8950"
Sep 18 22:00:33.136197 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:33.136157    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z7srk"
Sep 18 22:00:33.136741 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:33.136296    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z7srk" podUID="d2df6952-5b90-4dda-829f-62049ca10ae8"
Sep 18 22:00:33.136741 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:33.136523    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gb9sf"
Sep 18 22:00:33.136741 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:33.136621    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gb9sf" podUID="57c8eb94-06ca-4a20-a2d1-acc62a27e816"
Sep 18 22:00:33.136741 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:33.136645    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vmhg"
Sep 18 22:00:33.136977 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:33.136787    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vmhg" podUID="c715783a-a4e5-4cba-b189-cf2ff6eb8950"
Sep 18 22:00:35.133377 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:35.133342    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gb9sf"
Sep 18 22:00:35.133377 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:35.133361    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z7srk"
Sep 18 22:00:35.133805 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:35.133496    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gb9sf" podUID="57c8eb94-06ca-4a20-a2d1-acc62a27e816"
Sep 18 22:00:35.133805 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:35.133551    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z7srk" podUID="d2df6952-5b90-4dda-829f-62049ca10ae8"
Sep 18 22:00:35.133805 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:35.133594    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vmhg"
Sep 18 22:00:35.133805 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:35.133670    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vmhg" podUID="c715783a-a4e5-4cba-b189-cf2ff6eb8950"
Sep 18 22:00:37.133767 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:37.133731    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z7srk"
Sep 18 22:00:37.134203 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:37.133731    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vmhg"
Sep 18 22:00:37.134203 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:37.133868    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z7srk" podUID="d2df6952-5b90-4dda-829f-62049ca10ae8"
Sep 18 22:00:37.134203 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:37.133933    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vmhg" podUID="c715783a-a4e5-4cba-b189-cf2ff6eb8950"
Sep 18 22:00:37.134203 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:37.133732    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gb9sf"
Sep 18 22:00:37.134203 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:37.134015    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gb9sf" podUID="57c8eb94-06ca-4a20-a2d1-acc62a27e816"
Sep 18 22:00:38.853381 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:38.853343    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/57c8eb94-06ca-4a20-a2d1-acc62a27e816-original-pull-secret\") pod \"global-pull-secret-syncer-gb9sf\" (UID: \"57c8eb94-06ca-4a20-a2d1-acc62a27e816\") " pod="kube-system/global-pull-secret-syncer-gb9sf"
Sep 18 22:00:38.853877 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:38.853431    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c715783a-a4e5-4cba-b189-cf2ff6eb8950-metrics-certs\") pod \"network-metrics-daemon-4vmhg\" (UID: \"c715783a-a4e5-4cba-b189-cf2ff6eb8950\") " pod="openshift-multus/network-metrics-daemon-4vmhg"
Sep 18 22:00:38.853877 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:38.853532    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 22:00:38.853877 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:38.853598    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57c8eb94-06ca-4a20-a2d1-acc62a27e816-original-pull-secret podName:57c8eb94-06ca-4a20-a2d1-acc62a27e816 nodeName:}" failed. No retries permitted until 2026-09-18 22:00:54.853583437 +0000 UTC m=+34.173255470 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/57c8eb94-06ca-4a20-a2d1-acc62a27e816-original-pull-secret") pod "global-pull-secret-syncer-gb9sf" (UID: "57c8eb94-06ca-4a20-a2d1-acc62a27e816") : object "kube-system"/"original-pull-secret" not registered
Sep 18 22:00:38.853977 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:38.853537    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 22:00:38.853977 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:38.853919    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c715783a-a4e5-4cba-b189-cf2ff6eb8950-metrics-certs podName:c715783a-a4e5-4cba-b189-cf2ff6eb8950 nodeName:}" failed. No retries permitted until 2026-09-18 22:00:54.853903101 +0000 UTC m=+34.173575134 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c715783a-a4e5-4cba-b189-cf2ff6eb8950-metrics-certs") pod "network-metrics-daemon-4vmhg" (UID: "c715783a-a4e5-4cba-b189-cf2ff6eb8950") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 22:00:38.954512 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:38.954465    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbbr5\" (UniqueName: \"kubernetes.io/projected/d2df6952-5b90-4dda-829f-62049ca10ae8-kube-api-access-bbbr5\") pod \"network-check-target-z7srk\" (UID: \"d2df6952-5b90-4dda-829f-62049ca10ae8\") " pod="openshift-network-diagnostics/network-check-target-z7srk"
Sep 18 22:00:38.955154 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:38.955131    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 22:00:38.955240 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:38.955168    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 22:00:38.955240 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:38.955184    2577 projected.go:196] Error preparing data for projected volume kube-api-access-bbbr5 for pod openshift-network-diagnostics/network-check-target-z7srk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 22:00:38.955333 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:38.955261    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d2df6952-5b90-4dda-829f-62049ca10ae8-kube-api-access-bbbr5 podName:d2df6952-5b90-4dda-829f-62049ca10ae8 nodeName:}" failed. No retries permitted until 2026-09-18 22:00:54.955239255 +0000 UTC m=+34.274911292 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-bbbr5" (UniqueName: "kubernetes.io/projected/d2df6952-5b90-4dda-829f-62049ca10ae8-kube-api-access-bbbr5") pod "network-check-target-z7srk" (UID: "d2df6952-5b90-4dda-829f-62049ca10ae8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 22:00:39.133258 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:39.133167    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z7srk"
Sep 18 22:00:39.133448 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:39.133167    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gb9sf"
Sep 18 22:00:39.133448 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:39.133296    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z7srk" podUID="d2df6952-5b90-4dda-829f-62049ca10ae8"
Sep 18 22:00:39.133448 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:39.133312    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vmhg"
Sep 18 22:00:39.133448 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:39.133402    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gb9sf" podUID="57c8eb94-06ca-4a20-a2d1-acc62a27e816"
Sep 18 22:00:39.133638 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:39.133547    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vmhg" podUID="c715783a-a4e5-4cba-b189-cf2ff6eb8950"
Sep 18 22:00:41.133744 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:41.133708    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gb9sf"
Sep 18 22:00:41.134213 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:41.133773    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z7srk"
Sep 18 22:00:41.134213 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:41.133791    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gb9sf" podUID="57c8eb94-06ca-4a20-a2d1-acc62a27e816"
Sep 18 22:00:41.134213 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:41.133863    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z7srk" podUID="d2df6952-5b90-4dda-829f-62049ca10ae8"
Sep 18 22:00:41.134213 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:41.133926    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vmhg"
Sep 18 22:00:41.134213 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:41.133987    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vmhg" podUID="c715783a-a4e5-4cba-b189-cf2ff6eb8950"
Sep 18 22:00:43.135457 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:43.134799    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z7srk"
Sep 18 22:00:43.135457 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:43.134891    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z7srk" podUID="d2df6952-5b90-4dda-829f-62049ca10ae8"
Sep 18 22:00:43.135457 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:43.135127    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vmhg"
Sep 18 22:00:43.135457 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:43.135191    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vmhg" podUID="c715783a-a4e5-4cba-b189-cf2ff6eb8950"
Sep 18 22:00:43.135457 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:43.135232    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gb9sf"
Sep 18 22:00:43.135457 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:43.135285    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gb9sf" podUID="57c8eb94-06ca-4a20-a2d1-acc62a27e816"
Sep 18 22:00:43.324556 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:43.324159    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9hq94" event={"ID":"7a1c1140-3ecb-4c8b-9a06-cf3f32ce21d1","Type":"ContainerStarted","Data":"8883a351f39211348967b83e2964544dc923c7c4dbf099778089c3794a227d09"}
Sep 18 22:00:43.327353 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:43.327214    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8tbzr" event={"ID":"9c16bb59-78d7-4421-bffa-789677ffe031","Type":"ContainerStarted","Data":"ef5e1d3003d8241e7d05b9b494a271c02fea6ed0caa5062565f9ba71cba3cbd2"}
Sep 18 22:00:43.327353 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:43.327302    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8tbzr" event={"ID":"9c16bb59-78d7-4421-bffa-789677ffe031","Type":"ContainerStarted","Data":"0e244348193301b57902c27055a6809900ecc915a331d956ced66cc77fdab309"}
Sep 18 22:00:43.329436 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:43.329026    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-khq6l" event={"ID":"66277164-f820-4f58-b315-ee2bcacd20f3","Type":"ContainerStarted","Data":"1b76cb2944cdb93c3e7d077e1c22f2289c48c3f7f913c843205781a0df1e4464"}
Sep 18 22:00:43.330966 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:43.330919    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qnflp" event={"ID":"d322c364-182a-4826-af75-bc5dcab8bf38","Type":"ContainerStarted","Data":"8f3a7b702f84e531b74873c495ba914d3909ca0cc5dd58eaeecf2b2470f2134b"}
Sep 18 22:00:43.332326 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:43.332298    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7vn2" event={"ID":"5c3dc850-2b4b-4093-8d91-9807b70527a2","Type":"ContainerStarted","Data":"19024e4d058b823b214701fb25f8e85a7beb647076337b1f6521312e30036743"}
Sep 18 22:00:43.333723 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:43.333700    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-w5xfs" event={"ID":"9aea2f1a-d418-4d91-b512-3839fa148822","Type":"ContainerStarted","Data":"4454eaace2e6487e781497817d845a3abe7bd8d69226d3c42ffbd7c81c15e2dd"}
Sep 18 22:00:43.336147 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:43.336070    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gwrfw" event={"ID":"d27d4416-7b1a-4723-8d04-9c07231b5061","Type":"ContainerStarted","Data":"37f258a3b7781c4f8c5cafaed0555ff8fe41babc9ebd6a9fcf809e9e14722fdc"}
Sep 18 22:00:43.338960 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:43.338934    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5rhzl" event={"ID":"293a6c1f-7be4-4cd7-a29a-14f22e5a4aac","Type":"ContainerStarted","Data":"d05b899e53411983152c9b99fa48867ec87e4568ccdb034535fb13cd0cf455c6"}
Sep 18 22:00:43.344232 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:43.344183    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-9hq94" podStartSLOduration=2.477709608 podStartE2EDuration="21.34416601s" totalImagesPullingTime="18.866456402s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 22:00:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:00:43.343734585 +0000 UTC m=+22.663406639" watchObservedRunningTime="2026-09-18 22:00:43.34416601 +0000 UTC m=+22.663838067"
Sep 18 22:00:43.344570 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:43.344542    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-99.ec2.internal" podStartSLOduration=20.344534129 podStartE2EDuration="20.344534129s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 22:00:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:00:26.317952495 +0000 UTC m=+5.637624555" watchObservedRunningTime="2026-09-18 22:00:43.344534129 +0000 UTC m=+22.664206222"
Sep 18 22:00:43.383230 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:43.383184    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-khq6l" podStartSLOduration=2.5622225629999997 podStartE2EDuration="21.383167416s" totalImagesPullingTime="18.820944853s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 22:00:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:00:43.367222201 +0000 UTC m=+22.686894255" watchObservedRunningTime="2026-09-18 22:00:43.383167416 +0000 UTC m=+22.702839478"
Sep 18 22:00:43.383392 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:43.383290    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-w5xfs" podStartSLOduration=2.598658968 podStartE2EDuration="21.383285573s" totalImagesPullingTime="18.784626605s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 22:00:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:00:43.382967367 +0000 UTC m=+22.702639422" watchObservedRunningTime="2026-09-18 22:00:43.383285573 +0000 UTC m=+22.702957628"
Sep 18 22:00:43.431350 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:43.431307    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-gwrfw" podStartSLOduration=2.661173502 podStartE2EDuration="21.431290546s" totalImagesPullingTime="18.770117044s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:00:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:00:43.430773989 +0000 UTC m=+22.750446043" watchObservedRunningTime="2026-09-18 22:00:43.431290546 +0000 UTC m=+22.750962601"
Sep 18 22:00:43.453618 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:43.453563    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-qnflp" podStartSLOduration=2.6361305980000003 podStartE2EDuration="21.453541503s" totalImagesPullingTime="18.817410905s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 22:00:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:00:43.453098833 +0000 UTC m=+22.772770888" watchObservedRunningTime="2026-09-18 22:00:43.453541503 +0000 UTC m=+22.773213604"
Sep 18 22:00:44.342407 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:44.342337    2577 generic.go:356] "Generic (PLEG): container finished" podID="293a6c1f-7be4-4cd7-a29a-14f22e5a4aac" containerID="d05b899e53411983152c9b99fa48867ec87e4568ccdb034535fb13cd0cf455c6" exitCode=0
Sep 18 22:00:44.343176 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:44.342428    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5rhzl" event={"ID":"293a6c1f-7be4-4cd7-a29a-14f22e5a4aac","Type":"ContainerDied","Data":"d05b899e53411983152c9b99fa48867ec87e4568ccdb034535fb13cd0cf455c6"}
Sep 18 22:00:44.345769 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:44.345661    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8tbzr" event={"ID":"9c16bb59-78d7-4421-bffa-789677ffe031","Type":"ContainerStarted","Data":"a6017ffdb14d683d8e62fc3a256208ea35e2724cf34b475b25bb6405ec888660"}
Sep 18 22:00:44.345769 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:44.345731    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8tbzr" event={"ID":"9c16bb59-78d7-4421-bffa-789677ffe031","Type":"ContainerStarted","Data":"1cb5f179cb0159fb70d819e28e99a727cc9f75e71fdd87bdb4f786321eae8f7b"}
Sep 18 22:00:44.345769 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:44.345764    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8tbzr" event={"ID":"9c16bb59-78d7-4421-bffa-789677ffe031","Type":"ContainerStarted","Data":"556700e5bb1550b17e0fc3a7c7e6e12c0ad8f8b693be7b8abace48d0e5fb114f"}
Sep 18 22:00:44.345935 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:44.345795    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8tbzr" event={"ID":"9c16bb59-78d7-4421-bffa-789677ffe031","Type":"ContainerStarted","Data":"33b41db5586334d2817d38fd9db06055ffd5ec40c7ac7a7b35856d8ecdf7a5b5"}
Sep 18 22:00:44.757066 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:44.756852    2577 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 18 22:00:45.081063 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:45.080971    2577 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-18T22:00:44.757062307Z","UUID":"9fc6482e-f6d6-4d53-ad06-89d3b76eb9de","Handler":null,"Name":"","Endpoint":""}
Sep 18 22:00:45.082333 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:45.082312    2577 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 18 22:00:45.082333 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:45.082336    2577 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 18 22:00:45.133912 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:45.133885    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gb9sf"
Sep 18 22:00:45.134064 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:45.133885    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z7srk"
Sep 18 22:00:45.134064 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:45.133994    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gb9sf" podUID="57c8eb94-06ca-4a20-a2d1-acc62a27e816"
Sep 18 22:00:45.134064 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:45.134040    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z7srk" podUID="d2df6952-5b90-4dda-829f-62049ca10ae8"
Sep 18 22:00:45.134064 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:45.133886    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vmhg"
Sep 18 22:00:45.134266 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:45.134145    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vmhg" podUID="c715783a-a4e5-4cba-b189-cf2ff6eb8950"
Sep 18 22:00:45.350123 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:45.350036    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7vn2" event={"ID":"5c3dc850-2b4b-4093-8d91-9807b70527a2","Type":"ContainerStarted","Data":"dddeb2cde999d2f8998db474e4926c4d06901d503cffc16ca28e10ea8a9655f0"}
Sep 18 22:00:45.351743 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:45.351718    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zd4wk" event={"ID":"1bfa364a-1dc0-4525-831c-2ec292ec087a","Type":"ContainerStarted","Data":"431620e114df72b41c20890725e00aa292dbdd02322c6a1b0e4d4b940c531c79"}
Sep 18 22:00:45.370946 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:45.370909    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-zd4wk" podStartSLOduration=4.571697263 podStartE2EDuration="23.370894997s" totalImagesPullingTime="18.799197734s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 22:00:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:00:45.370551247 +0000 UTC m=+24.690223302" watchObservedRunningTime="2026-09-18 22:00:45.370894997 +0000 UTC m=+24.690567051"
Sep 18 22:00:46.358051 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:46.358009    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8tbzr" event={"ID":"9c16bb59-78d7-4421-bffa-789677ffe031","Type":"ContainerStarted","Data":"0e64033c503335962814e5c0556532d2b654f6344bfab0b4bae8b1538b01bb5d"}
Sep 18 22:00:46.360494 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:46.360450    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7vn2" event={"ID":"5c3dc850-2b4b-4093-8d91-9807b70527a2","Type":"ContainerStarted","Data":"dacaae586ef4f9c4db59c95f5b8a7a675d8e805c25eb7ea1e447a26fe708084a"}
Sep 18 22:00:47.133976 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:47.133941    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z7srk"
Sep 18 22:00:47.134163 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:47.134040    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z7srk" podUID="d2df6952-5b90-4dda-829f-62049ca10ae8"
Sep 18 22:00:47.134163 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:47.133941    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gb9sf"
Sep 18 22:00:47.134163 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:47.133941    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vmhg"
Sep 18 22:00:47.134163 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:47.134130    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gb9sf" podUID="57c8eb94-06ca-4a20-a2d1-acc62a27e816"
Sep 18 22:00:47.134383 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:47.134205    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vmhg" podUID="c715783a-a4e5-4cba-b189-cf2ff6eb8950"
Sep 18 22:00:47.268119 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:47.268083    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-gwrfw"
Sep 18 22:00:47.268733 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:47.268711    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-gwrfw"
Sep 18 22:00:47.289049 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:47.289003    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7vn2" podStartSLOduration=3.720154171 podStartE2EDuration="25.288987958s" totalImagesPullingTime="21.568833787s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 22:00:22 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:00:46.38492379 +0000 UTC m=+25.704595856" watchObservedRunningTime="2026-09-18 22:00:47.288987958 +0000 UTC m=+26.608660075"
Sep 18 22:00:47.363389 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:47.363349    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-gwrfw"
Sep 18 22:00:47.363894 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:47.363842    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-gwrfw"
Sep 18 22:00:49.136553 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:49.136491    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z7srk"
Sep 18 22:00:49.136984 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:49.136593    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vmhg"
Sep 18 22:00:49.136984 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:49.136700    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vmhg" podUID="c715783a-a4e5-4cba-b189-cf2ff6eb8950"
Sep 18 22:00:49.136984 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:49.136590    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z7srk" podUID="d2df6952-5b90-4dda-829f-62049ca10ae8"
Sep 18 22:00:49.136984 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:49.136753    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gb9sf"
Sep 18 22:00:49.136984 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:49.136869    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gb9sf" podUID="57c8eb94-06ca-4a20-a2d1-acc62a27e816"
Sep 18 22:00:50.371672 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:50.371481    2577 generic.go:356] "Generic (PLEG): container finished" podID="293a6c1f-7be4-4cd7-a29a-14f22e5a4aac" containerID="3f098c1fb195cdd29705c9360fc253316828483f4767e836cfabb2688c7d887b" exitCode=0
Sep 18 22:00:50.372159 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:50.371573    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5rhzl" event={"ID":"293a6c1f-7be4-4cd7-a29a-14f22e5a4aac","Type":"ContainerDied","Data":"3f098c1fb195cdd29705c9360fc253316828483f4767e836cfabb2688c7d887b"}
Sep 18 22:00:50.375489 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:50.375468    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8tbzr" event={"ID":"9c16bb59-78d7-4421-bffa-789677ffe031","Type":"ContainerStarted","Data":"306adb2509d05c68e4ea80812c6f8d44b3605d1641af50740f2071860be4b108"}
Sep 18 22:00:50.375748 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:50.375730    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8tbzr"
Sep 18 22:00:50.391393 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:50.391373    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8tbzr"
Sep 18 22:00:50.422536 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:50.422496    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-8tbzr" podStartSLOduration=9.579868355 podStartE2EDuration="28.422484844s" totalImagesPullingTime="18.842616489s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 22:00:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:00:50.421481549 +0000 UTC m=+29.741153603" watchObservedRunningTime="2026-09-18 22:00:50.422484844 +0000 UTC m=+29.742156898"
Sep 18 22:00:51.134617 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:51.134581    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vmhg"
Sep 18 22:00:51.134777 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:51.134663    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z7srk"
Sep 18 22:00:51.134777 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:51.134701    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gb9sf"
Sep 18 22:00:51.134777 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:51.134708    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vmhg" podUID="c715783a-a4e5-4cba-b189-cf2ff6eb8950"
Sep 18 22:00:51.134893 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:51.134770    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gb9sf" podUID="57c8eb94-06ca-4a20-a2d1-acc62a27e816"
Sep 18 22:00:51.134893 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:51.134821    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z7srk" podUID="d2df6952-5b90-4dda-829f-62049ca10ae8"
Sep 18 22:00:51.380538 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:51.380287    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5rhzl" event={"ID":"293a6c1f-7be4-4cd7-a29a-14f22e5a4aac","Type":"ContainerStarted","Data":"9f282fd2a1d11f95b8e3c33512785ed9b3b21b4c31b84177cb289a57c9e1846c"}
Sep 18 22:00:51.381160 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:51.380959    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8tbzr"
Sep 18 22:00:51.381160 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:51.381019    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8tbzr"
Sep 18 22:00:51.396064 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:51.395854    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4vmhg"]
Sep 18 22:00:51.396064 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:51.396009    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vmhg"
Sep 18 22:00:51.396191 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:51.396130    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vmhg" podUID="c715783a-a4e5-4cba-b189-cf2ff6eb8950"
Sep 18 22:00:51.396949 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:51.396231    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-gb9sf"]
Sep 18 22:00:51.396949 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:51.396319    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gb9sf"
Sep 18 22:00:51.396949 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:51.396378    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gb9sf" podUID="57c8eb94-06ca-4a20-a2d1-acc62a27e816"
Sep 18 22:00:51.397136 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:51.397089    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-z7srk"]
Sep 18 22:00:51.397200 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:51.397176    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z7srk"
Sep 18 22:00:51.397287 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:51.397265    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z7srk" podUID="d2df6952-5b90-4dda-829f-62049ca10ae8"
Sep 18 22:00:51.399065 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:51.399047    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8tbzr"
Sep 18 22:00:52.386810 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:52.386722    2577 generic.go:356] "Generic (PLEG): container finished" podID="293a6c1f-7be4-4cd7-a29a-14f22e5a4aac" containerID="9f282fd2a1d11f95b8e3c33512785ed9b3b21b4c31b84177cb289a57c9e1846c" exitCode=0
Sep 18 22:00:52.387281 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:52.386799    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5rhzl" event={"ID":"293a6c1f-7be4-4cd7-a29a-14f22e5a4aac","Type":"ContainerDied","Data":"9f282fd2a1d11f95b8e3c33512785ed9b3b21b4c31b84177cb289a57c9e1846c"}
Sep 18 22:00:53.136154 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:53.136126    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gb9sf"
Sep 18 22:00:53.136250 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:53.136169    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vmhg"
Sep 18 22:00:53.136250 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:53.136126    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z7srk"
Sep 18 22:00:53.136521 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:53.136245    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gb9sf" podUID="57c8eb94-06ca-4a20-a2d1-acc62a27e816"
Sep 18 22:00:53.136521 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:53.136335    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z7srk" podUID="d2df6952-5b90-4dda-829f-62049ca10ae8"
Sep 18 22:00:53.136521 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:53.136452    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vmhg" podUID="c715783a-a4e5-4cba-b189-cf2ff6eb8950"
Sep 18 22:00:53.392322 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:53.392243    2577 generic.go:356] "Generic (PLEG): container finished" podID="293a6c1f-7be4-4cd7-a29a-14f22e5a4aac" containerID="75021219ee9b2989b2c235e6f564885908cd9f02905c8abbe79795592edfcdcc" exitCode=0
Sep 18 22:00:53.392751 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:53.392314    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5rhzl" event={"ID":"293a6c1f-7be4-4cd7-a29a-14f22e5a4aac","Type":"ContainerDied","Data":"75021219ee9b2989b2c235e6f564885908cd9f02905c8abbe79795592edfcdcc"}
Sep 18 22:00:54.872878 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:54.872848    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c715783a-a4e5-4cba-b189-cf2ff6eb8950-metrics-certs\") pod \"network-metrics-daemon-4vmhg\" (UID: \"c715783a-a4e5-4cba-b189-cf2ff6eb8950\") " pod="openshift-multus/network-metrics-daemon-4vmhg"
Sep 18 22:00:54.873342 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:54.872901    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/57c8eb94-06ca-4a20-a2d1-acc62a27e816-original-pull-secret\") pod \"global-pull-secret-syncer-gb9sf\" (UID: \"57c8eb94-06ca-4a20-a2d1-acc62a27e816\") " pod="kube-system/global-pull-secret-syncer-gb9sf"
Sep 18 22:00:54.873342 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:54.872997    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 22:00:54.873342 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:54.872999    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 22:00:54.873342 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:54.873049    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57c8eb94-06ca-4a20-a2d1-acc62a27e816-original-pull-secret podName:57c8eb94-06ca-4a20-a2d1-acc62a27e816 nodeName:}" failed. No retries permitted until 2026-09-18 22:01:26.873035875 +0000 UTC m=+66.192707908 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/57c8eb94-06ca-4a20-a2d1-acc62a27e816-original-pull-secret") pod "global-pull-secret-syncer-gb9sf" (UID: "57c8eb94-06ca-4a20-a2d1-acc62a27e816") : object "kube-system"/"original-pull-secret" not registered
Sep 18 22:00:54.873342 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:54.873062    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c715783a-a4e5-4cba-b189-cf2ff6eb8950-metrics-certs podName:c715783a-a4e5-4cba-b189-cf2ff6eb8950 nodeName:}" failed. No retries permitted until 2026-09-18 22:01:26.873056044 +0000 UTC m=+66.192728076 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c715783a-a4e5-4cba-b189-cf2ff6eb8950-metrics-certs") pod "network-metrics-daemon-4vmhg" (UID: "c715783a-a4e5-4cba-b189-cf2ff6eb8950") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 22:00:54.973678 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:54.973641    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbbr5\" (UniqueName: \"kubernetes.io/projected/d2df6952-5b90-4dda-829f-62049ca10ae8-kube-api-access-bbbr5\") pod \"network-check-target-z7srk\" (UID: \"d2df6952-5b90-4dda-829f-62049ca10ae8\") " pod="openshift-network-diagnostics/network-check-target-z7srk"
Sep 18 22:00:54.973839 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:54.973774    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 22:00:54.973839 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:54.973794    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 22:00:54.973839 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:54.973804    2577 projected.go:196] Error preparing data for projected volume kube-api-access-bbbr5 for pod openshift-network-diagnostics/network-check-target-z7srk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 22:00:54.973938 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:54.973857    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d2df6952-5b90-4dda-829f-62049ca10ae8-kube-api-access-bbbr5 podName:d2df6952-5b90-4dda-829f-62049ca10ae8 nodeName:}" failed. No retries permitted until 2026-09-18 22:01:26.97383742 +0000 UTC m=+66.293509457 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-bbbr5" (UniqueName: "kubernetes.io/projected/d2df6952-5b90-4dda-829f-62049ca10ae8-kube-api-access-bbbr5") pod "network-check-target-z7srk" (UID: "d2df6952-5b90-4dda-829f-62049ca10ae8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 22:00:55.133170 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:55.133097    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vmhg"
Sep 18 22:00:55.133300 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:55.133225    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vmhg" podUID="c715783a-a4e5-4cba-b189-cf2ff6eb8950"
Sep 18 22:00:55.133300 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:55.133238    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gb9sf"
Sep 18 22:00:55.133300 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:55.133265    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z7srk"
Sep 18 22:00:55.133436 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:55.133314    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gb9sf" podUID="57c8eb94-06ca-4a20-a2d1-acc62a27e816"
Sep 18 22:00:55.133436 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:55.133377    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z7srk" podUID="d2df6952-5b90-4dda-829f-62049ca10ae8"
Sep 18 22:00:55.948270 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:55.948188    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-99.ec2.internal" event="NodeReady"
Sep 18 22:00:55.948707 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:55.948330    2577 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 18 22:00:56.001609 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:56.001577    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-w9b7s"]
Sep 18 22:00:56.021208 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:56.021169    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-7vzrh"]
Sep 18 22:00:56.024791 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:56.022576    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-w9b7s"
Sep 18 22:00:56.027062 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:56.027033    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 18 22:00:56.027658 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:56.027637    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 18 22:00:56.027724 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:56.027711    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-kdhvj\""
Sep 18 22:00:56.039058 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:56.039039    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-w9b7s"]
Sep 18 22:00:56.039158 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:56.039072    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7vzrh"]
Sep 18 22:00:56.039218 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:56.039157    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7vzrh"
Sep 18 22:00:56.043793 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:56.043774    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 18 22:00:56.044328 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:56.044312    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 18 22:00:56.044453 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:56.044340    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-vdm9t\""
Sep 18 22:00:56.044693 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:56.044666    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 18 22:00:56.181673 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:56.181637    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c8d12c54-c055-450f-b119-48b4667b3537-tmp-dir\") pod \"dns-default-w9b7s\" (UID: \"c8d12c54-c055-450f-b119-48b4667b3537\") " pod="openshift-dns/dns-default-w9b7s"
Sep 18 22:00:56.181827 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:56.181696    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c8d12c54-c055-450f-b119-48b4667b3537-config-volume\") pod \"dns-default-w9b7s\" (UID: \"c8d12c54-c055-450f-b119-48b4667b3537\") " pod="openshift-dns/dns-default-w9b7s"
Sep 18 22:00:56.181827 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:56.181729    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/099e9fb3-fc81-4c88-abd5-ff4cb99cf78b-cert\") pod \"ingress-canary-7vzrh\" (UID: \"099e9fb3-fc81-4c88-abd5-ff4cb99cf78b\") " pod="openshift-ingress-canary/ingress-canary-7vzrh"
Sep 18 22:00:56.181827 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:56.181758    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c8d12c54-c055-450f-b119-48b4667b3537-metrics-tls\") pod \"dns-default-w9b7s\" (UID: \"c8d12c54-c055-450f-b119-48b4667b3537\") " pod="openshift-dns/dns-default-w9b7s"
Sep 18 22:00:56.181827 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:56.181781    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8zxw\" (UniqueName: \"kubernetes.io/projected/c8d12c54-c055-450f-b119-48b4667b3537-kube-api-access-p8zxw\") pod \"dns-default-w9b7s\" (UID: \"c8d12c54-c055-450f-b119-48b4667b3537\") " pod="openshift-dns/dns-default-w9b7s"
Sep 18 22:00:56.181827 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:56.181801    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzm8g\" (UniqueName: \"kubernetes.io/projected/099e9fb3-fc81-4c88-abd5-ff4cb99cf78b-kube-api-access-nzm8g\") pod \"ingress-canary-7vzrh\" (UID: \"099e9fb3-fc81-4c88-abd5-ff4cb99cf78b\") " pod="openshift-ingress-canary/ingress-canary-7vzrh"
Sep 18 22:00:56.282617 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:56.282532    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c8d12c54-c055-450f-b119-48b4667b3537-tmp-dir\") pod \"dns-default-w9b7s\" (UID: \"c8d12c54-c055-450f-b119-48b4667b3537\") " pod="openshift-dns/dns-default-w9b7s"
Sep 18 22:00:56.282617 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:56.282578    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c8d12c54-c055-450f-b119-48b4667b3537-config-volume\") pod \"dns-default-w9b7s\" (UID: \"c8d12c54-c055-450f-b119-48b4667b3537\") " pod="openshift-dns/dns-default-w9b7s"
Sep 18 22:00:56.282831 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:56.282624    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/099e9fb3-fc81-4c88-abd5-ff4cb99cf78b-cert\") pod \"ingress-canary-7vzrh\" (UID: \"099e9fb3-fc81-4c88-abd5-ff4cb99cf78b\") " pod="openshift-ingress-canary/ingress-canary-7vzrh"
Sep 18 22:00:56.282831 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:56.282648    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c8d12c54-c055-450f-b119-48b4667b3537-metrics-tls\") pod \"dns-default-w9b7s\" (UID: \"c8d12c54-c055-450f-b119-48b4667b3537\") " pod="openshift-dns/dns-default-w9b7s"
Sep 18 22:00:56.282831 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:56.282668    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8zxw\" (UniqueName: \"kubernetes.io/projected/c8d12c54-c055-450f-b119-48b4667b3537-kube-api-access-p8zxw\") pod \"dns-default-w9b7s\" (UID: \"c8d12c54-c055-450f-b119-48b4667b3537\") " pod="openshift-dns/dns-default-w9b7s"
Sep 18 22:00:56.282831 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:56.282686    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzm8g\" (UniqueName: \"kubernetes.io/projected/099e9fb3-fc81-4c88-abd5-ff4cb99cf78b-kube-api-access-nzm8g\") pod \"ingress-canary-7vzrh\" (UID: \"099e9fb3-fc81-4c88-abd5-ff4cb99cf78b\") " pod="openshift-ingress-canary/ingress-canary-7vzrh"
Sep 18 22:00:56.283096 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:56.282959    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c8d12c54-c055-450f-b119-48b4667b3537-tmp-dir\") pod \"dns-default-w9b7s\" (UID: \"c8d12c54-c055-450f-b119-48b4667b3537\") " pod="openshift-dns/dns-default-w9b7s"
Sep 18 22:00:56.283301 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:56.283266    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 18 22:00:56.283465 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:56.283346    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8d12c54-c055-450f-b119-48b4667b3537-metrics-tls podName:c8d12c54-c055-450f-b119-48b4667b3537 nodeName:}" failed. No retries permitted until 2026-09-18 22:00:56.783326484 +0000 UTC m=+36.102998536 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c8d12c54-c055-450f-b119-48b4667b3537-metrics-tls") pod "dns-default-w9b7s" (UID: "c8d12c54-c055-450f-b119-48b4667b3537") : secret "dns-default-metrics-tls" not found
Sep 18 22:00:56.283685 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:56.283662    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c8d12c54-c055-450f-b119-48b4667b3537-config-volume\") pod \"dns-default-w9b7s\" (UID: \"c8d12c54-c055-450f-b119-48b4667b3537\") " pod="openshift-dns/dns-default-w9b7s"
Sep 18 22:00:56.288532 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:56.288513    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/099e9fb3-fc81-4c88-abd5-ff4cb99cf78b-cert\") pod \"ingress-canary-7vzrh\" (UID: \"099e9fb3-fc81-4c88-abd5-ff4cb99cf78b\") " pod="openshift-ingress-canary/ingress-canary-7vzrh"
Sep 18 22:00:56.296509 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:56.296480    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8zxw\" (UniqueName: \"kubernetes.io/projected/c8d12c54-c055-450f-b119-48b4667b3537-kube-api-access-p8zxw\") pod \"dns-default-w9b7s\" (UID: \"c8d12c54-c055-450f-b119-48b4667b3537\") " pod="openshift-dns/dns-default-w9b7s"
Sep 18 22:00:56.296631 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:56.296608    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzm8g\" (UniqueName: \"kubernetes.io/projected/099e9fb3-fc81-4c88-abd5-ff4cb99cf78b-kube-api-access-nzm8g\") pod \"ingress-canary-7vzrh\" (UID: \"099e9fb3-fc81-4c88-abd5-ff4cb99cf78b\") " pod="openshift-ingress-canary/ingress-canary-7vzrh"
Sep 18 22:00:56.349269 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:56.349242    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7vzrh"
Sep 18 22:00:56.678848 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:56.678657    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7vzrh"]
Sep 18 22:00:56.786431 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:56.786373    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c8d12c54-c055-450f-b119-48b4667b3537-metrics-tls\") pod \"dns-default-w9b7s\" (UID: \"c8d12c54-c055-450f-b119-48b4667b3537\") " pod="openshift-dns/dns-default-w9b7s"
Sep 18 22:00:56.786611 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:56.786559    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 18 22:00:56.786655 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:56.786616    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8d12c54-c055-450f-b119-48b4667b3537-metrics-tls podName:c8d12c54-c055-450f-b119-48b4667b3537 nodeName:}" failed. No retries permitted until 2026-09-18 22:00:57.7866029 +0000 UTC m=+37.106274936 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c8d12c54-c055-450f-b119-48b4667b3537-metrics-tls") pod "dns-default-w9b7s" (UID: "c8d12c54-c055-450f-b119-48b4667b3537") : secret "dns-default-metrics-tls" not found
Sep 18 22:00:57.133384 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:57.133352    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vmhg"
Sep 18 22:00:57.133875 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:57.133404    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gb9sf"
Sep 18 22:00:57.133875 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:57.133435    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z7srk"
Sep 18 22:00:57.136102 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:57.136016    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 18 22:00:57.136244 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:57.136142    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 18 22:00:57.137051 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:57.136782    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-27j86\""
Sep 18 22:00:57.137051 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:57.136844    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 18 22:00:57.137051 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:57.136905    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8l8bl\""
Sep 18 22:00:57.137198 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:57.137092    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 18 22:00:57.795680 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:57.795643    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c8d12c54-c055-450f-b119-48b4667b3537-metrics-tls\") pod \"dns-default-w9b7s\" (UID: \"c8d12c54-c055-450f-b119-48b4667b3537\") " pod="openshift-dns/dns-default-w9b7s"
Sep 18 22:00:57.795876 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:57.795806    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 18 22:00:57.795938 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:57.795884    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8d12c54-c055-450f-b119-48b4667b3537-metrics-tls podName:c8d12c54-c055-450f-b119-48b4667b3537 nodeName:}" failed. No retries permitted until 2026-09-18 22:00:59.795864759 +0000 UTC m=+39.115536810 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c8d12c54-c055-450f-b119-48b4667b3537-metrics-tls") pod "dns-default-w9b7s" (UID: "c8d12c54-c055-450f-b119-48b4667b3537") : secret "dns-default-metrics-tls" not found
Sep 18 22:00:57.996574 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:00:57.996539    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod099e9fb3_fc81_4c88_abd5_ff4cb99cf78b.slice/crio-c2fe268a3039a5b46902ca747f0744ec56de690ad8068ca1e2e92d88d3e67f80 WatchSource:0}: Error finding container c2fe268a3039a5b46902ca747f0744ec56de690ad8068ca1e2e92d88d3e67f80: Status 404 returned error can't find the container with id c2fe268a3039a5b46902ca747f0744ec56de690ad8068ca1e2e92d88d3e67f80
Sep 18 22:00:58.404832 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:58.404805    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7vzrh" event={"ID":"099e9fb3-fc81-4c88-abd5-ff4cb99cf78b","Type":"ContainerStarted","Data":"c2fe268a3039a5b46902ca747f0744ec56de690ad8068ca1e2e92d88d3e67f80"}
Sep 18 22:00:59.409728 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:59.409693    2577 generic.go:356] "Generic (PLEG): container finished" podID="293a6c1f-7be4-4cd7-a29a-14f22e5a4aac" containerID="44eb68cf09a34f22fd794eee74f4e3bf0101436263e5d98647505eaecff46fe2" exitCode=0
Sep 18 22:00:59.410272 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:59.409755    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5rhzl" event={"ID":"293a6c1f-7be4-4cd7-a29a-14f22e5a4aac","Type":"ContainerDied","Data":"44eb68cf09a34f22fd794eee74f4e3bf0101436263e5d98647505eaecff46fe2"}
Sep 18 22:00:59.811449 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:00:59.811394    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c8d12c54-c055-450f-b119-48b4667b3537-metrics-tls\") pod \"dns-default-w9b7s\" (UID: \"c8d12c54-c055-450f-b119-48b4667b3537\") " pod="openshift-dns/dns-default-w9b7s"
Sep 18 22:00:59.811643 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:59.811542    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 18 22:00:59.811643 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:00:59.811634    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8d12c54-c055-450f-b119-48b4667b3537-metrics-tls podName:c8d12c54-c055-450f-b119-48b4667b3537 nodeName:}" failed. No retries permitted until 2026-09-18 22:01:03.811613496 +0000 UTC m=+43.131285528 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c8d12c54-c055-450f-b119-48b4667b3537-metrics-tls") pod "dns-default-w9b7s" (UID: "c8d12c54-c055-450f-b119-48b4667b3537") : secret "dns-default-metrics-tls" not found
Sep 18 22:01:00.415096 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:00.415057    2577 generic.go:356] "Generic (PLEG): container finished" podID="293a6c1f-7be4-4cd7-a29a-14f22e5a4aac" containerID="dfe4210a4b792746540eddda738acafa4fbe8457dd3b18dd4ceae1225f7f10cb" exitCode=0
Sep 18 22:01:00.415561 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:00.415115    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5rhzl" event={"ID":"293a6c1f-7be4-4cd7-a29a-14f22e5a4aac","Type":"ContainerDied","Data":"dfe4210a4b792746540eddda738acafa4fbe8457dd3b18dd4ceae1225f7f10cb"}
Sep 18 22:01:01.421200 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:01.420954    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5rhzl" event={"ID":"293a6c1f-7be4-4cd7-a29a-14f22e5a4aac","Type":"ContainerStarted","Data":"6cf148152d9241472017fd0631dbcb0f26f0068e1b9a15f8075d49f4c44d9f0a"}
Sep 18 22:01:01.422818 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:01.422792    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7vzrh" event={"ID":"099e9fb3-fc81-4c88-abd5-ff4cb99cf78b","Type":"ContainerStarted","Data":"711ceb94234140aba06f8e5f88a30d008af7536906372c59d8e2becf0a17889c"}
Sep 18 22:01:01.471464 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:01.471397    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-5rhzl" podStartSLOduration=9.062501661 podStartE2EDuration="39.471381861s" totalImagesPullingTime="30.4088802s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 22:00:22 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:01:01.452749397 +0000 UTC m=+40.772421451" watchObservedRunningTime="2026-09-18 22:01:01.471381861 +0000 UTC m=+40.791053916"
Sep 18 22:01:03.840656 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:03.840614    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c8d12c54-c055-450f-b119-48b4667b3537-metrics-tls\") pod \"dns-default-w9b7s\" (UID: \"c8d12c54-c055-450f-b119-48b4667b3537\") " pod="openshift-dns/dns-default-w9b7s"
Sep 18 22:01:03.841044 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:01:03.840735    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 18 22:01:03.841044 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:01:03.840785    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8d12c54-c055-450f-b119-48b4667b3537-metrics-tls podName:c8d12c54-c055-450f-b119-48b4667b3537 nodeName:}" failed. No retries permitted until 2026-09-18 22:01:11.840772801 +0000 UTC m=+51.160444833 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c8d12c54-c055-450f-b119-48b4667b3537-metrics-tls") pod "dns-default-w9b7s" (UID: "c8d12c54-c055-450f-b119-48b4667b3537") : secret "dns-default-metrics-tls" not found
Sep 18 22:01:11.891763 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:11.891724    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c8d12c54-c055-450f-b119-48b4667b3537-metrics-tls\") pod \"dns-default-w9b7s\" (UID: \"c8d12c54-c055-450f-b119-48b4667b3537\") " pod="openshift-dns/dns-default-w9b7s"
Sep 18 22:01:11.892234 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:01:11.891881    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 18 22:01:11.892234 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:01:11.891947    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8d12c54-c055-450f-b119-48b4667b3537-metrics-tls podName:c8d12c54-c055-450f-b119-48b4667b3537 nodeName:}" failed. No retries permitted until 2026-09-18 22:01:27.89193292 +0000 UTC m=+67.211604952 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c8d12c54-c055-450f-b119-48b4667b3537-metrics-tls") pod "dns-default-w9b7s" (UID: "c8d12c54-c055-450f-b119-48b4667b3537") : secret "dns-default-metrics-tls" not found
Sep 18 22:01:13.059122 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:13.059041    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-7vzrh" podStartSLOduration=15.292825616 podStartE2EDuration="18.059017608s" totalImagesPullingTime="2.766191992s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:00:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:01:01.470994749 +0000 UTC m=+40.790666805" watchObservedRunningTime="2026-09-18 22:01:13.059017608 +0000 UTC m=+52.378689664"
Sep 18 22:01:13.059602 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:13.059249    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-d7zbx"]
Sep 18 22:01:13.065755 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:13.065734    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-d7zbx"
Sep 18 22:01:13.068216 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:13.068188    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Sep 18 22:01:13.068363 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:13.068222    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Sep 18 22:01:13.068363 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:13.068233    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Sep 18 22:01:13.068363 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:13.068249    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Sep 18 22:01:13.069010 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:13.068994    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-nqbsc\""
Sep 18 22:01:13.073437 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:13.073396    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-d7zbx"]
Sep 18 22:01:13.179312 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:13.179279    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-676ff698c8-qpzc8"]
Sep 18 22:01:13.181067 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:13.181052    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-676ff698c8-qpzc8"
Sep 18 22:01:13.185316 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:13.185297    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 18 22:01:13.185463 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:13.185298    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 18 22:01:13.185463 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:13.185349    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-m9bdj\""
Sep 18 22:01:13.185463 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:13.185375    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 18 22:01:13.191398 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:13.191377    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 18 22:01:13.201640 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:13.201621    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/be6728b1-ba42-42b6-8eb7-8c0399e18907-serving-cert\") pod \"kube-storage-version-migrator-operator-55889f7b47-d7zbx\" (UID: \"be6728b1-ba42-42b6-8eb7-8c0399e18907\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-d7zbx"
Sep 18 22:01:13.201746 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:13.201650    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/be6728b1-ba42-42b6-8eb7-8c0399e18907-config\") pod \"kube-storage-version-migrator-operator-55889f7b47-d7zbx\" (UID: \"be6728b1-ba42-42b6-8eb7-8c0399e18907\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-d7zbx"
Sep 18 22:01:13.201814 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:13.201796    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkb7t\" (UniqueName: \"kubernetes.io/projected/be6728b1-ba42-42b6-8eb7-8c0399e18907-kube-api-access-rkb7t\") pod \"kube-storage-version-migrator-operator-55889f7b47-d7zbx\" (UID: \"be6728b1-ba42-42b6-8eb7-8c0399e18907\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-d7zbx"
Sep 18 22:01:13.209627 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:13.209604    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-676ff698c8-qpzc8"]
Sep 18 22:01:13.300819 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:13.300780    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-fd4bb46c-h2847"]
Sep 18 22:01:13.302551 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:13.302536    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-6f9c644dd9-r282c"]
Sep 18 22:01:13.302646 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:13.302630    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-fd4bb46c-h2847"
Sep 18 22:01:13.302752 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:13.302730    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf-installation-pull-secrets\") pod \"image-registry-676ff698c8-qpzc8\" (UID: \"ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf\") " pod="openshift-image-registry/image-registry-676ff698c8-qpzc8"
Sep 18 22:01:13.302800 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:13.302787    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkb7t\" (UniqueName: \"kubernetes.io/projected/be6728b1-ba42-42b6-8eb7-8c0399e18907-kube-api-access-rkb7t\") pod \"kube-storage-version-migrator-operator-55889f7b47-d7zbx\" (UID: \"be6728b1-ba42-42b6-8eb7-8c0399e18907\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-d7zbx"
Sep 18 22:01:13.302859 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:13.302816    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf-registry-certificates\") pod \"image-registry-676ff698c8-qpzc8\" (UID: \"ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf\") " pod="openshift-image-registry/image-registry-676ff698c8-qpzc8"
Sep 18 22:01:13.302859 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:13.302844    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf-image-registry-private-configuration\") pod \"image-registry-676ff698c8-qpzc8\" (UID: \"ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf\") " pod="openshift-image-registry/image-registry-676ff698c8-qpzc8"
Sep 18 22:01:13.302951 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:13.302869    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf-trusted-ca\") pod \"image-registry-676ff698c8-qpzc8\" (UID: \"ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf\") " pod="openshift-image-registry/image-registry-676ff698c8-qpzc8"
Sep 18 22:01:13.302951 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:13.302892    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fh74r\" (UniqueName: \"kubernetes.io/projected/ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf-kube-api-access-fh74r\") pod \"image-registry-676ff698c8-qpzc8\" (UID: \"ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf\") " pod="openshift-image-registry/image-registry-676ff698c8-qpzc8"
Sep 18 22:01:13.302951 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:13.302919    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf-ca-trust-extracted\") pod \"image-registry-676ff698c8-qpzc8\" (UID: \"ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf\") " pod="openshift-image-registry/image-registry-676ff698c8-qpzc8"
Sep 18 22:01:13.303096 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:13.302981    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/be6728b1-ba42-42b6-8eb7-8c0399e18907-serving-cert\") pod \"kube-storage-version-migrator-operator-55889f7b47-d7zbx\" (UID: \"be6728b1-ba42-42b6-8eb7-8c0399e18907\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-d7zbx"
Sep 18 22:01:13.303096 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:13.303015    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/be6728b1-ba42-42b6-8eb7-8c0399e18907-config\") pod \"kube-storage-version-migrator-operator-55889f7b47-d7zbx\" (UID: \"be6728b1-ba42-42b6-8eb7-8c0399e18907\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-d7zbx"
Sep 18 22:01:13.303192 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:13.303120    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf-bound-sa-token\") pod \"image-registry-676ff698c8-qpzc8\" (UID: \"ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf\") " pod="openshift-image-registry/image-registry-676ff698c8-qpzc8"
Sep 18 22:01:13.303192 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:13.303151    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf-registry-tls\") pod \"image-registry-676ff698c8-qpzc8\" (UID: \"ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf\") " pod="openshift-image-registry/image-registry-676ff698c8-qpzc8"
Sep 18 22:01:13.303613 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:13.303590    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/be6728b1-ba42-42b6-8eb7-8c0399e18907-config\") pod \"kube-storage-version-migrator-operator-55889f7b47-d7zbx\" (UID: \"be6728b1-ba42-42b6-8eb7-8c0399e18907\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-d7zbx"
Sep 18 22:01:13.304171 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:13.304157    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-6f9c644dd9-r282c"
Sep 18 22:01:13.304606 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:13.304583    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Sep 18 22:01:13.305527 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:13.305512    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Sep 18 22:01:13.305647 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:13.305527    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-8m6g9\""
Sep 18 22:01:13.306254 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:13.306238    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Sep 18 22:01:13.306315 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:13.306287    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-qt9vt\""
Sep 18 22:01:13.306368 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:13.306342    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 18 22:01:13.307068 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:13.307040    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 18 22:01:13.307185 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:13.307120    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Sep 18 22:01:13.307311 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:13.307292    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Sep 18 22:01:13.307453 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:13.307407    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Sep 18 22:01:13.308024 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:13.308004    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/be6728b1-ba42-42b6-8eb7-8c0399e18907-serving-cert\") pod \"kube-storage-version-migrator-operator-55889f7b47-d7zbx\" (UID: \"be6728b1-ba42-42b6-8eb7-8c0399e18907\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-d7zbx"
Sep 18 22:01:13.311614 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:13.311557    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Sep 18 22:01:13.319699 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:13.319671    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Sep 18 22:01:13.322318 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:13.322293    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-fd4bb46c-h2847"]
Sep 18 22:01:13.323542 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:13.323520    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-6f9c644dd9-r282c"]
Sep 18 22:01:13.325230 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:13.325203    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkb7t\" (UniqueName: \"kubernetes.io/projected/be6728b1-ba42-42b6-8eb7-8c0399e18907-kube-api-access-rkb7t\") pod \"kube-storage-version-migrator-operator-55889f7b47-d7zbx\" (UID: \"be6728b1-ba42-42b6-8eb7-8c0399e18907\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-d7zbx"
Sep 18 22:01:13.375137 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:13.375111    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-d7zbx"
Sep 18 22:01:13.404217 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:13.404180    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf-registry-certificates\") pod \"image-registry-676ff698c8-qpzc8\" (UID: \"ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf\") " pod="openshift-image-registry/image-registry-676ff698c8-qpzc8"
Sep 18 22:01:13.404369 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:13.404233    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/180df824-c4c4-4de0-b270-597272b6f759-service-ca-bundle\") pod \"insights-operator-6f9c644dd9-r282c\" (UID: \"180df824-c4c4-4de0-b270-597272b6f759\") " pod="openshift-insights/insights-operator-6f9c644dd9-r282c"
Sep 18 22:01:13.404369 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:13.404267    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf-image-registry-private-configuration\") pod \"image-registry-676ff698c8-qpzc8\" (UID: \"ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf\") " pod="openshift-image-registry/image-registry-676ff698c8-qpzc8"
Sep 18 22:01:13.404369 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:13.404295    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf-trusted-ca\") pod \"image-registry-676ff698c8-qpzc8\" (UID: \"ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf\") " pod="openshift-image-registry/image-registry-676ff698c8-qpzc8"
Sep 18 22:01:13.404369 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:13.404322    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fh74r\" (UniqueName: \"kubernetes.io/projected/ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf-kube-api-access-fh74r\") pod \"image-registry-676ff698c8-qpzc8\" (UID: \"ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf\") " pod="openshift-image-registry/image-registry-676ff698c8-qpzc8"
Sep 18 22:01:13.404606 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:13.404380    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf-ca-trust-extracted\") pod \"image-registry-676ff698c8-qpzc8\" (UID: \"ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf\") " pod="openshift-image-registry/image-registry-676ff698c8-qpzc8"
Sep 18 22:01:13.404606 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:13.404442    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/125d5bb0-54b7-4dff-aa80-e737f2791533-trusted-ca\") pod \"console-operator-fd4bb46c-h2847\" (UID: \"125d5bb0-54b7-4dff-aa80-e737f2791533\") " pod="openshift-console-operator/console-operator-fd4bb46c-h2847"
Sep 18 22:01:13.404606 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:13.404506    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cddnj\" (UniqueName: \"kubernetes.io/projected/125d5bb0-54b7-4dff-aa80-e737f2791533-kube-api-access-cddnj\") pod \"console-operator-fd4bb46c-h2847\" (UID: \"125d5bb0-54b7-4dff-aa80-e737f2791533\") " pod="openshift-console-operator/console-operator-fd4bb46c-h2847"
Sep 18 22:01:13.404606 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:13.404568    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf-bound-sa-token\") pod \"image-registry-676ff698c8-qpzc8\" (UID: \"ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf\") " pod="openshift-image-registry/image-registry-676ff698c8-qpzc8"
Sep 18 22:01:13.404606 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:13.404594    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/180df824-c4c4-4de0-b270-597272b6f759-snapshots\") pod \"insights-operator-6f9c644dd9-r282c\" (UID: \"180df824-c4c4-4de0-b270-597272b6f759\") " pod="openshift-insights/insights-operator-6f9c644dd9-r282c"
Sep 18 22:01:13.404841 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:13.404619    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/180df824-c4c4-4de0-b270-597272b6f759-trusted-ca-bundle\") pod \"insights-operator-6f9c644dd9-r282c\" (UID: \"180df824-c4c4-4de0-b270-597272b6f759\") " pod="openshift-insights/insights-operator-6f9c644dd9-r282c"
Sep 18 22:01:13.404841 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:13.404644    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/180df824-c4c4-4de0-b270-597272b6f759-serving-cert\") pod \"insights-operator-6f9c644dd9-r282c\" (UID: \"180df824-c4c4-4de0-b270-597272b6f759\") " pod="openshift-insights/insights-operator-6f9c644dd9-r282c"
Sep 18 22:01:13.404841 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:13.404667    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twjc7\" (UniqueName: \"kubernetes.io/projected/180df824-c4c4-4de0-b270-597272b6f759-kube-api-access-twjc7\") pod \"insights-operator-6f9c644dd9-r282c\" (UID: \"180df824-c4c4-4de0-b270-597272b6f759\") " pod="openshift-insights/insights-operator-6f9c644dd9-r282c"
Sep 18 22:01:13.404841 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:13.404699    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf-registry-tls\") pod \"image-registry-676ff698c8-qpzc8\" (UID: \"ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf\") " pod="openshift-image-registry/image-registry-676ff698c8-qpzc8"
Sep 18 22:01:13.404841 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:13.404690    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf-registry-certificates\") pod \"image-registry-676ff698c8-qpzc8\" (UID: \"ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf\") " pod="openshift-image-registry/image-registry-676ff698c8-qpzc8"
Sep 18 22:01:13.404841 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:13.404725    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/125d5bb0-54b7-4dff-aa80-e737f2791533-config\") pod \"console-operator-fd4bb46c-h2847\" (UID: \"125d5bb0-54b7-4dff-aa80-e737f2791533\") " pod="openshift-console-operator/console-operator-fd4bb46c-h2847"
Sep 18 22:01:13.404841 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:13.404777    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/180df824-c4c4-4de0-b270-597272b6f759-tmp\") pod \"insights-operator-6f9c644dd9-r282c\" (UID: \"180df824-c4c4-4de0-b270-597272b6f759\") " pod="openshift-insights/insights-operator-6f9c644dd9-r282c"
Sep 18 22:01:13.404841 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:13.404808    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf-installation-pull-secrets\") pod \"image-registry-676ff698c8-qpzc8\" (UID: \"ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf\") " pod="openshift-image-registry/image-registry-676ff698c8-qpzc8"
Sep 18 22:01:13.405257 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:13.404847    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/125d5bb0-54b7-4dff-aa80-e737f2791533-serving-cert\") pod \"console-operator-fd4bb46c-h2847\" (UID: \"125d5bb0-54b7-4dff-aa80-e737f2791533\") " pod="openshift-console-operator/console-operator-fd4bb46c-h2847"
Sep 18 22:01:13.405257 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:13.405061    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf-ca-trust-extracted\") pod \"image-registry-676ff698c8-qpzc8\" (UID: \"ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf\") " pod="openshift-image-registry/image-registry-676ff698c8-qpzc8"
Sep 18 22:01:13.405376 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:01:13.405357    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 18 22:01:13.405482 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:01:13.405378    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-676ff698c8-qpzc8: secret "image-registry-tls" not found
Sep 18 22:01:13.405482 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:01:13.405470    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf-registry-tls podName:ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf nodeName:}" failed. No retries permitted until 2026-09-18 22:01:13.905451797 +0000 UTC m=+53.225123830 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf-registry-tls") pod "image-registry-676ff698c8-qpzc8" (UID: "ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf") : secret "image-registry-tls" not found
Sep 18 22:01:13.406156 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:13.406131    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf-trusted-ca\") pod \"image-registry-676ff698c8-qpzc8\" (UID: \"ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf\") " pod="openshift-image-registry/image-registry-676ff698c8-qpzc8"
Sep 18 22:01:13.407514 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:13.407493    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf-installation-pull-secrets\") pod \"image-registry-676ff698c8-qpzc8\" (UID: \"ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf\") " pod="openshift-image-registry/image-registry-676ff698c8-qpzc8"
Sep 18 22:01:13.407614 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:13.407595    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf-image-registry-private-configuration\") pod \"image-registry-676ff698c8-qpzc8\" (UID: \"ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf\") " pod="openshift-image-registry/image-registry-676ff698c8-qpzc8"
Sep 18 22:01:13.419190 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:13.419109    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf-bound-sa-token\") pod \"image-registry-676ff698c8-qpzc8\" (UID: \"ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf\") " pod="openshift-image-registry/image-registry-676ff698c8-qpzc8"
Sep 18 22:01:13.419190 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:13.419157    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fh74r\" (UniqueName: \"kubernetes.io/projected/ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf-kube-api-access-fh74r\") pod \"image-registry-676ff698c8-qpzc8\" (UID: \"ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf\") " pod="openshift-image-registry/image-registry-676ff698c8-qpzc8"
Sep 18 22:01:13.505722 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:13.505691    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/125d5bb0-54b7-4dff-aa80-e737f2791533-trusted-ca\") pod \"console-operator-fd4bb46c-h2847\" (UID: \"125d5bb0-54b7-4dff-aa80-e737f2791533\") " pod="openshift-console-operator/console-operator-fd4bb46c-h2847"
Sep 18 22:01:13.505869 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:13.505739    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cddnj\" (UniqueName: \"kubernetes.io/projected/125d5bb0-54b7-4dff-aa80-e737f2791533-kube-api-access-cddnj\") pod \"console-operator-fd4bb46c-h2847\" (UID: \"125d5bb0-54b7-4dff-aa80-e737f2791533\") " pod="openshift-console-operator/console-operator-fd4bb46c-h2847"
Sep 18 22:01:13.505869 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:13.505777    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/180df824-c4c4-4de0-b270-597272b6f759-snapshots\") pod \"insights-operator-6f9c644dd9-r282c\" (UID: \"180df824-c4c4-4de0-b270-597272b6f759\") " pod="openshift-insights/insights-operator-6f9c644dd9-r282c"
Sep 18 22:01:13.505869 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:13.505794    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/180df824-c4c4-4de0-b270-597272b6f759-trusted-ca-bundle\") pod \"insights-operator-6f9c644dd9-r282c\" (UID: \"180df824-c4c4-4de0-b270-597272b6f759\") " pod="openshift-insights/insights-operator-6f9c644dd9-r282c"
Sep 18 22:01:13.505869 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:13.505809    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/180df824-c4c4-4de0-b270-597272b6f759-serving-cert\") pod \"insights-operator-6f9c644dd9-r282c\" (UID: \"180df824-c4c4-4de0-b270-597272b6f759\") " pod="openshift-insights/insights-operator-6f9c644dd9-r282c"
Sep 18 22:01:13.505869 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:13.505825    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twjc7\" (UniqueName: \"kubernetes.io/projected/180df824-c4c4-4de0-b270-597272b6f759-kube-api-access-twjc7\") pod \"insights-operator-6f9c644dd9-r282c\" (UID: \"180df824-c4c4-4de0-b270-597272b6f759\") " pod="openshift-insights/insights-operator-6f9c644dd9-r282c"
Sep 18 22:01:13.505869 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:13.505859    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/125d5bb0-54b7-4dff-aa80-e737f2791533-config\") pod \"console-operator-fd4bb46c-h2847\" (UID: \"125d5bb0-54b7-4dff-aa80-e737f2791533\") " pod="openshift-console-operator/console-operator-fd4bb46c-h2847"
Sep 18 22:01:13.506143 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:13.505893    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/180df824-c4c4-4de0-b270-597272b6f759-tmp\") pod \"insights-operator-6f9c644dd9-r282c\" (UID: \"180df824-c4c4-4de0-b270-597272b6f759\") " pod="openshift-insights/insights-operator-6f9c644dd9-r282c"
Sep 18 22:01:13.506143 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:13.505951    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/125d5bb0-54b7-4dff-aa80-e737f2791533-serving-cert\") pod \"console-operator-fd4bb46c-h2847\" (UID: \"125d5bb0-54b7-4dff-aa80-e737f2791533\") " pod="openshift-console-operator/console-operator-fd4bb46c-h2847"
Sep 18 22:01:13.506143 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:13.505975    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/180df824-c4c4-4de0-b270-597272b6f759-service-ca-bundle\") pod \"insights-operator-6f9c644dd9-r282c\" (UID: \"180df824-c4c4-4de0-b270-597272b6f759\") " pod="openshift-insights/insights-operator-6f9c644dd9-r282c"
Sep 18 22:01:13.506645 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:13.506612    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/180df824-c4c4-4de0-b270-597272b6f759-snapshots\") pod \"insights-operator-6f9c644dd9-r282c\" (UID: \"180df824-c4c4-4de0-b270-597272b6f759\") " pod="openshift-insights/insights-operator-6f9c644dd9-r282c"
Sep 18 22:01:13.506645 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:13.506638    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/125d5bb0-54b7-4dff-aa80-e737f2791533-config\") pod \"console-operator-fd4bb46c-h2847\" (UID: \"125d5bb0-54b7-4dff-aa80-e737f2791533\") " pod="openshift-console-operator/console-operator-fd4bb46c-h2847"
Sep 18 22:01:13.506820 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:13.506658    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/180df824-c4c4-4de0-b270-597272b6f759-tmp\") pod \"insights-operator-6f9c644dd9-r282c\" (UID: \"180df824-c4c4-4de0-b270-597272b6f759\") " pod="openshift-insights/insights-operator-6f9c644dd9-r282c"
Sep 18 22:01:13.506820 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:13.506678    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/125d5bb0-54b7-4dff-aa80-e737f2791533-trusted-ca\") pod \"console-operator-fd4bb46c-h2847\" (UID: \"125d5bb0-54b7-4dff-aa80-e737f2791533\") " pod="openshift-console-operator/console-operator-fd4bb46c-h2847"
Sep 18 22:01:13.506820 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:13.506803    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/180df824-c4c4-4de0-b270-597272b6f759-trusted-ca-bundle\") pod \"insights-operator-6f9c644dd9-r282c\" (UID: \"180df824-c4c4-4de0-b270-597272b6f759\") " pod="openshift-insights/insights-operator-6f9c644dd9-r282c"
Sep 18 22:01:13.507147 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:13.506854    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/180df824-c4c4-4de0-b270-597272b6f759-service-ca-bundle\") pod \"insights-operator-6f9c644dd9-r282c\" (UID: \"180df824-c4c4-4de0-b270-597272b6f759\") " pod="openshift-insights/insights-operator-6f9c644dd9-r282c"
Sep 18 22:01:13.508455 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:13.508402    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/125d5bb0-54b7-4dff-aa80-e737f2791533-serving-cert\") pod \"console-operator-fd4bb46c-h2847\" (UID: \"125d5bb0-54b7-4dff-aa80-e737f2791533\") " pod="openshift-console-operator/console-operator-fd4bb46c-h2847"
Sep 18 22:01:13.508547 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:13.508505    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/180df824-c4c4-4de0-b270-597272b6f759-serving-cert\") pod \"insights-operator-6f9c644dd9-r282c\" (UID: \"180df824-c4c4-4de0-b270-597272b6f759\") " pod="openshift-insights/insights-operator-6f9c644dd9-r282c"
Sep 18 22:01:13.513629 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:13.513610    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-twjc7\" (UniqueName: \"kubernetes.io/projected/180df824-c4c4-4de0-b270-597272b6f759-kube-api-access-twjc7\") pod \"insights-operator-6f9c644dd9-r282c\" (UID: \"180df824-c4c4-4de0-b270-597272b6f759\") " pod="openshift-insights/insights-operator-6f9c644dd9-r282c"
Sep 18 22:01:13.513852 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:13.513834    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cddnj\" (UniqueName: \"kubernetes.io/projected/125d5bb0-54b7-4dff-aa80-e737f2791533-kube-api-access-cddnj\") pod \"console-operator-fd4bb46c-h2847\" (UID: \"125d5bb0-54b7-4dff-aa80-e737f2791533\") " pod="openshift-console-operator/console-operator-fd4bb46c-h2847"
Sep 18 22:01:13.619015 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:13.618930    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-fd4bb46c-h2847"
Sep 18 22:01:13.626551 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:13.626524    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-6f9c644dd9-r282c"
Sep 18 22:01:13.646009 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:13.645974    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-d7zbx"]
Sep 18 22:01:13.649765 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:01:13.649726    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe6728b1_ba42_42b6_8eb7_8c0399e18907.slice/crio-e6feb1926dbbd42e2c040970e1bb99e8838c7a8e9ebe9873e6c2cfd79acc414f WatchSource:0}: Error finding container e6feb1926dbbd42e2c040970e1bb99e8838c7a8e9ebe9873e6c2cfd79acc414f: Status 404 returned error can't find the container with id e6feb1926dbbd42e2c040970e1bb99e8838c7a8e9ebe9873e6c2cfd79acc414f
Sep 18 22:01:13.892819 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:13.892741    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-fd4bb46c-h2847"]
Sep 18 22:01:13.897538 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:01:13.896330    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod125d5bb0_54b7_4dff_aa80_e737f2791533.slice/crio-7eb789d9ae85d27b2c4c62ba102269b5d6a36b76a6c86eb53a1b587eae8f19b5 WatchSource:0}: Error finding container 7eb789d9ae85d27b2c4c62ba102269b5d6a36b76a6c86eb53a1b587eae8f19b5: Status 404 returned error can't find the container with id 7eb789d9ae85d27b2c4c62ba102269b5d6a36b76a6c86eb53a1b587eae8f19b5
Sep 18 22:01:13.897538 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:13.897476    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-6f9c644dd9-r282c"]
Sep 18 22:01:13.901707 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:01:13.901684    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod180df824_c4c4_4de0_b270_597272b6f759.slice/crio-18684a8616b3910d99843d08f167f90ad3f35d11d747b54a2d082ab643ae85ae WatchSource:0}: Error finding container 18684a8616b3910d99843d08f167f90ad3f35d11d747b54a2d082ab643ae85ae: Status 404 returned error can't find the container with id 18684a8616b3910d99843d08f167f90ad3f35d11d747b54a2d082ab643ae85ae
Sep 18 22:01:13.909151 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:13.909130    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf-registry-tls\") pod \"image-registry-676ff698c8-qpzc8\" (UID: \"ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf\") " pod="openshift-image-registry/image-registry-676ff698c8-qpzc8"
Sep 18 22:01:13.909260 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:01:13.909240    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 18 22:01:13.909260 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:01:13.909251    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-676ff698c8-qpzc8: secret "image-registry-tls" not found
Sep 18 22:01:13.909329 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:01:13.909292    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf-registry-tls podName:ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf nodeName:}" failed. No retries permitted until 2026-09-18 22:01:14.909280839 +0000 UTC m=+54.228952884 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf-registry-tls") pod "image-registry-676ff698c8-qpzc8" (UID: "ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf") : secret "image-registry-tls" not found
Sep 18 22:01:14.455181 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:14.455144    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-h2847" event={"ID":"125d5bb0-54b7-4dff-aa80-e737f2791533","Type":"ContainerStarted","Data":"7eb789d9ae85d27b2c4c62ba102269b5d6a36b76a6c86eb53a1b587eae8f19b5"}
Sep 18 22:01:14.456533 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:14.456501    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-6f9c644dd9-r282c" event={"ID":"180df824-c4c4-4de0-b270-597272b6f759","Type":"ContainerStarted","Data":"18684a8616b3910d99843d08f167f90ad3f35d11d747b54a2d082ab643ae85ae"}
Sep 18 22:01:14.457851 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:14.457827    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-d7zbx" event={"ID":"be6728b1-ba42-42b6-8eb7-8c0399e18907","Type":"ContainerStarted","Data":"e6feb1926dbbd42e2c040970e1bb99e8838c7a8e9ebe9873e6c2cfd79acc414f"}
Sep 18 22:01:14.916934 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:14.916893    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf-registry-tls\") pod \"image-registry-676ff698c8-qpzc8\" (UID: \"ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf\") " pod="openshift-image-registry/image-registry-676ff698c8-qpzc8"
Sep 18 22:01:14.917097 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:01:14.917053    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 18 22:01:14.917097 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:01:14.917068    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-676ff698c8-qpzc8: secret "image-registry-tls" not found
Sep 18 22:01:14.917209 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:01:14.917120    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf-registry-tls podName:ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf nodeName:}" failed. No retries permitted until 2026-09-18 22:01:16.917107651 +0000 UTC m=+56.236779683 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf-registry-tls") pod "image-registry-676ff698c8-qpzc8" (UID: "ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf") : secret "image-registry-tls" not found
Sep 18 22:01:16.936536 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:16.936509    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf-registry-tls\") pod \"image-registry-676ff698c8-qpzc8\" (UID: \"ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf\") " pod="openshift-image-registry/image-registry-676ff698c8-qpzc8"
Sep 18 22:01:16.936870 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:01:16.936671    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 18 22:01:16.936870 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:01:16.936692    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-676ff698c8-qpzc8: secret "image-registry-tls" not found
Sep 18 22:01:16.936870 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:01:16.936744    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf-registry-tls podName:ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf nodeName:}" failed. No retries permitted until 2026-09-18 22:01:20.936723336 +0000 UTC m=+60.256395396 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf-registry-tls") pod "image-registry-676ff698c8-qpzc8" (UID: "ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf") : secret "image-registry-tls" not found
Sep 18 22:01:17.467680 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:17.467648    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-h2847_125d5bb0-54b7-4dff-aa80-e737f2791533/console-operator/0.log"
Sep 18 22:01:17.467870 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:17.467697    2577 generic.go:356] "Generic (PLEG): container finished" podID="125d5bb0-54b7-4dff-aa80-e737f2791533" containerID="21fba7373adcfb3ec73088761c1790838744a004c63d9bb83e06207fc825310f" exitCode=255
Sep 18 22:01:17.467870 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:17.467795    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-h2847" event={"ID":"125d5bb0-54b7-4dff-aa80-e737f2791533","Type":"ContainerDied","Data":"21fba7373adcfb3ec73088761c1790838744a004c63d9bb83e06207fc825310f"}
Sep 18 22:01:17.468002 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:17.467988    2577 scope.go:117] "RemoveContainer" containerID="21fba7373adcfb3ec73088761c1790838744a004c63d9bb83e06207fc825310f"
Sep 18 22:01:17.469490 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:17.469462    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-6f9c644dd9-r282c" event={"ID":"180df824-c4c4-4de0-b270-597272b6f759","Type":"ContainerStarted","Data":"d0f47457681363b6a4d7cf53e537cba90583db8b84c891a053e9695e43c44581"}
Sep 18 22:01:17.471126 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:17.471100    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-d7zbx" event={"ID":"be6728b1-ba42-42b6-8eb7-8c0399e18907","Type":"ContainerStarted","Data":"bc4f4c48a2344a189629d5c2342e020e174253d0a8f25b7b68ece580dae8bba2"}
Sep 18 22:01:17.508786 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:17.508745    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-d7zbx" podStartSLOduration=1.295872577 podStartE2EDuration="4.508731245s" totalImagesPullingTime="3.212858668s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:01:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:01:17.508357944 +0000 UTC m=+56.828030011" watchObservedRunningTime="2026-09-18 22:01:17.508731245 +0000 UTC m=+56.828403299"
Sep 18 22:01:17.537487 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:17.537444    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-6f9c644dd9-r282c" podStartSLOduration=1.571495047 podStartE2EDuration="4.537404127s" totalImagesPullingTime="2.96590908s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:01:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:01:17.537230122 +0000 UTC m=+56.856902177" watchObservedRunningTime="2026-09-18 22:01:17.537404127 +0000 UTC m=+56.857076182"
Sep 18 22:01:18.476016 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:18.475989    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-h2847_125d5bb0-54b7-4dff-aa80-e737f2791533/console-operator/1.log"
Sep 18 22:01:18.476476 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:18.476462    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-h2847_125d5bb0-54b7-4dff-aa80-e737f2791533/console-operator/0.log"
Sep 18 22:01:18.476549 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:18.476495    2577 generic.go:356] "Generic (PLEG): container finished" podID="125d5bb0-54b7-4dff-aa80-e737f2791533" containerID="6e0e18c13f867ca8c103ba299a037e9466399c0280f9c0e249e7d7f9697d1287" exitCode=255
Sep 18 22:01:18.476603 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:18.476584    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-h2847" event={"ID":"125d5bb0-54b7-4dff-aa80-e737f2791533","Type":"ContainerDied","Data":"6e0e18c13f867ca8c103ba299a037e9466399c0280f9c0e249e7d7f9697d1287"}
Sep 18 22:01:18.476649 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:18.476640    2577 scope.go:117] "RemoveContainer" containerID="21fba7373adcfb3ec73088761c1790838744a004c63d9bb83e06207fc825310f"
Sep 18 22:01:18.476844 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:18.476822    2577 scope.go:117] "RemoveContainer" containerID="6e0e18c13f867ca8c103ba299a037e9466399c0280f9c0e249e7d7f9697d1287"
Sep 18 22:01:18.477043 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:01:18.477018    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-fd4bb46c-h2847_openshift-console-operator(125d5bb0-54b7-4dff-aa80-e737f2791533)\"" pod="openshift-console-operator/console-operator-fd4bb46c-h2847" podUID="125d5bb0-54b7-4dff-aa80-e737f2791533"
Sep 18 22:01:19.480947 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:19.480910    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-h2847_125d5bb0-54b7-4dff-aa80-e737f2791533/console-operator/1.log"
Sep 18 22:01:19.481309 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:19.481231    2577 scope.go:117] "RemoveContainer" containerID="6e0e18c13f867ca8c103ba299a037e9466399c0280f9c0e249e7d7f9697d1287"
Sep 18 22:01:19.481382 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:01:19.481364    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-fd4bb46c-h2847_openshift-console-operator(125d5bb0-54b7-4dff-aa80-e737f2791533)\"" pod="openshift-console-operator/console-operator-fd4bb46c-h2847" podUID="125d5bb0-54b7-4dff-aa80-e737f2791533"
Sep 18 22:01:19.503556 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:19.503526    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-ldnhp"]
Sep 18 22:01:19.505803 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:19.505787    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ldnhp"
Sep 18 22:01:19.507933 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:19.507913    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 18 22:01:19.508049 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:19.507971    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-wk4th\""
Sep 18 22:01:19.508344 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:19.508327    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 18 22:01:19.520871 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:19.520851    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ldnhp"]
Sep 18 22:01:19.646797 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:19.646765    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-55f6fc7b86-29b9s"]
Sep 18 22:01:19.650095 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:19.650066    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-55f6fc7b86-29b9s"
Sep 18 22:01:19.652773 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:19.652753    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Sep 18 22:01:19.652935 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:19.652753    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Sep 18 22:01:19.652935 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:19.652755    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Sep 18 22:01:19.653262 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:19.653245    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Sep 18 22:01:19.653442 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:19.653427    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-zvnrg\""
Sep 18 22:01:19.657025 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:19.657006    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d89bc690-49bd-4c8e-8f91-9dcefe8f7cf2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ldnhp\" (UID: \"d89bc690-49bd-4c8e-8f91-9dcefe8f7cf2\") " pod="openshift-insights/insights-runtime-extractor-ldnhp"
Sep 18 22:01:19.657098 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:19.657062    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d89bc690-49bd-4c8e-8f91-9dcefe8f7cf2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ldnhp\" (UID: \"d89bc690-49bd-4c8e-8f91-9dcefe8f7cf2\") " pod="openshift-insights/insights-runtime-extractor-ldnhp"
Sep 18 22:01:19.657148 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:19.657100    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d89bc690-49bd-4c8e-8f91-9dcefe8f7cf2-data-volume\") pod \"insights-runtime-extractor-ldnhp\" (UID: \"d89bc690-49bd-4c8e-8f91-9dcefe8f7cf2\") " pod="openshift-insights/insights-runtime-extractor-ldnhp"
Sep 18 22:01:19.657148 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:19.657136    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcqns\" (UniqueName: \"kubernetes.io/projected/d89bc690-49bd-4c8e-8f91-9dcefe8f7cf2-kube-api-access-rcqns\") pod \"insights-runtime-extractor-ldnhp\" (UID: \"d89bc690-49bd-4c8e-8f91-9dcefe8f7cf2\") " pod="openshift-insights/insights-runtime-extractor-ldnhp"
Sep 18 22:01:19.657361 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:19.657342    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d89bc690-49bd-4c8e-8f91-9dcefe8f7cf2-crio-socket\") pod \"insights-runtime-extractor-ldnhp\" (UID: \"d89bc690-49bd-4c8e-8f91-9dcefe8f7cf2\") " pod="openshift-insights/insights-runtime-extractor-ldnhp"
Sep 18 22:01:19.666008 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:19.665990    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-55f6fc7b86-29b9s"]
Sep 18 22:01:19.757795 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:19.757722    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d89bc690-49bd-4c8e-8f91-9dcefe8f7cf2-data-volume\") pod \"insights-runtime-extractor-ldnhp\" (UID: \"d89bc690-49bd-4c8e-8f91-9dcefe8f7cf2\") " pod="openshift-insights/insights-runtime-extractor-ldnhp"
Sep 18 22:01:19.757795 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:19.757771    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcqns\" (UniqueName: \"kubernetes.io/projected/d89bc690-49bd-4c8e-8f91-9dcefe8f7cf2-kube-api-access-rcqns\") pod \"insights-runtime-extractor-ldnhp\" (UID: \"d89bc690-49bd-4c8e-8f91-9dcefe8f7cf2\") " pod="openshift-insights/insights-runtime-extractor-ldnhp"
Sep 18 22:01:19.757982 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:19.757811    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6s5fb\" (UniqueName: \"kubernetes.io/projected/da0346e5-f032-49a0-bbed-fe5dab41890f-kube-api-access-6s5fb\") pod \"service-ca-55f6fc7b86-29b9s\" (UID: \"da0346e5-f032-49a0-bbed-fe5dab41890f\") " pod="openshift-service-ca/service-ca-55f6fc7b86-29b9s"
Sep 18 22:01:19.757982 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:19.757899    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d89bc690-49bd-4c8e-8f91-9dcefe8f7cf2-crio-socket\") pod \"insights-runtime-extractor-ldnhp\" (UID: \"d89bc690-49bd-4c8e-8f91-9dcefe8f7cf2\") " pod="openshift-insights/insights-runtime-extractor-ldnhp"
Sep 18 22:01:19.757982 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:19.757936    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/da0346e5-f032-49a0-bbed-fe5dab41890f-signing-key\") pod \"service-ca-55f6fc7b86-29b9s\" (UID: \"da0346e5-f032-49a0-bbed-fe5dab41890f\") " pod="openshift-service-ca/service-ca-55f6fc7b86-29b9s"
Sep 18 22:01:19.757982 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:19.757968    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/da0346e5-f032-49a0-bbed-fe5dab41890f-signing-cabundle\") pod \"service-ca-55f6fc7b86-29b9s\" (UID: \"da0346e5-f032-49a0-bbed-fe5dab41890f\") " pod="openshift-service-ca/service-ca-55f6fc7b86-29b9s"
Sep 18 22:01:19.758183 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:19.758003    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d89bc690-49bd-4c8e-8f91-9dcefe8f7cf2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ldnhp\" (UID: \"d89bc690-49bd-4c8e-8f91-9dcefe8f7cf2\") " pod="openshift-insights/insights-runtime-extractor-ldnhp"
Sep 18 22:01:19.758183 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:19.758007    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d89bc690-49bd-4c8e-8f91-9dcefe8f7cf2-crio-socket\") pod \"insights-runtime-extractor-ldnhp\" (UID: \"d89bc690-49bd-4c8e-8f91-9dcefe8f7cf2\") " pod="openshift-insights/insights-runtime-extractor-ldnhp"
Sep 18 22:01:19.758183 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:19.758071    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d89bc690-49bd-4c8e-8f91-9dcefe8f7cf2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ldnhp\" (UID: \"d89bc690-49bd-4c8e-8f91-9dcefe8f7cf2\") " pod="openshift-insights/insights-runtime-extractor-ldnhp"
Sep 18 22:01:19.758183 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:01:19.758085    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 18 22:01:19.758183 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:19.758136    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d89bc690-49bd-4c8e-8f91-9dcefe8f7cf2-data-volume\") pod \"insights-runtime-extractor-ldnhp\" (UID: \"d89bc690-49bd-4c8e-8f91-9dcefe8f7cf2\") " pod="openshift-insights/insights-runtime-extractor-ldnhp"
Sep 18 22:01:19.758183 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:01:19.758144    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d89bc690-49bd-4c8e-8f91-9dcefe8f7cf2-kube-rbac-proxy-cm podName:d89bc690-49bd-4c8e-8f91-9dcefe8f7cf2 nodeName:}" failed. No retries permitted until 2026-09-18 22:01:20.258128168 +0000 UTC m=+59.577800222 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d89bc690-49bd-4c8e-8f91-9dcefe8f7cf2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ldnhp" (UID: "d89bc690-49bd-4c8e-8f91-9dcefe8f7cf2") : configmap "kube-rbac-proxy" not found
Sep 18 22:01:19.758183 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:01:19.758173    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 18 22:01:19.758401 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:01:19.758210    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d89bc690-49bd-4c8e-8f91-9dcefe8f7cf2-insights-runtime-extractor-tls podName:d89bc690-49bd-4c8e-8f91-9dcefe8f7cf2 nodeName:}" failed. No retries permitted until 2026-09-18 22:01:20.258198656 +0000 UTC m=+59.577870693 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d89bc690-49bd-4c8e-8f91-9dcefe8f7cf2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ldnhp" (UID: "d89bc690-49bd-4c8e-8f91-9dcefe8f7cf2") : secret "insights-runtime-extractor-tls" not found
Sep 18 22:01:19.768198 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:19.768182    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcqns\" (UniqueName: \"kubernetes.io/projected/d89bc690-49bd-4c8e-8f91-9dcefe8f7cf2-kube-api-access-rcqns\") pod \"insights-runtime-extractor-ldnhp\" (UID: \"d89bc690-49bd-4c8e-8f91-9dcefe8f7cf2\") " pod="openshift-insights/insights-runtime-extractor-ldnhp"
Sep 18 22:01:19.858600 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:19.858567    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6s5fb\" (UniqueName: \"kubernetes.io/projected/da0346e5-f032-49a0-bbed-fe5dab41890f-kube-api-access-6s5fb\") pod \"service-ca-55f6fc7b86-29b9s\" (UID: \"da0346e5-f032-49a0-bbed-fe5dab41890f\") " pod="openshift-service-ca/service-ca-55f6fc7b86-29b9s"
Sep 18 22:01:19.858721 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:19.858611    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/da0346e5-f032-49a0-bbed-fe5dab41890f-signing-key\") pod \"service-ca-55f6fc7b86-29b9s\" (UID: \"da0346e5-f032-49a0-bbed-fe5dab41890f\") " pod="openshift-service-ca/service-ca-55f6fc7b86-29b9s"
Sep 18 22:01:19.858721 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:19.858634    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/da0346e5-f032-49a0-bbed-fe5dab41890f-signing-cabundle\") pod \"service-ca-55f6fc7b86-29b9s\" (UID: \"da0346e5-f032-49a0-bbed-fe5dab41890f\") " pod="openshift-service-ca/service-ca-55f6fc7b86-29b9s"
Sep 18 22:01:19.859340 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:19.859315    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/da0346e5-f032-49a0-bbed-fe5dab41890f-signing-cabundle\") pod \"service-ca-55f6fc7b86-29b9s\" (UID: \"da0346e5-f032-49a0-bbed-fe5dab41890f\") " pod="openshift-service-ca/service-ca-55f6fc7b86-29b9s"
Sep 18 22:01:19.861109 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:19.861093    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/da0346e5-f032-49a0-bbed-fe5dab41890f-signing-key\") pod \"service-ca-55f6fc7b86-29b9s\" (UID: \"da0346e5-f032-49a0-bbed-fe5dab41890f\") " pod="openshift-service-ca/service-ca-55f6fc7b86-29b9s"
Sep 18 22:01:19.866761 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:19.866737    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6s5fb\" (UniqueName: \"kubernetes.io/projected/da0346e5-f032-49a0-bbed-fe5dab41890f-kube-api-access-6s5fb\") pod \"service-ca-55f6fc7b86-29b9s\" (UID: \"da0346e5-f032-49a0-bbed-fe5dab41890f\") " pod="openshift-service-ca/service-ca-55f6fc7b86-29b9s"
Sep 18 22:01:19.959014 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:19.958983    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-55f6fc7b86-29b9s"
Sep 18 22:01:20.227243 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:20.227208    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-55f6fc7b86-29b9s"]
Sep 18 22:01:20.230823 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:01:20.230799    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda0346e5_f032_49a0_bbed_fe5dab41890f.slice/crio-872d61edc42b515aa7afb9a3e7119157be90b9c01d2fec6880e3365383cc7468 WatchSource:0}: Error finding container 872d61edc42b515aa7afb9a3e7119157be90b9c01d2fec6880e3365383cc7468: Status 404 returned error can't find the container with id 872d61edc42b515aa7afb9a3e7119157be90b9c01d2fec6880e3365383cc7468
Sep 18 22:01:20.261299 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:20.261276    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d89bc690-49bd-4c8e-8f91-9dcefe8f7cf2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ldnhp\" (UID: \"d89bc690-49bd-4c8e-8f91-9dcefe8f7cf2\") " pod="openshift-insights/insights-runtime-extractor-ldnhp"
Sep 18 22:01:20.261387 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:20.261318    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d89bc690-49bd-4c8e-8f91-9dcefe8f7cf2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ldnhp\" (UID: \"d89bc690-49bd-4c8e-8f91-9dcefe8f7cf2\") " pod="openshift-insights/insights-runtime-extractor-ldnhp"
Sep 18 22:01:20.261469 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:01:20.261395    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 18 22:01:20.261469 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:01:20.261439    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 18 22:01:20.261538 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:01:20.261479    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d89bc690-49bd-4c8e-8f91-9dcefe8f7cf2-kube-rbac-proxy-cm podName:d89bc690-49bd-4c8e-8f91-9dcefe8f7cf2 nodeName:}" failed. No retries permitted until 2026-09-18 22:01:21.261461871 +0000 UTC m=+60.581133904 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d89bc690-49bd-4c8e-8f91-9dcefe8f7cf2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ldnhp" (UID: "d89bc690-49bd-4c8e-8f91-9dcefe8f7cf2") : configmap "kube-rbac-proxy" not found
Sep 18 22:01:20.261538 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:01:20.261493    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d89bc690-49bd-4c8e-8f91-9dcefe8f7cf2-insights-runtime-extractor-tls podName:d89bc690-49bd-4c8e-8f91-9dcefe8f7cf2 nodeName:}" failed. No retries permitted until 2026-09-18 22:01:21.261487218 +0000 UTC m=+60.581159251 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d89bc690-49bd-4c8e-8f91-9dcefe8f7cf2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ldnhp" (UID: "d89bc690-49bd-4c8e-8f91-9dcefe8f7cf2") : secret "insights-runtime-extractor-tls" not found
Sep 18 22:01:20.484655 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:20.484569    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-55f6fc7b86-29b9s" event={"ID":"da0346e5-f032-49a0-bbed-fe5dab41890f","Type":"ContainerStarted","Data":"872d61edc42b515aa7afb9a3e7119157be90b9c01d2fec6880e3365383cc7468"}
Sep 18 22:01:20.966030 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:20.965989    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf-registry-tls\") pod \"image-registry-676ff698c8-qpzc8\" (UID: \"ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf\") " pod="openshift-image-registry/image-registry-676ff698c8-qpzc8"
Sep 18 22:01:20.966196 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:01:20.966171    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 18 22:01:20.966196 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:01:20.966192    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-676ff698c8-qpzc8: secret "image-registry-tls" not found
Sep 18 22:01:20.966266 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:01:20.966254    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf-registry-tls podName:ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf nodeName:}" failed. No retries permitted until 2026-09-18 22:01:28.966235314 +0000 UTC m=+68.285907364 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf-registry-tls") pod "image-registry-676ff698c8-qpzc8" (UID: "ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf") : secret "image-registry-tls" not found
Sep 18 22:01:21.268074 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:21.267981    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d89bc690-49bd-4c8e-8f91-9dcefe8f7cf2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ldnhp\" (UID: \"d89bc690-49bd-4c8e-8f91-9dcefe8f7cf2\") " pod="openshift-insights/insights-runtime-extractor-ldnhp"
Sep 18 22:01:21.268074 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:21.268031    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d89bc690-49bd-4c8e-8f91-9dcefe8f7cf2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ldnhp\" (UID: \"d89bc690-49bd-4c8e-8f91-9dcefe8f7cf2\") " pod="openshift-insights/insights-runtime-extractor-ldnhp"
Sep 18 22:01:21.268297 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:01:21.268125    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 18 22:01:21.268297 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:01:21.268131    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 18 22:01:21.268297 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:01:21.268207    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d89bc690-49bd-4c8e-8f91-9dcefe8f7cf2-kube-rbac-proxy-cm podName:d89bc690-49bd-4c8e-8f91-9dcefe8f7cf2 nodeName:}" failed. No retries permitted until 2026-09-18 22:01:23.268186159 +0000 UTC m=+62.587858209 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d89bc690-49bd-4c8e-8f91-9dcefe8f7cf2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ldnhp" (UID: "d89bc690-49bd-4c8e-8f91-9dcefe8f7cf2") : configmap "kube-rbac-proxy" not found
Sep 18 22:01:21.268297 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:01:21.268227    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d89bc690-49bd-4c8e-8f91-9dcefe8f7cf2-insights-runtime-extractor-tls podName:d89bc690-49bd-4c8e-8f91-9dcefe8f7cf2 nodeName:}" failed. No retries permitted until 2026-09-18 22:01:23.268218548 +0000 UTC m=+62.587890587 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d89bc690-49bd-4c8e-8f91-9dcefe8f7cf2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ldnhp" (UID: "d89bc690-49bd-4c8e-8f91-9dcefe8f7cf2") : secret "insights-runtime-extractor-tls" not found
Sep 18 22:01:22.046705 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:22.046681    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qnflp_d322c364-182a-4826-af75-bc5dcab8bf38/dns-node-resolver/0.log"
Sep 18 22:01:22.491355 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:22.491321    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-55f6fc7b86-29b9s" event={"ID":"da0346e5-f032-49a0-bbed-fe5dab41890f","Type":"ContainerStarted","Data":"d7b42228d85fc98e965230b9b468797f57d5913ac43874af5789c62a407d82d9"}
Sep 18 22:01:22.512895 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:22.512851    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-55f6fc7b86-29b9s" podStartSLOduration=1.7574263220000002 podStartE2EDuration="3.512837151s" totalImagesPullingTime="1.755410829s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:01:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:01:22.511195301 +0000 UTC m=+61.830867354" watchObservedRunningTime="2026-09-18 22:01:22.512837151 +0000 UTC m=+61.832509206"
Sep 18 22:01:23.287702 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:23.287663    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d89bc690-49bd-4c8e-8f91-9dcefe8f7cf2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ldnhp\" (UID: \"d89bc690-49bd-4c8e-8f91-9dcefe8f7cf2\") " pod="openshift-insights/insights-runtime-extractor-ldnhp"
Sep 18 22:01:23.288116 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:23.287722    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d89bc690-49bd-4c8e-8f91-9dcefe8f7cf2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ldnhp\" (UID: \"d89bc690-49bd-4c8e-8f91-9dcefe8f7cf2\") " pod="openshift-insights/insights-runtime-extractor-ldnhp"
Sep 18 22:01:23.288116 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:01:23.287787    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 18 22:01:23.288116 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:01:23.287834    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 18 22:01:23.288116 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:01:23.287852    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d89bc690-49bd-4c8e-8f91-9dcefe8f7cf2-kube-rbac-proxy-cm podName:d89bc690-49bd-4c8e-8f91-9dcefe8f7cf2 nodeName:}" failed. No retries permitted until 2026-09-18 22:01:27.287836721 +0000 UTC m=+66.607508754 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d89bc690-49bd-4c8e-8f91-9dcefe8f7cf2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ldnhp" (UID: "d89bc690-49bd-4c8e-8f91-9dcefe8f7cf2") : configmap "kube-rbac-proxy" not found
Sep 18 22:01:23.288116 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:01:23.287880    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d89bc690-49bd-4c8e-8f91-9dcefe8f7cf2-insights-runtime-extractor-tls podName:d89bc690-49bd-4c8e-8f91-9dcefe8f7cf2 nodeName:}" failed. No retries permitted until 2026-09-18 22:01:27.287868033 +0000 UTC m=+66.607540070 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d89bc690-49bd-4c8e-8f91-9dcefe8f7cf2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ldnhp" (UID: "d89bc690-49bd-4c8e-8f91-9dcefe8f7cf2") : secret "insights-runtime-extractor-tls" not found
Sep 18 22:01:23.403001 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:23.402977    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8tbzr"
Sep 18 22:01:23.448186 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:23.448160    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-w5xfs_9aea2f1a-d418-4d91-b512-3839fa148822/node-ca/0.log"
Sep 18 22:01:23.620036 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:23.620003    2577 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-fd4bb46c-h2847"
Sep 18 22:01:23.620216 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:23.620055    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-fd4bb46c-h2847"
Sep 18 22:01:23.620383 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:23.620371    2577 scope.go:117] "RemoveContainer" containerID="6e0e18c13f867ca8c103ba299a037e9466399c0280f9c0e249e7d7f9697d1287"
Sep 18 22:01:23.620546 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:01:23.620527    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-fd4bb46c-h2847_openshift-console-operator(125d5bb0-54b7-4dff-aa80-e737f2791533)\"" pod="openshift-console-operator/console-operator-fd4bb46c-h2847" podUID="125d5bb0-54b7-4dff-aa80-e737f2791533"
Sep 18 22:01:23.846561 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:23.846523    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7vzrh_099e9fb3-fc81-4c88-abd5-ff4cb99cf78b/serve-healthcheck-canary/0.log"
Sep 18 22:01:24.847446 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:24.847380    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55889f7b47-d7zbx_be6728b1-ba42-42b6-8eb7-8c0399e18907/kube-storage-version-migrator-operator/0.log"
Sep 18 22:01:26.920792 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:26.920757    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/57c8eb94-06ca-4a20-a2d1-acc62a27e816-original-pull-secret\") pod \"global-pull-secret-syncer-gb9sf\" (UID: \"57c8eb94-06ca-4a20-a2d1-acc62a27e816\") " pod="kube-system/global-pull-secret-syncer-gb9sf"
Sep 18 22:01:26.921265 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:26.920819    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c715783a-a4e5-4cba-b189-cf2ff6eb8950-metrics-certs\") pod \"network-metrics-daemon-4vmhg\" (UID: \"c715783a-a4e5-4cba-b189-cf2ff6eb8950\") " pod="openshift-multus/network-metrics-daemon-4vmhg"
Sep 18 22:01:26.923968 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:26.923949    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 18 22:01:26.924030 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:26.923956    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 18 22:01:26.931943 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:01:26.931917    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 18 22:01:26.932013 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:01:26.931982    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c715783a-a4e5-4cba-b189-cf2ff6eb8950-metrics-certs podName:c715783a-a4e5-4cba-b189-cf2ff6eb8950 nodeName:}" failed. No retries permitted until 2026-09-18 22:02:30.931965697 +0000 UTC m=+130.251637732 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c715783a-a4e5-4cba-b189-cf2ff6eb8950-metrics-certs") pod "network-metrics-daemon-4vmhg" (UID: "c715783a-a4e5-4cba-b189-cf2ff6eb8950") : secret "metrics-daemon-secret" not found
Sep 18 22:01:26.934167 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:26.934147    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/57c8eb94-06ca-4a20-a2d1-acc62a27e816-original-pull-secret\") pod \"global-pull-secret-syncer-gb9sf\" (UID: \"57c8eb94-06ca-4a20-a2d1-acc62a27e816\") " pod="kube-system/global-pull-secret-syncer-gb9sf"
Sep 18 22:01:27.021347 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:27.021312    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbbr5\" (UniqueName: \"kubernetes.io/projected/d2df6952-5b90-4dda-829f-62049ca10ae8-kube-api-access-bbbr5\") pod \"network-check-target-z7srk\" (UID: \"d2df6952-5b90-4dda-829f-62049ca10ae8\") " pod="openshift-network-diagnostics/network-check-target-z7srk"
Sep 18 22:01:27.023849 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:27.023821    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 18 22:01:27.033817 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:27.033801    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 18 22:01:27.045027 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:27.045004    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbbr5\" (UniqueName: \"kubernetes.io/projected/d2df6952-5b90-4dda-829f-62049ca10ae8-kube-api-access-bbbr5\") pod \"network-check-target-z7srk\" (UID: \"d2df6952-5b90-4dda-829f-62049ca10ae8\") " pod="openshift-network-diagnostics/network-check-target-z7srk"
Sep 18 22:01:27.145842 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:27.145820    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gb9sf"
Sep 18 22:01:27.165309 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:27.165288    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8l8bl\""
Sep 18 22:01:27.168316 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:27.168295    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z7srk"
Sep 18 22:01:27.323961 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:27.323932    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d89bc690-49bd-4c8e-8f91-9dcefe8f7cf2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ldnhp\" (UID: \"d89bc690-49bd-4c8e-8f91-9dcefe8f7cf2\") " pod="openshift-insights/insights-runtime-extractor-ldnhp"
Sep 18 22:01:27.324119 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:27.324003    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d89bc690-49bd-4c8e-8f91-9dcefe8f7cf2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ldnhp\" (UID: \"d89bc690-49bd-4c8e-8f91-9dcefe8f7cf2\") " pod="openshift-insights/insights-runtime-extractor-ldnhp"
Sep 18 22:01:27.324119 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:01:27.324072    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 18 22:01:27.324119 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:01:27.324106    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 18 22:01:27.324224 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:01:27.324123    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d89bc690-49bd-4c8e-8f91-9dcefe8f7cf2-kube-rbac-proxy-cm podName:d89bc690-49bd-4c8e-8f91-9dcefe8f7cf2 nodeName:}" failed. No retries permitted until 2026-09-18 22:01:35.324109606 +0000 UTC m=+74.643781639 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d89bc690-49bd-4c8e-8f91-9dcefe8f7cf2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ldnhp" (UID: "d89bc690-49bd-4c8e-8f91-9dcefe8f7cf2") : configmap "kube-rbac-proxy" not found
Sep 18 22:01:27.324224 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:01:27.324161    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d89bc690-49bd-4c8e-8f91-9dcefe8f7cf2-insights-runtime-extractor-tls podName:d89bc690-49bd-4c8e-8f91-9dcefe8f7cf2 nodeName:}" failed. No retries permitted until 2026-09-18 22:01:35.324148956 +0000 UTC m=+74.643821017 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d89bc690-49bd-4c8e-8f91-9dcefe8f7cf2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ldnhp" (UID: "d89bc690-49bd-4c8e-8f91-9dcefe8f7cf2") : secret "insights-runtime-extractor-tls" not found
Sep 18 22:01:27.433024 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:27.432955    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-gb9sf"]
Sep 18 22:01:27.435930 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:01:27.435905    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57c8eb94_06ca_4a20_a2d1_acc62a27e816.slice/crio-85c2419d1f67bc41c90136f8d7a8098fdbd37bebff8fbca09305a742d6c49bbb WatchSource:0}: Error finding container 85c2419d1f67bc41c90136f8d7a8098fdbd37bebff8fbca09305a742d6c49bbb: Status 404 returned error can't find the container with id 85c2419d1f67bc41c90136f8d7a8098fdbd37bebff8fbca09305a742d6c49bbb
Sep 18 22:01:27.458036 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:27.458013    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-z7srk"]
Sep 18 22:01:27.460815 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:01:27.460791    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2df6952_5b90_4dda_829f_62049ca10ae8.slice/crio-7ef4ae9896fa41f5eb50c0d4b415453ffb6104ae2861c8038e04c18ced19bcd2 WatchSource:0}: Error finding container 7ef4ae9896fa41f5eb50c0d4b415453ffb6104ae2861c8038e04c18ced19bcd2: Status 404 returned error can't find the container with id 7ef4ae9896fa41f5eb50c0d4b415453ffb6104ae2861c8038e04c18ced19bcd2
Sep 18 22:01:27.505671 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:27.505642    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-z7srk" event={"ID":"d2df6952-5b90-4dda-829f-62049ca10ae8","Type":"ContainerStarted","Data":"7ef4ae9896fa41f5eb50c0d4b415453ffb6104ae2861c8038e04c18ced19bcd2"}
Sep 18 22:01:27.506794 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:27.506770    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-gb9sf" event={"ID":"57c8eb94-06ca-4a20-a2d1-acc62a27e816","Type":"ContainerStarted","Data":"85c2419d1f67bc41c90136f8d7a8098fdbd37bebff8fbca09305a742d6c49bbb"}
Sep 18 22:01:27.928483 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:27.928448    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c8d12c54-c055-450f-b119-48b4667b3537-metrics-tls\") pod \"dns-default-w9b7s\" (UID: \"c8d12c54-c055-450f-b119-48b4667b3537\") " pod="openshift-dns/dns-default-w9b7s"
Sep 18 22:01:27.930950 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:27.930928    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c8d12c54-c055-450f-b119-48b4667b3537-metrics-tls\") pod \"dns-default-w9b7s\" (UID: \"c8d12c54-c055-450f-b119-48b4667b3537\") " pod="openshift-dns/dns-default-w9b7s"
Sep 18 22:01:28.139099 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:28.139064    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-kdhvj\""
Sep 18 22:01:28.147009 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:28.146984    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-w9b7s"
Sep 18 22:01:28.437385 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:01:28.437354    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8d12c54_c055_450f_b119_48b4667b3537.slice/crio-312778c3047b50bd88e35d6678e25ba78c144636ef60b50c8e4595795a5f9f49 WatchSource:0}: Error finding container 312778c3047b50bd88e35d6678e25ba78c144636ef60b50c8e4595795a5f9f49: Status 404 returned error can't find the container with id 312778c3047b50bd88e35d6678e25ba78c144636ef60b50c8e4595795a5f9f49
Sep 18 22:01:28.437740 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:28.437696    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-w9b7s"]
Sep 18 22:01:28.512376 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:28.512307    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-w9b7s" event={"ID":"c8d12c54-c055-450f-b119-48b4667b3537","Type":"ContainerStarted","Data":"312778c3047b50bd88e35d6678e25ba78c144636ef60b50c8e4595795a5f9f49"}
Sep 18 22:01:29.055365 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:29.041323    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf-registry-tls\") pod \"image-registry-676ff698c8-qpzc8\" (UID: \"ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf\") " pod="openshift-image-registry/image-registry-676ff698c8-qpzc8"
Sep 18 22:01:29.055365 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:29.048918    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf-registry-tls\") pod \"image-registry-676ff698c8-qpzc8\" (UID: \"ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf\") " pod="openshift-image-registry/image-registry-676ff698c8-qpzc8"
Sep 18 22:01:29.091867 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:29.091838    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-m9bdj\""
Sep 18 22:01:29.099650 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:29.099625    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-676ff698c8-qpzc8"
Sep 18 22:01:29.399887 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:29.399694    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-676ff698c8-qpzc8"]
Sep 18 22:01:29.404381 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:01:29.404354    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff7e13a9_23dc_4c8a_9dbd_4cd8710fd7cf.slice/crio-237e7772adc922a1ec7ef32988379780240368a82df7aacdcee35a395b1a65d4 WatchSource:0}: Error finding container 237e7772adc922a1ec7ef32988379780240368a82df7aacdcee35a395b1a65d4: Status 404 returned error can't find the container with id 237e7772adc922a1ec7ef32988379780240368a82df7aacdcee35a395b1a65d4
Sep 18 22:01:29.520117 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:29.520083    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-676ff698c8-qpzc8" event={"ID":"ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf","Type":"ContainerStarted","Data":"32782d9512908833ba6a44d02799d2c730c024fcabdc0c7a01583a0822d0fe37"}
Sep 18 22:01:29.520254 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:29.520145    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-676ff698c8-qpzc8" event={"ID":"ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf","Type":"ContainerStarted","Data":"237e7772adc922a1ec7ef32988379780240368a82df7aacdcee35a395b1a65d4"}
Sep 18 22:01:29.520779 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:29.520759    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-676ff698c8-qpzc8"
Sep 18 22:01:29.542207 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:29.542156    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-676ff698c8-qpzc8" podStartSLOduration=16.54213602 podStartE2EDuration="16.54213602s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:01:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:01:29.540473454 +0000 UTC m=+68.860145509" watchObservedRunningTime="2026-09-18 22:01:29.54213602 +0000 UTC m=+68.861808077"
Sep 18 22:01:33.537157 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:33.537054    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-w9b7s" event={"ID":"c8d12c54-c055-450f-b119-48b4667b3537","Type":"ContainerStarted","Data":"252b85cfe0a332b4232c32d91f6bad4a5cc21151e8fd0e222cad6a698a02a1c6"}
Sep 18 22:01:33.537157 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:33.537130    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-w9b7s" event={"ID":"c8d12c54-c055-450f-b119-48b4667b3537","Type":"ContainerStarted","Data":"42716dc09f9580a96a07ae3752495f9c416bb595ae01c003d49d70eda0442ebb"}
Sep 18 22:01:33.537657 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:33.537161    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-w9b7s"
Sep 18 22:01:33.538549 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:33.538521    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-z7srk" event={"ID":"d2df6952-5b90-4dda-829f-62049ca10ae8","Type":"ContainerStarted","Data":"1f5a96db401a4858f49aaaba57740b5cbd5b263cc9e38c976ea8150b4626446c"}
Sep 18 22:01:33.538670 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:33.538574    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-z7srk"
Sep 18 22:01:33.539900 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:33.539869    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-gb9sf" event={"ID":"57c8eb94-06ca-4a20-a2d1-acc62a27e816","Type":"ContainerStarted","Data":"bcb22f007291172bc3343f40bd62d38a7be51cbb96dbf3f5f864e58427de4929"}
Sep 18 22:01:33.554328 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:33.554287    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-w9b7s" podStartSLOduration=33.832901213 podStartE2EDuration="38.554274632s" totalImagesPullingTime="4.721373419s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:00:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:01:33.554056697 +0000 UTC m=+72.873728751" watchObservedRunningTime="2026-09-18 22:01:33.554274632 +0000 UTC m=+72.873946681"
Sep 18 22:01:33.570227 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:33.570177    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-z7srk" podStartSLOduration=65.87556055 podStartE2EDuration="1m11.570163879s" totalImagesPullingTime="5.694603329s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:00:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:01:33.568652237 +0000 UTC m=+72.888324291" watchObservedRunningTime="2026-09-18 22:01:33.570163879 +0000 UTC m=+72.889835935"
Sep 18 22:01:33.585541 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:33.585504    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-gb9sf" podStartSLOduration=65.855075012 podStartE2EDuration="1m11.585493474s" totalImagesPullingTime="5.730418462s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 22:00:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:01:33.584822272 +0000 UTC m=+72.904494320" watchObservedRunningTime="2026-09-18 22:01:33.585493474 +0000 UTC m=+72.905165529"
Sep 18 22:01:34.133702 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:34.133676    2577 scope.go:117] "RemoveContainer" containerID="6e0e18c13f867ca8c103ba299a037e9466399c0280f9c0e249e7d7f9697d1287"
Sep 18 22:01:34.545829 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:34.545753    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-h2847_125d5bb0-54b7-4dff-aa80-e737f2791533/console-operator/1.log"
Sep 18 22:01:34.546227 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:34.545909    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-h2847" event={"ID":"125d5bb0-54b7-4dff-aa80-e737f2791533","Type":"ContainerStarted","Data":"ddb5cea97f0598ac1ebae61417a4c22f6d5388c02507548296a1e9a61df9e6f1"}
Sep 18 22:01:34.571918 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:34.571866    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-fd4bb46c-h2847" podStartSLOduration=18.602489097 podStartE2EDuration="21.571850826s" totalImagesPullingTime="2.969361729s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:01:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:01:34.571687555 +0000 UTC m=+73.891359611" watchObservedRunningTime="2026-09-18 22:01:34.571850826 +0000 UTC m=+73.891522881"
Sep 18 22:01:35.396121 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:35.396075    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d89bc690-49bd-4c8e-8f91-9dcefe8f7cf2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ldnhp\" (UID: \"d89bc690-49bd-4c8e-8f91-9dcefe8f7cf2\") " pod="openshift-insights/insights-runtime-extractor-ldnhp"
Sep 18 22:01:35.396121 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:35.396133    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d89bc690-49bd-4c8e-8f91-9dcefe8f7cf2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ldnhp\" (UID: \"d89bc690-49bd-4c8e-8f91-9dcefe8f7cf2\") " pod="openshift-insights/insights-runtime-extractor-ldnhp"
Sep 18 22:01:35.396673 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:35.396653    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d89bc690-49bd-4c8e-8f91-9dcefe8f7cf2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ldnhp\" (UID: \"d89bc690-49bd-4c8e-8f91-9dcefe8f7cf2\") " pod="openshift-insights/insights-runtime-extractor-ldnhp"
Sep 18 22:01:35.398560 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:35.398543    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d89bc690-49bd-4c8e-8f91-9dcefe8f7cf2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ldnhp\" (UID: \"d89bc690-49bd-4c8e-8f91-9dcefe8f7cf2\") " pod="openshift-insights/insights-runtime-extractor-ldnhp"
Sep 18 22:01:35.416713 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:35.416689    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-wk4th\""
Sep 18 22:01:35.425105 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:35.425085    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ldnhp"
Sep 18 22:01:35.705270 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:35.705205    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ldnhp"]
Sep 18 22:01:35.708265 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:01:35.708239    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd89bc690_49bd_4c8e_8f91_9dcefe8f7cf2.slice/crio-2e349f09ab7ba8d592183b3ad8288b27cb98a343ab4cd68b2884ca3f34e1fd63 WatchSource:0}: Error finding container 2e349f09ab7ba8d592183b3ad8288b27cb98a343ab4cd68b2884ca3f34e1fd63: Status 404 returned error can't find the container with id 2e349f09ab7ba8d592183b3ad8288b27cb98a343ab4cd68b2884ca3f34e1fd63
Sep 18 22:01:36.554377 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:36.554347    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ldnhp" event={"ID":"d89bc690-49bd-4c8e-8f91-9dcefe8f7cf2","Type":"ContainerStarted","Data":"efdc2f0287b0822bd99a1fd57ddf0107db4c44ffec60915881daa94fdfc82916"}
Sep 18 22:01:36.554507 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:36.554403    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ldnhp" event={"ID":"d89bc690-49bd-4c8e-8f91-9dcefe8f7cf2","Type":"ContainerStarted","Data":"5e201b1a92abf8600de61ba8322526fbbac5f0708749cb93c05abb578b556baf"}
Sep 18 22:01:36.554507 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:36.554442    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ldnhp" event={"ID":"d89bc690-49bd-4c8e-8f91-9dcefe8f7cf2","Type":"ContainerStarted","Data":"2e349f09ab7ba8d592183b3ad8288b27cb98a343ab4cd68b2884ca3f34e1fd63"}
Sep 18 22:01:38.562650 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:38.562616    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ldnhp" event={"ID":"d89bc690-49bd-4c8e-8f91-9dcefe8f7cf2","Type":"ContainerStarted","Data":"d48b00fab1a5fc1bc09409779af1b7c5faf9d2f84331381937938cda69458075"}
Sep 18 22:01:38.583896 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:38.583848    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-ldnhp" podStartSLOduration=17.412301324 podStartE2EDuration="19.583822929s" totalImagesPullingTime="2.171521605s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 22:01:19 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:01:38.582337242 +0000 UTC m=+77.902009297" watchObservedRunningTime="2026-09-18 22:01:38.583822929 +0000 UTC m=+77.903494981"
Sep 18 22:01:43.548335 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:43.548207    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-w9b7s"
Sep 18 22:01:44.195789 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:44.195750    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5489dfbb8b-6jrjj"]
Sep 18 22:01:44.200017 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:44.200001    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5489dfbb8b-6jrjj"
Sep 18 22:01:44.217044 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:44.217017    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Sep 18 22:01:44.217870 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:44.217852    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Sep 18 22:01:44.217982 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:44.217894    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 18 22:01:44.217982 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:44.217964    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 18 22:01:44.218097 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:44.217979    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Sep 18 22:01:44.218097 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:44.218000    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Sep 18 22:01:44.218097 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:44.218031    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 18 22:01:44.243663 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:44.243634    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-676ff698c8-qpzc8"]
Sep 18 22:01:44.248070 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:44.248048    2577 patch_prober.go:28] interesting pod/image-registry-676ff698c8-qpzc8 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 18 22:01:44.248180 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:44.248095    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-676ff698c8-qpzc8" podUID="ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 22:01:44.258794 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:44.258766    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/4fb17d25-59ac-44e9-89a8-9005286da90a-ca\") pod \"cluster-proxy-proxy-agent-5489dfbb8b-6jrjj\" (UID: \"4fb17d25-59ac-44e9-89a8-9005286da90a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5489dfbb8b-6jrjj"
Sep 18 22:01:44.258901 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:44.258798    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4fb17d25-59ac-44e9-89a8-9005286da90a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5489dfbb8b-6jrjj\" (UID: \"4fb17d25-59ac-44e9-89a8-9005286da90a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5489dfbb8b-6jrjj"
Sep 18 22:01:44.258901 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:44.258821    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/4fb17d25-59ac-44e9-89a8-9005286da90a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5489dfbb8b-6jrjj\" (UID: \"4fb17d25-59ac-44e9-89a8-9005286da90a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5489dfbb8b-6jrjj"
Sep 18 22:01:44.258901 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:44.258881    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/4fb17d25-59ac-44e9-89a8-9005286da90a-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5489dfbb8b-6jrjj\" (UID: \"4fb17d25-59ac-44e9-89a8-9005286da90a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5489dfbb8b-6jrjj"
Sep 18 22:01:44.259054 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:44.258931    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/4fb17d25-59ac-44e9-89a8-9005286da90a-hub\") pod \"cluster-proxy-proxy-agent-5489dfbb8b-6jrjj\" (UID: \"4fb17d25-59ac-44e9-89a8-9005286da90a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5489dfbb8b-6jrjj"
Sep 18 22:01:44.259054 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:44.258967    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vz25h\" (UniqueName: \"kubernetes.io/projected/4fb17d25-59ac-44e9-89a8-9005286da90a-kube-api-access-vz25h\") pod \"cluster-proxy-proxy-agent-5489dfbb8b-6jrjj\" (UID: \"4fb17d25-59ac-44e9-89a8-9005286da90a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5489dfbb8b-6jrjj"
Sep 18 22:01:44.259132 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:44.259102    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5489dfbb8b-6jrjj"]
Sep 18 22:01:44.359977 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:44.359953    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/4fb17d25-59ac-44e9-89a8-9005286da90a-ca\") pod \"cluster-proxy-proxy-agent-5489dfbb8b-6jrjj\" (UID: \"4fb17d25-59ac-44e9-89a8-9005286da90a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5489dfbb8b-6jrjj"
Sep 18 22:01:44.359977 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:44.359980    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4fb17d25-59ac-44e9-89a8-9005286da90a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5489dfbb8b-6jrjj\" (UID: \"4fb17d25-59ac-44e9-89a8-9005286da90a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5489dfbb8b-6jrjj"
Sep 18 22:01:44.360203 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:44.359999    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/4fb17d25-59ac-44e9-89a8-9005286da90a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5489dfbb8b-6jrjj\" (UID: \"4fb17d25-59ac-44e9-89a8-9005286da90a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5489dfbb8b-6jrjj"
Sep 18 22:01:44.360203 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:44.360039    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/4fb17d25-59ac-44e9-89a8-9005286da90a-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5489dfbb8b-6jrjj\" (UID: \"4fb17d25-59ac-44e9-89a8-9005286da90a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5489dfbb8b-6jrjj"
Sep 18 22:01:44.360203 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:44.360076    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/4fb17d25-59ac-44e9-89a8-9005286da90a-hub\") pod \"cluster-proxy-proxy-agent-5489dfbb8b-6jrjj\" (UID: \"4fb17d25-59ac-44e9-89a8-9005286da90a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5489dfbb8b-6jrjj"
Sep 18 22:01:44.360203 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:44.360107    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vz25h\" (UniqueName: \"kubernetes.io/projected/4fb17d25-59ac-44e9-89a8-9005286da90a-kube-api-access-vz25h\") pod \"cluster-proxy-proxy-agent-5489dfbb8b-6jrjj\" (UID: \"4fb17d25-59ac-44e9-89a8-9005286da90a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5489dfbb8b-6jrjj"
Sep 18 22:01:44.360881 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:44.360856    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/4fb17d25-59ac-44e9-89a8-9005286da90a-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5489dfbb8b-6jrjj\" (UID: \"4fb17d25-59ac-44e9-89a8-9005286da90a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5489dfbb8b-6jrjj"
Sep 18 22:01:44.362678 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:44.362654    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/4fb17d25-59ac-44e9-89a8-9005286da90a-hub\") pod \"cluster-proxy-proxy-agent-5489dfbb8b-6jrjj\" (UID: \"4fb17d25-59ac-44e9-89a8-9005286da90a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5489dfbb8b-6jrjj"
Sep 18 22:01:44.362802 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:44.362720    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/4fb17d25-59ac-44e9-89a8-9005286da90a-ca\") pod \"cluster-proxy-proxy-agent-5489dfbb8b-6jrjj\" (UID: \"4fb17d25-59ac-44e9-89a8-9005286da90a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5489dfbb8b-6jrjj"
Sep 18 22:01:44.363207 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:44.363187    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/4fb17d25-59ac-44e9-89a8-9005286da90a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5489dfbb8b-6jrjj\" (UID: \"4fb17d25-59ac-44e9-89a8-9005286da90a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5489dfbb8b-6jrjj"
Sep 18 22:01:44.363260 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:44.363247    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4fb17d25-59ac-44e9-89a8-9005286da90a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5489dfbb8b-6jrjj\" (UID: \"4fb17d25-59ac-44e9-89a8-9005286da90a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5489dfbb8b-6jrjj"
Sep 18 22:01:44.397430 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:44.397393    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vz25h\" (UniqueName: \"kubernetes.io/projected/4fb17d25-59ac-44e9-89a8-9005286da90a-kube-api-access-vz25h\") pod \"cluster-proxy-proxy-agent-5489dfbb8b-6jrjj\" (UID: \"4fb17d25-59ac-44e9-89a8-9005286da90a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5489dfbb8b-6jrjj"
Sep 18 22:01:44.530937 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:44.530871    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5489dfbb8b-6jrjj"
Sep 18 22:01:44.546543 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:44.546523    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-fd4bb46c-h2847"
Sep 18 22:01:44.551188 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:44.551165    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-fd4bb46c-h2847"
Sep 18 22:01:44.807339 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:44.807318    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5489dfbb8b-6jrjj"]
Sep 18 22:01:44.810227 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:01:44.810204    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4fb17d25_59ac_44e9_89a8_9005286da90a.slice/crio-2738047f8451a869ec3049b73be733e8652e036665dab55cafeef43ad476b735 WatchSource:0}: Error finding container 2738047f8451a869ec3049b73be733e8652e036665dab55cafeef43ad476b735: Status 404 returned error can't find the container with id 2738047f8451a869ec3049b73be733e8652e036665dab55cafeef43ad476b735
Sep 18 22:01:45.588802 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:45.588767    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5489dfbb8b-6jrjj" event={"ID":"4fb17d25-59ac-44e9-89a8-9005286da90a","Type":"ContainerStarted","Data":"2738047f8451a869ec3049b73be733e8652e036665dab55cafeef43ad476b735"}
Sep 18 22:01:49.605818 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:49.605780    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5489dfbb8b-6jrjj" event={"ID":"4fb17d25-59ac-44e9-89a8-9005286da90a","Type":"ContainerStarted","Data":"553c06aa233c2837ee0a3ad0a1a8de5422d26e0762cbe43e240680228c9f7d54"}
Sep 18 22:01:49.605818 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:49.605827    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5489dfbb8b-6jrjj" event={"ID":"4fb17d25-59ac-44e9-89a8-9005286da90a","Type":"ContainerStarted","Data":"ecf4bed97355cf7f671ec4be1490534db2ff8d4ef964ebc93e54946cc3d1f787"}
Sep 18 22:01:49.606260 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:49.605841    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5489dfbb8b-6jrjj" event={"ID":"4fb17d25-59ac-44e9-89a8-9005286da90a","Type":"ContainerStarted","Data":"fbb5dc901f3985a81be2e0a2bb7970d3c88e053443b979b8e98b0a9550ece93a"}
Sep 18 22:01:49.627732 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:49.627688    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5489dfbb8b-6jrjj" podStartSLOduration=1.86890054 podStartE2EDuration="5.627673511s" totalImagesPullingTime="3.758772971s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:01:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:01:49.626704643 +0000 UTC m=+88.946376698" watchObservedRunningTime="2026-09-18 22:01:49.627673511 +0000 UTC m=+88.947345565"
Sep 18 22:01:54.248731 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:01:54.248696    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-676ff698c8-qpzc8"
Sep 18 22:02:04.548504 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:04.548474    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-z7srk"
Sep 18 22:02:09.263742 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:09.263671    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-676ff698c8-qpzc8" podUID="ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf" containerName="registry" containerID="cri-o://32782d9512908833ba6a44d02799d2c730c024fcabdc0c7a01583a0822d0fe37" gracePeriod=30
Sep 18 22:02:09.495370 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:09.495347    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-676ff698c8-qpzc8"
Sep 18 22:02:09.657391 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:09.657355    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf-trusted-ca\") pod \"ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf\" (UID: \"ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf\") "
Sep 18 22:02:09.657588 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:09.657448    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf-image-registry-private-configuration\") pod \"ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf\" (UID: \"ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf\") "
Sep 18 22:02:09.657588 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:09.657553    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf-ca-trust-extracted\") pod \"ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf\" (UID: \"ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf\") "
Sep 18 22:02:09.657706 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:09.657601    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf-registry-certificates\") pod \"ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf\" (UID: \"ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf\") "
Sep 18 22:02:09.657706 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:09.657646    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf-bound-sa-token\") pod \"ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf\" (UID: \"ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf\") "
Sep 18 22:02:09.657706 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:09.657686    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf-installation-pull-secrets\") pod \"ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf\" (UID: \"ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf\") "
Sep 18 22:02:09.657848 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:09.657712    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fh74r\" (UniqueName: \"kubernetes.io/projected/ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf-kube-api-access-fh74r\") pod \"ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf\" (UID: \"ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf\") "
Sep 18 22:02:09.657848 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:09.657737    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf-registry-tls\") pod \"ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf\" (UID: \"ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf\") "
Sep 18 22:02:09.657848 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:09.657790    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf" (UID: "ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:02:09.657988 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:09.657969    2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf-trusted-ca\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:02:09.659246 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:09.658916    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf" (UID: "ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:02:09.660914 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:09.660865    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf" (UID: "ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 22:02:09.662029 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:09.661984    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf" (UID: "ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:02:09.663219 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:09.663185    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf" (UID: "ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 22:02:09.664819 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:09.664738    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf-kube-api-access-fh74r" (OuterVolumeSpecName: "kube-api-access-fh74r") pod "ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf" (UID: "ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf"). InnerVolumeSpecName "kube-api-access-fh74r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:02:09.668606 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:09.668025    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf" (UID: "ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:02:09.669475 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:09.669148    2577 generic.go:356] "Generic (PLEG): container finished" podID="ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf" containerID="32782d9512908833ba6a44d02799d2c730c024fcabdc0c7a01583a0822d0fe37" exitCode=0
Sep 18 22:02:09.669475 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:09.669223    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-676ff698c8-qpzc8" event={"ID":"ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf","Type":"ContainerDied","Data":"32782d9512908833ba6a44d02799d2c730c024fcabdc0c7a01583a0822d0fe37"}
Sep 18 22:02:09.669475 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:09.669266    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-676ff698c8-qpzc8" event={"ID":"ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf","Type":"ContainerDied","Data":"237e7772adc922a1ec7ef32988379780240368a82df7aacdcee35a395b1a65d4"}
Sep 18 22:02:09.669475 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:09.669291    2577 scope.go:117] "RemoveContainer" containerID="32782d9512908833ba6a44d02799d2c730c024fcabdc0c7a01583a0822d0fe37"
Sep 18 22:02:09.669475 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:09.669292    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-676ff698c8-qpzc8"
Sep 18 22:02:09.669475 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:09.669446    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf" (UID: "ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:02:09.673861 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:09.673842    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-b48bp"]
Sep 18 22:02:09.674209 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:09.674142    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf" containerName="registry"
Sep 18 22:02:09.674209 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:09.674160    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf" containerName="registry"
Sep 18 22:02:09.674332 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:09.674233    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf" containerName="registry"
Sep 18 22:02:09.677301 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:09.677282    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-84c885658c-b48bp"
Sep 18 22:02:09.680015 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:09.679660    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Sep 18 22:02:09.680015 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:09.679890    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Sep 18 22:02:09.680015 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:09.679956    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 18 22:02:09.680495 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:09.680475    2577 scope.go:117] "RemoveContainer" containerID="32782d9512908833ba6a44d02799d2c730c024fcabdc0c7a01583a0822d0fe37"
Sep 18 22:02:09.681005 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:09.680678    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Sep 18 22:02:09.681005 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:02:09.680783    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"32782d9512908833ba6a44d02799d2c730c024fcabdc0c7a01583a0822d0fe37\": container with ID starting with 32782d9512908833ba6a44d02799d2c730c024fcabdc0c7a01583a0822d0fe37 not found: ID does not exist" containerID="32782d9512908833ba6a44d02799d2c730c024fcabdc0c7a01583a0822d0fe37"
Sep 18 22:02:09.681005 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:09.680800    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-lcvdp\""
Sep 18 22:02:09.681005 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:09.680812    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32782d9512908833ba6a44d02799d2c730c024fcabdc0c7a01583a0822d0fe37"} err="failed to get container status \"32782d9512908833ba6a44d02799d2c730c024fcabdc0c7a01583a0822d0fe37\": rpc error: code = NotFound desc = could not find container \"32782d9512908833ba6a44d02799d2c730c024fcabdc0c7a01583a0822d0fe37\": container with ID starting with 32782d9512908833ba6a44d02799d2c730c024fcabdc0c7a01583a0822d0fe37 not found: ID does not exist"
Sep 18 22:02:09.681005 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:09.680888    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 18 22:02:09.681005 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:09.680922    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 18 22:02:09.695989 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:09.695938    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-b48bp"]
Sep 18 22:02:09.710970 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:09.710944    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-xthcf"]
Sep 18 22:02:09.713782 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:09.713766    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-xthcf"
Sep 18 22:02:09.716166 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:09.716139    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-vz5jd\""
Sep 18 22:02:09.716644 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:09.716615    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 18 22:02:09.716750 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:09.716727    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 18 22:02:09.716915 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:09.716892    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 18 22:02:09.758644 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:09.758615    2577 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf-bound-sa-token\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:02:09.758761 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:09.758654    2577 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf-installation-pull-secrets\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:02:09.758761 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:09.758671    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fh74r\" (UniqueName: \"kubernetes.io/projected/ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf-kube-api-access-fh74r\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:02:09.758761 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:09.758687    2577 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf-registry-tls\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:02:09.758761 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:09.758702    2577 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf-image-registry-private-configuration\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:02:09.758761 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:09.758715    2577 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf-ca-trust-extracted\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:02:09.758761 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:09.758729    2577 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf-registry-certificates\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:02:09.859630 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:09.859604    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/9a2a6552-13e7-4318-9777-19dbfabb09f5-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-b48bp\" (UID: \"9a2a6552-13e7-4318-9777-19dbfabb09f5\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-b48bp"
Sep 18 22:02:09.859755 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:09.859644    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e5139388-724b-423b-9dff-2a25de46a9bd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xthcf\" (UID: \"e5139388-724b-423b-9dff-2a25de46a9bd\") " pod="openshift-monitoring/node-exporter-xthcf"
Sep 18 22:02:09.859755 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:09.859671    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9a2a6552-13e7-4318-9777-19dbfabb09f5-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-b48bp\" (UID: \"9a2a6552-13e7-4318-9777-19dbfabb09f5\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-b48bp"
Sep 18 22:02:09.859832 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:09.859775    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cddnn\" (UniqueName: \"kubernetes.io/projected/9a2a6552-13e7-4318-9777-19dbfabb09f5-kube-api-access-cddnn\") pod \"kube-state-metrics-84c885658c-b48bp\" (UID: \"9a2a6552-13e7-4318-9777-19dbfabb09f5\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-b48bp"
Sep 18 22:02:09.859832 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:09.859806    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e5139388-724b-423b-9dff-2a25de46a9bd-node-exporter-tls\") pod \"node-exporter-xthcf\" (UID: \"e5139388-724b-423b-9dff-2a25de46a9bd\") " pod="openshift-monitoring/node-exporter-xthcf"
Sep 18 22:02:09.859832 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:09.859824    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e5139388-724b-423b-9dff-2a25de46a9bd-metrics-client-ca\") pod \"node-exporter-xthcf\" (UID: \"e5139388-724b-423b-9dff-2a25de46a9bd\") " pod="openshift-monitoring/node-exporter-xthcf"
Sep 18 22:02:09.859941 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:09.859843    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9a2a6552-13e7-4318-9777-19dbfabb09f5-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-b48bp\" (UID: \"9a2a6552-13e7-4318-9777-19dbfabb09f5\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-b48bp"
Sep 18 22:02:09.859941 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:09.859886    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e5139388-724b-423b-9dff-2a25de46a9bd-node-exporter-accelerators-collector-config\") pod \"node-exporter-xthcf\" (UID: \"e5139388-724b-423b-9dff-2a25de46a9bd\") " pod="openshift-monitoring/node-exporter-xthcf"
Sep 18 22:02:09.859941 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:09.859905    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/9a2a6552-13e7-4318-9777-19dbfabb09f5-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-b48bp\" (UID: \"9a2a6552-13e7-4318-9777-19dbfabb09f5\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-b48bp"
Sep 18 22:02:09.859941 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:09.859919    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e5139388-724b-423b-9dff-2a25de46a9bd-node-exporter-wtmp\") pod \"node-exporter-xthcf\" (UID: \"e5139388-724b-423b-9dff-2a25de46a9bd\") " pod="openshift-monitoring/node-exporter-xthcf"
Sep 18 22:02:09.860080 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:09.859943    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e5139388-724b-423b-9dff-2a25de46a9bd-node-exporter-textfile\") pod \"node-exporter-xthcf\" (UID: \"e5139388-724b-423b-9dff-2a25de46a9bd\") " pod="openshift-monitoring/node-exporter-xthcf"
Sep 18 22:02:09.860080 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:09.860002    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a2a6552-13e7-4318-9777-19dbfabb09f5-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-b48bp\" (UID: \"9a2a6552-13e7-4318-9777-19dbfabb09f5\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-b48bp"
Sep 18 22:02:09.860080 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:09.860035    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e5139388-724b-423b-9dff-2a25de46a9bd-sys\") pod \"node-exporter-xthcf\" (UID: \"e5139388-724b-423b-9dff-2a25de46a9bd\") " pod="openshift-monitoring/node-exporter-xthcf"
Sep 18 22:02:09.860080 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:09.860059    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gmwn\" (UniqueName: \"kubernetes.io/projected/e5139388-724b-423b-9dff-2a25de46a9bd-kube-api-access-5gmwn\") pod \"node-exporter-xthcf\" (UID: \"e5139388-724b-423b-9dff-2a25de46a9bd\") " pod="openshift-monitoring/node-exporter-xthcf"
Sep 18 22:02:09.860215 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:09.860082    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e5139388-724b-423b-9dff-2a25de46a9bd-root\") pod \"node-exporter-xthcf\" (UID: \"e5139388-724b-423b-9dff-2a25de46a9bd\") " pod="openshift-monitoring/node-exporter-xthcf"
Sep 18 22:02:09.961311 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:09.961235    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e5139388-724b-423b-9dff-2a25de46a9bd-root\") pod \"node-exporter-xthcf\" (UID: \"e5139388-724b-423b-9dff-2a25de46a9bd\") " pod="openshift-monitoring/node-exporter-xthcf"
Sep 18 22:02:09.961311 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:09.961286    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/9a2a6552-13e7-4318-9777-19dbfabb09f5-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-b48bp\" (UID: \"9a2a6552-13e7-4318-9777-19dbfabb09f5\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-b48bp"
Sep 18 22:02:09.961550 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:09.961313    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e5139388-724b-423b-9dff-2a25de46a9bd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xthcf\" (UID: \"e5139388-724b-423b-9dff-2a25de46a9bd\") " pod="openshift-monitoring/node-exporter-xthcf"
Sep 18 22:02:09.961550 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:09.961342    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9a2a6552-13e7-4318-9777-19dbfabb09f5-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-b48bp\" (UID: \"9a2a6552-13e7-4318-9777-19dbfabb09f5\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-b48bp"
Sep 18 22:02:09.961550 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:09.961357    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e5139388-724b-423b-9dff-2a25de46a9bd-root\") pod \"node-exporter-xthcf\" (UID: \"e5139388-724b-423b-9dff-2a25de46a9bd\") " pod="openshift-monitoring/node-exporter-xthcf"
Sep 18 22:02:09.961550 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:09.961441    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cddnn\" (UniqueName: \"kubernetes.io/projected/9a2a6552-13e7-4318-9777-19dbfabb09f5-kube-api-access-cddnn\") pod \"kube-state-metrics-84c885658c-b48bp\" (UID: \"9a2a6552-13e7-4318-9777-19dbfabb09f5\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-b48bp"
Sep 18 22:02:09.961550 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:09.961473    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e5139388-724b-423b-9dff-2a25de46a9bd-node-exporter-tls\") pod \"node-exporter-xthcf\" (UID: \"e5139388-724b-423b-9dff-2a25de46a9bd\") " pod="openshift-monitoring/node-exporter-xthcf"
Sep 18 22:02:09.961550 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:09.961497    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e5139388-724b-423b-9dff-2a25de46a9bd-metrics-client-ca\") pod \"node-exporter-xthcf\" (UID: \"e5139388-724b-423b-9dff-2a25de46a9bd\") " pod="openshift-monitoring/node-exporter-xthcf"
Sep 18 22:02:09.961550 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:09.961526    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9a2a6552-13e7-4318-9777-19dbfabb09f5-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-b48bp\" (UID: \"9a2a6552-13e7-4318-9777-19dbfabb09f5\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-b48bp"
Sep 18 22:02:09.961912 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:09.961559    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e5139388-724b-423b-9dff-2a25de46a9bd-node-exporter-accelerators-collector-config\") pod \"node-exporter-xthcf\" (UID: \"e5139388-724b-423b-9dff-2a25de46a9bd\") " pod="openshift-monitoring/node-exporter-xthcf"
Sep 18 22:02:09.961912 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:09.961588    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/9a2a6552-13e7-4318-9777-19dbfabb09f5-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-b48bp\" (UID: \"9a2a6552-13e7-4318-9777-19dbfabb09f5\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-b48bp"
Sep 18 22:02:09.961912 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:09.961613    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e5139388-724b-423b-9dff-2a25de46a9bd-node-exporter-wtmp\") pod \"node-exporter-xthcf\" (UID: \"e5139388-724b-423b-9dff-2a25de46a9bd\") " pod="openshift-monitoring/node-exporter-xthcf"
Sep 18 22:02:09.961912 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:09.961637    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e5139388-724b-423b-9dff-2a25de46a9bd-node-exporter-textfile\") pod \"node-exporter-xthcf\" (UID: \"e5139388-724b-423b-9dff-2a25de46a9bd\") " pod="openshift-monitoring/node-exporter-xthcf"
Sep 18 22:02:09.961912 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:09.961666    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a2a6552-13e7-4318-9777-19dbfabb09f5-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-b48bp\" (UID: \"9a2a6552-13e7-4318-9777-19dbfabb09f5\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-b48bp"
Sep 18 22:02:09.961912 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:09.961690    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e5139388-724b-423b-9dff-2a25de46a9bd-sys\") pod \"node-exporter-xthcf\" (UID: \"e5139388-724b-423b-9dff-2a25de46a9bd\") " pod="openshift-monitoring/node-exporter-xthcf"
Sep 18 22:02:09.961912 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:09.961712    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gmwn\" (UniqueName: \"kubernetes.io/projected/e5139388-724b-423b-9dff-2a25de46a9bd-kube-api-access-5gmwn\") pod \"node-exporter-xthcf\" (UID: \"e5139388-724b-423b-9dff-2a25de46a9bd\") " pod="openshift-monitoring/node-exporter-xthcf"
Sep 18 22:02:09.962665 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:09.962277    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e5139388-724b-423b-9dff-2a25de46a9bd-node-exporter-accelerators-collector-config\") pod \"node-exporter-xthcf\" (UID: \"e5139388-724b-423b-9dff-2a25de46a9bd\") " pod="openshift-monitoring/node-exporter-xthcf"
Sep 18 22:02:09.962665 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:09.962533    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e5139388-724b-423b-9dff-2a25de46a9bd-node-exporter-textfile\") pod \"node-exporter-xthcf\" (UID: \"e5139388-724b-423b-9dff-2a25de46a9bd\") " pod="openshift-monitoring/node-exporter-xthcf"
Sep 18 22:02:09.963558 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:09.962878    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e5139388-724b-423b-9dff-2a25de46a9bd-node-exporter-wtmp\") pod \"node-exporter-xthcf\" (UID: \"e5139388-724b-423b-9dff-2a25de46a9bd\") " pod="openshift-monitoring/node-exporter-xthcf"
Sep 18 22:02:09.963558 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:09.963234    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e5139388-724b-423b-9dff-2a25de46a9bd-sys\") pod \"node-exporter-xthcf\" (UID: \"e5139388-724b-423b-9dff-2a25de46a9bd\") " pod="openshift-monitoring/node-exporter-xthcf"
Sep 18 22:02:09.963558 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:09.963507    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a2a6552-13e7-4318-9777-19dbfabb09f5-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-b48bp\" (UID: \"9a2a6552-13e7-4318-9777-19dbfabb09f5\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-b48bp"
Sep 18 22:02:09.963776 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:09.963584    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/9a2a6552-13e7-4318-9777-19dbfabb09f5-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-b48bp\" (UID: \"9a2a6552-13e7-4318-9777-19dbfabb09f5\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-b48bp"
Sep 18 22:02:09.963776 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:09.963608    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e5139388-724b-423b-9dff-2a25de46a9bd-metrics-client-ca\") pod \"node-exporter-xthcf\" (UID: \"e5139388-724b-423b-9dff-2a25de46a9bd\") " pod="openshift-monitoring/node-exporter-xthcf"
Sep 18 22:02:09.964236 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:09.964210    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/9a2a6552-13e7-4318-9777-19dbfabb09f5-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-b48bp\" (UID: \"9a2a6552-13e7-4318-9777-19dbfabb09f5\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-b48bp"
Sep 18 22:02:09.964509 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:09.964268    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e5139388-724b-423b-9dff-2a25de46a9bd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xthcf\" (UID: \"e5139388-724b-423b-9dff-2a25de46a9bd\") " pod="openshift-monitoring/node-exporter-xthcf"
Sep 18 22:02:09.966151 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:09.966127    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e5139388-724b-423b-9dff-2a25de46a9bd-node-exporter-tls\") pod \"node-exporter-xthcf\" (UID: \"e5139388-724b-423b-9dff-2a25de46a9bd\") " pod="openshift-monitoring/node-exporter-xthcf"
Sep 18 22:02:09.966242 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:09.966194    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9a2a6552-13e7-4318-9777-19dbfabb09f5-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-b48bp\" (UID: \"9a2a6552-13e7-4318-9777-19dbfabb09f5\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-b48bp"
Sep 18 22:02:09.967541 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:09.967518    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9a2a6552-13e7-4318-9777-19dbfabb09f5-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-b48bp\" (UID: \"9a2a6552-13e7-4318-9777-19dbfabb09f5\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-b48bp"
Sep 18 22:02:09.971916 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:09.971895    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cddnn\" (UniqueName: \"kubernetes.io/projected/9a2a6552-13e7-4318-9777-19dbfabb09f5-kube-api-access-cddnn\") pod \"kube-state-metrics-84c885658c-b48bp\" (UID: \"9a2a6552-13e7-4318-9777-19dbfabb09f5\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-b48bp"
Sep 18 22:02:09.978647 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:09.978628    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gmwn\" (UniqueName: \"kubernetes.io/projected/e5139388-724b-423b-9dff-2a25de46a9bd-kube-api-access-5gmwn\") pod \"node-exporter-xthcf\" (UID: \"e5139388-724b-423b-9dff-2a25de46a9bd\") " pod="openshift-monitoring/node-exporter-xthcf"
Sep 18 22:02:09.988776 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:09.988759    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-84c885658c-b48bp"
Sep 18 22:02:09.993306 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:09.993287    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-676ff698c8-qpzc8"]
Sep 18 22:02:09.997246 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:09.997227    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-676ff698c8-qpzc8"]
Sep 18 22:02:10.024062 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:10.024033    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-xthcf"
Sep 18 22:02:10.035847 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:02:10.035806    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5139388_724b_423b_9dff_2a25de46a9bd.slice/crio-6686113faf83ecfe4910b9f2fa2f4db7b62c8929bd1207a82877f72015164e83 WatchSource:0}: Error finding container 6686113faf83ecfe4910b9f2fa2f4db7b62c8929bd1207a82877f72015164e83: Status 404 returned error can't find the container with id 6686113faf83ecfe4910b9f2fa2f4db7b62c8929bd1207a82877f72015164e83
Sep 18 22:02:10.265746 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:10.265657    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-b48bp"]
Sep 18 22:02:10.267798 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:02:10.267775    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a2a6552_13e7_4318_9777_19dbfabb09f5.slice/crio-9c04b22da038e7de7dfbc15fd1481a0882a92989cc617aa9f5d77c7dc6f8189c WatchSource:0}: Error finding container 9c04b22da038e7de7dfbc15fd1481a0882a92989cc617aa9f5d77c7dc6f8189c: Status 404 returned error can't find the container with id 9c04b22da038e7de7dfbc15fd1481a0882a92989cc617aa9f5d77c7dc6f8189c
Sep 18 22:02:10.675434 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:10.675373    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xthcf" event={"ID":"e5139388-724b-423b-9dff-2a25de46a9bd","Type":"ContainerStarted","Data":"6686113faf83ecfe4910b9f2fa2f4db7b62c8929bd1207a82877f72015164e83"}
Sep 18 22:02:10.677842 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:10.677812    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-b48bp" event={"ID":"9a2a6552-13e7-4318-9777-19dbfabb09f5","Type":"ContainerStarted","Data":"9c04b22da038e7de7dfbc15fd1481a0882a92989cc617aa9f5d77c7dc6f8189c"}
Sep 18 22:02:11.139874 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:11.139847    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf" path="/var/lib/kubelet/pods/ff7e13a9-23dc-4c8a-9dbd-4cd8710fd7cf/volumes"
Sep 18 22:02:11.683709 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:11.683674    2577 generic.go:356] "Generic (PLEG): container finished" podID="e5139388-724b-423b-9dff-2a25de46a9bd" containerID="11bda2e04b54fab2a313239081eb5e1b94b779af9a157d45772500ef56bff3aa" exitCode=0
Sep 18 22:02:11.684144 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:11.683722    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xthcf" event={"ID":"e5139388-724b-423b-9dff-2a25de46a9bd","Type":"ContainerDied","Data":"11bda2e04b54fab2a313239081eb5e1b94b779af9a157d45772500ef56bff3aa"}
Sep 18 22:02:12.689150 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:12.689118    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-b48bp" event={"ID":"9a2a6552-13e7-4318-9777-19dbfabb09f5","Type":"ContainerStarted","Data":"5471900a152afbed0599c0adce64618355fb38b3b37759e4e3fc51817e2c040c"}
Sep 18 22:02:12.689610 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:12.689181    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-b48bp" event={"ID":"9a2a6552-13e7-4318-9777-19dbfabb09f5","Type":"ContainerStarted","Data":"fc1b5a960fe3ee5c01078da893966d21d5e0fb30d46d3d071af6b104251c0493"}
Sep 18 22:02:12.689610 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:12.689208    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-b48bp" event={"ID":"9a2a6552-13e7-4318-9777-19dbfabb09f5","Type":"ContainerStarted","Data":"e0438fa0008611abde854ab759e55181344cfce272520954e13aa82004599029"}
Sep 18 22:02:12.691242 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:12.691222    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xthcf" event={"ID":"e5139388-724b-423b-9dff-2a25de46a9bd","Type":"ContainerStarted","Data":"6ad876963de0a7edd0b9c70c4f5537399a8a3512247c569d3bdc60f4a799f9ba"}
Sep 18 22:02:12.691356 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:12.691258    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xthcf" event={"ID":"e5139388-724b-423b-9dff-2a25de46a9bd","Type":"ContainerStarted","Data":"f905c9f58cc1c59faac59fb21e62c399b1cc592711a2a4aba294fa7199718f08"}
Sep 18 22:02:12.780603 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:12.780551    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-84c885658c-b48bp" podStartSLOduration=2.258689822 podStartE2EDuration="3.780534328s" totalImagesPullingTime="1.521844506s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:02:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:02:12.714944776 +0000 UTC m=+112.034616830" watchObservedRunningTime="2026-09-18 22:02:12.780534328 +0000 UTC m=+112.100206382"
Sep 18 22:02:12.781151 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:12.781119    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-xthcf" podStartSLOduration=2.670826739 podStartE2EDuration="3.781111307s" totalImagesPullingTime="1.032974024s" totalInitContainerRuntime="77.310544ms" isStatefulPod=true podCreationTimestamp="2026-09-18 22:02:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:02:12.77920187 +0000 UTC m=+112.098873924" watchObservedRunningTime="2026-09-18 22:02:12.781111307 +0000 UTC m=+112.100783362"
Sep 18 22:02:14.416936 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:14.416895    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-58895d6784-ptj2t"]
Sep 18 22:02:14.420539 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:14.420516    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58895d6784-ptj2t"
Sep 18 22:02:14.423565 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:14.423541    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 18 22:02:14.424690 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:14.424645    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 18 22:02:14.427433 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:14.427346    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 18 22:02:14.427541 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:14.427480    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 18 22:02:14.427613 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:14.427480    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 18 22:02:14.427613 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:14.427595    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 18 22:02:14.428601 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:14.428572    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-x59bp\""
Sep 18 22:02:14.431678 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:14.431662    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 18 22:02:14.432552 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:14.432536    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 18 22:02:14.439342 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:14.439322    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-58895d6784-ptj2t"]
Sep 18 22:02:14.497729 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:14.497694    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92gqc\" (UniqueName: \"kubernetes.io/projected/acdbe1be-9a1b-4d37-935d-1048f6e734b3-kube-api-access-92gqc\") pod \"console-58895d6784-ptj2t\" (UID: \"acdbe1be-9a1b-4d37-935d-1048f6e734b3\") " pod="openshift-console/console-58895d6784-ptj2t"
Sep 18 22:02:14.497923 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:14.497755    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/acdbe1be-9a1b-4d37-935d-1048f6e734b3-console-oauth-config\") pod \"console-58895d6784-ptj2t\" (UID: \"acdbe1be-9a1b-4d37-935d-1048f6e734b3\") " pod="openshift-console/console-58895d6784-ptj2t"
Sep 18 22:02:14.497923 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:14.497788    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/acdbe1be-9a1b-4d37-935d-1048f6e734b3-oauth-serving-cert\") pod \"console-58895d6784-ptj2t\" (UID: \"acdbe1be-9a1b-4d37-935d-1048f6e734b3\") " pod="openshift-console/console-58895d6784-ptj2t"
Sep 18 22:02:14.497923 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:14.497815    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/acdbe1be-9a1b-4d37-935d-1048f6e734b3-service-ca\") pod \"console-58895d6784-ptj2t\" (UID: \"acdbe1be-9a1b-4d37-935d-1048f6e734b3\") " pod="openshift-console/console-58895d6784-ptj2t"
Sep 18 22:02:14.497923 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:14.497829    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/acdbe1be-9a1b-4d37-935d-1048f6e734b3-trusted-ca-bundle\") pod \"console-58895d6784-ptj2t\" (UID: \"acdbe1be-9a1b-4d37-935d-1048f6e734b3\") " pod="openshift-console/console-58895d6784-ptj2t"
Sep 18 22:02:14.497923 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:14.497844    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/acdbe1be-9a1b-4d37-935d-1048f6e734b3-console-serving-cert\") pod \"console-58895d6784-ptj2t\" (UID: \"acdbe1be-9a1b-4d37-935d-1048f6e734b3\") " pod="openshift-console/console-58895d6784-ptj2t"
Sep 18 22:02:14.497923 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:14.497864    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/acdbe1be-9a1b-4d37-935d-1048f6e734b3-console-config\") pod \"console-58895d6784-ptj2t\" (UID: \"acdbe1be-9a1b-4d37-935d-1048f6e734b3\") " pod="openshift-console/console-58895d6784-ptj2t"
Sep 18 22:02:14.599072 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:14.599043    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/acdbe1be-9a1b-4d37-935d-1048f6e734b3-oauth-serving-cert\") pod \"console-58895d6784-ptj2t\" (UID: \"acdbe1be-9a1b-4d37-935d-1048f6e734b3\") " pod="openshift-console/console-58895d6784-ptj2t"
Sep 18 22:02:14.599262 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:14.599085    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/acdbe1be-9a1b-4d37-935d-1048f6e734b3-service-ca\") pod \"console-58895d6784-ptj2t\" (UID: \"acdbe1be-9a1b-4d37-935d-1048f6e734b3\") " pod="openshift-console/console-58895d6784-ptj2t"
Sep 18 22:02:14.599262 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:14.599103    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/acdbe1be-9a1b-4d37-935d-1048f6e734b3-trusted-ca-bundle\") pod \"console-58895d6784-ptj2t\" (UID: \"acdbe1be-9a1b-4d37-935d-1048f6e734b3\") " pod="openshift-console/console-58895d6784-ptj2t"
Sep 18 22:02:14.599262 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:14.599121    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/acdbe1be-9a1b-4d37-935d-1048f6e734b3-console-serving-cert\") pod \"console-58895d6784-ptj2t\" (UID: \"acdbe1be-9a1b-4d37-935d-1048f6e734b3\") " pod="openshift-console/console-58895d6784-ptj2t"
Sep 18 22:02:14.599262 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:14.599151    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/acdbe1be-9a1b-4d37-935d-1048f6e734b3-console-config\") pod \"console-58895d6784-ptj2t\" (UID: \"acdbe1be-9a1b-4d37-935d-1048f6e734b3\") " pod="openshift-console/console-58895d6784-ptj2t"
Sep 18 22:02:14.599262 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:14.599185    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92gqc\" (UniqueName: \"kubernetes.io/projected/acdbe1be-9a1b-4d37-935d-1048f6e734b3-kube-api-access-92gqc\") pod \"console-58895d6784-ptj2t\" (UID: \"acdbe1be-9a1b-4d37-935d-1048f6e734b3\") " pod="openshift-console/console-58895d6784-ptj2t"
Sep 18 22:02:14.599547 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:14.599269    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/acdbe1be-9a1b-4d37-935d-1048f6e734b3-console-oauth-config\") pod \"console-58895d6784-ptj2t\" (UID: \"acdbe1be-9a1b-4d37-935d-1048f6e734b3\") " pod="openshift-console/console-58895d6784-ptj2t"
Sep 18 22:02:14.599927 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:14.599904    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/acdbe1be-9a1b-4d37-935d-1048f6e734b3-service-ca\") pod \"console-58895d6784-ptj2t\" (UID: \"acdbe1be-9a1b-4d37-935d-1048f6e734b3\") " pod="openshift-console/console-58895d6784-ptj2t"
Sep 18 22:02:14.600024 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:14.599904    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/acdbe1be-9a1b-4d37-935d-1048f6e734b3-oauth-serving-cert\") pod \"console-58895d6784-ptj2t\" (UID: \"acdbe1be-9a1b-4d37-935d-1048f6e734b3\") " pod="openshift-console/console-58895d6784-ptj2t"
Sep 18 22:02:14.600024 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:14.599957    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/acdbe1be-9a1b-4d37-935d-1048f6e734b3-console-config\") pod \"console-58895d6784-ptj2t\" (UID: \"acdbe1be-9a1b-4d37-935d-1048f6e734b3\") " pod="openshift-console/console-58895d6784-ptj2t"
Sep 18 22:02:14.600273 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:14.600252    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/acdbe1be-9a1b-4d37-935d-1048f6e734b3-trusted-ca-bundle\") pod \"console-58895d6784-ptj2t\" (UID: \"acdbe1be-9a1b-4d37-935d-1048f6e734b3\") " pod="openshift-console/console-58895d6784-ptj2t"
Sep 18 22:02:14.601796 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:14.601779    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/acdbe1be-9a1b-4d37-935d-1048f6e734b3-console-oauth-config\") pod \"console-58895d6784-ptj2t\" (UID: \"acdbe1be-9a1b-4d37-935d-1048f6e734b3\") " pod="openshift-console/console-58895d6784-ptj2t"
Sep 18 22:02:14.601979 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:14.601963    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/acdbe1be-9a1b-4d37-935d-1048f6e734b3-console-serving-cert\") pod \"console-58895d6784-ptj2t\" (UID: \"acdbe1be-9a1b-4d37-935d-1048f6e734b3\") " pod="openshift-console/console-58895d6784-ptj2t"
Sep 18 22:02:14.607989 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:14.607957    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-92gqc\" (UniqueName: \"kubernetes.io/projected/acdbe1be-9a1b-4d37-935d-1048f6e734b3-kube-api-access-92gqc\") pod \"console-58895d6784-ptj2t\" (UID: \"acdbe1be-9a1b-4d37-935d-1048f6e734b3\") " pod="openshift-console/console-58895d6784-ptj2t"
Sep 18 22:02:14.729634 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:14.729566    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58895d6784-ptj2t"
Sep 18 22:02:14.852399 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:14.852365    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5d79948b-vnmxt"]
Sep 18 22:02:14.855875 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:14.855860    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5d79948b-vnmxt"
Sep 18 22:02:14.858443 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:14.858424    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Sep 18 22:02:14.858716 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:14.858701    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Sep 18 22:02:14.858837 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:14.858818    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Sep 18 22:02:14.858837 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:14.858833    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Sep 18 22:02:14.859166 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:14.859153    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-m692b\""
Sep 18 22:02:14.859325 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:14.859312    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Sep 18 22:02:14.863946 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:14.863928    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Sep 18 22:02:14.870130 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:14.870111    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5d79948b-vnmxt"]
Sep 18 22:02:14.901146 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:14.901112    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmv2f\" (UniqueName: \"kubernetes.io/projected/9a8c65d2-19fd-4545-bf89-39641a5ea60c-kube-api-access-qmv2f\") pod \"telemeter-client-5d79948b-vnmxt\" (UID: \"9a8c65d2-19fd-4545-bf89-39641a5ea60c\") " pod="openshift-monitoring/telemeter-client-5d79948b-vnmxt"
Sep 18 22:02:14.901146 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:14.901144    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/9a8c65d2-19fd-4545-bf89-39641a5ea60c-telemeter-client-tls\") pod \"telemeter-client-5d79948b-vnmxt\" (UID: \"9a8c65d2-19fd-4545-bf89-39641a5ea60c\") " pod="openshift-monitoring/telemeter-client-5d79948b-vnmxt"
Sep 18 22:02:14.901337 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:14.901166    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a8c65d2-19fd-4545-bf89-39641a5ea60c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5d79948b-vnmxt\" (UID: \"9a8c65d2-19fd-4545-bf89-39641a5ea60c\") " pod="openshift-monitoring/telemeter-client-5d79948b-vnmxt"
Sep 18 22:02:14.901337 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:14.901191    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/9a8c65d2-19fd-4545-bf89-39641a5ea60c-secret-telemeter-client\") pod \"telemeter-client-5d79948b-vnmxt\" (UID: \"9a8c65d2-19fd-4545-bf89-39641a5ea60c\") " pod="openshift-monitoring/telemeter-client-5d79948b-vnmxt"
Sep 18 22:02:14.901337 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:14.901251    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/9a8c65d2-19fd-4545-bf89-39641a5ea60c-federate-client-tls\") pod \"telemeter-client-5d79948b-vnmxt\" (UID: \"9a8c65d2-19fd-4545-bf89-39641a5ea60c\") " pod="openshift-monitoring/telemeter-client-5d79948b-vnmxt"
Sep 18 22:02:14.901337 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:14.901286    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a8c65d2-19fd-4545-bf89-39641a5ea60c-metrics-client-ca\") pod \"telemeter-client-5d79948b-vnmxt\" (UID: \"9a8c65d2-19fd-4545-bf89-39641a5ea60c\") " pod="openshift-monitoring/telemeter-client-5d79948b-vnmxt"
Sep 18 22:02:14.901337 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:14.901320    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9a8c65d2-19fd-4545-bf89-39641a5ea60c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5d79948b-vnmxt\" (UID: \"9a8c65d2-19fd-4545-bf89-39641a5ea60c\") " pod="openshift-monitoring/telemeter-client-5d79948b-vnmxt"
Sep 18 22:02:14.901519 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:14.901376    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a8c65d2-19fd-4545-bf89-39641a5ea60c-serving-certs-ca-bundle\") pod \"telemeter-client-5d79948b-vnmxt\" (UID: \"9a8c65d2-19fd-4545-bf89-39641a5ea60c\") " pod="openshift-monitoring/telemeter-client-5d79948b-vnmxt"
Sep 18 22:02:15.001458 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:15.001359    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-58895d6784-ptj2t"]
Sep 18 22:02:15.001734 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:15.001719    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/9a8c65d2-19fd-4545-bf89-39641a5ea60c-secret-telemeter-client\") pod \"telemeter-client-5d79948b-vnmxt\" (UID: \"9a8c65d2-19fd-4545-bf89-39641a5ea60c\") " pod="openshift-monitoring/telemeter-client-5d79948b-vnmxt"
Sep 18 22:02:15.001796 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:15.001779    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/9a8c65d2-19fd-4545-bf89-39641a5ea60c-federate-client-tls\") pod \"telemeter-client-5d79948b-vnmxt\" (UID: \"9a8c65d2-19fd-4545-bf89-39641a5ea60c\") " pod="openshift-monitoring/telemeter-client-5d79948b-vnmxt"
Sep 18 22:02:15.001834 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:15.001814    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a8c65d2-19fd-4545-bf89-39641a5ea60c-metrics-client-ca\") pod \"telemeter-client-5d79948b-vnmxt\" (UID: \"9a8c65d2-19fd-4545-bf89-39641a5ea60c\") " pod="openshift-monitoring/telemeter-client-5d79948b-vnmxt"
Sep 18 22:02:15.001876 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:15.001847    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9a8c65d2-19fd-4545-bf89-39641a5ea60c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5d79948b-vnmxt\" (UID: \"9a8c65d2-19fd-4545-bf89-39641a5ea60c\") " pod="openshift-monitoring/telemeter-client-5d79948b-vnmxt"
Sep 18 22:02:15.001998 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:15.001977    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a8c65d2-19fd-4545-bf89-39641a5ea60c-serving-certs-ca-bundle\") pod \"telemeter-client-5d79948b-vnmxt\" (UID: \"9a8c65d2-19fd-4545-bf89-39641a5ea60c\") " pod="openshift-monitoring/telemeter-client-5d79948b-vnmxt"
Sep 18 22:02:15.002073 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:15.002048    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmv2f\" (UniqueName: \"kubernetes.io/projected/9a8c65d2-19fd-4545-bf89-39641a5ea60c-kube-api-access-qmv2f\") pod \"telemeter-client-5d79948b-vnmxt\" (UID: \"9a8c65d2-19fd-4545-bf89-39641a5ea60c\") " pod="openshift-monitoring/telemeter-client-5d79948b-vnmxt"
Sep 18 22:02:15.002128 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:15.002084    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/9a8c65d2-19fd-4545-bf89-39641a5ea60c-telemeter-client-tls\") pod \"telemeter-client-5d79948b-vnmxt\" (UID: \"9a8c65d2-19fd-4545-bf89-39641a5ea60c\") " pod="openshift-monitoring/telemeter-client-5d79948b-vnmxt"
Sep 18 22:02:15.002128 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:15.002121    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a8c65d2-19fd-4545-bf89-39641a5ea60c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5d79948b-vnmxt\" (UID: \"9a8c65d2-19fd-4545-bf89-39641a5ea60c\") " pod="openshift-monitoring/telemeter-client-5d79948b-vnmxt"
Sep 18 22:02:15.003037 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:15.002988    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a8c65d2-19fd-4545-bf89-39641a5ea60c-serving-certs-ca-bundle\") pod \"telemeter-client-5d79948b-vnmxt\" (UID: \"9a8c65d2-19fd-4545-bf89-39641a5ea60c\") " pod="openshift-monitoring/telemeter-client-5d79948b-vnmxt"
Sep 18 22:02:15.003138 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:15.003079    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a8c65d2-19fd-4545-bf89-39641a5ea60c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5d79948b-vnmxt\" (UID: \"9a8c65d2-19fd-4545-bf89-39641a5ea60c\") " pod="openshift-monitoring/telemeter-client-5d79948b-vnmxt"
Sep 18 22:02:15.003138 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:15.003127    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a8c65d2-19fd-4545-bf89-39641a5ea60c-metrics-client-ca\") pod \"telemeter-client-5d79948b-vnmxt\" (UID: \"9a8c65d2-19fd-4545-bf89-39641a5ea60c\") " pod="openshift-monitoring/telemeter-client-5d79948b-vnmxt"
Sep 18 22:02:15.004918 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:15.004891    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/9a8c65d2-19fd-4545-bf89-39641a5ea60c-telemeter-client-tls\") pod \"telemeter-client-5d79948b-vnmxt\" (UID: \"9a8c65d2-19fd-4545-bf89-39641a5ea60c\") " pod="openshift-monitoring/telemeter-client-5d79948b-vnmxt"
Sep 18 22:02:15.005042 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:15.004926    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/9a8c65d2-19fd-4545-bf89-39641a5ea60c-federate-client-tls\") pod \"telemeter-client-5d79948b-vnmxt\" (UID: \"9a8c65d2-19fd-4545-bf89-39641a5ea60c\") " pod="openshift-monitoring/telemeter-client-5d79948b-vnmxt"
Sep 18 22:02:15.005042 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:15.004964    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/9a8c65d2-19fd-4545-bf89-39641a5ea60c-secret-telemeter-client\") pod \"telemeter-client-5d79948b-vnmxt\" (UID: \"9a8c65d2-19fd-4545-bf89-39641a5ea60c\") " pod="openshift-monitoring/telemeter-client-5d79948b-vnmxt"
Sep 18 22:02:15.005042 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:15.005021    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9a8c65d2-19fd-4545-bf89-39641a5ea60c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5d79948b-vnmxt\" (UID: \"9a8c65d2-19fd-4545-bf89-39641a5ea60c\") " pod="openshift-monitoring/telemeter-client-5d79948b-vnmxt"
Sep 18 22:02:15.005176 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:02:15.005136    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacdbe1be_9a1b_4d37_935d_1048f6e734b3.slice/crio-528557b31f119ae7bfcd507f5a92b597b59ebae151f45101a118973cb30a5e7a WatchSource:0}: Error finding container 528557b31f119ae7bfcd507f5a92b597b59ebae151f45101a118973cb30a5e7a: Status 404 returned error can't find the container with id 528557b31f119ae7bfcd507f5a92b597b59ebae151f45101a118973cb30a5e7a
Sep 18 22:02:15.009939 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:15.009921    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmv2f\" (UniqueName: \"kubernetes.io/projected/9a8c65d2-19fd-4545-bf89-39641a5ea60c-kube-api-access-qmv2f\") pod \"telemeter-client-5d79948b-vnmxt\" (UID: \"9a8c65d2-19fd-4545-bf89-39641a5ea60c\") " pod="openshift-monitoring/telemeter-client-5d79948b-vnmxt"
Sep 18 22:02:15.166000 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:15.165969    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5d79948b-vnmxt"
Sep 18 22:02:15.444126 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:15.444042    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5d79948b-vnmxt"]
Sep 18 22:02:15.445330 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:02:15.445300    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a8c65d2_19fd_4545_bf89_39641a5ea60c.slice/crio-7a00e7f4be5a9a485c90d71e19902a2d70358acb0d7fc844570d3c0660b22afd WatchSource:0}: Error finding container 7a00e7f4be5a9a485c90d71e19902a2d70358acb0d7fc844570d3c0660b22afd: Status 404 returned error can't find the container with id 7a00e7f4be5a9a485c90d71e19902a2d70358acb0d7fc844570d3c0660b22afd
Sep 18 22:02:15.714803 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:15.714646    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5d79948b-vnmxt" event={"ID":"9a8c65d2-19fd-4545-bf89-39641a5ea60c","Type":"ContainerStarted","Data":"7a00e7f4be5a9a485c90d71e19902a2d70358acb0d7fc844570d3c0660b22afd"}
Sep 18 22:02:15.717086 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:15.717048    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58895d6784-ptj2t" event={"ID":"acdbe1be-9a1b-4d37-935d-1048f6e734b3","Type":"ContainerStarted","Data":"528557b31f119ae7bfcd507f5a92b597b59ebae151f45101a118973cb30a5e7a"}
Sep 18 22:02:19.735375 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:19.735285    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5d79948b-vnmxt" event={"ID":"9a8c65d2-19fd-4545-bf89-39641a5ea60c","Type":"ContainerStarted","Data":"38bb2d507e2a2fb2da24db3875ee57efbba20f4ae55c62abd58a87dc8aeb07e4"}
Sep 18 22:02:19.736838 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:19.736815    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58895d6784-ptj2t" event={"ID":"acdbe1be-9a1b-4d37-935d-1048f6e734b3","Type":"ContainerStarted","Data":"9d192cae6c4818fda6abd2d1b984dec4b7f7dc22e25e2e55b2ba82ce3aeacfe2"}
Sep 18 22:02:19.759947 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:19.759896    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-58895d6784-ptj2t" podStartSLOduration=1.325198366 podStartE2EDuration="5.759876182s" totalImagesPullingTime="4.434677816s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:02:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:02:19.759185953 +0000 UTC m=+119.078858007" watchObservedRunningTime="2026-09-18 22:02:19.759876182 +0000 UTC m=+119.079548239"
Sep 18 22:02:20.748121 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:20.748084    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5d79948b-vnmxt" event={"ID":"9a8c65d2-19fd-4545-bf89-39641a5ea60c","Type":"ContainerStarted","Data":"70ed69ad2748b54c4ad259438bed1258598a5cc45c73902e7ca9e7bb4adbf46e"}
Sep 18 22:02:21.753112 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:21.753080    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5d79948b-vnmxt" event={"ID":"9a8c65d2-19fd-4545-bf89-39641a5ea60c","Type":"ContainerStarted","Data":"b95c4d15b403431729a05c5ef168bf4600d81a9a934ff627d625e06ef62a335c"}
Sep 18 22:02:21.776079 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:21.775802    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5d79948b-vnmxt" podStartSLOduration=2.6168296460000002 podStartE2EDuration="7.775780105s" totalImagesPullingTime="5.158950459s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:02:14 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:02:21.774511827 +0000 UTC m=+121.094183873" watchObservedRunningTime="2026-09-18 22:02:21.775780105 +0000 UTC m=+121.095452160"
Sep 18 22:02:21.877030 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:21.876996    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-58895d6784-ptj2t"]
Sep 18 22:02:23.762133 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:23.762093    2577 generic.go:356] "Generic (PLEG): container finished" podID="be6728b1-ba42-42b6-8eb7-8c0399e18907" containerID="bc4f4c48a2344a189629d5c2342e020e174253d0a8f25b7b68ece580dae8bba2" exitCode=0
Sep 18 22:02:23.762517 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:23.762167    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-d7zbx" event={"ID":"be6728b1-ba42-42b6-8eb7-8c0399e18907","Type":"ContainerDied","Data":"bc4f4c48a2344a189629d5c2342e020e174253d0a8f25b7b68ece580dae8bba2"}
Sep 18 22:02:23.762517 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:23.762516    2577 scope.go:117] "RemoveContainer" containerID="bc4f4c48a2344a189629d5c2342e020e174253d0a8f25b7b68ece580dae8bba2"
Sep 18 22:02:24.730167 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:24.730132    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-58895d6784-ptj2t"
Sep 18 22:02:24.767056 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:24.767022    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-d7zbx" event={"ID":"be6728b1-ba42-42b6-8eb7-8c0399e18907","Type":"ContainerStarted","Data":"3b1611ec8fc6fb2e61ba810ef7576fe71a8a56ae2c64da01a348708c20211e0c"}
Sep 18 22:02:28.781865 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:28.781785    2577 generic.go:356] "Generic (PLEG): container finished" podID="180df824-c4c4-4de0-b270-597272b6f759" containerID="d0f47457681363b6a4d7cf53e537cba90583db8b84c891a053e9695e43c44581" exitCode=0
Sep 18 22:02:28.781865 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:28.781851    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-6f9c644dd9-r282c" event={"ID":"180df824-c4c4-4de0-b270-597272b6f759","Type":"ContainerDied","Data":"d0f47457681363b6a4d7cf53e537cba90583db8b84c891a053e9695e43c44581"}
Sep 18 22:02:28.782360 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:28.782257    2577 scope.go:117] "RemoveContainer" containerID="d0f47457681363b6a4d7cf53e537cba90583db8b84c891a053e9695e43c44581"
Sep 18 22:02:29.790972 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:29.790939    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-6f9c644dd9-r282c" event={"ID":"180df824-c4c4-4de0-b270-597272b6f759","Type":"ContainerStarted","Data":"8fee5a9b28580cdc03c7693c9e6f7dbb884fa6855a9b5e3505216b00c8782cd9"}
Sep 18 22:02:30.938352 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:30.938314    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c715783a-a4e5-4cba-b189-cf2ff6eb8950-metrics-certs\") pod \"network-metrics-daemon-4vmhg\" (UID: \"c715783a-a4e5-4cba-b189-cf2ff6eb8950\") " pod="openshift-multus/network-metrics-daemon-4vmhg"
Sep 18 22:02:30.940771 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:30.940742    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c715783a-a4e5-4cba-b189-cf2ff6eb8950-metrics-certs\") pod \"network-metrics-daemon-4vmhg\" (UID: \"c715783a-a4e5-4cba-b189-cf2ff6eb8950\") " pod="openshift-multus/network-metrics-daemon-4vmhg"
Sep 18 22:02:31.054755 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:31.054724    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-27j86\""
Sep 18 22:02:31.063470 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:31.063450    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vmhg"
Sep 18 22:02:31.333255 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:31.333214    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4vmhg"]
Sep 18 22:02:31.336629 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:02:31.336598    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc715783a_a4e5_4cba_b189_cf2ff6eb8950.slice/crio-69eeabbe5a10f2c4f9f88ab097058cd7f8012f22cd483ec53a12f25382dcdf51 WatchSource:0}: Error finding container 69eeabbe5a10f2c4f9f88ab097058cd7f8012f22cd483ec53a12f25382dcdf51: Status 404 returned error can't find the container with id 69eeabbe5a10f2c4f9f88ab097058cd7f8012f22cd483ec53a12f25382dcdf51
Sep 18 22:02:31.799355 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:31.799281    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4vmhg" event={"ID":"c715783a-a4e5-4cba-b189-cf2ff6eb8950","Type":"ContainerStarted","Data":"69eeabbe5a10f2c4f9f88ab097058cd7f8012f22cd483ec53a12f25382dcdf51"}
Sep 18 22:02:32.804998 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:32.804915    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4vmhg" event={"ID":"c715783a-a4e5-4cba-b189-cf2ff6eb8950","Type":"ContainerStarted","Data":"7b34c3a24b5517b5875cc82b697af5eb3f498c57c77fe3f82ec563a53c2c998f"}
Sep 18 22:02:32.804998 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:32.804971    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4vmhg" event={"ID":"c715783a-a4e5-4cba-b189-cf2ff6eb8950","Type":"ContainerStarted","Data":"0c32473a0b947eece5e7a39c5d2ad9f4e43da41d99942e58c67e172d50a5d3fc"}
Sep 18 22:02:32.841516 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:32.841473    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-4vmhg" podStartSLOduration=129.863487047 podStartE2EDuration="2m10.841456074s" totalImagesPullingTime="977.969027ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:00:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:02:32.840011577 +0000 UTC m=+132.159683632" watchObservedRunningTime="2026-09-18 22:02:32.841456074 +0000 UTC m=+132.161128129"
Sep 18 22:02:46.896487 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:46.896453    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-58895d6784-ptj2t" podUID="acdbe1be-9a1b-4d37-935d-1048f6e734b3" containerName="console" containerID="cri-o://9d192cae6c4818fda6abd2d1b984dec4b7f7dc22e25e2e55b2ba82ce3aeacfe2" gracePeriod=15
Sep 18 22:02:47.146302 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:47.146277    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58895d6784-ptj2t"
Sep 18 22:02:47.264677 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:47.264602    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/acdbe1be-9a1b-4d37-935d-1048f6e734b3-console-oauth-config\") pod \"acdbe1be-9a1b-4d37-935d-1048f6e734b3\" (UID: \"acdbe1be-9a1b-4d37-935d-1048f6e734b3\") "
Sep 18 22:02:47.264677 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:47.264652    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/acdbe1be-9a1b-4d37-935d-1048f6e734b3-console-config\") pod \"acdbe1be-9a1b-4d37-935d-1048f6e734b3\" (UID: \"acdbe1be-9a1b-4d37-935d-1048f6e734b3\") "
Sep 18 22:02:47.264891 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:47.264697    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-92gqc\" (UniqueName: \"kubernetes.io/projected/acdbe1be-9a1b-4d37-935d-1048f6e734b3-kube-api-access-92gqc\") pod \"acdbe1be-9a1b-4d37-935d-1048f6e734b3\" (UID: \"acdbe1be-9a1b-4d37-935d-1048f6e734b3\") "
Sep 18 22:02:47.264891 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:47.264720    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/acdbe1be-9a1b-4d37-935d-1048f6e734b3-oauth-serving-cert\") pod \"acdbe1be-9a1b-4d37-935d-1048f6e734b3\" (UID: \"acdbe1be-9a1b-4d37-935d-1048f6e734b3\") "
Sep 18 22:02:47.264891 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:47.264755    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/acdbe1be-9a1b-4d37-935d-1048f6e734b3-service-ca\") pod \"acdbe1be-9a1b-4d37-935d-1048f6e734b3\" (UID: \"acdbe1be-9a1b-4d37-935d-1048f6e734b3\") "
Sep 18 22:02:47.265038 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:47.264922    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/acdbe1be-9a1b-4d37-935d-1048f6e734b3-console-serving-cert\") pod \"acdbe1be-9a1b-4d37-935d-1048f6e734b3\" (UID: \"acdbe1be-9a1b-4d37-935d-1048f6e734b3\") "
Sep 18 22:02:47.265038 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:47.264990    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/acdbe1be-9a1b-4d37-935d-1048f6e734b3-trusted-ca-bundle\") pod \"acdbe1be-9a1b-4d37-935d-1048f6e734b3\" (UID: \"acdbe1be-9a1b-4d37-935d-1048f6e734b3\") "
Sep 18 22:02:47.265163 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:47.265140    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/acdbe1be-9a1b-4d37-935d-1048f6e734b3-service-ca" (OuterVolumeSpecName: "service-ca") pod "acdbe1be-9a1b-4d37-935d-1048f6e734b3" (UID: "acdbe1be-9a1b-4d37-935d-1048f6e734b3"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:02:47.265221 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:47.265152    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/acdbe1be-9a1b-4d37-935d-1048f6e734b3-console-config" (OuterVolumeSpecName: "console-config") pod "acdbe1be-9a1b-4d37-935d-1048f6e734b3" (UID: "acdbe1be-9a1b-4d37-935d-1048f6e734b3"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:02:47.265221 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:47.265160    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/acdbe1be-9a1b-4d37-935d-1048f6e734b3-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "acdbe1be-9a1b-4d37-935d-1048f6e734b3" (UID: "acdbe1be-9a1b-4d37-935d-1048f6e734b3"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:02:47.265317 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:47.265277    2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/acdbe1be-9a1b-4d37-935d-1048f6e734b3-console-config\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:02:47.265436 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:47.265383    2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/acdbe1be-9a1b-4d37-935d-1048f6e734b3-oauth-serving-cert\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:02:47.265436 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:47.265405    2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/acdbe1be-9a1b-4d37-935d-1048f6e734b3-service-ca\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:02:47.265699 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:47.265676    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/acdbe1be-9a1b-4d37-935d-1048f6e734b3-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "acdbe1be-9a1b-4d37-935d-1048f6e734b3" (UID: "acdbe1be-9a1b-4d37-935d-1048f6e734b3"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:02:47.267079 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:47.267055    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/acdbe1be-9a1b-4d37-935d-1048f6e734b3-kube-api-access-92gqc" (OuterVolumeSpecName: "kube-api-access-92gqc") pod "acdbe1be-9a1b-4d37-935d-1048f6e734b3" (UID: "acdbe1be-9a1b-4d37-935d-1048f6e734b3"). InnerVolumeSpecName "kube-api-access-92gqc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:02:47.267079 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:47.267069    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/acdbe1be-9a1b-4d37-935d-1048f6e734b3-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "acdbe1be-9a1b-4d37-935d-1048f6e734b3" (UID: "acdbe1be-9a1b-4d37-935d-1048f6e734b3"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 22:02:47.267182 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:47.267119    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/acdbe1be-9a1b-4d37-935d-1048f6e734b3-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "acdbe1be-9a1b-4d37-935d-1048f6e734b3" (UID: "acdbe1be-9a1b-4d37-935d-1048f6e734b3"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 22:02:47.366437 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:47.366381    2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/acdbe1be-9a1b-4d37-935d-1048f6e734b3-console-serving-cert\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:02:47.366437 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:47.366432    2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/acdbe1be-9a1b-4d37-935d-1048f6e734b3-trusted-ca-bundle\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:02:47.366608 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:47.366445    2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/acdbe1be-9a1b-4d37-935d-1048f6e734b3-console-oauth-config\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:02:47.366608 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:47.366458    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-92gqc\" (UniqueName: \"kubernetes.io/projected/acdbe1be-9a1b-4d37-935d-1048f6e734b3-kube-api-access-92gqc\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:02:47.864401 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:47.864368    2577 generic.go:356] "Generic (PLEG): container finished" podID="acdbe1be-9a1b-4d37-935d-1048f6e734b3" containerID="9d192cae6c4818fda6abd2d1b984dec4b7f7dc22e25e2e55b2ba82ce3aeacfe2" exitCode=0
Sep 18 22:02:47.864589 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:47.864436    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58895d6784-ptj2t"
Sep 18 22:02:47.864589 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:47.864452    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58895d6784-ptj2t" event={"ID":"acdbe1be-9a1b-4d37-935d-1048f6e734b3","Type":"ContainerDied","Data":"9d192cae6c4818fda6abd2d1b984dec4b7f7dc22e25e2e55b2ba82ce3aeacfe2"}
Sep 18 22:02:47.864589 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:47.864503    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58895d6784-ptj2t" event={"ID":"acdbe1be-9a1b-4d37-935d-1048f6e734b3","Type":"ContainerDied","Data":"528557b31f119ae7bfcd507f5a92b597b59ebae151f45101a118973cb30a5e7a"}
Sep 18 22:02:47.864589 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:47.864526    2577 scope.go:117] "RemoveContainer" containerID="9d192cae6c4818fda6abd2d1b984dec4b7f7dc22e25e2e55b2ba82ce3aeacfe2"
Sep 18 22:02:47.873290 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:47.873272    2577 scope.go:117] "RemoveContainer" containerID="9d192cae6c4818fda6abd2d1b984dec4b7f7dc22e25e2e55b2ba82ce3aeacfe2"
Sep 18 22:02:47.873588 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:02:47.873568    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d192cae6c4818fda6abd2d1b984dec4b7f7dc22e25e2e55b2ba82ce3aeacfe2\": container with ID starting with 9d192cae6c4818fda6abd2d1b984dec4b7f7dc22e25e2e55b2ba82ce3aeacfe2 not found: ID does not exist" containerID="9d192cae6c4818fda6abd2d1b984dec4b7f7dc22e25e2e55b2ba82ce3aeacfe2"
Sep 18 22:02:47.873664 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:47.873599    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d192cae6c4818fda6abd2d1b984dec4b7f7dc22e25e2e55b2ba82ce3aeacfe2"} err="failed to get container status \"9d192cae6c4818fda6abd2d1b984dec4b7f7dc22e25e2e55b2ba82ce3aeacfe2\": rpc error: code = NotFound desc = could not find container \"9d192cae6c4818fda6abd2d1b984dec4b7f7dc22e25e2e55b2ba82ce3aeacfe2\": container with ID starting with 9d192cae6c4818fda6abd2d1b984dec4b7f7dc22e25e2e55b2ba82ce3aeacfe2 not found: ID does not exist"
Sep 18 22:02:47.884455 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:47.884431    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-58895d6784-ptj2t"]
Sep 18 22:02:47.886946 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:47.886927    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-58895d6784-ptj2t"]
Sep 18 22:02:49.137721 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:02:49.137690    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="acdbe1be-9a1b-4d37-935d-1048f6e734b3" path="/var/lib/kubelet/pods/acdbe1be-9a1b-4d37-935d-1048f6e734b3/volumes"
Sep 18 22:05:21.020400 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:05:21.020371    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-h2847_125d5bb0-54b7-4dff-aa80-e737f2791533/console-operator/1.log"
Sep 18 22:05:21.022757 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:05:21.022733    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-h2847_125d5bb0-54b7-4dff-aa80-e737f2791533/console-operator/1.log"
Sep 18 22:05:21.030450 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:05:21.030401    2577 kubelet.go:1648] "Image garbage collection succeeded"
Sep 18 22:05:41.467569 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:05:41.467541    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cc84d"]
Sep 18 22:05:41.469877 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:05:41.467881    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="acdbe1be-9a1b-4d37-935d-1048f6e734b3" containerName="console"
Sep 18 22:05:41.469877 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:05:41.467894    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="acdbe1be-9a1b-4d37-935d-1048f6e734b3" containerName="console"
Sep 18 22:05:41.469877 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:05:41.467950    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="acdbe1be-9a1b-4d37-935d-1048f6e734b3" containerName="console"
Sep 18 22:05:41.470669 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:05:41.470654    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cc84d"
Sep 18 22:05:41.473937 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:05:41.473919    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 18 22:05:41.474368 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:05:41.474352    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 18 22:05:41.474443 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:05:41.474352    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6gs9k\""
Sep 18 22:05:41.486916 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:05:41.486894    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cc84d"]
Sep 18 22:05:41.629591 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:05:41.629551    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gd6k5\" (UniqueName: \"kubernetes.io/projected/abf83758-f7de-4d34-98cb-4ba4acee9687-kube-api-access-gd6k5\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cc84d\" (UID: \"abf83758-f7de-4d34-98cb-4ba4acee9687\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cc84d"
Sep 18 22:05:41.629767 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:05:41.629599    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/abf83758-f7de-4d34-98cb-4ba4acee9687-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cc84d\" (UID: \"abf83758-f7de-4d34-98cb-4ba4acee9687\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cc84d"
Sep 18 22:05:41.629767 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:05:41.629643    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/abf83758-f7de-4d34-98cb-4ba4acee9687-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cc84d\" (UID: \"abf83758-f7de-4d34-98cb-4ba4acee9687\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cc84d"
Sep 18 22:05:41.730909 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:05:41.730825    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gd6k5\" (UniqueName: \"kubernetes.io/projected/abf83758-f7de-4d34-98cb-4ba4acee9687-kube-api-access-gd6k5\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cc84d\" (UID: \"abf83758-f7de-4d34-98cb-4ba4acee9687\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cc84d"
Sep 18 22:05:41.730909 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:05:41.730891    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/abf83758-f7de-4d34-98cb-4ba4acee9687-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cc84d\" (UID: \"abf83758-f7de-4d34-98cb-4ba4acee9687\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cc84d"
Sep 18 22:05:41.731062 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:05:41.730925    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/abf83758-f7de-4d34-98cb-4ba4acee9687-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cc84d\" (UID: \"abf83758-f7de-4d34-98cb-4ba4acee9687\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cc84d"
Sep 18 22:05:41.731267 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:05:41.731250    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/abf83758-f7de-4d34-98cb-4ba4acee9687-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cc84d\" (UID: \"abf83758-f7de-4d34-98cb-4ba4acee9687\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cc84d"
Sep 18 22:05:41.731312 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:05:41.731297    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/abf83758-f7de-4d34-98cb-4ba4acee9687-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cc84d\" (UID: \"abf83758-f7de-4d34-98cb-4ba4acee9687\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cc84d"
Sep 18 22:05:41.739057 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:05:41.739034    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gd6k5\" (UniqueName: \"kubernetes.io/projected/abf83758-f7de-4d34-98cb-4ba4acee9687-kube-api-access-gd6k5\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cc84d\" (UID: \"abf83758-f7de-4d34-98cb-4ba4acee9687\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cc84d"
Sep 18 22:05:41.779512 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:05:41.779489    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cc84d"
Sep 18 22:05:42.055291 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:05:42.055266    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cc84d"]
Sep 18 22:05:42.056817 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:05:42.056792    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabf83758_f7de_4d34_98cb_4ba4acee9687.slice/crio-2b5ba78ed473de6466df54dac175a983f1da4526aa97775a6cda1a6b4fd34c48 WatchSource:0}: Error finding container 2b5ba78ed473de6466df54dac175a983f1da4526aa97775a6cda1a6b4fd34c48: Status 404 returned error can't find the container with id 2b5ba78ed473de6466df54dac175a983f1da4526aa97775a6cda1a6b4fd34c48
Sep 18 22:05:42.058605 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:05:42.058590    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 18 22:05:42.474105 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:05:42.474067    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cc84d" event={"ID":"abf83758-f7de-4d34-98cb-4ba4acee9687","Type":"ContainerStarted","Data":"2b5ba78ed473de6466df54dac175a983f1da4526aa97775a6cda1a6b4fd34c48"}
Sep 18 22:05:48.498705 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:05:48.498612    2577 generic.go:356] "Generic (PLEG): container finished" podID="abf83758-f7de-4d34-98cb-4ba4acee9687" containerID="6359f61137399c3a10a071cdc8df3e97782c44f4cbd1a7f68a66da69d9bde5c9" exitCode=0
Sep 18 22:05:48.499069 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:05:48.498700    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cc84d" event={"ID":"abf83758-f7de-4d34-98cb-4ba4acee9687","Type":"ContainerDied","Data":"6359f61137399c3a10a071cdc8df3e97782c44f4cbd1a7f68a66da69d9bde5c9"}
Sep 18 22:05:51.512203 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:05:51.512174    2577 generic.go:356] "Generic (PLEG): container finished" podID="abf83758-f7de-4d34-98cb-4ba4acee9687" containerID="d438bae0933fc62189684fa262a6cce739dc6cde4e09ba5f07c4bd15eb7724a9" exitCode=0
Sep 18 22:05:51.512570 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:05:51.512262    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cc84d" event={"ID":"abf83758-f7de-4d34-98cb-4ba4acee9687","Type":"ContainerDied","Data":"d438bae0933fc62189684fa262a6cce739dc6cde4e09ba5f07c4bd15eb7724a9"}
Sep 18 22:05:59.546961 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:05:59.546918    2577 generic.go:356] "Generic (PLEG): container finished" podID="abf83758-f7de-4d34-98cb-4ba4acee9687" containerID="ebe41fdbd4092067af9676cfb7ac1cff6535797f00067f9263152b43916c071c" exitCode=0
Sep 18 22:05:59.547457 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:05:59.546997    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cc84d" event={"ID":"abf83758-f7de-4d34-98cb-4ba4acee9687","Type":"ContainerDied","Data":"ebe41fdbd4092067af9676cfb7ac1cff6535797f00067f9263152b43916c071c"}
Sep 18 22:06:00.673792 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:00.673771    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cc84d"
Sep 18 22:06:00.783852 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:00.783816    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/abf83758-f7de-4d34-98cb-4ba4acee9687-util\") pod \"abf83758-f7de-4d34-98cb-4ba4acee9687\" (UID: \"abf83758-f7de-4d34-98cb-4ba4acee9687\") "
Sep 18 22:06:00.784018 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:00.783863    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/abf83758-f7de-4d34-98cb-4ba4acee9687-bundle\") pod \"abf83758-f7de-4d34-98cb-4ba4acee9687\" (UID: \"abf83758-f7de-4d34-98cb-4ba4acee9687\") "
Sep 18 22:06:00.784018 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:00.783912    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gd6k5\" (UniqueName: \"kubernetes.io/projected/abf83758-f7de-4d34-98cb-4ba4acee9687-kube-api-access-gd6k5\") pod \"abf83758-f7de-4d34-98cb-4ba4acee9687\" (UID: \"abf83758-f7de-4d34-98cb-4ba4acee9687\") "
Sep 18 22:06:00.784514 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:00.784491    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/abf83758-f7de-4d34-98cb-4ba4acee9687-bundle" (OuterVolumeSpecName: "bundle") pod "abf83758-f7de-4d34-98cb-4ba4acee9687" (UID: "abf83758-f7de-4d34-98cb-4ba4acee9687"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:06:00.786235 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:00.786210    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/abf83758-f7de-4d34-98cb-4ba4acee9687-kube-api-access-gd6k5" (OuterVolumeSpecName: "kube-api-access-gd6k5") pod "abf83758-f7de-4d34-98cb-4ba4acee9687" (UID: "abf83758-f7de-4d34-98cb-4ba4acee9687"). InnerVolumeSpecName "kube-api-access-gd6k5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:06:00.790653 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:00.790628    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/abf83758-f7de-4d34-98cb-4ba4acee9687-util" (OuterVolumeSpecName: "util") pod "abf83758-f7de-4d34-98cb-4ba4acee9687" (UID: "abf83758-f7de-4d34-98cb-4ba4acee9687"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:06:00.884740 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:00.884712    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gd6k5\" (UniqueName: \"kubernetes.io/projected/abf83758-f7de-4d34-98cb-4ba4acee9687-kube-api-access-gd6k5\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:06:00.884740 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:00.884738    2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/abf83758-f7de-4d34-98cb-4ba4acee9687-util\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:06:00.884897 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:00.884746    2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/abf83758-f7de-4d34-98cb-4ba4acee9687-bundle\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:06:01.555819 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:01.555736    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cc84d" event={"ID":"abf83758-f7de-4d34-98cb-4ba4acee9687","Type":"ContainerDied","Data":"2b5ba78ed473de6466df54dac175a983f1da4526aa97775a6cda1a6b4fd34c48"}
Sep 18 22:06:01.555819 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:01.555786    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2b5ba78ed473de6466df54dac175a983f1da4526aa97775a6cda1a6b4fd34c48"
Sep 18 22:06:01.555819 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:01.555744    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cc84d"
Sep 18 22:06:05.585543 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:05.585516    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j5kjj"]
Sep 18 22:06:05.586027 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:05.585766    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abf83758-f7de-4d34-98cb-4ba4acee9687" containerName="extract"
Sep 18 22:06:05.586027 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:05.585776    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="abf83758-f7de-4d34-98cb-4ba4acee9687" containerName="extract"
Sep 18 22:06:05.586027 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:05.585784    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abf83758-f7de-4d34-98cb-4ba4acee9687" containerName="util"
Sep 18 22:06:05.586027 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:05.585789    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="abf83758-f7de-4d34-98cb-4ba4acee9687" containerName="util"
Sep 18 22:06:05.586027 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:05.585795    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abf83758-f7de-4d34-98cb-4ba4acee9687" containerName="pull"
Sep 18 22:06:05.586027 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:05.585800    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="abf83758-f7de-4d34-98cb-4ba4acee9687" containerName="pull"
Sep 18 22:06:05.586027 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:05.585840    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="abf83758-f7de-4d34-98cb-4ba4acee9687" containerName="extract"
Sep 18 22:06:05.627909 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:05.627883    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j5kjj"]
Sep 18 22:06:05.628082 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:05.627969    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j5kjj"
Sep 18 22:06:05.631885 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:05.631863    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Sep 18 22:06:05.632025 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:05.631993    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-xqkk4\""
Sep 18 22:06:05.632823 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:05.632807    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Sep 18 22:06:05.717486 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:05.717455    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvtcg\" (UniqueName: \"kubernetes.io/projected/515952c8-c5ca-46f9-b31b-60da90e3fd4c-kube-api-access-rvtcg\") pod \"cert-manager-operator-controller-manager-55c444bf86-j5kjj\" (UID: \"515952c8-c5ca-46f9-b31b-60da90e3fd4c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j5kjj"
Sep 18 22:06:05.717612 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:05.717514    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/515952c8-c5ca-46f9-b31b-60da90e3fd4c-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-j5kjj\" (UID: \"515952c8-c5ca-46f9-b31b-60da90e3fd4c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j5kjj"
Sep 18 22:06:05.817914 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:05.817890    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvtcg\" (UniqueName: \"kubernetes.io/projected/515952c8-c5ca-46f9-b31b-60da90e3fd4c-kube-api-access-rvtcg\") pod \"cert-manager-operator-controller-manager-55c444bf86-j5kjj\" (UID: \"515952c8-c5ca-46f9-b31b-60da90e3fd4c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j5kjj"
Sep 18 22:06:05.818046 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:05.817951    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/515952c8-c5ca-46f9-b31b-60da90e3fd4c-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-j5kjj\" (UID: \"515952c8-c5ca-46f9-b31b-60da90e3fd4c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j5kjj"
Sep 18 22:06:05.818329 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:05.818312    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/515952c8-c5ca-46f9-b31b-60da90e3fd4c-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-j5kjj\" (UID: \"515952c8-c5ca-46f9-b31b-60da90e3fd4c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j5kjj"
Sep 18 22:06:05.836473 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:05.836401    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvtcg\" (UniqueName: \"kubernetes.io/projected/515952c8-c5ca-46f9-b31b-60da90e3fd4c-kube-api-access-rvtcg\") pod \"cert-manager-operator-controller-manager-55c444bf86-j5kjj\" (UID: \"515952c8-c5ca-46f9-b31b-60da90e3fd4c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j5kjj"
Sep 18 22:06:05.939661 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:05.939617    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j5kjj"
Sep 18 22:06:06.262551 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:06.262483    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j5kjj"]
Sep 18 22:06:06.266176 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:06:06.266155    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod515952c8_c5ca_46f9_b31b_60da90e3fd4c.slice/crio-c24e02f10320a2ee4b3f3125e363ae38af7c0b01a9881448bbeebcac675bf0d6 WatchSource:0}: Error finding container c24e02f10320a2ee4b3f3125e363ae38af7c0b01a9881448bbeebcac675bf0d6: Status 404 returned error can't find the container with id c24e02f10320a2ee4b3f3125e363ae38af7c0b01a9881448bbeebcac675bf0d6
Sep 18 22:06:06.576199 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:06.576166    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j5kjj" event={"ID":"515952c8-c5ca-46f9-b31b-60da90e3fd4c","Type":"ContainerStarted","Data":"c24e02f10320a2ee4b3f3125e363ae38af7c0b01a9881448bbeebcac675bf0d6"}
Sep 18 22:06:08.587102 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:08.587064    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j5kjj" event={"ID":"515952c8-c5ca-46f9-b31b-60da90e3fd4c","Type":"ContainerStarted","Data":"788c97345ada52a7ca91bf75c7d645e1e35b1901279d77be46aedbe70caf80b1"}
Sep 18 22:06:08.629963 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:08.629914    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j5kjj" podStartSLOduration=2.089529979 podStartE2EDuration="3.629897743s" totalImagesPullingTime="1.540367764s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:06:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:06:08.628451101 +0000 UTC m=+347.948123156" watchObservedRunningTime="2026-09-18 22:06:08.629897743 +0000 UTC m=+347.949569798"
Sep 18 22:06:09.286549 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:09.286515    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f445ms"]
Sep 18 22:06:09.288671 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:09.288649    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f445ms"
Sep 18 22:06:09.292568 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:09.292516    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 18 22:06:09.292778 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:09.292761    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 18 22:06:09.296629 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:09.296612    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6gs9k\""
Sep 18 22:06:09.310995 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:09.310970    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f445ms"]
Sep 18 22:06:09.345952 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:09.345925    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/397bf443-0790-44db-9d5e-b1de7783dd2c-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f445ms\" (UID: \"397bf443-0790-44db-9d5e-b1de7783dd2c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f445ms"
Sep 18 22:06:09.346057 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:09.345979    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kd2hx\" (UniqueName: \"kubernetes.io/projected/397bf443-0790-44db-9d5e-b1de7783dd2c-kube-api-access-kd2hx\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f445ms\" (UID: \"397bf443-0790-44db-9d5e-b1de7783dd2c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f445ms"
Sep 18 22:06:09.346057 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:09.346047    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/397bf443-0790-44db-9d5e-b1de7783dd2c-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f445ms\" (UID: \"397bf443-0790-44db-9d5e-b1de7783dd2c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f445ms"
Sep 18 22:06:09.447057 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:09.447022    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kd2hx\" (UniqueName: \"kubernetes.io/projected/397bf443-0790-44db-9d5e-b1de7783dd2c-kube-api-access-kd2hx\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f445ms\" (UID: \"397bf443-0790-44db-9d5e-b1de7783dd2c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f445ms"
Sep 18 22:06:09.447240 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:09.447070    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/397bf443-0790-44db-9d5e-b1de7783dd2c-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f445ms\" (UID: \"397bf443-0790-44db-9d5e-b1de7783dd2c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f445ms"
Sep 18 22:06:09.447240 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:09.447091    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/397bf443-0790-44db-9d5e-b1de7783dd2c-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f445ms\" (UID: \"397bf443-0790-44db-9d5e-b1de7783dd2c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f445ms"
Sep 18 22:06:09.447434 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:09.447386    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/397bf443-0790-44db-9d5e-b1de7783dd2c-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f445ms\" (UID: \"397bf443-0790-44db-9d5e-b1de7783dd2c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f445ms"
Sep 18 22:06:09.447499 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:09.447433    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/397bf443-0790-44db-9d5e-b1de7783dd2c-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f445ms\" (UID: \"397bf443-0790-44db-9d5e-b1de7783dd2c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f445ms"
Sep 18 22:06:09.463946 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:09.463921    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kd2hx\" (UniqueName: \"kubernetes.io/projected/397bf443-0790-44db-9d5e-b1de7783dd2c-kube-api-access-kd2hx\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f445ms\" (UID: \"397bf443-0790-44db-9d5e-b1de7783dd2c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f445ms"
Sep 18 22:06:09.597361 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:09.597307    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f445ms"
Sep 18 22:06:09.873213 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:09.873132    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f445ms"]
Sep 18 22:06:09.876085 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:06:09.876057    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod397bf443_0790_44db_9d5e_b1de7783dd2c.slice/crio-740812180a24e5ae8b0e5e2a4158cfa16048d01703a9921512e9f6f3fd832c17 WatchSource:0}: Error finding container 740812180a24e5ae8b0e5e2a4158cfa16048d01703a9921512e9f6f3fd832c17: Status 404 returned error can't find the container with id 740812180a24e5ae8b0e5e2a4158cfa16048d01703a9921512e9f6f3fd832c17
Sep 18 22:06:10.598059 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:10.598029    2577 generic.go:356] "Generic (PLEG): container finished" podID="397bf443-0790-44db-9d5e-b1de7783dd2c" containerID="3f974cfd9c46fa845a14a8628c9291865e8dc0527d1e4713af36f2a526e48b5c" exitCode=0
Sep 18 22:06:10.598466 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:10.598091    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f445ms" event={"ID":"397bf443-0790-44db-9d5e-b1de7783dd2c","Type":"ContainerDied","Data":"3f974cfd9c46fa845a14a8628c9291865e8dc0527d1e4713af36f2a526e48b5c"}
Sep 18 22:06:10.598466 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:10.598130    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f445ms" event={"ID":"397bf443-0790-44db-9d5e-b1de7783dd2c","Type":"ContainerStarted","Data":"740812180a24e5ae8b0e5e2a4158cfa16048d01703a9921512e9f6f3fd832c17"}
Sep 18 22:06:13.613599 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:13.613561    2577 generic.go:356] "Generic (PLEG): container finished" podID="397bf443-0790-44db-9d5e-b1de7783dd2c" containerID="6529ce87d9e8349a499791e6a0a1fb424d5d5d8b13e9d86360ba3dfdb421e586" exitCode=0
Sep 18 22:06:13.613599 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:13.613602    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f445ms" event={"ID":"397bf443-0790-44db-9d5e-b1de7783dd2c","Type":"ContainerDied","Data":"6529ce87d9e8349a499791e6a0a1fb424d5d5d8b13e9d86360ba3dfdb421e586"}
Sep 18 22:06:14.619180 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:14.619144    2577 generic.go:356] "Generic (PLEG): container finished" podID="397bf443-0790-44db-9d5e-b1de7783dd2c" containerID="d613db4ef14fab552d5b803316e621e9ed2a5c30cc8f5613898beac53cc550f5" exitCode=0
Sep 18 22:06:14.619646 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:14.619195    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f445ms" event={"ID":"397bf443-0790-44db-9d5e-b1de7783dd2c","Type":"ContainerDied","Data":"d613db4ef14fab552d5b803316e621e9ed2a5c30cc8f5613898beac53cc550f5"}
Sep 18 22:06:15.744606 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:15.744584    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f445ms"
Sep 18 22:06:15.800336 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:15.800310    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/397bf443-0790-44db-9d5e-b1de7783dd2c-bundle\") pod \"397bf443-0790-44db-9d5e-b1de7783dd2c\" (UID: \"397bf443-0790-44db-9d5e-b1de7783dd2c\") "
Sep 18 22:06:15.800498 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:15.800352    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kd2hx\" (UniqueName: \"kubernetes.io/projected/397bf443-0790-44db-9d5e-b1de7783dd2c-kube-api-access-kd2hx\") pod \"397bf443-0790-44db-9d5e-b1de7783dd2c\" (UID: \"397bf443-0790-44db-9d5e-b1de7783dd2c\") "
Sep 18 22:06:15.800498 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:15.800401    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/397bf443-0790-44db-9d5e-b1de7783dd2c-util\") pod \"397bf443-0790-44db-9d5e-b1de7783dd2c\" (UID: \"397bf443-0790-44db-9d5e-b1de7783dd2c\") "
Sep 18 22:06:15.800826 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:15.800781    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/397bf443-0790-44db-9d5e-b1de7783dd2c-bundle" (OuterVolumeSpecName: "bundle") pod "397bf443-0790-44db-9d5e-b1de7783dd2c" (UID: "397bf443-0790-44db-9d5e-b1de7783dd2c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:06:15.802704 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:15.802683    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/397bf443-0790-44db-9d5e-b1de7783dd2c-kube-api-access-kd2hx" (OuterVolumeSpecName: "kube-api-access-kd2hx") pod "397bf443-0790-44db-9d5e-b1de7783dd2c" (UID: "397bf443-0790-44db-9d5e-b1de7783dd2c"). InnerVolumeSpecName "kube-api-access-kd2hx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:06:15.805369 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:15.805347    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/397bf443-0790-44db-9d5e-b1de7783dd2c-util" (OuterVolumeSpecName: "util") pod "397bf443-0790-44db-9d5e-b1de7783dd2c" (UID: "397bf443-0790-44db-9d5e-b1de7783dd2c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:06:15.901450 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:15.901356    2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/397bf443-0790-44db-9d5e-b1de7783dd2c-util\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:06:15.901450 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:15.901388    2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/397bf443-0790-44db-9d5e-b1de7783dd2c-bundle\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:06:15.901450 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:15.901398    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kd2hx\" (UniqueName: \"kubernetes.io/projected/397bf443-0790-44db-9d5e-b1de7783dd2c-kube-api-access-kd2hx\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:06:16.628589 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:16.628556    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f445ms"
Sep 18 22:06:16.628758 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:16.628555    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f445ms" event={"ID":"397bf443-0790-44db-9d5e-b1de7783dd2c","Type":"ContainerDied","Data":"740812180a24e5ae8b0e5e2a4158cfa16048d01703a9921512e9f6f3fd832c17"}
Sep 18 22:06:16.628758 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:16.628678    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="740812180a24e5ae8b0e5e2a4158cfa16048d01703a9921512e9f6f3fd832c17"
Sep 18 22:06:20.309702 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:20.309666    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-pblqh"]
Sep 18 22:06:20.310117 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:20.309934    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="397bf443-0790-44db-9d5e-b1de7783dd2c" containerName="pull"
Sep 18 22:06:20.310117 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:20.309945    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="397bf443-0790-44db-9d5e-b1de7783dd2c" containerName="pull"
Sep 18 22:06:20.310117 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:20.309959    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="397bf443-0790-44db-9d5e-b1de7783dd2c" containerName="extract"
Sep 18 22:06:20.310117 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:20.309965    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="397bf443-0790-44db-9d5e-b1de7783dd2c" containerName="extract"
Sep 18 22:06:20.310117 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:20.309976    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="397bf443-0790-44db-9d5e-b1de7783dd2c" containerName="util"
Sep 18 22:06:20.310117 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:20.309981    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="397bf443-0790-44db-9d5e-b1de7783dd2c" containerName="util"
Sep 18 22:06:20.310117 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:20.310023    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="397bf443-0790-44db-9d5e-b1de7783dd2c" containerName="extract"
Sep 18 22:06:20.313497 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:20.313481    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-pblqh"
Sep 18 22:06:20.315824 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:20.315797    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 18 22:06:20.316546 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:20.316526    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 18 22:06:20.316672 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:20.316529    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-kn4nv\""
Sep 18 22:06:20.321162 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:20.321138    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-pblqh"]
Sep 18 22:06:20.434451 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:20.434401    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfmgg\" (UniqueName: \"kubernetes.io/projected/241b2b78-c7b6-4c34-abfd-2b8b98336d2c-kube-api-access-gfmgg\") pod \"cert-manager-55b4d954d5-pblqh\" (UID: \"241b2b78-c7b6-4c34-abfd-2b8b98336d2c\") " pod="cert-manager/cert-manager-55b4d954d5-pblqh"
Sep 18 22:06:20.434451 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:20.434455    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/241b2b78-c7b6-4c34-abfd-2b8b98336d2c-bound-sa-token\") pod \"cert-manager-55b4d954d5-pblqh\" (UID: \"241b2b78-c7b6-4c34-abfd-2b8b98336d2c\") " pod="cert-manager/cert-manager-55b4d954d5-pblqh"
Sep 18 22:06:20.535500 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:20.535456    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfmgg\" (UniqueName: \"kubernetes.io/projected/241b2b78-c7b6-4c34-abfd-2b8b98336d2c-kube-api-access-gfmgg\") pod \"cert-manager-55b4d954d5-pblqh\" (UID: \"241b2b78-c7b6-4c34-abfd-2b8b98336d2c\") " pod="cert-manager/cert-manager-55b4d954d5-pblqh"
Sep 18 22:06:20.535500 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:20.535503    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/241b2b78-c7b6-4c34-abfd-2b8b98336d2c-bound-sa-token\") pod \"cert-manager-55b4d954d5-pblqh\" (UID: \"241b2b78-c7b6-4c34-abfd-2b8b98336d2c\") " pod="cert-manager/cert-manager-55b4d954d5-pblqh"
Sep 18 22:06:20.543821 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:20.543789    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/241b2b78-c7b6-4c34-abfd-2b8b98336d2c-bound-sa-token\") pod \"cert-manager-55b4d954d5-pblqh\" (UID: \"241b2b78-c7b6-4c34-abfd-2b8b98336d2c\") " pod="cert-manager/cert-manager-55b4d954d5-pblqh"
Sep 18 22:06:20.544098 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:20.544082    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfmgg\" (UniqueName: \"kubernetes.io/projected/241b2b78-c7b6-4c34-abfd-2b8b98336d2c-kube-api-access-gfmgg\") pod \"cert-manager-55b4d954d5-pblqh\" (UID: \"241b2b78-c7b6-4c34-abfd-2b8b98336d2c\") " pod="cert-manager/cert-manager-55b4d954d5-pblqh"
Sep 18 22:06:20.622902 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:20.622826    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-pblqh"
Sep 18 22:06:20.894303 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:20.894266    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-pblqh"]
Sep 18 22:06:20.896471 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:06:20.896437    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod241b2b78_c7b6_4c34_abfd_2b8b98336d2c.slice/crio-f71f303a69d4510aaefd6640efcc7eee58abbe7ff70c1722eb9bb7c013482065 WatchSource:0}: Error finding container f71f303a69d4510aaefd6640efcc7eee58abbe7ff70c1722eb9bb7c013482065: Status 404 returned error can't find the container with id f71f303a69d4510aaefd6640efcc7eee58abbe7ff70c1722eb9bb7c013482065
Sep 18 22:06:21.651305 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:21.651262    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-pblqh" event={"ID":"241b2b78-c7b6-4c34-abfd-2b8b98336d2c","Type":"ContainerStarted","Data":"f71f303a69d4510aaefd6640efcc7eee58abbe7ff70c1722eb9bb7c013482065"}
Sep 18 22:06:23.662461 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:23.662328    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-pblqh" event={"ID":"241b2b78-c7b6-4c34-abfd-2b8b98336d2c","Type":"ContainerStarted","Data":"927be2c06a5f861420309b1cc1be9c0e36077edb0de44a8cb69d78a05ca08237"}
Sep 18 22:06:23.710845 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:23.710786    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-pblqh" podStartSLOduration=1.232742217 podStartE2EDuration="3.710769855s" totalImagesPullingTime="2.478027638s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:06:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:06:23.709370077 +0000 UTC m=+363.029042131" watchObservedRunningTime="2026-09-18 22:06:23.710769855 +0000 UTC m=+363.030441910"
Sep 18 22:06:27.194120 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:27.194090    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4bgdf"]
Sep 18 22:06:27.197483 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:27.197466    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4bgdf"
Sep 18 22:06:27.199837 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:27.199814    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 18 22:06:27.200465 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:27.200441    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6gs9k\""
Sep 18 22:06:27.200587 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:27.200494    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 18 22:06:27.208101 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:27.208078    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4bgdf"]
Sep 18 22:06:27.284358 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:27.284325    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sljp8\" (UniqueName: \"kubernetes.io/projected/89c9a2df-c7e4-4728-8113-75545c27a44f-kube-api-access-sljp8\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4bgdf\" (UID: \"89c9a2df-c7e4-4728-8113-75545c27a44f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4bgdf"
Sep 18 22:06:27.284525 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:27.284367    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/89c9a2df-c7e4-4728-8113-75545c27a44f-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4bgdf\" (UID: \"89c9a2df-c7e4-4728-8113-75545c27a44f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4bgdf"
Sep 18 22:06:27.284525 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:27.284472    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/89c9a2df-c7e4-4728-8113-75545c27a44f-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4bgdf\" (UID: \"89c9a2df-c7e4-4728-8113-75545c27a44f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4bgdf"
Sep 18 22:06:27.385291 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:27.385258    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/89c9a2df-c7e4-4728-8113-75545c27a44f-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4bgdf\" (UID: \"89c9a2df-c7e4-4728-8113-75545c27a44f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4bgdf"
Sep 18 22:06:27.385460 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:27.385299    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sljp8\" (UniqueName: \"kubernetes.io/projected/89c9a2df-c7e4-4728-8113-75545c27a44f-kube-api-access-sljp8\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4bgdf\" (UID: \"89c9a2df-c7e4-4728-8113-75545c27a44f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4bgdf"
Sep 18 22:06:27.385460 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:27.385324    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/89c9a2df-c7e4-4728-8113-75545c27a44f-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4bgdf\" (UID: \"89c9a2df-c7e4-4728-8113-75545c27a44f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4bgdf"
Sep 18 22:06:27.385645 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:27.385624    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/89c9a2df-c7e4-4728-8113-75545c27a44f-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4bgdf\" (UID: \"89c9a2df-c7e4-4728-8113-75545c27a44f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4bgdf"
Sep 18 22:06:27.385691 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:27.385646    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/89c9a2df-c7e4-4728-8113-75545c27a44f-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4bgdf\" (UID: \"89c9a2df-c7e4-4728-8113-75545c27a44f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4bgdf"
Sep 18 22:06:27.394571 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:27.394551    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sljp8\" (UniqueName: \"kubernetes.io/projected/89c9a2df-c7e4-4728-8113-75545c27a44f-kube-api-access-sljp8\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4bgdf\" (UID: \"89c9a2df-c7e4-4728-8113-75545c27a44f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4bgdf"
Sep 18 22:06:27.506605 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:27.506544    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4bgdf"
Sep 18 22:06:27.781624 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:27.781542    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4bgdf"]
Sep 18 22:06:27.784685 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:06:27.784658    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89c9a2df_c7e4_4728_8113_75545c27a44f.slice/crio-bdd4cf973208c56bc2e0c7861b445e413cda2b3a5b113ac4d4f9ef0f6171d30b WatchSource:0}: Error finding container bdd4cf973208c56bc2e0c7861b445e413cda2b3a5b113ac4d4f9ef0f6171d30b: Status 404 returned error can't find the container with id bdd4cf973208c56bc2e0c7861b445e413cda2b3a5b113ac4d4f9ef0f6171d30b
Sep 18 22:06:28.685353 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:28.685276    2577 generic.go:356] "Generic (PLEG): container finished" podID="89c9a2df-c7e4-4728-8113-75545c27a44f" containerID="73c7292eb0c138ca33769766eb803b69bc0b2da8a517478f1ef8a45162372daa" exitCode=0
Sep 18 22:06:28.685353 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:28.685312    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4bgdf" event={"ID":"89c9a2df-c7e4-4728-8113-75545c27a44f","Type":"ContainerDied","Data":"73c7292eb0c138ca33769766eb803b69bc0b2da8a517478f1ef8a45162372daa"}
Sep 18 22:06:28.685353 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:28.685347    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4bgdf" event={"ID":"89c9a2df-c7e4-4728-8113-75545c27a44f","Type":"ContainerStarted","Data":"bdd4cf973208c56bc2e0c7861b445e413cda2b3a5b113ac4d4f9ef0f6171d30b"}
Sep 18 22:06:30.694808 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:30.694773    2577 generic.go:356] "Generic (PLEG): container finished" podID="89c9a2df-c7e4-4728-8113-75545c27a44f" containerID="3b48ad3b8386cc302419a204031ef5716a17d98231634e8ebc8d915af6de0e65" exitCode=0
Sep 18 22:06:30.695251 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:30.694816    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4bgdf" event={"ID":"89c9a2df-c7e4-4728-8113-75545c27a44f","Type":"ContainerDied","Data":"3b48ad3b8386cc302419a204031ef5716a17d98231634e8ebc8d915af6de0e65"}
Sep 18 22:06:31.700866 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:31.700820    2577 generic.go:356] "Generic (PLEG): container finished" podID="89c9a2df-c7e4-4728-8113-75545c27a44f" containerID="4612e084621cebb23d0ab54f77a22fb3177683abed2b809ee19abdb1bc0ab7b7" exitCode=0
Sep 18 22:06:31.701318 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:31.700885    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4bgdf" event={"ID":"89c9a2df-c7e4-4728-8113-75545c27a44f","Type":"ContainerDied","Data":"4612e084621cebb23d0ab54f77a22fb3177683abed2b809ee19abdb1bc0ab7b7"}
Sep 18 22:06:32.830754 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:32.830728    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4bgdf"
Sep 18 22:06:32.927202 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:32.927177    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/89c9a2df-c7e4-4728-8113-75545c27a44f-bundle\") pod \"89c9a2df-c7e4-4728-8113-75545c27a44f\" (UID: \"89c9a2df-c7e4-4728-8113-75545c27a44f\") "
Sep 18 22:06:32.927364 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:32.927213    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/89c9a2df-c7e4-4728-8113-75545c27a44f-util\") pod \"89c9a2df-c7e4-4728-8113-75545c27a44f\" (UID: \"89c9a2df-c7e4-4728-8113-75545c27a44f\") "
Sep 18 22:06:32.927364 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:32.927305    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sljp8\" (UniqueName: \"kubernetes.io/projected/89c9a2df-c7e4-4728-8113-75545c27a44f-kube-api-access-sljp8\") pod \"89c9a2df-c7e4-4728-8113-75545c27a44f\" (UID: \"89c9a2df-c7e4-4728-8113-75545c27a44f\") "
Sep 18 22:06:32.928054 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:32.927978    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89c9a2df-c7e4-4728-8113-75545c27a44f-bundle" (OuterVolumeSpecName: "bundle") pod "89c9a2df-c7e4-4728-8113-75545c27a44f" (UID: "89c9a2df-c7e4-4728-8113-75545c27a44f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:06:32.929580 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:32.929553    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89c9a2df-c7e4-4728-8113-75545c27a44f-kube-api-access-sljp8" (OuterVolumeSpecName: "kube-api-access-sljp8") pod "89c9a2df-c7e4-4728-8113-75545c27a44f" (UID: "89c9a2df-c7e4-4728-8113-75545c27a44f"). InnerVolumeSpecName "kube-api-access-sljp8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:06:32.932564 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:32.932545    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89c9a2df-c7e4-4728-8113-75545c27a44f-util" (OuterVolumeSpecName: "util") pod "89c9a2df-c7e4-4728-8113-75545c27a44f" (UID: "89c9a2df-c7e4-4728-8113-75545c27a44f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:06:33.028479 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:33.028393    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sljp8\" (UniqueName: \"kubernetes.io/projected/89c9a2df-c7e4-4728-8113-75545c27a44f-kube-api-access-sljp8\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:06:33.028479 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:33.028437    2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/89c9a2df-c7e4-4728-8113-75545c27a44f-bundle\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:06:33.028479 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:33.028446    2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/89c9a2df-c7e4-4728-8113-75545c27a44f-util\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:06:33.710680 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:33.710654    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4bgdf"
Sep 18 22:06:33.710680 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:33.710664    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4bgdf" event={"ID":"89c9a2df-c7e4-4728-8113-75545c27a44f","Type":"ContainerDied","Data":"bdd4cf973208c56bc2e0c7861b445e413cda2b3a5b113ac4d4f9ef0f6171d30b"}
Sep 18 22:06:33.710928 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:33.710704    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bdd4cf973208c56bc2e0c7861b445e413cda2b3a5b113ac4d4f9ef0f6171d30b"
Sep 18 22:06:37.965744 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:37.965707    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09frdh"]
Sep 18 22:06:37.966126 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:37.965962    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89c9a2df-c7e4-4728-8113-75545c27a44f" containerName="util"
Sep 18 22:06:37.966126 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:37.965972    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="89c9a2df-c7e4-4728-8113-75545c27a44f" containerName="util"
Sep 18 22:06:37.966126 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:37.965985    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89c9a2df-c7e4-4728-8113-75545c27a44f" containerName="pull"
Sep 18 22:06:37.966126 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:37.965991    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="89c9a2df-c7e4-4728-8113-75545c27a44f" containerName="pull"
Sep 18 22:06:37.966126 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:37.965996    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89c9a2df-c7e4-4728-8113-75545c27a44f" containerName="extract"
Sep 18 22:06:37.966126 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:37.966001    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="89c9a2df-c7e4-4728-8113-75545c27a44f" containerName="extract"
Sep 18 22:06:37.966126 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:37.966054    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="89c9a2df-c7e4-4728-8113-75545c27a44f" containerName="extract"
Sep 18 22:06:37.969233 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:37.969217    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09frdh"
Sep 18 22:06:37.976116 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:37.976096    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6gs9k\""
Sep 18 22:06:37.976212 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:37.976173    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 18 22:06:37.977620 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:37.977608    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 18 22:06:37.993044 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:37.993022    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09frdh"]
Sep 18 22:06:38.062398 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:38.062367    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7884f0db-8000-4d1f-9f12-7670b72e45bd-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09frdh\" (UID: \"7884f0db-8000-4d1f-9f12-7670b72e45bd\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09frdh"
Sep 18 22:06:38.062398 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:38.062399    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7884f0db-8000-4d1f-9f12-7670b72e45bd-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09frdh\" (UID: \"7884f0db-8000-4d1f-9f12-7670b72e45bd\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09frdh"
Sep 18 22:06:38.062580 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:38.062507    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2npwd\" (UniqueName: \"kubernetes.io/projected/7884f0db-8000-4d1f-9f12-7670b72e45bd-kube-api-access-2npwd\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09frdh\" (UID: \"7884f0db-8000-4d1f-9f12-7670b72e45bd\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09frdh"
Sep 18 22:06:38.163374 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:38.163345    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7884f0db-8000-4d1f-9f12-7670b72e45bd-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09frdh\" (UID: \"7884f0db-8000-4d1f-9f12-7670b72e45bd\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09frdh"
Sep 18 22:06:38.163374 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:38.163373    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7884f0db-8000-4d1f-9f12-7670b72e45bd-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09frdh\" (UID: \"7884f0db-8000-4d1f-9f12-7670b72e45bd\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09frdh"
Sep 18 22:06:38.163596 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:38.163453    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2npwd\" (UniqueName: \"kubernetes.io/projected/7884f0db-8000-4d1f-9f12-7670b72e45bd-kube-api-access-2npwd\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09frdh\" (UID: \"7884f0db-8000-4d1f-9f12-7670b72e45bd\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09frdh"
Sep 18 22:06:38.163721 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:38.163702    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7884f0db-8000-4d1f-9f12-7670b72e45bd-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09frdh\" (UID: \"7884f0db-8000-4d1f-9f12-7670b72e45bd\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09frdh"
Sep 18 22:06:38.163792 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:38.163777    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7884f0db-8000-4d1f-9f12-7670b72e45bd-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09frdh\" (UID: \"7884f0db-8000-4d1f-9f12-7670b72e45bd\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09frdh"
Sep 18 22:06:38.177170 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:38.177144    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2npwd\" (UniqueName: \"kubernetes.io/projected/7884f0db-8000-4d1f-9f12-7670b72e45bd-kube-api-access-2npwd\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09frdh\" (UID: \"7884f0db-8000-4d1f-9f12-7670b72e45bd\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09frdh"
Sep 18 22:06:38.277500 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:38.277441    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09frdh"
Sep 18 22:06:38.606336 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:06:38.606306    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7884f0db_8000_4d1f_9f12_7670b72e45bd.slice/crio-82d81a771fd03e8b155f77f4a8fd5366211d493fbc26c867fa28a6c874ac7009 WatchSource:0}: Error finding container 82d81a771fd03e8b155f77f4a8fd5366211d493fbc26c867fa28a6c874ac7009: Status 404 returned error can't find the container with id 82d81a771fd03e8b155f77f4a8fd5366211d493fbc26c867fa28a6c874ac7009
Sep 18 22:06:38.620698 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:38.620676    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09frdh"]
Sep 18 22:06:38.732649 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:38.732622    2577 generic.go:356] "Generic (PLEG): container finished" podID="7884f0db-8000-4d1f-9f12-7670b72e45bd" containerID="3f84d5d5c63892bdcd6c540a504927e7df4fd2a48c9a9b6d666bb9611ded7ba1" exitCode=0
Sep 18 22:06:38.732792 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:38.732683    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09frdh" event={"ID":"7884f0db-8000-4d1f-9f12-7670b72e45bd","Type":"ContainerDied","Data":"3f84d5d5c63892bdcd6c540a504927e7df4fd2a48c9a9b6d666bb9611ded7ba1"}
Sep 18 22:06:38.732792 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:38.732750    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09frdh" event={"ID":"7884f0db-8000-4d1f-9f12-7670b72e45bd","Type":"ContainerStarted","Data":"82d81a771fd03e8b155f77f4a8fd5366211d493fbc26c867fa28a6c874ac7009"}
Sep 18 22:06:39.738985 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:39.738952    2577 generic.go:356] "Generic (PLEG): container finished" podID="7884f0db-8000-4d1f-9f12-7670b72e45bd" containerID="64152c6d8a99e776ecfe25a0a9757277778365fef64108adbe15ecd039cbcd77" exitCode=0
Sep 18 22:06:39.739462 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:39.739040    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09frdh" event={"ID":"7884f0db-8000-4d1f-9f12-7670b72e45bd","Type":"ContainerDied","Data":"64152c6d8a99e776ecfe25a0a9757277778365fef64108adbe15ecd039cbcd77"}
Sep 18 22:06:40.203622 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:40.203594    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79cf4c6fc4-trjj6"]
Sep 18 22:06:40.207505 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:40.207481    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-79cf4c6fc4-trjj6"
Sep 18 22:06:40.211467 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:40.211442    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 18 22:06:40.211609 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:40.211588    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 18 22:06:40.212003 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:40.211985    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 18 22:06:40.212096 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:40.211985    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 18 22:06:40.212156 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:40.212122    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-lkk4s\""
Sep 18 22:06:40.232061 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:40.232029    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79cf4c6fc4-trjj6"]
Sep 18 22:06:40.283190 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:40.283164    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3c45757c-4a4e-49a1-94dd-3a0ba4e0458a-webhook-cert\") pod \"opendatahub-operator-controller-manager-79cf4c6fc4-trjj6\" (UID: \"3c45757c-4a4e-49a1-94dd-3a0ba4e0458a\") " pod="opendatahub/opendatahub-operator-controller-manager-79cf4c6fc4-trjj6"
Sep 18 22:06:40.283350 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:40.283217    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3c45757c-4a4e-49a1-94dd-3a0ba4e0458a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79cf4c6fc4-trjj6\" (UID: \"3c45757c-4a4e-49a1-94dd-3a0ba4e0458a\") " pod="opendatahub/opendatahub-operator-controller-manager-79cf4c6fc4-trjj6"
Sep 18 22:06:40.283350 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:40.283245    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3c45757c-4a4e-49a1-94dd-3a0ba4e0458a-manifests\") pod \"opendatahub-operator-controller-manager-79cf4c6fc4-trjj6\" (UID: \"3c45757c-4a4e-49a1-94dd-3a0ba4e0458a\") " pod="opendatahub/opendatahub-operator-controller-manager-79cf4c6fc4-trjj6"
Sep 18 22:06:40.283350 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:40.283271    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6x4x\" (UniqueName: \"kubernetes.io/projected/3c45757c-4a4e-49a1-94dd-3a0ba4e0458a-kube-api-access-r6x4x\") pod \"opendatahub-operator-controller-manager-79cf4c6fc4-trjj6\" (UID: \"3c45757c-4a4e-49a1-94dd-3a0ba4e0458a\") " pod="opendatahub/opendatahub-operator-controller-manager-79cf4c6fc4-trjj6"
Sep 18 22:06:40.283350 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:40.283341    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3c45757c-4a4e-49a1-94dd-3a0ba4e0458a-tmp\") pod \"opendatahub-operator-controller-manager-79cf4c6fc4-trjj6\" (UID: \"3c45757c-4a4e-49a1-94dd-3a0ba4e0458a\") " pod="opendatahub/opendatahub-operator-controller-manager-79cf4c6fc4-trjj6"
Sep 18 22:06:40.383755 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:40.383724    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3c45757c-4a4e-49a1-94dd-3a0ba4e0458a-webhook-cert\") pod \"opendatahub-operator-controller-manager-79cf4c6fc4-trjj6\" (UID: \"3c45757c-4a4e-49a1-94dd-3a0ba4e0458a\") " pod="opendatahub/opendatahub-operator-controller-manager-79cf4c6fc4-trjj6"
Sep 18 22:06:40.383938 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:40.383767    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3c45757c-4a4e-49a1-94dd-3a0ba4e0458a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79cf4c6fc4-trjj6\" (UID: \"3c45757c-4a4e-49a1-94dd-3a0ba4e0458a\") " pod="opendatahub/opendatahub-operator-controller-manager-79cf4c6fc4-trjj6"
Sep 18 22:06:40.383938 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:40.383788    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3c45757c-4a4e-49a1-94dd-3a0ba4e0458a-manifests\") pod \"opendatahub-operator-controller-manager-79cf4c6fc4-trjj6\" (UID: \"3c45757c-4a4e-49a1-94dd-3a0ba4e0458a\") " pod="opendatahub/opendatahub-operator-controller-manager-79cf4c6fc4-trjj6"
Sep 18 22:06:40.383938 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:40.383811    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6x4x\" (UniqueName: \"kubernetes.io/projected/3c45757c-4a4e-49a1-94dd-3a0ba4e0458a-kube-api-access-r6x4x\") pod \"opendatahub-operator-controller-manager-79cf4c6fc4-trjj6\" (UID: \"3c45757c-4a4e-49a1-94dd-3a0ba4e0458a\") " pod="opendatahub/opendatahub-operator-controller-manager-79cf4c6fc4-trjj6"
Sep 18 22:06:40.383938 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:40.383862    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3c45757c-4a4e-49a1-94dd-3a0ba4e0458a-tmp\") pod \"opendatahub-operator-controller-manager-79cf4c6fc4-trjj6\" (UID: \"3c45757c-4a4e-49a1-94dd-3a0ba4e0458a\") " pod="opendatahub/opendatahub-operator-controller-manager-79cf4c6fc4-trjj6"
Sep 18 22:06:40.384203 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:40.384181    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3c45757c-4a4e-49a1-94dd-3a0ba4e0458a-manifests\") pod \"opendatahub-operator-controller-manager-79cf4c6fc4-trjj6\" (UID: \"3c45757c-4a4e-49a1-94dd-3a0ba4e0458a\") " pod="opendatahub/opendatahub-operator-controller-manager-79cf4c6fc4-trjj6"
Sep 18 22:06:40.386295 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:40.386267    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3c45757c-4a4e-49a1-94dd-3a0ba4e0458a-tmp\") pod \"opendatahub-operator-controller-manager-79cf4c6fc4-trjj6\" (UID: \"3c45757c-4a4e-49a1-94dd-3a0ba4e0458a\") " pod="opendatahub/opendatahub-operator-controller-manager-79cf4c6fc4-trjj6"
Sep 18 22:06:40.386445 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:40.386313    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3c45757c-4a4e-49a1-94dd-3a0ba4e0458a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79cf4c6fc4-trjj6\" (UID: \"3c45757c-4a4e-49a1-94dd-3a0ba4e0458a\") " pod="opendatahub/opendatahub-operator-controller-manager-79cf4c6fc4-trjj6"
Sep 18 22:06:40.386546 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:40.386529    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3c45757c-4a4e-49a1-94dd-3a0ba4e0458a-webhook-cert\") pod \"opendatahub-operator-controller-manager-79cf4c6fc4-trjj6\" (UID: \"3c45757c-4a4e-49a1-94dd-3a0ba4e0458a\") " pod="opendatahub/opendatahub-operator-controller-manager-79cf4c6fc4-trjj6"
Sep 18 22:06:40.393752 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:40.393729    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6x4x\" (UniqueName: \"kubernetes.io/projected/3c45757c-4a4e-49a1-94dd-3a0ba4e0458a-kube-api-access-r6x4x\") pod \"opendatahub-operator-controller-manager-79cf4c6fc4-trjj6\" (UID: \"3c45757c-4a4e-49a1-94dd-3a0ba4e0458a\") " pod="opendatahub/opendatahub-operator-controller-manager-79cf4c6fc4-trjj6"
Sep 18 22:06:40.518220 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:40.518131    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-79cf4c6fc4-trjj6"
Sep 18 22:06:40.749941 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:40.749899    2577 generic.go:356] "Generic (PLEG): container finished" podID="7884f0db-8000-4d1f-9f12-7670b72e45bd" containerID="f09c3d3008fe3f9cc8cec4e6b0a4ce91a8389489a98c7ac8875f6e3096c35ee3" exitCode=0
Sep 18 22:06:40.750304 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:40.749964    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09frdh" event={"ID":"7884f0db-8000-4d1f-9f12-7670b72e45bd","Type":"ContainerDied","Data":"f09c3d3008fe3f9cc8cec4e6b0a4ce91a8389489a98c7ac8875f6e3096c35ee3"}
Sep 18 22:06:40.823673 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:40.823643    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79cf4c6fc4-trjj6"]
Sep 18 22:06:40.828807 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:06:40.828782    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c45757c_4a4e_49a1_94dd_3a0ba4e0458a.slice/crio-02afe198ede366ec07bec9f2e40114be652ef88ab4efd00fc53eeb1540e26f76 WatchSource:0}: Error finding container 02afe198ede366ec07bec9f2e40114be652ef88ab4efd00fc53eeb1540e26f76: Status 404 returned error can't find the container with id 02afe198ede366ec07bec9f2e40114be652ef88ab4efd00fc53eeb1540e26f76
Sep 18 22:06:41.757650 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:41.757570    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79cf4c6fc4-trjj6" event={"ID":"3c45757c-4a4e-49a1-94dd-3a0ba4e0458a","Type":"ContainerStarted","Data":"02afe198ede366ec07bec9f2e40114be652ef88ab4efd00fc53eeb1540e26f76"}
Sep 18 22:06:41.901117 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:41.901086    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09frdh"
Sep 18 22:06:41.998548 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:41.998521    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2npwd\" (UniqueName: \"kubernetes.io/projected/7884f0db-8000-4d1f-9f12-7670b72e45bd-kube-api-access-2npwd\") pod \"7884f0db-8000-4d1f-9f12-7670b72e45bd\" (UID: \"7884f0db-8000-4d1f-9f12-7670b72e45bd\") "
Sep 18 22:06:41.998771 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:41.998750    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7884f0db-8000-4d1f-9f12-7670b72e45bd-util\") pod \"7884f0db-8000-4d1f-9f12-7670b72e45bd\" (UID: \"7884f0db-8000-4d1f-9f12-7670b72e45bd\") "
Sep 18 22:06:41.998846 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:41.998787    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7884f0db-8000-4d1f-9f12-7670b72e45bd-bundle\") pod \"7884f0db-8000-4d1f-9f12-7670b72e45bd\" (UID: \"7884f0db-8000-4d1f-9f12-7670b72e45bd\") "
Sep 18 22:06:41.999894 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:41.999807    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7884f0db-8000-4d1f-9f12-7670b72e45bd-bundle" (OuterVolumeSpecName: "bundle") pod "7884f0db-8000-4d1f-9f12-7670b72e45bd" (UID: "7884f0db-8000-4d1f-9f12-7670b72e45bd"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:06:42.004574 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:42.004533    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7884f0db-8000-4d1f-9f12-7670b72e45bd-kube-api-access-2npwd" (OuterVolumeSpecName: "kube-api-access-2npwd") pod "7884f0db-8000-4d1f-9f12-7670b72e45bd" (UID: "7884f0db-8000-4d1f-9f12-7670b72e45bd"). InnerVolumeSpecName "kube-api-access-2npwd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:06:42.010396 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:42.010328    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7884f0db-8000-4d1f-9f12-7670b72e45bd-util" (OuterVolumeSpecName: "util") pod "7884f0db-8000-4d1f-9f12-7670b72e45bd" (UID: "7884f0db-8000-4d1f-9f12-7670b72e45bd"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:06:42.100433 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:42.100381    2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7884f0db-8000-4d1f-9f12-7670b72e45bd-util\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:06:42.100433 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:42.100430    2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7884f0db-8000-4d1f-9f12-7670b72e45bd-bundle\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:06:42.100649 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:42.100445    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2npwd\" (UniqueName: \"kubernetes.io/projected/7884f0db-8000-4d1f-9f12-7670b72e45bd-kube-api-access-2npwd\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:06:42.764073 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:42.764032    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09frdh" event={"ID":"7884f0db-8000-4d1f-9f12-7670b72e45bd","Type":"ContainerDied","Data":"82d81a771fd03e8b155f77f4a8fd5366211d493fbc26c867fa28a6c874ac7009"}
Sep 18 22:06:42.764490 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:42.764096    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="82d81a771fd03e8b155f77f4a8fd5366211d493fbc26c867fa28a6c874ac7009"
Sep 18 22:06:42.764490 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:42.764043    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09frdh"
Sep 18 22:06:44.775728 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:44.775692    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79cf4c6fc4-trjj6" event={"ID":"3c45757c-4a4e-49a1-94dd-3a0ba4e0458a","Type":"ContainerStarted","Data":"94486ac813a15991f21b1bc889e972b8741591761914d5399b0ef0c95caf1783"}
Sep 18 22:06:45.782176 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:45.782136    2577 generic.go:356] "Generic (PLEG): container finished" podID="3c45757c-4a4e-49a1-94dd-3a0ba4e0458a" containerID="94486ac813a15991f21b1bc889e972b8741591761914d5399b0ef0c95caf1783" exitCode=0
Sep 18 22:06:45.782636 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:45.782224    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79cf4c6fc4-trjj6" event={"ID":"3c45757c-4a4e-49a1-94dd-3a0ba4e0458a","Type":"ContainerDied","Data":"94486ac813a15991f21b1bc889e972b8741591761914d5399b0ef0c95caf1783"}
Sep 18 22:06:46.789791 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:46.789756    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79cf4c6fc4-trjj6" event={"ID":"3c45757c-4a4e-49a1-94dd-3a0ba4e0458a","Type":"ContainerStarted","Data":"594b8ff86be3d27ad19d1d75b7e87bbf18019fc2d4412188ec3cb36f805be3c5"}
Sep 18 22:06:46.790272 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:46.789851    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-79cf4c6fc4-trjj6"
Sep 18 22:06:46.810464 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:46.810393    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-79cf4c6fc4-trjj6" podStartSLOduration=2.300933198 podStartE2EDuration="6.810375265s" totalImagesPullingTime="3.418915534s" totalInitContainerRuntime="1.090526533s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:06:40 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:06:46.80906157 +0000 UTC m=+386.128733629" watchObservedRunningTime="2026-09-18 22:06:46.810375265 +0000 UTC m=+386.130047320"
Sep 18 22:06:55.228518 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:55.228482    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-59977c9f9d-89dwm"]
Sep 18 22:06:55.229066 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:55.228757    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7884f0db-8000-4d1f-9f12-7670b72e45bd" containerName="pull"
Sep 18 22:06:55.229066 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:55.228767    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="7884f0db-8000-4d1f-9f12-7670b72e45bd" containerName="pull"
Sep 18 22:06:55.229066 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:55.228780    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7884f0db-8000-4d1f-9f12-7670b72e45bd" containerName="util"
Sep 18 22:06:55.229066 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:55.228786    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="7884f0db-8000-4d1f-9f12-7670b72e45bd" containerName="util"
Sep 18 22:06:55.229066 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:55.228799    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7884f0db-8000-4d1f-9f12-7670b72e45bd" containerName="extract"
Sep 18 22:06:55.229066 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:55.228804    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="7884f0db-8000-4d1f-9f12-7670b72e45bd" containerName="extract"
Sep 18 22:06:55.229066 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:55.228846    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="7884f0db-8000-4d1f-9f12-7670b72e45bd" containerName="extract"
Sep 18 22:06:55.236872 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:55.236843    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59977c9f9d-89dwm"
Sep 18 22:06:55.241762 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:55.241735    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 18 22:06:55.242638 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:55.242617    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 18 22:06:55.242746 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:55.242687    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 18 22:06:55.242746 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:55.242619    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 18 22:06:55.242851 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:55.242752    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-x59bp\""
Sep 18 22:06:55.243867 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:55.243461    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 18 22:06:55.243867 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:55.243566    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 18 22:06:55.244069 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:55.244047    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 18 22:06:55.247626 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:55.247603    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 18 22:06:55.250206 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:55.250187    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59977c9f9d-89dwm"]
Sep 18 22:06:55.316453 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:55.316406    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzxm8\" (UniqueName: \"kubernetes.io/projected/4d95f81d-d3a8-48dc-a63d-7e171c697ab5-kube-api-access-jzxm8\") pod \"console-59977c9f9d-89dwm\" (UID: \"4d95f81d-d3a8-48dc-a63d-7e171c697ab5\") " pod="openshift-console/console-59977c9f9d-89dwm"
Sep 18 22:06:55.316591 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:55.316461    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d95f81d-d3a8-48dc-a63d-7e171c697ab5-trusted-ca-bundle\") pod \"console-59977c9f9d-89dwm\" (UID: \"4d95f81d-d3a8-48dc-a63d-7e171c697ab5\") " pod="openshift-console/console-59977c9f9d-89dwm"
Sep 18 22:06:55.316591 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:55.316483    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4d95f81d-d3a8-48dc-a63d-7e171c697ab5-console-oauth-config\") pod \"console-59977c9f9d-89dwm\" (UID: \"4d95f81d-d3a8-48dc-a63d-7e171c697ab5\") " pod="openshift-console/console-59977c9f9d-89dwm"
Sep 18 22:06:55.316591 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:55.316524    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4d95f81d-d3a8-48dc-a63d-7e171c697ab5-console-config\") pod \"console-59977c9f9d-89dwm\" (UID: \"4d95f81d-d3a8-48dc-a63d-7e171c697ab5\") " pod="openshift-console/console-59977c9f9d-89dwm"
Sep 18 22:06:55.316591 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:55.316566    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4d95f81d-d3a8-48dc-a63d-7e171c697ab5-console-serving-cert\") pod \"console-59977c9f9d-89dwm\" (UID: \"4d95f81d-d3a8-48dc-a63d-7e171c697ab5\") " pod="openshift-console/console-59977c9f9d-89dwm"
Sep 18 22:06:55.316591 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:55.316586    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4d95f81d-d3a8-48dc-a63d-7e171c697ab5-service-ca\") pod \"console-59977c9f9d-89dwm\" (UID: \"4d95f81d-d3a8-48dc-a63d-7e171c697ab5\") " pod="openshift-console/console-59977c9f9d-89dwm"
Sep 18 22:06:55.316750 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:55.316631    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4d95f81d-d3a8-48dc-a63d-7e171c697ab5-oauth-serving-cert\") pod \"console-59977c9f9d-89dwm\" (UID: \"4d95f81d-d3a8-48dc-a63d-7e171c697ab5\") " pod="openshift-console/console-59977c9f9d-89dwm"
Sep 18 22:06:55.417700 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:55.417669    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4d95f81d-d3a8-48dc-a63d-7e171c697ab5-oauth-serving-cert\") pod \"console-59977c9f9d-89dwm\" (UID: \"4d95f81d-d3a8-48dc-a63d-7e171c697ab5\") " pod="openshift-console/console-59977c9f9d-89dwm"
Sep 18 22:06:55.417837 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:55.417705    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzxm8\" (UniqueName: \"kubernetes.io/projected/4d95f81d-d3a8-48dc-a63d-7e171c697ab5-kube-api-access-jzxm8\") pod \"console-59977c9f9d-89dwm\" (UID: \"4d95f81d-d3a8-48dc-a63d-7e171c697ab5\") " pod="openshift-console/console-59977c9f9d-89dwm"
Sep 18 22:06:55.417837 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:55.417732    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d95f81d-d3a8-48dc-a63d-7e171c697ab5-trusted-ca-bundle\") pod \"console-59977c9f9d-89dwm\" (UID: \"4d95f81d-d3a8-48dc-a63d-7e171c697ab5\") " pod="openshift-console/console-59977c9f9d-89dwm"
Sep 18 22:06:55.417837 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:55.417765    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4d95f81d-d3a8-48dc-a63d-7e171c697ab5-console-oauth-config\") pod \"console-59977c9f9d-89dwm\" (UID: \"4d95f81d-d3a8-48dc-a63d-7e171c697ab5\") " pod="openshift-console/console-59977c9f9d-89dwm"
Sep 18 22:06:55.417961 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:55.417937    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4d95f81d-d3a8-48dc-a63d-7e171c697ab5-console-config\") pod \"console-59977c9f9d-89dwm\" (UID: \"4d95f81d-d3a8-48dc-a63d-7e171c697ab5\") " pod="openshift-console/console-59977c9f9d-89dwm"
Sep 18 22:06:55.418005 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:55.417993    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4d95f81d-d3a8-48dc-a63d-7e171c697ab5-console-serving-cert\") pod \"console-59977c9f9d-89dwm\" (UID: \"4d95f81d-d3a8-48dc-a63d-7e171c697ab5\") " pod="openshift-console/console-59977c9f9d-89dwm"
Sep 18 22:06:55.418044 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:55.418022    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4d95f81d-d3a8-48dc-a63d-7e171c697ab5-service-ca\") pod \"console-59977c9f9d-89dwm\" (UID: \"4d95f81d-d3a8-48dc-a63d-7e171c697ab5\") " pod="openshift-console/console-59977c9f9d-89dwm"
Sep 18 22:06:55.418675 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:55.418652    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4d95f81d-d3a8-48dc-a63d-7e171c697ab5-console-config\") pod \"console-59977c9f9d-89dwm\" (UID: \"4d95f81d-d3a8-48dc-a63d-7e171c697ab5\") " pod="openshift-console/console-59977c9f9d-89dwm"
Sep 18 22:06:55.418769 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:55.418616    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4d95f81d-d3a8-48dc-a63d-7e171c697ab5-oauth-serving-cert\") pod \"console-59977c9f9d-89dwm\" (UID: \"4d95f81d-d3a8-48dc-a63d-7e171c697ab5\") " pod="openshift-console/console-59977c9f9d-89dwm"
Sep 18 22:06:55.418769 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:55.418688    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4d95f81d-d3a8-48dc-a63d-7e171c697ab5-service-ca\") pod \"console-59977c9f9d-89dwm\" (UID: \"4d95f81d-d3a8-48dc-a63d-7e171c697ab5\") " pod="openshift-console/console-59977c9f9d-89dwm"
Sep 18 22:06:55.418769 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:55.418700    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d95f81d-d3a8-48dc-a63d-7e171c697ab5-trusted-ca-bundle\") pod \"console-59977c9f9d-89dwm\" (UID: \"4d95f81d-d3a8-48dc-a63d-7e171c697ab5\") " pod="openshift-console/console-59977c9f9d-89dwm"
Sep 18 22:06:55.420370 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:55.420344    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4d95f81d-d3a8-48dc-a63d-7e171c697ab5-console-oauth-config\") pod \"console-59977c9f9d-89dwm\" (UID: \"4d95f81d-d3a8-48dc-a63d-7e171c697ab5\") " pod="openshift-console/console-59977c9f9d-89dwm"
Sep 18 22:06:55.420600 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:55.420579    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4d95f81d-d3a8-48dc-a63d-7e171c697ab5-console-serving-cert\") pod \"console-59977c9f9d-89dwm\" (UID: \"4d95f81d-d3a8-48dc-a63d-7e171c697ab5\") " pod="openshift-console/console-59977c9f9d-89dwm"
Sep 18 22:06:55.426749 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:55.426722    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzxm8\" (UniqueName: \"kubernetes.io/projected/4d95f81d-d3a8-48dc-a63d-7e171c697ab5-kube-api-access-jzxm8\") pod \"console-59977c9f9d-89dwm\" (UID: \"4d95f81d-d3a8-48dc-a63d-7e171c697ab5\") " pod="openshift-console/console-59977c9f9d-89dwm"
Sep 18 22:06:55.546818 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:55.546738    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59977c9f9d-89dwm"
Sep 18 22:06:55.821492 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:55.821467    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59977c9f9d-89dwm"]
Sep 18 22:06:55.823659 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:06:55.823634    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d95f81d_d3a8_48dc_a63d_7e171c697ab5.slice/crio-ebead123066fe071139cfdae0d4f2b8ad753d1f385425b7ada9ceda2ea06438d WatchSource:0}: Error finding container ebead123066fe071139cfdae0d4f2b8ad753d1f385425b7ada9ceda2ea06438d: Status 404 returned error can't find the container with id ebead123066fe071139cfdae0d4f2b8ad753d1f385425b7ada9ceda2ea06438d
Sep 18 22:06:55.829734 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:55.829710    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59977c9f9d-89dwm" event={"ID":"4d95f81d-d3a8-48dc-a63d-7e171c697ab5","Type":"ContainerStarted","Data":"ebead123066fe071139cfdae0d4f2b8ad753d1f385425b7ada9ceda2ea06438d"}
Sep 18 22:06:56.840198 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:56.840161    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59977c9f9d-89dwm" event={"ID":"4d95f81d-d3a8-48dc-a63d-7e171c697ab5","Type":"ContainerStarted","Data":"077041c0ab210c2fa15233d1018f90ef1272faf7e5ad68f222a0a1c0d672e4e1"}
Sep 18 22:06:56.859018 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:56.858969    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-59977c9f9d-89dwm" podStartSLOduration=1.858954829 podStartE2EDuration="1.858954829s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:06:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:06:56.857600747 +0000 UTC m=+396.177272801" watchObservedRunningTime="2026-09-18 22:06:56.858954829 +0000 UTC m=+396.178626885"
Sep 18 22:06:57.796970 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:06:57.796933    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-79cf4c6fc4-trjj6"
Sep 18 22:07:00.035214 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:00.035177    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-666584dbdf-c64gg"]
Sep 18 22:07:00.037665 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:00.037644    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-666584dbdf-c64gg"
Sep 18 22:07:00.040685 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:00.040661    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 18 22:07:00.040805 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:00.040688    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 18 22:07:00.040805 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:00.040730    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 18 22:07:00.040805 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:00.040749    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 18 22:07:00.040805 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:00.040747    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-l7zbn\""
Sep 18 22:07:00.053494 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:00.053471    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-666584dbdf-c64gg"]
Sep 18 22:07:00.158700 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:00.158663    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ff79945-92fa-408c-a29a-2fc8108000fd-tls-certs\") pod \"kube-auth-proxy-666584dbdf-c64gg\" (UID: \"9ff79945-92fa-408c-a29a-2fc8108000fd\") " pod="openshift-ingress/kube-auth-proxy-666584dbdf-c64gg"
Sep 18 22:07:00.158890 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:00.158743    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9ff79945-92fa-408c-a29a-2fc8108000fd-tmp\") pod \"kube-auth-proxy-666584dbdf-c64gg\" (UID: \"9ff79945-92fa-408c-a29a-2fc8108000fd\") " pod="openshift-ingress/kube-auth-proxy-666584dbdf-c64gg"
Sep 18 22:07:00.158890 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:00.158773    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kznq\" (UniqueName: \"kubernetes.io/projected/9ff79945-92fa-408c-a29a-2fc8108000fd-kube-api-access-7kznq\") pod \"kube-auth-proxy-666584dbdf-c64gg\" (UID: \"9ff79945-92fa-408c-a29a-2fc8108000fd\") " pod="openshift-ingress/kube-auth-proxy-666584dbdf-c64gg"
Sep 18 22:07:00.260030 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:00.259996    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9ff79945-92fa-408c-a29a-2fc8108000fd-tmp\") pod \"kube-auth-proxy-666584dbdf-c64gg\" (UID: \"9ff79945-92fa-408c-a29a-2fc8108000fd\") " pod="openshift-ingress/kube-auth-proxy-666584dbdf-c64gg"
Sep 18 22:07:00.260030 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:00.260031    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kznq\" (UniqueName: \"kubernetes.io/projected/9ff79945-92fa-408c-a29a-2fc8108000fd-kube-api-access-7kznq\") pod \"kube-auth-proxy-666584dbdf-c64gg\" (UID: \"9ff79945-92fa-408c-a29a-2fc8108000fd\") " pod="openshift-ingress/kube-auth-proxy-666584dbdf-c64gg"
Sep 18 22:07:00.260255 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:00.260079    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ff79945-92fa-408c-a29a-2fc8108000fd-tls-certs\") pod \"kube-auth-proxy-666584dbdf-c64gg\" (UID: \"9ff79945-92fa-408c-a29a-2fc8108000fd\") " pod="openshift-ingress/kube-auth-proxy-666584dbdf-c64gg"
Sep 18 22:07:00.262504 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:00.262481    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9ff79945-92fa-408c-a29a-2fc8108000fd-tmp\") pod \"kube-auth-proxy-666584dbdf-c64gg\" (UID: \"9ff79945-92fa-408c-a29a-2fc8108000fd\") " pod="openshift-ingress/kube-auth-proxy-666584dbdf-c64gg"
Sep 18 22:07:00.262787 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:00.262767    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ff79945-92fa-408c-a29a-2fc8108000fd-tls-certs\") pod \"kube-auth-proxy-666584dbdf-c64gg\" (UID: \"9ff79945-92fa-408c-a29a-2fc8108000fd\") " pod="openshift-ingress/kube-auth-proxy-666584dbdf-c64gg"
Sep 18 22:07:00.273193 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:00.273164    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kznq\" (UniqueName: \"kubernetes.io/projected/9ff79945-92fa-408c-a29a-2fc8108000fd-kube-api-access-7kznq\") pod \"kube-auth-proxy-666584dbdf-c64gg\" (UID: \"9ff79945-92fa-408c-a29a-2fc8108000fd\") " pod="openshift-ingress/kube-auth-proxy-666584dbdf-c64gg"
Sep 18 22:07:00.347954 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:00.347921    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-666584dbdf-c64gg"
Sep 18 22:07:00.627452 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:00.627431    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-666584dbdf-c64gg"]
Sep 18 22:07:00.629000 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:07:00.628974    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ff79945_92fa_408c_a29a_2fc8108000fd.slice/crio-a98e9486677827d80373a3b3ea0c2cbc3de861b2022cc279db57b9003820eb45 WatchSource:0}: Error finding container a98e9486677827d80373a3b3ea0c2cbc3de861b2022cc279db57b9003820eb45: Status 404 returned error can't find the container with id a98e9486677827d80373a3b3ea0c2cbc3de861b2022cc279db57b9003820eb45
Sep 18 22:07:00.860648 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:00.860612    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-666584dbdf-c64gg" event={"ID":"9ff79945-92fa-408c-a29a-2fc8108000fd","Type":"ContainerStarted","Data":"a98e9486677827d80373a3b3ea0c2cbc3de861b2022cc279db57b9003820eb45"}
Sep 18 22:07:01.856820 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:01.856776    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2krc7"]
Sep 18 22:07:01.860135 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:01.860112    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2krc7"
Sep 18 22:07:01.863440 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:01.863381    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 18 22:07:01.863561 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:01.863518    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 18 22:07:01.863769 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:01.863740    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-6s2nn\""
Sep 18 22:07:01.864457 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:01.864163    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 18 22:07:01.864750 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:01.864575    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 18 22:07:01.877139 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:01.877082    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2krc7"]
Sep 18 22:07:01.976267 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:01.976224    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5a255cf3-e424-40df-9094-51140df0b966-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-2krc7\" (UID: \"5a255cf3-e424-40df-9094-51140df0b966\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2krc7"
Sep 18 22:07:01.976488 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:01.976282    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a255cf3-e424-40df-9094-51140df0b966-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-2krc7\" (UID: \"5a255cf3-e424-40df-9094-51140df0b966\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2krc7"
Sep 18 22:07:01.976488 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:01.976313    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5a255cf3-e424-40df-9094-51140df0b966-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-2krc7\" (UID: \"5a255cf3-e424-40df-9094-51140df0b966\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2krc7"
Sep 18 22:07:01.976488 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:01.976395    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5a255cf3-e424-40df-9094-51140df0b966-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-2krc7\" (UID: \"5a255cf3-e424-40df-9094-51140df0b966\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2krc7"
Sep 18 22:07:01.976488 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:01.976466    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5a255cf3-e424-40df-9094-51140df0b966-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-2krc7\" (UID: \"5a255cf3-e424-40df-9094-51140df0b966\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2krc7"
Sep 18 22:07:01.976714 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:01.976512    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a255cf3-e424-40df-9094-51140df0b966-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-2krc7\" (UID: \"5a255cf3-e424-40df-9094-51140df0b966\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2krc7"
Sep 18 22:07:01.976714 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:01.976542    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rs9rh\" (UniqueName: \"kubernetes.io/projected/5a255cf3-e424-40df-9094-51140df0b966-kube-api-access-rs9rh\") pod \"istiod-openshift-gateway-7b7995d5cd-2krc7\" (UID: \"5a255cf3-e424-40df-9094-51140df0b966\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2krc7"
Sep 18 22:07:02.077006 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:02.076967    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a255cf3-e424-40df-9094-51140df0b966-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-2krc7\" (UID: \"5a255cf3-e424-40df-9094-51140df0b966\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2krc7"
Sep 18 22:07:02.077006 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:02.077016    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5a255cf3-e424-40df-9094-51140df0b966-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-2krc7\" (UID: \"5a255cf3-e424-40df-9094-51140df0b966\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2krc7"
Sep 18 22:07:02.077261 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:02.077068    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5a255cf3-e424-40df-9094-51140df0b966-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-2krc7\" (UID: \"5a255cf3-e424-40df-9094-51140df0b966\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2krc7"
Sep 18 22:07:02.077261 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:02.077097    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5a255cf3-e424-40df-9094-51140df0b966-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-2krc7\" (UID: \"5a255cf3-e424-40df-9094-51140df0b966\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2krc7"
Sep 18 22:07:02.077261 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:02.077140    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a255cf3-e424-40df-9094-51140df0b966-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-2krc7\" (UID: \"5a255cf3-e424-40df-9094-51140df0b966\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2krc7"
Sep 18 22:07:02.077261 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:02.077163    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rs9rh\" (UniqueName: \"kubernetes.io/projected/5a255cf3-e424-40df-9094-51140df0b966-kube-api-access-rs9rh\") pod \"istiod-openshift-gateway-7b7995d5cd-2krc7\" (UID: \"5a255cf3-e424-40df-9094-51140df0b966\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2krc7"
Sep 18 22:07:02.077261 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:02.077221    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5a255cf3-e424-40df-9094-51140df0b966-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-2krc7\" (UID: \"5a255cf3-e424-40df-9094-51140df0b966\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2krc7"
Sep 18 22:07:02.077778 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:02.077741    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5a255cf3-e424-40df-9094-51140df0b966-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-2krc7\" (UID: \"5a255cf3-e424-40df-9094-51140df0b966\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2krc7"
Sep 18 22:07:02.080326 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:02.080299    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5a255cf3-e424-40df-9094-51140df0b966-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-2krc7\" (UID: \"5a255cf3-e424-40df-9094-51140df0b966\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2krc7"
Sep 18 22:07:02.081217 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:02.081180    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5a255cf3-e424-40df-9094-51140df0b966-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-2krc7\" (UID: \"5a255cf3-e424-40df-9094-51140df0b966\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2krc7"
Sep 18 22:07:02.082063 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:02.082003    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a255cf3-e424-40df-9094-51140df0b966-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-2krc7\" (UID: \"5a255cf3-e424-40df-9094-51140df0b966\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2krc7"
Sep 18 22:07:02.082768 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:02.082744    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5a255cf3-e424-40df-9094-51140df0b966-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-2krc7\" (UID: \"5a255cf3-e424-40df-9094-51140df0b966\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2krc7"
Sep 18 22:07:02.086647 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:02.086605    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rs9rh\" (UniqueName: \"kubernetes.io/projected/5a255cf3-e424-40df-9094-51140df0b966-kube-api-access-rs9rh\") pod \"istiod-openshift-gateway-7b7995d5cd-2krc7\" (UID: \"5a255cf3-e424-40df-9094-51140df0b966\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2krc7"
Sep 18 22:07:02.087025 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:02.087000    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a255cf3-e424-40df-9094-51140df0b966-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-2krc7\" (UID: \"5a255cf3-e424-40df-9094-51140df0b966\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2krc7"
Sep 18 22:07:02.176078 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:02.175995    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2krc7"
Sep 18 22:07:03.776886 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:03.776774    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2krc7"]
Sep 18 22:07:03.779573 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:07:03.779543    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a255cf3_e424_40df_9094_51140df0b966.slice/crio-4337d7da20eeb3914fa288ddf48c07d143b8caed12dc47cc1d7606b6d1e3613c WatchSource:0}: Error finding container 4337d7da20eeb3914fa288ddf48c07d143b8caed12dc47cc1d7606b6d1e3613c: Status 404 returned error can't find the container with id 4337d7da20eeb3914fa288ddf48c07d143b8caed12dc47cc1d7606b6d1e3613c
Sep 18 22:07:03.878105 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:03.878067    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2krc7" event={"ID":"5a255cf3-e424-40df-9094-51140df0b966","Type":"ContainerStarted","Data":"4337d7da20eeb3914fa288ddf48c07d143b8caed12dc47cc1d7606b6d1e3613c"}
Sep 18 22:07:03.879507 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:03.879483    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-666584dbdf-c64gg" event={"ID":"9ff79945-92fa-408c-a29a-2fc8108000fd","Type":"ContainerStarted","Data":"5598a1c8c888e19de6372464d5e47278740c301532c437945cd507e0c9e71347"}
Sep 18 22:07:03.903821 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:03.903770    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-666584dbdf-c64gg" podStartSLOduration=0.977574454 podStartE2EDuration="3.903755663s" totalImagesPullingTime="2.926181209s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:07:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:07:03.902283832 +0000 UTC m=+403.221955887" watchObservedRunningTime="2026-09-18 22:07:03.903755663 +0000 UTC m=+403.223427719"
Sep 18 22:07:05.547480 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:05.547445    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-59977c9f9d-89dwm"
Sep 18 22:07:05.547931 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:05.547518    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-59977c9f9d-89dwm"
Sep 18 22:07:05.552714 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:05.552687    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-59977c9f9d-89dwm"
Sep 18 22:07:05.893146 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:05.893120    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-59977c9f9d-89dwm"
Sep 18 22:07:08.730380 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:08.730330    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:07:08.730782 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:08.730443    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:07:08.904096 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:08.904061    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2krc7" event={"ID":"5a255cf3-e424-40df-9094-51140df0b966","Type":"ContainerStarted","Data":"cbef20a551bc881ec89af4a1461ebfd9a60196479d035932da5e8c5dc7f634fb"}
Sep 18 22:07:08.904288 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:08.904147    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2krc7"
Sep 18 22:07:08.958046 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:08.957992    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2krc7" podStartSLOduration=3.009564503 podStartE2EDuration="7.957975709s" totalImagesPullingTime="4.948411206s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:07:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:07:08.956694057 +0000 UTC m=+408.276366114" watchObservedRunningTime="2026-09-18 22:07:08.957975709 +0000 UTC m=+408.277647763"
Sep 18 22:07:09.910822 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:09.910788    2577 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-2krc7 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 18 22:07:09.911217 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:09.910862    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2krc7" podUID="5a255cf3-e424-40df-9094-51140df0b966" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 22:07:10.647599 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:10.647561    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-2wnkk"]
Sep 18 22:07:10.652723 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:10.652699    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-2wnkk"
Sep 18 22:07:10.655038 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:10.655019    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Sep 18 22:07:10.655175 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:10.655018    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-cngcc\""
Sep 18 22:07:10.661507 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:10.661065    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-2wnkk"]
Sep 18 22:07:10.714813 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:10.714765    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wn6lc"]
Sep 18 22:07:10.718613 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:10.718590    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wn6lc"
Sep 18 22:07:10.721507 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:10.721483    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-sf86b\""
Sep 18 22:07:10.749391 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:10.749363    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wn6lc"]
Sep 18 22:07:10.849459 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:10.849389    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b6a37e6c-ee5e-4c66-ac57-f1a4893a6d5c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wn6lc\" (UID: \"b6a37e6c-ee5e-4c66-ac57-f1a4893a6d5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wn6lc"
Sep 18 22:07:10.849643 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:10.849481    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6a37e6c-ee5e-4c66-ac57-f1a4893a6d5c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wn6lc\" (UID: \"b6a37e6c-ee5e-4c66-ac57-f1a4893a6d5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wn6lc"
Sep 18 22:07:10.849643 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:10.849516    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6a37e6c-ee5e-4c66-ac57-f1a4893a6d5c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wn6lc\" (UID: \"b6a37e6c-ee5e-4c66-ac57-f1a4893a6d5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wn6lc"
Sep 18 22:07:10.849643 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:10.849573    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b6a37e6c-ee5e-4c66-ac57-f1a4893a6d5c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wn6lc\" (UID: \"b6a37e6c-ee5e-4c66-ac57-f1a4893a6d5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wn6lc"
Sep 18 22:07:10.849799 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:10.849625    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b6a37e6c-ee5e-4c66-ac57-f1a4893a6d5c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wn6lc\" (UID: \"b6a37e6c-ee5e-4c66-ac57-f1a4893a6d5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wn6lc"
Sep 18 22:07:10.849799 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:10.849671    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b6a37e6c-ee5e-4c66-ac57-f1a4893a6d5c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wn6lc\" (UID: \"b6a37e6c-ee5e-4c66-ac57-f1a4893a6d5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wn6lc"
Sep 18 22:07:10.849799 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:10.849731    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fd762570-226a-49e7-80d2-2f18e3c16917-cert\") pod \"odh-model-controller-7998c67dc4-2wnkk\" (UID: \"fd762570-226a-49e7-80d2-2f18e3c16917\") " pod="opendatahub/odh-model-controller-7998c67dc4-2wnkk"
Sep 18 22:07:10.849799 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:10.849765    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rlkh\" (UniqueName: \"kubernetes.io/projected/fd762570-226a-49e7-80d2-2f18e3c16917-kube-api-access-9rlkh\") pod \"odh-model-controller-7998c67dc4-2wnkk\" (UID: \"fd762570-226a-49e7-80d2-2f18e3c16917\") " pod="opendatahub/odh-model-controller-7998c67dc4-2wnkk"
Sep 18 22:07:10.849799 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:10.849792    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7c2h\" (UniqueName: \"kubernetes.io/projected/b6a37e6c-ee5e-4c66-ac57-f1a4893a6d5c-kube-api-access-s7c2h\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wn6lc\" (UID: \"b6a37e6c-ee5e-4c66-ac57-f1a4893a6d5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wn6lc"
Sep 18 22:07:10.850049 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:10.849824    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b6a37e6c-ee5e-4c66-ac57-f1a4893a6d5c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wn6lc\" (UID: \"b6a37e6c-ee5e-4c66-ac57-f1a4893a6d5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wn6lc"
Sep 18 22:07:10.850049 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:10.849854    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b6a37e6c-ee5e-4c66-ac57-f1a4893a6d5c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wn6lc\" (UID: \"b6a37e6c-ee5e-4c66-ac57-f1a4893a6d5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wn6lc"
Sep 18 22:07:10.950464 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:10.950359    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6a37e6c-ee5e-4c66-ac57-f1a4893a6d5c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wn6lc\" (UID: \"b6a37e6c-ee5e-4c66-ac57-f1a4893a6d5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wn6lc"
Sep 18 22:07:10.950464 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:10.950397    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6a37e6c-ee5e-4c66-ac57-f1a4893a6d5c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wn6lc\" (UID: \"b6a37e6c-ee5e-4c66-ac57-f1a4893a6d5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wn6lc"
Sep 18 22:07:10.950464 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:10.950433    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b6a37e6c-ee5e-4c66-ac57-f1a4893a6d5c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wn6lc\" (UID: \"b6a37e6c-ee5e-4c66-ac57-f1a4893a6d5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wn6lc"
Sep 18 22:07:10.950464 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:10.950456    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b6a37e6c-ee5e-4c66-ac57-f1a4893a6d5c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wn6lc\" (UID: \"b6a37e6c-ee5e-4c66-ac57-f1a4893a6d5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wn6lc"
Sep 18 22:07:10.951068 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:10.950481    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b6a37e6c-ee5e-4c66-ac57-f1a4893a6d5c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wn6lc\" (UID: \"b6a37e6c-ee5e-4c66-ac57-f1a4893a6d5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wn6lc"
Sep 18 22:07:10.951068 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:10.950508    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fd762570-226a-49e7-80d2-2f18e3c16917-cert\") pod \"odh-model-controller-7998c67dc4-2wnkk\" (UID: \"fd762570-226a-49e7-80d2-2f18e3c16917\") " pod="opendatahub/odh-model-controller-7998c67dc4-2wnkk"
Sep 18 22:07:10.951068 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:10.950544    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rlkh\" (UniqueName: \"kubernetes.io/projected/fd762570-226a-49e7-80d2-2f18e3c16917-kube-api-access-9rlkh\") pod \"odh-model-controller-7998c67dc4-2wnkk\" (UID: \"fd762570-226a-49e7-80d2-2f18e3c16917\") " pod="opendatahub/odh-model-controller-7998c67dc4-2wnkk"
Sep 18 22:07:10.951068 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:10.950567    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7c2h\" (UniqueName: \"kubernetes.io/projected/b6a37e6c-ee5e-4c66-ac57-f1a4893a6d5c-kube-api-access-s7c2h\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wn6lc\" (UID: \"b6a37e6c-ee5e-4c66-ac57-f1a4893a6d5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wn6lc"
Sep 18 22:07:10.951068 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:10.950598    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b6a37e6c-ee5e-4c66-ac57-f1a4893a6d5c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wn6lc\" (UID: \"b6a37e6c-ee5e-4c66-ac57-f1a4893a6d5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wn6lc"
Sep 18 22:07:10.951068 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:10.950631    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b6a37e6c-ee5e-4c66-ac57-f1a4893a6d5c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wn6lc\" (UID: \"b6a37e6c-ee5e-4c66-ac57-f1a4893a6d5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wn6lc"
Sep 18 22:07:10.951068 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:10.950710    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b6a37e6c-ee5e-4c66-ac57-f1a4893a6d5c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wn6lc\" (UID: \"b6a37e6c-ee5e-4c66-ac57-f1a4893a6d5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wn6lc"
Sep 18 22:07:10.951068 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:10.950869    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6a37e6c-ee5e-4c66-ac57-f1a4893a6d5c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wn6lc\" (UID: \"b6a37e6c-ee5e-4c66-ac57-f1a4893a6d5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wn6lc"
Sep 18 22:07:10.951068 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:07:10.951050    2577 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Sep 18 22:07:10.951523 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:07:10.951118    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd762570-226a-49e7-80d2-2f18e3c16917-cert podName:fd762570-226a-49e7-80d2-2f18e3c16917 nodeName:}" failed. No retries permitted until 2026-09-18 22:07:11.451098474 +0000 UTC m=+410.770770520 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/fd762570-226a-49e7-80d2-2f18e3c16917-cert") pod "odh-model-controller-7998c67dc4-2wnkk" (UID: "fd762570-226a-49e7-80d2-2f18e3c16917") : secret "odh-model-controller-webhook-cert" not found
Sep 18 22:07:10.951523 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:10.951223    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b6a37e6c-ee5e-4c66-ac57-f1a4893a6d5c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wn6lc\" (UID: \"b6a37e6c-ee5e-4c66-ac57-f1a4893a6d5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wn6lc"
Sep 18 22:07:10.951523 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:10.951407    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6a37e6c-ee5e-4c66-ac57-f1a4893a6d5c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wn6lc\" (UID: \"b6a37e6c-ee5e-4c66-ac57-f1a4893a6d5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wn6lc"
Sep 18 22:07:10.951523 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:10.951498    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b6a37e6c-ee5e-4c66-ac57-f1a4893a6d5c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wn6lc\" (UID: \"b6a37e6c-ee5e-4c66-ac57-f1a4893a6d5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wn6lc"
Sep 18 22:07:10.951741 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:10.951545    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b6a37e6c-ee5e-4c66-ac57-f1a4893a6d5c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wn6lc\" (UID: \"b6a37e6c-ee5e-4c66-ac57-f1a4893a6d5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wn6lc"
Sep 18 22:07:10.953440 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:10.953401    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b6a37e6c-ee5e-4c66-ac57-f1a4893a6d5c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wn6lc\" (UID: \"b6a37e6c-ee5e-4c66-ac57-f1a4893a6d5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wn6lc"
Sep 18 22:07:10.953960 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:10.953938    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b6a37e6c-ee5e-4c66-ac57-f1a4893a6d5c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wn6lc\" (UID: \"b6a37e6c-ee5e-4c66-ac57-f1a4893a6d5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wn6lc"
Sep 18 22:07:10.969399 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:10.969360    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b6a37e6c-ee5e-4c66-ac57-f1a4893a6d5c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wn6lc\" (UID: \"b6a37e6c-ee5e-4c66-ac57-f1a4893a6d5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wn6lc"
Sep 18 22:07:10.970443 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:10.970400    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rlkh\" (UniqueName: \"kubernetes.io/projected/fd762570-226a-49e7-80d2-2f18e3c16917-kube-api-access-9rlkh\") pod \"odh-model-controller-7998c67dc4-2wnkk\" (UID: \"fd762570-226a-49e7-80d2-2f18e3c16917\") " pod="opendatahub/odh-model-controller-7998c67dc4-2wnkk"
Sep 18 22:07:10.972084 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:10.972065    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7c2h\" (UniqueName: \"kubernetes.io/projected/b6a37e6c-ee5e-4c66-ac57-f1a4893a6d5c-kube-api-access-s7c2h\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wn6lc\" (UID: \"b6a37e6c-ee5e-4c66-ac57-f1a4893a6d5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wn6lc"
Sep 18 22:07:11.031360 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:11.031320    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wn6lc"
Sep 18 22:07:11.333055 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:11.333025    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wn6lc"]
Sep 18 22:07:11.335956 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:07:11.335927    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6a37e6c_ee5e_4c66_ac57_f1a4893a6d5c.slice/crio-f74702ab610d1205769734943486dfd9bc6fa5cf54039c5b93a82a388fa7712b WatchSource:0}: Error finding container f74702ab610d1205769734943486dfd9bc6fa5cf54039c5b93a82a388fa7712b: Status 404 returned error can't find the container with id f74702ab610d1205769734943486dfd9bc6fa5cf54039c5b93a82a388fa7712b
Sep 18 22:07:11.453611 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:11.453564    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fd762570-226a-49e7-80d2-2f18e3c16917-cert\") pod \"odh-model-controller-7998c67dc4-2wnkk\" (UID: \"fd762570-226a-49e7-80d2-2f18e3c16917\") " pod="opendatahub/odh-model-controller-7998c67dc4-2wnkk"
Sep 18 22:07:11.456422 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:11.456389    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fd762570-226a-49e7-80d2-2f18e3c16917-cert\") pod \"odh-model-controller-7998c67dc4-2wnkk\" (UID: \"fd762570-226a-49e7-80d2-2f18e3c16917\") " pod="opendatahub/odh-model-controller-7998c67dc4-2wnkk"
Sep 18 22:07:11.565727 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:11.565683    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-2wnkk"
Sep 18 22:07:11.847040 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:11.847013    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-2wnkk"]
Sep 18 22:07:11.849698 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:07:11.849669    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd762570_226a_49e7_80d2_2f18e3c16917.slice/crio-8e76a7cda1201fe0d241fddac55262232592500e02a3232eef01a2967d943b27 WatchSource:0}: Error finding container 8e76a7cda1201fe0d241fddac55262232592500e02a3232eef01a2967d943b27: Status 404 returned error can't find the container with id 8e76a7cda1201fe0d241fddac55262232592500e02a3232eef01a2967d943b27
Sep 18 22:07:11.921569 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:11.921475    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-2wnkk" event={"ID":"fd762570-226a-49e7-80d2-2f18e3c16917","Type":"ContainerStarted","Data":"8e76a7cda1201fe0d241fddac55262232592500e02a3232eef01a2967d943b27"}
Sep 18 22:07:11.923396 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:11.923362    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wn6lc" event={"ID":"b6a37e6c-ee5e-4c66-ac57-f1a4893a6d5c","Type":"ContainerStarted","Data":"f74702ab610d1205769734943486dfd9bc6fa5cf54039c5b93a82a388fa7712b"}
Sep 18 22:07:12.911836 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:12.911794    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2krc7"
Sep 18 22:07:14.941690 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:14.941598    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-2wnkk" event={"ID":"fd762570-226a-49e7-80d2-2f18e3c16917","Type":"ContainerStarted","Data":"2b0e01d6860a3027c08d5d56637bfaa35e2b72139cb9ad65562e5765f73c861e"}
Sep 18 22:07:14.942061 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:14.941694    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-2wnkk"
Sep 18 22:07:14.992676 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:14.992621    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-2wnkk" podStartSLOduration=2.271157428 podStartE2EDuration="4.99260494s" totalImagesPullingTime="2.721447512s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:07:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:07:14.990691511 +0000 UTC m=+414.310363565" watchObservedRunningTime="2026-09-18 22:07:14.99260494 +0000 UTC m=+414.312276995"
Sep 18 22:07:22.260513 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:22.260484    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-8ghwr"]
Sep 18 22:07:22.266721 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:22.266699    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-8ghwr"
Sep 18 22:07:22.279210 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:22.279191    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Sep 18 22:07:22.319470 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:22.319431    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-7mn6k\""
Sep 18 22:07:22.346695 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:22.346666    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/33469be5-3311-4ff5-9057-664d0a8d5a8b-cert\") pod \"kserve-controller-manager-d6f4b65b8-8ghwr\" (UID: \"33469be5-3311-4ff5-9057-664d0a8d5a8b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-8ghwr"
Sep 18 22:07:22.346840 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:22.346705    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p85h2\" (UniqueName: \"kubernetes.io/projected/33469be5-3311-4ff5-9057-664d0a8d5a8b-kube-api-access-p85h2\") pod \"kserve-controller-manager-d6f4b65b8-8ghwr\" (UID: \"33469be5-3311-4ff5-9057-664d0a8d5a8b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-8ghwr"
Sep 18 22:07:22.346914 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:22.346895    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-gct4p"]
Sep 18 22:07:22.349062 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:22.349042    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gct4p"
Sep 18 22:07:22.363013 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:22.362991    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-5b7bp\""
Sep 18 22:07:22.363122 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:22.363081    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Sep 18 22:07:22.447749 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:22.447705    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gv9gz\" (UniqueName: \"kubernetes.io/projected/e2542921-25af-417a-a0b4-f01b9a098c20-kube-api-access-gv9gz\") pod \"llmisvc-controller-manager-777c6bd7d5-gct4p\" (UID: \"e2542921-25af-417a-a0b4-f01b9a098c20\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gct4p"
Sep 18 22:07:22.447749 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:22.447756    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e2542921-25af-417a-a0b4-f01b9a098c20-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-gct4p\" (UID: \"e2542921-25af-417a-a0b4-f01b9a098c20\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gct4p"
Sep 18 22:07:22.447954 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:22.447855    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/33469be5-3311-4ff5-9057-664d0a8d5a8b-cert\") pod \"kserve-controller-manager-d6f4b65b8-8ghwr\" (UID: \"33469be5-3311-4ff5-9057-664d0a8d5a8b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-8ghwr"
Sep 18 22:07:22.447954 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:22.447880    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p85h2\" (UniqueName: \"kubernetes.io/projected/33469be5-3311-4ff5-9057-664d0a8d5a8b-kube-api-access-p85h2\") pod \"kserve-controller-manager-d6f4b65b8-8ghwr\" (UID: \"33469be5-3311-4ff5-9057-664d0a8d5a8b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-8ghwr"
Sep 18 22:07:22.450502 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:22.450469    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/33469be5-3311-4ff5-9057-664d0a8d5a8b-cert\") pod \"kserve-controller-manager-d6f4b65b8-8ghwr\" (UID: \"33469be5-3311-4ff5-9057-664d0a8d5a8b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-8ghwr"
Sep 18 22:07:22.454613 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:22.454588    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-8ghwr"]
Sep 18 22:07:22.475919 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:22.475895    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p85h2\" (UniqueName: \"kubernetes.io/projected/33469be5-3311-4ff5-9057-664d0a8d5a8b-kube-api-access-p85h2\") pod \"kserve-controller-manager-d6f4b65b8-8ghwr\" (UID: \"33469be5-3311-4ff5-9057-664d0a8d5a8b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-8ghwr"
Sep 18 22:07:22.500532 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:22.500504    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-gct4p"]
Sep 18 22:07:22.549060 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:22.548986    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gv9gz\" (UniqueName: \"kubernetes.io/projected/e2542921-25af-417a-a0b4-f01b9a098c20-kube-api-access-gv9gz\") pod \"llmisvc-controller-manager-777c6bd7d5-gct4p\" (UID: \"e2542921-25af-417a-a0b4-f01b9a098c20\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gct4p"
Sep 18 22:07:22.549060 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:22.549021    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e2542921-25af-417a-a0b4-f01b9a098c20-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-gct4p\" (UID: \"e2542921-25af-417a-a0b4-f01b9a098c20\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gct4p"
Sep 18 22:07:22.551459 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:22.551438    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e2542921-25af-417a-a0b4-f01b9a098c20-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-gct4p\" (UID: \"e2542921-25af-417a-a0b4-f01b9a098c20\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gct4p"
Sep 18 22:07:22.563023 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:22.563000    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gv9gz\" (UniqueName: \"kubernetes.io/projected/e2542921-25af-417a-a0b4-f01b9a098c20-kube-api-access-gv9gz\") pod \"llmisvc-controller-manager-777c6bd7d5-gct4p\" (UID: \"e2542921-25af-417a-a0b4-f01b9a098c20\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gct4p"
Sep 18 22:07:22.576891 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:22.576867    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-8ghwr"
Sep 18 22:07:22.659257 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:22.659225    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gct4p"
Sep 18 22:07:22.873962 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:22.873942    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-8ghwr"]
Sep 18 22:07:22.876342 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:07:22.876316    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33469be5_3311_4ff5_9057_664d0a8d5a8b.slice/crio-9338b74e28825a35fb0f73dff1caadcb29ca04fde9d7535b07c8fc6dcdb26622 WatchSource:0}: Error finding container 9338b74e28825a35fb0f73dff1caadcb29ca04fde9d7535b07c8fc6dcdb26622: Status 404 returned error can't find the container with id 9338b74e28825a35fb0f73dff1caadcb29ca04fde9d7535b07c8fc6dcdb26622
Sep 18 22:07:22.942909 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:22.942889    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-gct4p"]
Sep 18 22:07:22.945122 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:07:22.945094    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode2542921_25af_417a_a0b4_f01b9a098c20.slice/crio-ff07c8cd564b5247ecf3ea1b0117dff902860bdf2ece6c7ce9a31751dd7afc66 WatchSource:0}: Error finding container ff07c8cd564b5247ecf3ea1b0117dff902860bdf2ece6c7ce9a31751dd7afc66: Status 404 returned error can't find the container with id ff07c8cd564b5247ecf3ea1b0117dff902860bdf2ece6c7ce9a31751dd7afc66
Sep 18 22:07:22.981909 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:22.981873    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gct4p" event={"ID":"e2542921-25af-417a-a0b4-f01b9a098c20","Type":"ContainerStarted","Data":"ff07c8cd564b5247ecf3ea1b0117dff902860bdf2ece6c7ce9a31751dd7afc66"}
Sep 18 22:07:22.983092 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:22.983068    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-8ghwr" event={"ID":"33469be5-3311-4ff5-9057-664d0a8d5a8b","Type":"ContainerStarted","Data":"9338b74e28825a35fb0f73dff1caadcb29ca04fde9d7535b07c8fc6dcdb26622"}
Sep 18 22:07:23.180150 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:23.180061    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2krc7"]
Sep 18 22:07:23.180361 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:23.180258    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2krc7" podUID="5a255cf3-e424-40df-9094-51140df0b966" containerName="discovery" containerID="cri-o://cbef20a551bc881ec89af4a1461ebfd9a60196479d035932da5e8c5dc7f634fb" gracePeriod=30
Sep 18 22:07:23.418135 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:23.418111    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2krc7"
Sep 18 22:07:23.455562 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:23.455490    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5a255cf3-e424-40df-9094-51140df0b966-cacerts\") pod \"5a255cf3-e424-40df-9094-51140df0b966\" (UID: \"5a255cf3-e424-40df-9094-51140df0b966\") "
Sep 18 22:07:23.455562 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:23.455532    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a255cf3-e424-40df-9094-51140df0b966-istio-token\") pod \"5a255cf3-e424-40df-9094-51140df0b966\" (UID: \"5a255cf3-e424-40df-9094-51140df0b966\") "
Sep 18 22:07:23.455562 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:23.455548    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rs9rh\" (UniqueName: \"kubernetes.io/projected/5a255cf3-e424-40df-9094-51140df0b966-kube-api-access-rs9rh\") pod \"5a255cf3-e424-40df-9094-51140df0b966\" (UID: \"5a255cf3-e424-40df-9094-51140df0b966\") "
Sep 18 22:07:23.455802 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:23.455589    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5a255cf3-e424-40df-9094-51140df0b966-istio-csr-dns-cert\") pod \"5a255cf3-e424-40df-9094-51140df0b966\" (UID: \"5a255cf3-e424-40df-9094-51140df0b966\") "
Sep 18 22:07:23.455802 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:23.455621    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5a255cf3-e424-40df-9094-51140df0b966-istio-csr-ca-configmap\") pod \"5a255cf3-e424-40df-9094-51140df0b966\" (UID: \"5a255cf3-e424-40df-9094-51140df0b966\") "
Sep 18 22:07:23.455802 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:23.455670    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5a255cf3-e424-40df-9094-51140df0b966-istio-kubeconfig\") pod \"5a255cf3-e424-40df-9094-51140df0b966\" (UID: \"5a255cf3-e424-40df-9094-51140df0b966\") "
Sep 18 22:07:23.455802 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:23.455708    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a255cf3-e424-40df-9094-51140df0b966-local-certs\") pod \"5a255cf3-e424-40df-9094-51140df0b966\" (UID: \"5a255cf3-e424-40df-9094-51140df0b966\") "
Sep 18 22:07:23.456400 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:23.456217    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a255cf3-e424-40df-9094-51140df0b966-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "5a255cf3-e424-40df-9094-51140df0b966" (UID: "5a255cf3-e424-40df-9094-51140df0b966"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:07:23.458390 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:23.458363    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a255cf3-e424-40df-9094-51140df0b966-kube-api-access-rs9rh" (OuterVolumeSpecName: "kube-api-access-rs9rh") pod "5a255cf3-e424-40df-9094-51140df0b966" (UID: "5a255cf3-e424-40df-9094-51140df0b966"). InnerVolumeSpecName "kube-api-access-rs9rh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:07:23.458390 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:23.458377    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a255cf3-e424-40df-9094-51140df0b966-istio-token" (OuterVolumeSpecName: "istio-token") pod "5a255cf3-e424-40df-9094-51140df0b966" (UID: "5a255cf3-e424-40df-9094-51140df0b966"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:07:23.458556 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:23.458478    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a255cf3-e424-40df-9094-51140df0b966-cacerts" (OuterVolumeSpecName: "cacerts") pod "5a255cf3-e424-40df-9094-51140df0b966" (UID: "5a255cf3-e424-40df-9094-51140df0b966"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 22:07:23.458701 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:23.458684    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a255cf3-e424-40df-9094-51140df0b966-local-certs" (OuterVolumeSpecName: "local-certs") pod "5a255cf3-e424-40df-9094-51140df0b966" (UID: "5a255cf3-e424-40df-9094-51140df0b966"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:07:23.459585 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:23.459550    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a255cf3-e424-40df-9094-51140df0b966-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "5a255cf3-e424-40df-9094-51140df0b966" (UID: "5a255cf3-e424-40df-9094-51140df0b966"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 22:07:23.459833 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:23.459804    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a255cf3-e424-40df-9094-51140df0b966-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "5a255cf3-e424-40df-9094-51140df0b966" (UID: "5a255cf3-e424-40df-9094-51140df0b966"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 22:07:23.557297 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:23.557257    2577 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5a255cf3-e424-40df-9094-51140df0b966-istio-kubeconfig\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:07:23.557297 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:23.557295    2577 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a255cf3-e424-40df-9094-51140df0b966-local-certs\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:07:23.557563 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:23.557309    2577 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5a255cf3-e424-40df-9094-51140df0b966-cacerts\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:07:23.557563 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:23.557323    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a255cf3-e424-40df-9094-51140df0b966-istio-token\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:07:23.557563 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:23.557336    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rs9rh\" (UniqueName: \"kubernetes.io/projected/5a255cf3-e424-40df-9094-51140df0b966-kube-api-access-rs9rh\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:07:23.557563 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:23.557351    2577 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5a255cf3-e424-40df-9094-51140df0b966-istio-csr-dns-cert\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:07:23.557563 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:23.557366    2577 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5a255cf3-e424-40df-9094-51140df0b966-istio-csr-ca-configmap\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:07:23.993289 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:23.993252    2577 generic.go:356] "Generic (PLEG): container finished" podID="5a255cf3-e424-40df-9094-51140df0b966" containerID="cbef20a551bc881ec89af4a1461ebfd9a60196479d035932da5e8c5dc7f634fb" exitCode=0
Sep 18 22:07:23.993714 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:23.993430    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2krc7" event={"ID":"5a255cf3-e424-40df-9094-51140df0b966","Type":"ContainerDied","Data":"cbef20a551bc881ec89af4a1461ebfd9a60196479d035932da5e8c5dc7f634fb"}
Sep 18 22:07:23.993714 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:23.993481    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2krc7" event={"ID":"5a255cf3-e424-40df-9094-51140df0b966","Type":"ContainerDied","Data":"4337d7da20eeb3914fa288ddf48c07d143b8caed12dc47cc1d7606b6d1e3613c"}
Sep 18 22:07:23.993714 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:23.993508    2577 scope.go:117] "RemoveContainer" containerID="cbef20a551bc881ec89af4a1461ebfd9a60196479d035932da5e8c5dc7f634fb"
Sep 18 22:07:23.993714 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:23.993652    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2krc7"
Sep 18 22:07:24.033725 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:24.033680    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2krc7"]
Sep 18 22:07:24.040271 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:24.040235    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2krc7"]
Sep 18 22:07:24.208698 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:24.208671    2577 scope.go:117] "RemoveContainer" containerID="cbef20a551bc881ec89af4a1461ebfd9a60196479d035932da5e8c5dc7f634fb"
Sep 18 22:07:24.209168 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:07:24.209130    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cbef20a551bc881ec89af4a1461ebfd9a60196479d035932da5e8c5dc7f634fb\": container with ID starting with cbef20a551bc881ec89af4a1461ebfd9a60196479d035932da5e8c5dc7f634fb not found: ID does not exist" containerID="cbef20a551bc881ec89af4a1461ebfd9a60196479d035932da5e8c5dc7f634fb"
Sep 18 22:07:24.209251 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:24.209176    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cbef20a551bc881ec89af4a1461ebfd9a60196479d035932da5e8c5dc7f634fb"} err="failed to get container status \"cbef20a551bc881ec89af4a1461ebfd9a60196479d035932da5e8c5dc7f634fb\": rpc error: code = NotFound desc = could not find container \"cbef20a551bc881ec89af4a1461ebfd9a60196479d035932da5e8c5dc7f634fb\": container with ID starting with cbef20a551bc881ec89af4a1461ebfd9a60196479d035932da5e8c5dc7f634fb not found: ID does not exist"
Sep 18 22:07:25.138832 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:25.138792    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a255cf3-e424-40df-9094-51140df0b966" path="/var/lib/kubelet/pods/5a255cf3-e424-40df-9094-51140df0b966/volumes"
Sep 18 22:07:25.948553 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:25.948531    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-2wnkk"
Sep 18 22:07:26.007831 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:26.007801    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gct4p" event={"ID":"e2542921-25af-417a-a0b4-f01b9a098c20","Type":"ContainerStarted","Data":"3fbcbff33d393b2613aef99fdc1014b9dd2140583911571a9971669e0b44914d"}
Sep 18 22:07:26.008001 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:26.007891    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gct4p"
Sep 18 22:07:26.009729 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:26.009696    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-8ghwr" event={"ID":"33469be5-3311-4ff5-9057-664d0a8d5a8b","Type":"ContainerStarted","Data":"cbf8651a8b5025599005b672ef3e78d22ca12791e05a001e21726336efbe4b84"}
Sep 18 22:07:26.009853 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:26.009758    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-8ghwr"
Sep 18 22:07:26.029202 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:26.029158    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gct4p" podStartSLOduration=1.08333179 podStartE2EDuration="4.029141189s" totalImagesPullingTime="2.945809399s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:07:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:07:26.028324512 +0000 UTC m=+425.347996568" watchObservedRunningTime="2026-09-18 22:07:26.029141189 +0000 UTC m=+425.348813245"
Sep 18 22:07:26.051791 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:26.051745    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-8ghwr" podStartSLOduration=1.764324154 podStartE2EDuration="4.051727649s" totalImagesPullingTime="2.287403495s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:07:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:07:26.049260944 +0000 UTC m=+425.368933001" watchObservedRunningTime="2026-09-18 22:07:26.051727649 +0000 UTC m=+425.371399704"
Sep 18 22:07:30.469519 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:30.469475    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:07:30.469815 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:30.469572    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:07:30.469815 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:30.469607    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:07:31.037150 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:31.037112    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wn6lc" event={"ID":"b6a37e6c-ee5e-4c66-ac57-f1a4893a6d5c","Type":"ContainerStarted","Data":"d9f758fef57ccfc644a125c35f94d73fa59529d67f1437b992472438725cca60"}
Sep 18 22:07:31.062670 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:31.062621    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wn6lc" podStartSLOduration=1.932179363 podStartE2EDuration="21.062605635s" totalImagesPullingTime="19.130426272s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:07:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:07:31.060169401 +0000 UTC m=+430.379841455" watchObservedRunningTime="2026-09-18 22:07:31.062605635 +0000 UTC m=+430.382277760"
Sep 18 22:07:32.032339 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:32.032297    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wn6lc"
Sep 18 22:07:32.037008 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:32.036983    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wn6lc"
Sep 18 22:07:32.041446 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:32.041421    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wn6lc"
Sep 18 22:07:32.042180 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:32.042165    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wn6lc"
Sep 18 22:07:57.017121 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:57.017092    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gct4p"
Sep 18 22:07:57.020148 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:07:57.020096    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-8ghwr"
Sep 18 22:08:17.884872 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:17.884837    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7q9zpk"]
Sep 18 22:08:17.885361 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:17.885160    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a255cf3-e424-40df-9094-51140df0b966" containerName="discovery"
Sep 18 22:08:17.885361 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:17.885171    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a255cf3-e424-40df-9094-51140df0b966" containerName="discovery"
Sep 18 22:08:17.885361 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:17.885233    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a255cf3-e424-40df-9094-51140df0b966" containerName="discovery"
Sep 18 22:08:17.887291 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:17.887274    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7q9zpk"
Sep 18 22:08:17.889872 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:17.889849    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 18 22:08:17.890611 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:17.890578    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 18 22:08:17.890683 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:17.890583    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6gs9k\""
Sep 18 22:08:17.900039 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:17.900013    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7q9zpk"]
Sep 18 22:08:17.975465 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:17.975435    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6qdrxt"]
Sep 18 22:08:17.977687 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:17.977669    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6qdrxt"
Sep 18 22:08:17.992691 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:17.992670    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6qdrxt"]
Sep 18 22:08:18.036078 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:18.036054    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zb44r\" (UniqueName: \"kubernetes.io/projected/a8aba5a9-cce9-49fe-be26-0487c3c75071-kube-api-access-zb44r\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7q9zpk\" (UID: \"a8aba5a9-cce9-49fe-be26-0487c3c75071\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7q9zpk"
Sep 18 22:08:18.036183 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:18.036086    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa388291-e84d-4492-a604-cb90eaa03f66-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6qdrxt\" (UID: \"aa388291-e84d-4492-a604-cb90eaa03f66\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6qdrxt"
Sep 18 22:08:18.036183 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:18.036107    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a8aba5a9-cce9-49fe-be26-0487c3c75071-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7q9zpk\" (UID: \"a8aba5a9-cce9-49fe-be26-0487c3c75071\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7q9zpk"
Sep 18 22:08:18.036183 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:18.036130    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mq2c2\" (UniqueName: \"kubernetes.io/projected/aa388291-e84d-4492-a604-cb90eaa03f66-kube-api-access-mq2c2\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6qdrxt\" (UID: \"aa388291-e84d-4492-a604-cb90eaa03f66\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6qdrxt"
Sep 18 22:08:18.036301 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:18.036186    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a8aba5a9-cce9-49fe-be26-0487c3c75071-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7q9zpk\" (UID: \"a8aba5a9-cce9-49fe-be26-0487c3c75071\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7q9zpk"
Sep 18 22:08:18.036301 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:18.036207    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa388291-e84d-4492-a604-cb90eaa03f66-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6qdrxt\" (UID: \"aa388291-e84d-4492-a604-cb90eaa03f66\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6qdrxt"
Sep 18 22:08:18.076685 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:18.076651    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awg46d"]
Sep 18 22:08:18.079054 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:18.079037    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awg46d"
Sep 18 22:08:18.093143 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:18.093123    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awg46d"]
Sep 18 22:08:18.136897 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:18.136843    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zb44r\" (UniqueName: \"kubernetes.io/projected/a8aba5a9-cce9-49fe-be26-0487c3c75071-kube-api-access-zb44r\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7q9zpk\" (UID: \"a8aba5a9-cce9-49fe-be26-0487c3c75071\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7q9zpk"
Sep 18 22:08:18.136897 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:18.136875    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa388291-e84d-4492-a604-cb90eaa03f66-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6qdrxt\" (UID: \"aa388291-e84d-4492-a604-cb90eaa03f66\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6qdrxt"
Sep 18 22:08:18.136897 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:18.136894    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a8aba5a9-cce9-49fe-be26-0487c3c75071-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7q9zpk\" (UID: \"a8aba5a9-cce9-49fe-be26-0487c3c75071\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7q9zpk"
Sep 18 22:08:18.137107 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:18.137010    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mq2c2\" (UniqueName: \"kubernetes.io/projected/aa388291-e84d-4492-a604-cb90eaa03f66-kube-api-access-mq2c2\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6qdrxt\" (UID: \"aa388291-e84d-4492-a604-cb90eaa03f66\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6qdrxt"
Sep 18 22:08:18.137107 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:18.137053    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/966f0048-1b3f-4b99-a415-176362ec8c8a-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awg46d\" (UID: \"966f0048-1b3f-4b99-a415-176362ec8c8a\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awg46d"
Sep 18 22:08:18.137220 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:18.137114    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a8aba5a9-cce9-49fe-be26-0487c3c75071-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7q9zpk\" (UID: \"a8aba5a9-cce9-49fe-be26-0487c3c75071\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7q9zpk"
Sep 18 22:08:18.137220 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:18.137163    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dq542\" (UniqueName: \"kubernetes.io/projected/966f0048-1b3f-4b99-a415-176362ec8c8a-kube-api-access-dq542\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awg46d\" (UID: \"966f0048-1b3f-4b99-a415-176362ec8c8a\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awg46d"
Sep 18 22:08:18.137220 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:18.137187    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/966f0048-1b3f-4b99-a415-176362ec8c8a-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awg46d\" (UID: \"966f0048-1b3f-4b99-a415-176362ec8c8a\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awg46d"
Sep 18 22:08:18.137370 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:18.137222    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa388291-e84d-4492-a604-cb90eaa03f66-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6qdrxt\" (UID: \"aa388291-e84d-4492-a604-cb90eaa03f66\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6qdrxt"
Sep 18 22:08:18.137370 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:18.137241    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa388291-e84d-4492-a604-cb90eaa03f66-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6qdrxt\" (UID: \"aa388291-e84d-4492-a604-cb90eaa03f66\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6qdrxt"
Sep 18 22:08:18.137507 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:18.137443    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a8aba5a9-cce9-49fe-be26-0487c3c75071-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7q9zpk\" (UID: \"a8aba5a9-cce9-49fe-be26-0487c3c75071\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7q9zpk"
Sep 18 22:08:18.137507 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:18.137468    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a8aba5a9-cce9-49fe-be26-0487c3c75071-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7q9zpk\" (UID: \"a8aba5a9-cce9-49fe-be26-0487c3c75071\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7q9zpk"
Sep 18 22:08:18.137507 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:18.137479    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa388291-e84d-4492-a604-cb90eaa03f66-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6qdrxt\" (UID: \"aa388291-e84d-4492-a604-cb90eaa03f66\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6qdrxt"
Sep 18 22:08:18.145615 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:18.145593    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mq2c2\" (UniqueName: \"kubernetes.io/projected/aa388291-e84d-4492-a604-cb90eaa03f66-kube-api-access-mq2c2\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6qdrxt\" (UID: \"aa388291-e84d-4492-a604-cb90eaa03f66\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6qdrxt"
Sep 18 22:08:18.145694 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:18.145673    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zb44r\" (UniqueName: \"kubernetes.io/projected/a8aba5a9-cce9-49fe-be26-0487c3c75071-kube-api-access-zb44r\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7q9zpk\" (UID: \"a8aba5a9-cce9-49fe-be26-0487c3c75071\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7q9zpk"
Sep 18 22:08:18.182003 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:18.181976    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckzpn8"]
Sep 18 22:08:18.186894 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:18.186871    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckzpn8"
Sep 18 22:08:18.195700 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:18.195679    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7q9zpk"
Sep 18 22:08:18.198165 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:18.198145    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckzpn8"]
Sep 18 22:08:18.239640 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:18.238272    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5332941f-b3d6-4c00-a6d9-556dfd9496d3-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckzpn8\" (UID: \"5332941f-b3d6-4c00-a6d9-556dfd9496d3\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckzpn8"
Sep 18 22:08:18.239640 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:18.238358    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/966f0048-1b3f-4b99-a415-176362ec8c8a-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awg46d\" (UID: \"966f0048-1b3f-4b99-a415-176362ec8c8a\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awg46d"
Sep 18 22:08:18.239640 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:18.238393    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5332941f-b3d6-4c00-a6d9-556dfd9496d3-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckzpn8\" (UID: \"5332941f-b3d6-4c00-a6d9-556dfd9496d3\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckzpn8"
Sep 18 22:08:18.239640 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:18.238485    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dq542\" (UniqueName: \"kubernetes.io/projected/966f0048-1b3f-4b99-a415-176362ec8c8a-kube-api-access-dq542\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awg46d\" (UID: \"966f0048-1b3f-4b99-a415-176362ec8c8a\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awg46d"
Sep 18 22:08:18.239640 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:18.238513    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4gzx\" (UniqueName: \"kubernetes.io/projected/5332941f-b3d6-4c00-a6d9-556dfd9496d3-kube-api-access-t4gzx\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckzpn8\" (UID: \"5332941f-b3d6-4c00-a6d9-556dfd9496d3\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckzpn8"
Sep 18 22:08:18.239640 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:18.238539    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/966f0048-1b3f-4b99-a415-176362ec8c8a-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awg46d\" (UID: \"966f0048-1b3f-4b99-a415-176362ec8c8a\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awg46d"
Sep 18 22:08:18.239640 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:18.238918    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/966f0048-1b3f-4b99-a415-176362ec8c8a-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awg46d\" (UID: \"966f0048-1b3f-4b99-a415-176362ec8c8a\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awg46d"
Sep 18 22:08:18.239640 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:18.239005    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/966f0048-1b3f-4b99-a415-176362ec8c8a-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awg46d\" (UID: \"966f0048-1b3f-4b99-a415-176362ec8c8a\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awg46d"
Sep 18 22:08:18.248507 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:18.248468    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dq542\" (UniqueName: \"kubernetes.io/projected/966f0048-1b3f-4b99-a415-176362ec8c8a-kube-api-access-dq542\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awg46d\" (UID: \"966f0048-1b3f-4b99-a415-176362ec8c8a\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awg46d"
Sep 18 22:08:18.286855 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:18.286576    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6qdrxt"
Sep 18 22:08:18.340062 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:18.339069    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4gzx\" (UniqueName: \"kubernetes.io/projected/5332941f-b3d6-4c00-a6d9-556dfd9496d3-kube-api-access-t4gzx\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckzpn8\" (UID: \"5332941f-b3d6-4c00-a6d9-556dfd9496d3\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckzpn8"
Sep 18 22:08:18.340062 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:18.339147    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5332941f-b3d6-4c00-a6d9-556dfd9496d3-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckzpn8\" (UID: \"5332941f-b3d6-4c00-a6d9-556dfd9496d3\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckzpn8"
Sep 18 22:08:18.340062 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:18.339205    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5332941f-b3d6-4c00-a6d9-556dfd9496d3-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckzpn8\" (UID: \"5332941f-b3d6-4c00-a6d9-556dfd9496d3\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckzpn8"
Sep 18 22:08:18.340062 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:18.339689    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5332941f-b3d6-4c00-a6d9-556dfd9496d3-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckzpn8\" (UID: \"5332941f-b3d6-4c00-a6d9-556dfd9496d3\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckzpn8"
Sep 18 22:08:18.340337 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:18.340150    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5332941f-b3d6-4c00-a6d9-556dfd9496d3-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckzpn8\" (UID: \"5332941f-b3d6-4c00-a6d9-556dfd9496d3\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckzpn8"
Sep 18 22:08:18.352474 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:18.352401    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4gzx\" (UniqueName: \"kubernetes.io/projected/5332941f-b3d6-4c00-a6d9-556dfd9496d3-kube-api-access-t4gzx\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckzpn8\" (UID: \"5332941f-b3d6-4c00-a6d9-556dfd9496d3\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckzpn8"
Sep 18 22:08:18.388316 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:18.388259    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awg46d"
Sep 18 22:08:18.479032 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:18.479008    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7q9zpk"]
Sep 18 22:08:18.481294 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:08:18.481266    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8aba5a9_cce9_49fe_be26_0487c3c75071.slice/crio-e8104fc102fae6a920796ba55528697afea225bb8aaf01b55178d16a90ce7f4b WatchSource:0}: Error finding container e8104fc102fae6a920796ba55528697afea225bb8aaf01b55178d16a90ce7f4b: Status 404 returned error can't find the container with id e8104fc102fae6a920796ba55528697afea225bb8aaf01b55178d16a90ce7f4b
Sep 18 22:08:18.498026 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:18.498008    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckzpn8"
Sep 18 22:08:18.567166 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:18.567139    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6qdrxt"]
Sep 18 22:08:18.571129 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:08:18.571088    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa388291_e84d_4492_a604_cb90eaa03f66.slice/crio-d4e5c5a9a6e8aa5425e4bd5a14d218709d60f7b9a47d7eb81f004badf6fe0686 WatchSource:0}: Error finding container d4e5c5a9a6e8aa5425e4bd5a14d218709d60f7b9a47d7eb81f004badf6fe0686: Status 404 returned error can't find the container with id d4e5c5a9a6e8aa5425e4bd5a14d218709d60f7b9a47d7eb81f004badf6fe0686
Sep 18 22:08:18.666223 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:18.666196    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awg46d"]
Sep 18 22:08:18.667981 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:08:18.667957    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod966f0048_1b3f_4b99_a415_176362ec8c8a.slice/crio-99ebb9d66c1b6ce9a4a55a47dc25e27f9ca0853507fad00fa301265bf5adda49 WatchSource:0}: Error finding container 99ebb9d66c1b6ce9a4a55a47dc25e27f9ca0853507fad00fa301265bf5adda49: Status 404 returned error can't find the container with id 99ebb9d66c1b6ce9a4a55a47dc25e27f9ca0853507fad00fa301265bf5adda49
Sep 18 22:08:18.777525 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:18.777498    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckzpn8"]
Sep 18 22:08:18.812224 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:08:18.812185    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5332941f_b3d6_4c00_a6d9_556dfd9496d3.slice/crio-2532ff5965fe56ed27daff0be021a40dda3ce8b4aabf850295a080fe22014f5a WatchSource:0}: Error finding container 2532ff5965fe56ed27daff0be021a40dda3ce8b4aabf850295a080fe22014f5a: Status 404 returned error can't find the container with id 2532ff5965fe56ed27daff0be021a40dda3ce8b4aabf850295a080fe22014f5a
Sep 18 22:08:19.281999 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:19.281919    2577 generic.go:356] "Generic (PLEG): container finished" podID="966f0048-1b3f-4b99-a415-176362ec8c8a" containerID="de68d19eb9b62a47f83d44790fc3b1335b03b8896eb5896ba3267c125ea50a6d" exitCode=0
Sep 18 22:08:19.282473 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:19.282010    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awg46d" event={"ID":"966f0048-1b3f-4b99-a415-176362ec8c8a","Type":"ContainerDied","Data":"de68d19eb9b62a47f83d44790fc3b1335b03b8896eb5896ba3267c125ea50a6d"}
Sep 18 22:08:19.282473 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:19.282067    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awg46d" event={"ID":"966f0048-1b3f-4b99-a415-176362ec8c8a","Type":"ContainerStarted","Data":"99ebb9d66c1b6ce9a4a55a47dc25e27f9ca0853507fad00fa301265bf5adda49"}
Sep 18 22:08:19.283696 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:19.283674    2577 generic.go:356] "Generic (PLEG): container finished" podID="a8aba5a9-cce9-49fe-be26-0487c3c75071" containerID="4cdede7423bb86519ba50c7316b6ead1988934160479db9baded3b8a9130394e" exitCode=0
Sep 18 22:08:19.283788 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:19.283765    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7q9zpk" event={"ID":"a8aba5a9-cce9-49fe-be26-0487c3c75071","Type":"ContainerDied","Data":"4cdede7423bb86519ba50c7316b6ead1988934160479db9baded3b8a9130394e"}
Sep 18 22:08:19.283846 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:19.283830    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7q9zpk" event={"ID":"a8aba5a9-cce9-49fe-be26-0487c3c75071","Type":"ContainerStarted","Data":"e8104fc102fae6a920796ba55528697afea225bb8aaf01b55178d16a90ce7f4b"}
Sep 18 22:08:19.285217 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:19.285197    2577 generic.go:356] "Generic (PLEG): container finished" podID="5332941f-b3d6-4c00-a6d9-556dfd9496d3" containerID="0856b848616b060671f75429e8e8a5dbdae9894a44f1ad8640f9e91f5f77b756" exitCode=0
Sep 18 22:08:19.285287 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:19.285268    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckzpn8" event={"ID":"5332941f-b3d6-4c00-a6d9-556dfd9496d3","Type":"ContainerDied","Data":"0856b848616b060671f75429e8e8a5dbdae9894a44f1ad8640f9e91f5f77b756"}
Sep 18 22:08:19.285335 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:19.285307    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckzpn8" event={"ID":"5332941f-b3d6-4c00-a6d9-556dfd9496d3","Type":"ContainerStarted","Data":"2532ff5965fe56ed27daff0be021a40dda3ce8b4aabf850295a080fe22014f5a"}
Sep 18 22:08:19.287016 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:19.286998    2577 generic.go:356] "Generic (PLEG): container finished" podID="aa388291-e84d-4492-a604-cb90eaa03f66" containerID="757deea635ffe823adfc7aa0ccc2541d8fd5530127d84908d682f34faff3c5d2" exitCode=0
Sep 18 22:08:19.287111 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:19.287040    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6qdrxt" event={"ID":"aa388291-e84d-4492-a604-cb90eaa03f66","Type":"ContainerDied","Data":"757deea635ffe823adfc7aa0ccc2541d8fd5530127d84908d682f34faff3c5d2"}
Sep 18 22:08:19.287111 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:19.287096    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6qdrxt" event={"ID":"aa388291-e84d-4492-a604-cb90eaa03f66","Type":"ContainerStarted","Data":"d4e5c5a9a6e8aa5425e4bd5a14d218709d60f7b9a47d7eb81f004badf6fe0686"}
Sep 18 22:08:20.297319 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:20.296759    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7q9zpk" event={"ID":"a8aba5a9-cce9-49fe-be26-0487c3c75071","Type":"ContainerStarted","Data":"2b2fb27be22e77c40e2c321c52b04aa58cf66b2bc4d0fd46bb77f31539908975"}
Sep 18 22:08:20.301152 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:20.301115    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6qdrxt" event={"ID":"aa388291-e84d-4492-a604-cb90eaa03f66","Type":"ContainerStarted","Data":"3be7a72bdddba98d0dd506974801c7effa8cc19ddfb0267460bf0303dcc138cf"}
Sep 18 22:08:21.307814 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:21.307721    2577 generic.go:356] "Generic (PLEG): container finished" podID="5332941f-b3d6-4c00-a6d9-556dfd9496d3" containerID="c8e3e7184aa39d37d613ce488aa4a445aaa444fcb41eb66b77e7d4e762bf380f" exitCode=0
Sep 18 22:08:21.308315 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:21.307804    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckzpn8" event={"ID":"5332941f-b3d6-4c00-a6d9-556dfd9496d3","Type":"ContainerDied","Data":"c8e3e7184aa39d37d613ce488aa4a445aaa444fcb41eb66b77e7d4e762bf380f"}
Sep 18 22:08:21.309919 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:21.309900    2577 generic.go:356] "Generic (PLEG): container finished" podID="aa388291-e84d-4492-a604-cb90eaa03f66" containerID="3be7a72bdddba98d0dd506974801c7effa8cc19ddfb0267460bf0303dcc138cf" exitCode=0
Sep 18 22:08:21.310016 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:21.309983    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6qdrxt" event={"ID":"aa388291-e84d-4492-a604-cb90eaa03f66","Type":"ContainerDied","Data":"3be7a72bdddba98d0dd506974801c7effa8cc19ddfb0267460bf0303dcc138cf"}
Sep 18 22:08:21.312010 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:21.311989    2577 generic.go:356] "Generic (PLEG): container finished" podID="966f0048-1b3f-4b99-a415-176362ec8c8a" containerID="64f2a562a741da4ae8325ede138bf8c0f0deada91ad1b3f80cc47ace47235d93" exitCode=0
Sep 18 22:08:21.312086 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:21.312066    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awg46d" event={"ID":"966f0048-1b3f-4b99-a415-176362ec8c8a","Type":"ContainerDied","Data":"64f2a562a741da4ae8325ede138bf8c0f0deada91ad1b3f80cc47ace47235d93"}
Sep 18 22:08:21.314129 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:21.314109    2577 generic.go:356] "Generic (PLEG): container finished" podID="a8aba5a9-cce9-49fe-be26-0487c3c75071" containerID="2b2fb27be22e77c40e2c321c52b04aa58cf66b2bc4d0fd46bb77f31539908975" exitCode=0
Sep 18 22:08:21.314213 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:21.314154    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7q9zpk" event={"ID":"a8aba5a9-cce9-49fe-be26-0487c3c75071","Type":"ContainerDied","Data":"2b2fb27be22e77c40e2c321c52b04aa58cf66b2bc4d0fd46bb77f31539908975"}
Sep 18 22:08:22.322228 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:22.322193    2577 generic.go:356] "Generic (PLEG): container finished" podID="5332941f-b3d6-4c00-a6d9-556dfd9496d3" containerID="8a2dad6ee4ce8647aba23a11b73d247d8b2d2e9d0fecd4c685560373f3ee51db" exitCode=0
Sep 18 22:08:22.322691 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:22.322279    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckzpn8" event={"ID":"5332941f-b3d6-4c00-a6d9-556dfd9496d3","Type":"ContainerDied","Data":"8a2dad6ee4ce8647aba23a11b73d247d8b2d2e9d0fecd4c685560373f3ee51db"}
Sep 18 22:08:22.324437 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:22.324395    2577 generic.go:356] "Generic (PLEG): container finished" podID="aa388291-e84d-4492-a604-cb90eaa03f66" containerID="305ba48f4644964308d218460bf6faeb6f3e445c32fb0bdefa499a282a0e5d89" exitCode=0
Sep 18 22:08:22.324540 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:22.324445    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6qdrxt" event={"ID":"aa388291-e84d-4492-a604-cb90eaa03f66","Type":"ContainerDied","Data":"305ba48f4644964308d218460bf6faeb6f3e445c32fb0bdefa499a282a0e5d89"}
Sep 18 22:08:22.326628 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:22.326608    2577 generic.go:356] "Generic (PLEG): container finished" podID="966f0048-1b3f-4b99-a415-176362ec8c8a" containerID="68c8224d580cc045e1e5b446819a10d1272d549fe31fc54f62b9eee55b27179b" exitCode=0
Sep 18 22:08:22.326725 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:22.326682    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awg46d" event={"ID":"966f0048-1b3f-4b99-a415-176362ec8c8a","Type":"ContainerDied","Data":"68c8224d580cc045e1e5b446819a10d1272d549fe31fc54f62b9eee55b27179b"}
Sep 18 22:08:22.328922 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:22.328904    2577 generic.go:356] "Generic (PLEG): container finished" podID="a8aba5a9-cce9-49fe-be26-0487c3c75071" containerID="5bc8798999c2612a9de64284ac62adc42efa0270d850aa04343fa4c47d58db89" exitCode=0
Sep 18 22:08:22.329011 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:22.328928    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7q9zpk" event={"ID":"a8aba5a9-cce9-49fe-be26-0487c3c75071","Type":"ContainerDied","Data":"5bc8798999c2612a9de64284ac62adc42efa0270d850aa04343fa4c47d58db89"}
Sep 18 22:08:23.474247 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:23.474222    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6qdrxt"
Sep 18 22:08:23.552880 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:23.552852    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awg46d"
Sep 18 22:08:23.560184 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:23.560158    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7q9zpk"
Sep 18 22:08:23.565280 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:23.565256    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckzpn8"
Sep 18 22:08:23.592725 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:23.592653    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mq2c2\" (UniqueName: \"kubernetes.io/projected/aa388291-e84d-4492-a604-cb90eaa03f66-kube-api-access-mq2c2\") pod \"aa388291-e84d-4492-a604-cb90eaa03f66\" (UID: \"aa388291-e84d-4492-a604-cb90eaa03f66\") "
Sep 18 22:08:23.592725 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:23.592720    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa388291-e84d-4492-a604-cb90eaa03f66-util\") pod \"aa388291-e84d-4492-a604-cb90eaa03f66\" (UID: \"aa388291-e84d-4492-a604-cb90eaa03f66\") "
Sep 18 22:08:23.592984 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:23.592763    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa388291-e84d-4492-a604-cb90eaa03f66-bundle\") pod \"aa388291-e84d-4492-a604-cb90eaa03f66\" (UID: \"aa388291-e84d-4492-a604-cb90eaa03f66\") "
Sep 18 22:08:23.593531 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:23.593505    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa388291-e84d-4492-a604-cb90eaa03f66-bundle" (OuterVolumeSpecName: "bundle") pod "aa388291-e84d-4492-a604-cb90eaa03f66" (UID: "aa388291-e84d-4492-a604-cb90eaa03f66"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:08:23.595154 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:23.595127    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa388291-e84d-4492-a604-cb90eaa03f66-kube-api-access-mq2c2" (OuterVolumeSpecName: "kube-api-access-mq2c2") pod "aa388291-e84d-4492-a604-cb90eaa03f66" (UID: "aa388291-e84d-4492-a604-cb90eaa03f66"). InnerVolumeSpecName "kube-api-access-mq2c2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:08:23.599943 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:23.599908    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa388291-e84d-4492-a604-cb90eaa03f66-util" (OuterVolumeSpecName: "util") pod "aa388291-e84d-4492-a604-cb90eaa03f66" (UID: "aa388291-e84d-4492-a604-cb90eaa03f66"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:08:23.693990 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:23.693955    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a8aba5a9-cce9-49fe-be26-0487c3c75071-bundle\") pod \"a8aba5a9-cce9-49fe-be26-0487c3c75071\" (UID: \"a8aba5a9-cce9-49fe-be26-0487c3c75071\") "
Sep 18 22:08:23.694163 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:23.694019    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t4gzx\" (UniqueName: \"kubernetes.io/projected/5332941f-b3d6-4c00-a6d9-556dfd9496d3-kube-api-access-t4gzx\") pod \"5332941f-b3d6-4c00-a6d9-556dfd9496d3\" (UID: \"5332941f-b3d6-4c00-a6d9-556dfd9496d3\") "
Sep 18 22:08:23.694163 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:23.694046    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a8aba5a9-cce9-49fe-be26-0487c3c75071-util\") pod \"a8aba5a9-cce9-49fe-be26-0487c3c75071\" (UID: \"a8aba5a9-cce9-49fe-be26-0487c3c75071\") "
Sep 18 22:08:23.694163 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:23.694070    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/966f0048-1b3f-4b99-a415-176362ec8c8a-util\") pod \"966f0048-1b3f-4b99-a415-176362ec8c8a\" (UID: \"966f0048-1b3f-4b99-a415-176362ec8c8a\") "
Sep 18 22:08:23.694163 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:23.694091    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zb44r\" (UniqueName: \"kubernetes.io/projected/a8aba5a9-cce9-49fe-be26-0487c3c75071-kube-api-access-zb44r\") pod \"a8aba5a9-cce9-49fe-be26-0487c3c75071\" (UID: \"a8aba5a9-cce9-49fe-be26-0487c3c75071\") "
Sep 18 22:08:23.694163 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:23.694113    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/966f0048-1b3f-4b99-a415-176362ec8c8a-bundle\") pod \"966f0048-1b3f-4b99-a415-176362ec8c8a\" (UID: \"966f0048-1b3f-4b99-a415-176362ec8c8a\") "
Sep 18 22:08:23.694163 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:23.694140    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5332941f-b3d6-4c00-a6d9-556dfd9496d3-util\") pod \"5332941f-b3d6-4c00-a6d9-556dfd9496d3\" (UID: \"5332941f-b3d6-4c00-a6d9-556dfd9496d3\") "
Sep 18 22:08:23.694163 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:23.694166    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5332941f-b3d6-4c00-a6d9-556dfd9496d3-bundle\") pod \"5332941f-b3d6-4c00-a6d9-556dfd9496d3\" (UID: \"5332941f-b3d6-4c00-a6d9-556dfd9496d3\") "
Sep 18 22:08:23.694565 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:23.694188    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dq542\" (UniqueName: \"kubernetes.io/projected/966f0048-1b3f-4b99-a415-176362ec8c8a-kube-api-access-dq542\") pod \"966f0048-1b3f-4b99-a415-176362ec8c8a\" (UID: \"966f0048-1b3f-4b99-a415-176362ec8c8a\") "
Sep 18 22:08:23.694565 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:23.694492    2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa388291-e84d-4492-a604-cb90eaa03f66-bundle\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:08:23.694565 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:23.694513    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mq2c2\" (UniqueName: \"kubernetes.io/projected/aa388291-e84d-4492-a604-cb90eaa03f66-kube-api-access-mq2c2\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:08:23.694565 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:23.694529    2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa388291-e84d-4492-a604-cb90eaa03f66-util\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:08:23.694943 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:23.694865    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5332941f-b3d6-4c00-a6d9-556dfd9496d3-bundle" (OuterVolumeSpecName: "bundle") pod "5332941f-b3d6-4c00-a6d9-556dfd9496d3" (UID: "5332941f-b3d6-4c00-a6d9-556dfd9496d3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:08:23.695066 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:23.694932    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8aba5a9-cce9-49fe-be26-0487c3c75071-bundle" (OuterVolumeSpecName: "bundle") pod "a8aba5a9-cce9-49fe-be26-0487c3c75071" (UID: "a8aba5a9-cce9-49fe-be26-0487c3c75071"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:08:23.695694 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:23.695600    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/966f0048-1b3f-4b99-a415-176362ec8c8a-bundle" (OuterVolumeSpecName: "bundle") pod "966f0048-1b3f-4b99-a415-176362ec8c8a" (UID: "966f0048-1b3f-4b99-a415-176362ec8c8a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:08:23.697386 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:23.697358    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5332941f-b3d6-4c00-a6d9-556dfd9496d3-kube-api-access-t4gzx" (OuterVolumeSpecName: "kube-api-access-t4gzx") pod "5332941f-b3d6-4c00-a6d9-556dfd9496d3" (UID: "5332941f-b3d6-4c00-a6d9-556dfd9496d3"). InnerVolumeSpecName "kube-api-access-t4gzx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:08:23.697495 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:23.697406    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/966f0048-1b3f-4b99-a415-176362ec8c8a-kube-api-access-dq542" (OuterVolumeSpecName: "kube-api-access-dq542") pod "966f0048-1b3f-4b99-a415-176362ec8c8a" (UID: "966f0048-1b3f-4b99-a415-176362ec8c8a"). InnerVolumeSpecName "kube-api-access-dq542". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:08:23.697495 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:23.697481    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8aba5a9-cce9-49fe-be26-0487c3c75071-kube-api-access-zb44r" (OuterVolumeSpecName: "kube-api-access-zb44r") pod "a8aba5a9-cce9-49fe-be26-0487c3c75071" (UID: "a8aba5a9-cce9-49fe-be26-0487c3c75071"). InnerVolumeSpecName "kube-api-access-zb44r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:08:23.700967 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:23.700947    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/966f0048-1b3f-4b99-a415-176362ec8c8a-util" (OuterVolumeSpecName: "util") pod "966f0048-1b3f-4b99-a415-176362ec8c8a" (UID: "966f0048-1b3f-4b99-a415-176362ec8c8a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:08:23.701919 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:23.701896    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8aba5a9-cce9-49fe-be26-0487c3c75071-util" (OuterVolumeSpecName: "util") pod "a8aba5a9-cce9-49fe-be26-0487c3c75071" (UID: "a8aba5a9-cce9-49fe-be26-0487c3c75071"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:08:23.703258 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:23.703238    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5332941f-b3d6-4c00-a6d9-556dfd9496d3-util" (OuterVolumeSpecName: "util") pod "5332941f-b3d6-4c00-a6d9-556dfd9496d3" (UID: "5332941f-b3d6-4c00-a6d9-556dfd9496d3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:08:23.795524 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:23.795490    2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/966f0048-1b3f-4b99-a415-176362ec8c8a-util\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:08:23.795524 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:23.795520    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zb44r\" (UniqueName: \"kubernetes.io/projected/a8aba5a9-cce9-49fe-be26-0487c3c75071-kube-api-access-zb44r\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:08:23.795524 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:23.795531    2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/966f0048-1b3f-4b99-a415-176362ec8c8a-bundle\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:08:23.795757 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:23.795540    2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5332941f-b3d6-4c00-a6d9-556dfd9496d3-util\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:08:23.795757 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:23.795548    2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5332941f-b3d6-4c00-a6d9-556dfd9496d3-bundle\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:08:23.795757 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:23.795555    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dq542\" (UniqueName: \"kubernetes.io/projected/966f0048-1b3f-4b99-a415-176362ec8c8a-kube-api-access-dq542\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:08:23.795757 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:23.795563    2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a8aba5a9-cce9-49fe-be26-0487c3c75071-bundle\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:08:23.795757 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:23.795570    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t4gzx\" (UniqueName: \"kubernetes.io/projected/5332941f-b3d6-4c00-a6d9-556dfd9496d3-kube-api-access-t4gzx\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:08:23.795757 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:23.795577    2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a8aba5a9-cce9-49fe-be26-0487c3c75071-util\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:08:24.340797 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:24.340768    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7q9zpk"
Sep 18 22:08:24.340975 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:24.340767    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7q9zpk" event={"ID":"a8aba5a9-cce9-49fe-be26-0487c3c75071","Type":"ContainerDied","Data":"e8104fc102fae6a920796ba55528697afea225bb8aaf01b55178d16a90ce7f4b"}
Sep 18 22:08:24.340975 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:24.340903    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e8104fc102fae6a920796ba55528697afea225bb8aaf01b55178d16a90ce7f4b"
Sep 18 22:08:24.342877 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:24.342854    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckzpn8" event={"ID":"5332941f-b3d6-4c00-a6d9-556dfd9496d3","Type":"ContainerDied","Data":"2532ff5965fe56ed27daff0be021a40dda3ce8b4aabf850295a080fe22014f5a"}
Sep 18 22:08:24.343015 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:24.342894    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2532ff5965fe56ed27daff0be021a40dda3ce8b4aabf850295a080fe22014f5a"
Sep 18 22:08:24.343015 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:24.342859    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckzpn8"
Sep 18 22:08:24.344906 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:24.344888    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6qdrxt"
Sep 18 22:08:24.345054 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:24.344919    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6qdrxt" event={"ID":"aa388291-e84d-4492-a604-cb90eaa03f66","Type":"ContainerDied","Data":"d4e5c5a9a6e8aa5425e4bd5a14d218709d60f7b9a47d7eb81f004badf6fe0686"}
Sep 18 22:08:24.345054 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:24.344955    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d4e5c5a9a6e8aa5425e4bd5a14d218709d60f7b9a47d7eb81f004badf6fe0686"
Sep 18 22:08:24.347163 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:24.347137    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awg46d" event={"ID":"966f0048-1b3f-4b99-a415-176362ec8c8a","Type":"ContainerDied","Data":"99ebb9d66c1b6ce9a4a55a47dc25e27f9ca0853507fad00fa301265bf5adda49"}
Sep 18 22:08:24.347274 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:24.347176    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="99ebb9d66c1b6ce9a4a55a47dc25e27f9ca0853507fad00fa301265bf5adda49"
Sep 18 22:08:24.347274 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:24.347184    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awg46d"
Sep 18 22:08:32.118827 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:32.118791    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-8r76d"]
Sep 18 22:08:32.119237 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:32.119108    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="966f0048-1b3f-4b99-a415-176362ec8c8a" containerName="pull"
Sep 18 22:08:32.119237 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:32.119119    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="966f0048-1b3f-4b99-a415-176362ec8c8a" containerName="pull"
Sep 18 22:08:32.119237 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:32.119127    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa388291-e84d-4492-a604-cb90eaa03f66" containerName="util"
Sep 18 22:08:32.119237 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:32.119132    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa388291-e84d-4492-a604-cb90eaa03f66" containerName="util"
Sep 18 22:08:32.119237 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:32.119138    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5332941f-b3d6-4c00-a6d9-556dfd9496d3" containerName="util"
Sep 18 22:08:32.119237 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:32.119144    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="5332941f-b3d6-4c00-a6d9-556dfd9496d3" containerName="util"
Sep 18 22:08:32.119237 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:32.119150    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa388291-e84d-4492-a604-cb90eaa03f66" containerName="extract"
Sep 18 22:08:32.119237 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:32.119155    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa388291-e84d-4492-a604-cb90eaa03f66" containerName="extract"
Sep 18 22:08:32.119237 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:32.119160    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5332941f-b3d6-4c00-a6d9-556dfd9496d3" containerName="extract"
Sep 18 22:08:32.119237 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:32.119165    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="5332941f-b3d6-4c00-a6d9-556dfd9496d3" containerName="extract"
Sep 18 22:08:32.119237 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:32.119170    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="966f0048-1b3f-4b99-a415-176362ec8c8a" containerName="extract"
Sep 18 22:08:32.119237 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:32.119175    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="966f0048-1b3f-4b99-a415-176362ec8c8a" containerName="extract"
Sep 18 22:08:32.119237 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:32.119183    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8aba5a9-cce9-49fe-be26-0487c3c75071" containerName="pull"
Sep 18 22:08:32.119237 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:32.119191    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8aba5a9-cce9-49fe-be26-0487c3c75071" containerName="pull"
Sep 18 22:08:32.119237 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:32.119197    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8aba5a9-cce9-49fe-be26-0487c3c75071" containerName="extract"
Sep 18 22:08:32.119237 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:32.119202    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8aba5a9-cce9-49fe-be26-0487c3c75071" containerName="extract"
Sep 18 22:08:32.119237 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:32.119210    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="966f0048-1b3f-4b99-a415-176362ec8c8a" containerName="util"
Sep 18 22:08:32.119237 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:32.119214    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="966f0048-1b3f-4b99-a415-176362ec8c8a" containerName="util"
Sep 18 22:08:32.119237 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:32.119221    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa388291-e84d-4492-a604-cb90eaa03f66" containerName="pull"
Sep 18 22:08:32.119237 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:32.119226    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa388291-e84d-4492-a604-cb90eaa03f66" containerName="pull"
Sep 18 22:08:32.119237 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:32.119232    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5332941f-b3d6-4c00-a6d9-556dfd9496d3" containerName="pull"
Sep 18 22:08:32.119237 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:32.119236    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="5332941f-b3d6-4c00-a6d9-556dfd9496d3" containerName="pull"
Sep 18 22:08:32.119237 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:32.119245    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8aba5a9-cce9-49fe-be26-0487c3c75071" containerName="util"
Sep 18 22:08:32.119237 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:32.119250    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8aba5a9-cce9-49fe-be26-0487c3c75071" containerName="util"
Sep 18 22:08:32.119919 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:32.119296    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="5332941f-b3d6-4c00-a6d9-556dfd9496d3" containerName="extract"
Sep 18 22:08:32.119919 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:32.119303    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa388291-e84d-4492-a604-cb90eaa03f66" containerName="extract"
Sep 18 22:08:32.119919 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:32.119309    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8aba5a9-cce9-49fe-be26-0487c3c75071" containerName="extract"
Sep 18 22:08:32.119919 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:32.119315    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="966f0048-1b3f-4b99-a415-176362ec8c8a" containerName="extract"
Sep 18 22:08:32.126070 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:32.123346    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-8r76d"
Sep 18 22:08:32.127505 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:32.127483    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-sk59l\""
Sep 18 22:08:32.128181 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:32.128160    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 18 22:08:32.128282 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:32.128181    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Sep 18 22:08:32.128282 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:32.128197    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 18 22:08:32.135941 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:32.135911    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-8r76d"]
Sep 18 22:08:32.268701 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:32.268661    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhhqc\" (UniqueName: \"kubernetes.io/projected/65aa5a5c-2b45-47b3-965a-8e90c4dea733-kube-api-access-mhhqc\") pod \"dns-operator-controller-manager-7b84cd7c9c-8r76d\" (UID: \"65aa5a5c-2b45-47b3-965a-8e90c4dea733\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-8r76d"
Sep 18 22:08:32.370112 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:32.370031    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhhqc\" (UniqueName: \"kubernetes.io/projected/65aa5a5c-2b45-47b3-965a-8e90c4dea733-kube-api-access-mhhqc\") pod \"dns-operator-controller-manager-7b84cd7c9c-8r76d\" (UID: \"65aa5a5c-2b45-47b3-965a-8e90c4dea733\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-8r76d"
Sep 18 22:08:32.384786 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:32.384752    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhhqc\" (UniqueName: \"kubernetes.io/projected/65aa5a5c-2b45-47b3-965a-8e90c4dea733-kube-api-access-mhhqc\") pod \"dns-operator-controller-manager-7b84cd7c9c-8r76d\" (UID: \"65aa5a5c-2b45-47b3-965a-8e90c4dea733\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-8r76d"
Sep 18 22:08:32.435153 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:32.435110    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-8r76d"
Sep 18 22:08:32.715508 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:32.715478    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-8r76d"]
Sep 18 22:08:32.716759 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:08:32.716732    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65aa5a5c_2b45_47b3_965a_8e90c4dea733.slice/crio-4232552f0184e65a5de7826752df9a8c1316e073f1ef9d5eb0c14da3e2181002 WatchSource:0}: Error finding container 4232552f0184e65a5de7826752df9a8c1316e073f1ef9d5eb0c14da3e2181002: Status 404 returned error can't find the container with id 4232552f0184e65a5de7826752df9a8c1316e073f1ef9d5eb0c14da3e2181002
Sep 18 22:08:33.395563 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:33.395528    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-8r76d" event={"ID":"65aa5a5c-2b45-47b3-965a-8e90c4dea733","Type":"ContainerStarted","Data":"4232552f0184e65a5de7826752df9a8c1316e073f1ef9d5eb0c14da3e2181002"}
Sep 18 22:08:36.423164 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:36.423117    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-8r76d" event={"ID":"65aa5a5c-2b45-47b3-965a-8e90c4dea733","Type":"ContainerStarted","Data":"88275ea82cd46de0a117cb26c958348e62b09f2f3c1a901a270d003bb793e8a0"}
Sep 18 22:08:36.423670 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:36.423396    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-8r76d"
Sep 18 22:08:36.464020 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:36.463958    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-8r76d" podStartSLOduration=1.563633003 podStartE2EDuration="4.46393793s" totalImagesPullingTime="2.900304927s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:08:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:08:36.461888699 +0000 UTC m=+495.781560755" watchObservedRunningTime="2026-09-18 22:08:36.46393793 +0000 UTC m=+495.783609986"
Sep 18 22:08:37.383914 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:37.383882    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-q5txd"]
Sep 18 22:08:37.387335 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:37.387318    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-q5txd"
Sep 18 22:08:37.391602 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:37.391580    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-zz7vq\""
Sep 18 22:08:37.407050 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:37.407025    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-q5txd"]
Sep 18 22:08:37.415693 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:37.415671    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3a259dda-42a7-4b33-8c95-bb34cf71a2da-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-q5txd\" (UID: \"3a259dda-42a7-4b33-8c95-bb34cf71a2da\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-q5txd"
Sep 18 22:08:37.415798 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:37.415748    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvp7g\" (UniqueName: \"kubernetes.io/projected/3a259dda-42a7-4b33-8c95-bb34cf71a2da-kube-api-access-dvp7g\") pod \"kuadrant-operator-controller-manager-76f8f686bf-q5txd\" (UID: \"3a259dda-42a7-4b33-8c95-bb34cf71a2da\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-q5txd"
Sep 18 22:08:37.516273 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:37.516238    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvp7g\" (UniqueName: \"kubernetes.io/projected/3a259dda-42a7-4b33-8c95-bb34cf71a2da-kube-api-access-dvp7g\") pod \"kuadrant-operator-controller-manager-76f8f686bf-q5txd\" (UID: \"3a259dda-42a7-4b33-8c95-bb34cf71a2da\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-q5txd"
Sep 18 22:08:37.516776 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:37.516301    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3a259dda-42a7-4b33-8c95-bb34cf71a2da-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-q5txd\" (UID: \"3a259dda-42a7-4b33-8c95-bb34cf71a2da\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-q5txd"
Sep 18 22:08:37.516776 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:37.516726    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3a259dda-42a7-4b33-8c95-bb34cf71a2da-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-q5txd\" (UID: \"3a259dda-42a7-4b33-8c95-bb34cf71a2da\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-q5txd"
Sep 18 22:08:37.537700 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:37.537665    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvp7g\" (UniqueName: \"kubernetes.io/projected/3a259dda-42a7-4b33-8c95-bb34cf71a2da-kube-api-access-dvp7g\") pod \"kuadrant-operator-controller-manager-76f8f686bf-q5txd\" (UID: \"3a259dda-42a7-4b33-8c95-bb34cf71a2da\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-q5txd"
Sep 18 22:08:37.697616 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:37.697532    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-q5txd"
Sep 18 22:08:37.987746 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:37.987718    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-q5txd"]
Sep 18 22:08:37.990782 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:08:37.990754    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a259dda_42a7_4b33_8c95_bb34cf71a2da.slice/crio-c6747c5ee702dff04cf2ea3ae2207720307f9b7dc7c42eac30b86a642a9e7d00 WatchSource:0}: Error finding container c6747c5ee702dff04cf2ea3ae2207720307f9b7dc7c42eac30b86a642a9e7d00: Status 404 returned error can't find the container with id c6747c5ee702dff04cf2ea3ae2207720307f9b7dc7c42eac30b86a642a9e7d00
Sep 18 22:08:38.434859 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:38.434829    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-q5txd" event={"ID":"3a259dda-42a7-4b33-8c95-bb34cf71a2da","Type":"ContainerStarted","Data":"c6747c5ee702dff04cf2ea3ae2207720307f9b7dc7c42eac30b86a642a9e7d00"}
Sep 18 22:08:38.664547 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:38.664518    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-nmt8r"]
Sep 18 22:08:38.669581 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:38.669560    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-nmt8r"
Sep 18 22:08:38.671830 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:38.671811    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-bnk88\""
Sep 18 22:08:38.679159 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:38.679126    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-nmt8r"]
Sep 18 22:08:38.724866 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:38.724797    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qh9hk\" (UniqueName: \"kubernetes.io/projected/b4bf058b-905d-481c-b4bd-15e25a5c9c76-kube-api-access-qh9hk\") pod \"limitador-operator-controller-manager-74495c69f8-nmt8r\" (UID: \"b4bf058b-905d-481c-b4bd-15e25a5c9c76\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-nmt8r"
Sep 18 22:08:38.826047 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:38.825998    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qh9hk\" (UniqueName: \"kubernetes.io/projected/b4bf058b-905d-481c-b4bd-15e25a5c9c76-kube-api-access-qh9hk\") pod \"limitador-operator-controller-manager-74495c69f8-nmt8r\" (UID: \"b4bf058b-905d-481c-b4bd-15e25a5c9c76\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-nmt8r"
Sep 18 22:08:38.835867 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:38.835842    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qh9hk\" (UniqueName: \"kubernetes.io/projected/b4bf058b-905d-481c-b4bd-15e25a5c9c76-kube-api-access-qh9hk\") pod \"limitador-operator-controller-manager-74495c69f8-nmt8r\" (UID: \"b4bf058b-905d-481c-b4bd-15e25a5c9c76\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-nmt8r"
Sep 18 22:08:38.980665 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:38.980568    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-nmt8r"
Sep 18 22:08:39.283149 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:39.283122    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-nmt8r"]
Sep 18 22:08:39.285755 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:08:39.285723    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4bf058b_905d_481c_b4bd_15e25a5c9c76.slice/crio-ee600b584c4fa935e5fe2db922110c8a441c188b2717bace6082184b4a35023a WatchSource:0}: Error finding container ee600b584c4fa935e5fe2db922110c8a441c188b2717bace6082184b4a35023a: Status 404 returned error can't find the container with id ee600b584c4fa935e5fe2db922110c8a441c188b2717bace6082184b4a35023a
Sep 18 22:08:39.442230 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:39.442191    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-nmt8r" event={"ID":"b4bf058b-905d-481c-b4bd-15e25a5c9c76","Type":"ContainerStarted","Data":"ee600b584c4fa935e5fe2db922110c8a441c188b2717bace6082184b4a35023a"}
Sep 18 22:08:41.502944 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:41.502906    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-2shkc"]
Sep 18 22:08:41.506639 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:41.506603    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-2shkc"
Sep 18 22:08:41.509748 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:41.509722    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-gtnl9\""
Sep 18 22:08:41.544681 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:41.544649    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-2shkc"]
Sep 18 22:08:41.555283 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:41.555252    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pczvl\" (UniqueName: \"kubernetes.io/projected/1c9f995a-988a-4242-b75b-9bb9c83c1f3b-kube-api-access-pczvl\") pod \"authorino-operator-76b478bd78-2shkc\" (UID: \"1c9f995a-988a-4242-b75b-9bb9c83c1f3b\") " pod="kuadrant-system/authorino-operator-76b478bd78-2shkc"
Sep 18 22:08:41.656075 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:41.656040    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pczvl\" (UniqueName: \"kubernetes.io/projected/1c9f995a-988a-4242-b75b-9bb9c83c1f3b-kube-api-access-pczvl\") pod \"authorino-operator-76b478bd78-2shkc\" (UID: \"1c9f995a-988a-4242-b75b-9bb9c83c1f3b\") " pod="kuadrant-system/authorino-operator-76b478bd78-2shkc"
Sep 18 22:08:41.687696 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:41.687665    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pczvl\" (UniqueName: \"kubernetes.io/projected/1c9f995a-988a-4242-b75b-9bb9c83c1f3b-kube-api-access-pczvl\") pod \"authorino-operator-76b478bd78-2shkc\" (UID: \"1c9f995a-988a-4242-b75b-9bb9c83c1f3b\") " pod="kuadrant-system/authorino-operator-76b478bd78-2shkc"
Sep 18 22:08:41.820000 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:41.819961    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-2shkc"
Sep 18 22:08:42.679971 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:42.679945    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-2shkc"]
Sep 18 22:08:42.682184 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:08:42.682158    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c9f995a_988a_4242_b75b_9bb9c83c1f3b.slice/crio-8e2d8fc0437097be1944eaf8e7ef817a730d3e48b80793f6eace362bbe060c20 WatchSource:0}: Error finding container 8e2d8fc0437097be1944eaf8e7ef817a730d3e48b80793f6eace362bbe060c20: Status 404 returned error can't find the container with id 8e2d8fc0437097be1944eaf8e7ef817a730d3e48b80793f6eace362bbe060c20
Sep 18 22:08:43.472077 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:43.472043    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-q5txd" event={"ID":"3a259dda-42a7-4b33-8c95-bb34cf71a2da","Type":"ContainerStarted","Data":"0739f86226ee699fb1af7858294861bb0bf0af4ca6da86451de7640c473642a8"}
Sep 18 22:08:43.472232 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:43.472175    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-q5txd"
Sep 18 22:08:43.473610 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:43.473576    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-2shkc" event={"ID":"1c9f995a-988a-4242-b75b-9bb9c83c1f3b","Type":"ContainerStarted","Data":"8e2d8fc0437097be1944eaf8e7ef817a730d3e48b80793f6eace362bbe060c20"}
Sep 18 22:08:43.475216 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:43.475197    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-nmt8r" event={"ID":"b4bf058b-905d-481c-b4bd-15e25a5c9c76","Type":"ContainerStarted","Data":"c0592747f614ebe21f892ec9b70467723b119b2669fa7bc859898537917d1192"}
Sep 18 22:08:43.475332 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:43.475319    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-nmt8r"
Sep 18 22:08:43.494461 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:43.494389    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-q5txd" podStartSLOduration=2.096557528 podStartE2EDuration="6.494375797s" totalImagesPullingTime="4.397818269s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:08:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:08:43.493273603 +0000 UTC m=+502.812945671" watchObservedRunningTime="2026-09-18 22:08:43.494375797 +0000 UTC m=+502.814047852"
Sep 18 22:08:43.516794 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:43.516749    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-nmt8r" podStartSLOduration=2.4183505419999998 podStartE2EDuration="5.516735161s" totalImagesPullingTime="3.098384619s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:08:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:08:43.514772902 +0000 UTC m=+502.834444958" watchObservedRunningTime="2026-09-18 22:08:43.516735161 +0000 UTC m=+502.836407216"
Sep 18 22:08:44.485612 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:44.485521    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-2shkc" event={"ID":"1c9f995a-988a-4242-b75b-9bb9c83c1f3b","Type":"ContainerStarted","Data":"f9a9649ba7fd7efe842880a0d31430bdd047d26a25be3cb4ec0a068242d6a09b"}
Sep 18 22:08:44.508545 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:44.508495    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-76b478bd78-2shkc" podStartSLOduration=2.037907894 podStartE2EDuration="3.508480122s" totalImagesPullingTime="1.470572228s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:08:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:08:44.506118136 +0000 UTC m=+503.825790190" watchObservedRunningTime="2026-09-18 22:08:44.508480122 +0000 UTC m=+503.828152176"
Sep 18 22:08:45.397609 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:45.397574    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-vwdjr"]
Sep 18 22:08:45.401543 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:45.401517    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-vwdjr"
Sep 18 22:08:45.404300 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:45.404280    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Sep 18 22:08:45.405803 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:45.405780    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-jxbsr\""
Sep 18 22:08:45.413764 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:45.413742    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Sep 18 22:08:45.423680 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:45.423656    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-vwdjr"]
Sep 18 22:08:45.491319 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:45.491279    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-76b478bd78-2shkc"
Sep 18 22:08:45.499759 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:45.499737    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/baf93c9a-150e-4a54-bafb-f6f97afaebed-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-vwdjr\" (UID: \"baf93c9a-150e-4a54-bafb-f6f97afaebed\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-vwdjr"
Sep 18 22:08:45.499858 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:45.499780    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wn5d7\" (UniqueName: \"kubernetes.io/projected/baf93c9a-150e-4a54-bafb-f6f97afaebed-kube-api-access-wn5d7\") pod \"kuadrant-console-plugin-fbdd4f445-vwdjr\" (UID: \"baf93c9a-150e-4a54-bafb-f6f97afaebed\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-vwdjr"
Sep 18 22:08:45.499858 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:45.499819    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/baf93c9a-150e-4a54-bafb-f6f97afaebed-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-vwdjr\" (UID: \"baf93c9a-150e-4a54-bafb-f6f97afaebed\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-vwdjr"
Sep 18 22:08:45.601176 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:45.601143    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/baf93c9a-150e-4a54-bafb-f6f97afaebed-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-vwdjr\" (UID: \"baf93c9a-150e-4a54-bafb-f6f97afaebed\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-vwdjr"
Sep 18 22:08:45.601349 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:45.601186    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wn5d7\" (UniqueName: \"kubernetes.io/projected/baf93c9a-150e-4a54-bafb-f6f97afaebed-kube-api-access-wn5d7\") pod \"kuadrant-console-plugin-fbdd4f445-vwdjr\" (UID: \"baf93c9a-150e-4a54-bafb-f6f97afaebed\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-vwdjr"
Sep 18 22:08:45.601349 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:45.601221    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/baf93c9a-150e-4a54-bafb-f6f97afaebed-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-vwdjr\" (UID: \"baf93c9a-150e-4a54-bafb-f6f97afaebed\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-vwdjr"
Sep 18 22:08:45.601349 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:08:45.601302    2577 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Sep 18 22:08:45.601546 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:08:45.601378    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/baf93c9a-150e-4a54-bafb-f6f97afaebed-plugin-serving-cert podName:baf93c9a-150e-4a54-bafb-f6f97afaebed nodeName:}" failed. No retries permitted until 2026-09-18 22:08:46.101357694 +0000 UTC m=+505.421029749 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/baf93c9a-150e-4a54-bafb-f6f97afaebed-plugin-serving-cert") pod "kuadrant-console-plugin-fbdd4f445-vwdjr" (UID: "baf93c9a-150e-4a54-bafb-f6f97afaebed") : secret "plugin-serving-cert" not found
Sep 18 22:08:45.601833 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:45.601816    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/baf93c9a-150e-4a54-bafb-f6f97afaebed-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-vwdjr\" (UID: \"baf93c9a-150e-4a54-bafb-f6f97afaebed\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-vwdjr"
Sep 18 22:08:45.617740 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:45.617711    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wn5d7\" (UniqueName: \"kubernetes.io/projected/baf93c9a-150e-4a54-bafb-f6f97afaebed-kube-api-access-wn5d7\") pod \"kuadrant-console-plugin-fbdd4f445-vwdjr\" (UID: \"baf93c9a-150e-4a54-bafb-f6f97afaebed\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-vwdjr"
Sep 18 22:08:46.105844 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:46.105810    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/baf93c9a-150e-4a54-bafb-f6f97afaebed-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-vwdjr\" (UID: \"baf93c9a-150e-4a54-bafb-f6f97afaebed\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-vwdjr"
Sep 18 22:08:46.108292 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:46.108269    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/baf93c9a-150e-4a54-bafb-f6f97afaebed-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-vwdjr\" (UID: \"baf93c9a-150e-4a54-bafb-f6f97afaebed\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-vwdjr"
Sep 18 22:08:46.312646 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:46.312612    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-vwdjr"
Sep 18 22:08:46.637623 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:46.637442    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-vwdjr"]
Sep 18 22:08:46.640252 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:08:46.640223    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbaf93c9a_150e_4a54_bafb_f6f97afaebed.slice/crio-526ade871b81a7d51e20b5b4dbf40353baa870380115c66da20322adc1bfd6b5 WatchSource:0}: Error finding container 526ade871b81a7d51e20b5b4dbf40353baa870380115c66da20322adc1bfd6b5: Status 404 returned error can't find the container with id 526ade871b81a7d51e20b5b4dbf40353baa870380115c66da20322adc1bfd6b5
Sep 18 22:08:47.430896 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:47.430867    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-8r76d"
Sep 18 22:08:47.503462 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:47.503426    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-vwdjr" event={"ID":"baf93c9a-150e-4a54-bafb-f6f97afaebed","Type":"ContainerStarted","Data":"526ade871b81a7d51e20b5b4dbf40353baa870380115c66da20322adc1bfd6b5"}
Sep 18 22:08:52.535211 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:52.535169    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-vwdjr" event={"ID":"baf93c9a-150e-4a54-bafb-f6f97afaebed","Type":"ContainerStarted","Data":"108ee7e69ca63ab2c76f5d25787a5844ff01363d0635a89d6a338215e290ff52"}
Sep 18 22:08:52.561823 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:52.561773    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-vwdjr" podStartSLOduration=2.695474094 podStartE2EDuration="7.561756449s" totalImagesPullingTime="4.866282355s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:08:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:08:52.56109762 +0000 UTC m=+511.880769675" watchObservedRunningTime="2026-09-18 22:08:52.561756449 +0000 UTC m=+511.881428503"
Sep 18 22:08:54.487861 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:54.487833    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-nmt8r"
Sep 18 22:08:54.488292 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:54.487918    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-q5txd"
Sep 18 22:08:56.498988 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:56.498950    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-76b478bd78-2shkc"
Sep 18 22:08:56.743964 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:56.743928    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-q5txd"]
Sep 18 22:08:56.744186 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:56.744157    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-q5txd" podUID="3a259dda-42a7-4b33-8c95-bb34cf71a2da" containerName="manager" containerID="cri-o://0739f86226ee699fb1af7858294861bb0bf0af4ca6da86451de7640c473642a8" gracePeriod=2
Sep 18 22:08:56.760150 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:56.760122    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-q5txd"]
Sep 18 22:08:56.780226 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:56.780196    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-nmt8r"]
Sep 18 22:08:56.780395 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:56.780376    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-nmt8r" podUID="b4bf058b-905d-481c-b4bd-15e25a5c9c76" containerName="manager" containerID="cri-o://c0592747f614ebe21f892ec9b70467723b119b2669fa7bc859898537917d1192" gracePeriod=2
Sep 18 22:08:56.783869 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:08:56.783751    2577 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"3a259dda-42a7-4b33-8c95-bb34cf71a2da\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-76f8f686bf-q5txd\": pods \"kuadrant-operator-controller-manager-76f8f686bf-q5txd\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-q5txd"
Sep 18 22:08:56.785748 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:08:56.785715    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-q5txd\" is forbidden: User \"system:node:ip-10-0-141-99.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-99.ec2.internal' and this object" podUID="3a259dda-42a7-4b33-8c95-bb34cf71a2da" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-q5txd"
Sep 18 22:08:56.797908 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:56.797879    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hxqz6"]
Sep 18 22:08:56.798472 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:56.798401    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a259dda-42a7-4b33-8c95-bb34cf71a2da" containerName="manager"
Sep 18 22:08:56.798472 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:56.798437    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a259dda-42a7-4b33-8c95-bb34cf71a2da" containerName="manager"
Sep 18 22:08:56.798676 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:56.798522    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a259dda-42a7-4b33-8c95-bb34cf71a2da" containerName="manager"
Sep 18 22:08:56.826192 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:56.826171    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-nmt8r"]
Sep 18 22:08:56.826284 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:56.826266    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hxqz6"
Sep 18 22:08:56.839462 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:56.839437    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-74rm8"]
Sep 18 22:08:56.839975 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:56.839959    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4bf058b-905d-481c-b4bd-15e25a5c9c76" containerName="manager"
Sep 18 22:08:56.840018 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:56.839981    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4bf058b-905d-481c-b4bd-15e25a5c9c76" containerName="manager"
Sep 18 22:08:56.840073 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:56.840062    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4bf058b-905d-481c-b4bd-15e25a5c9c76" containerName="manager"
Sep 18 22:08:56.864021 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:56.863969    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hxqz6"]
Sep 18 22:08:56.864176 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:56.864113    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-74rm8"
Sep 18 22:08:56.865967 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:56.865943    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-74rm8"]
Sep 18 22:08:56.904888 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:56.904859    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwwg6\" (UniqueName: \"kubernetes.io/projected/8785c31a-e73d-4904-9eb9-a64e1eedf7dc-kube-api-access-xwwg6\") pod \"kuadrant-operator-controller-manager-76f8f686bf-hxqz6\" (UID: \"8785c31a-e73d-4904-9eb9-a64e1eedf7dc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hxqz6"
Sep 18 22:08:56.905028 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:56.904934    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8785c31a-e73d-4904-9eb9-a64e1eedf7dc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-hxqz6\" (UID: \"8785c31a-e73d-4904-9eb9-a64e1eedf7dc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hxqz6"
Sep 18 22:08:56.911489 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:08:56.911461    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-q5txd\" is forbidden: User \"system:node:ip-10-0-141-99.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-99.ec2.internal' and this object" podUID="3a259dda-42a7-4b33-8c95-bb34cf71a2da" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-q5txd"
Sep 18 22:08:56.913567 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:08:56.913534    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-nmt8r\" is forbidden: User \"system:node:ip-10-0-141-99.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-99.ec2.internal' and this object" podUID="b4bf058b-905d-481c-b4bd-15e25a5c9c76" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-nmt8r"
Sep 18 22:08:56.916299 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:08:56.916043    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-q5txd\" is forbidden: User \"system:node:ip-10-0-141-99.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-99.ec2.internal' and this object" podUID="3a259dda-42a7-4b33-8c95-bb34cf71a2da" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-q5txd"
Sep 18 22:08:56.918054 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:08:56.918020    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-nmt8r\" is forbidden: User \"system:node:ip-10-0-141-99.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-99.ec2.internal' and this object" podUID="b4bf058b-905d-481c-b4bd-15e25a5c9c76" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-nmt8r"
Sep 18 22:08:57.006365 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:57.006273    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8785c31a-e73d-4904-9eb9-a64e1eedf7dc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-hxqz6\" (UID: \"8785c31a-e73d-4904-9eb9-a64e1eedf7dc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hxqz6"
Sep 18 22:08:57.006517 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:57.006395    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sm5rv\" (UniqueName: \"kubernetes.io/projected/989cf005-4244-4113-a129-d003828298b7-kube-api-access-sm5rv\") pod \"limitador-operator-controller-manager-74495c69f8-74rm8\" (UID: \"989cf005-4244-4113-a129-d003828298b7\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-74rm8"
Sep 18 22:08:57.006517 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:57.006483    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwwg6\" (UniqueName: \"kubernetes.io/projected/8785c31a-e73d-4904-9eb9-a64e1eedf7dc-kube-api-access-xwwg6\") pod \"kuadrant-operator-controller-manager-76f8f686bf-hxqz6\" (UID: \"8785c31a-e73d-4904-9eb9-a64e1eedf7dc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hxqz6"
Sep 18 22:08:57.006696 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:57.006673    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8785c31a-e73d-4904-9eb9-a64e1eedf7dc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-hxqz6\" (UID: \"8785c31a-e73d-4904-9eb9-a64e1eedf7dc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hxqz6"
Sep 18 22:08:57.041005 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:57.040970    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwwg6\" (UniqueName: \"kubernetes.io/projected/8785c31a-e73d-4904-9eb9-a64e1eedf7dc-kube-api-access-xwwg6\") pod \"kuadrant-operator-controller-manager-76f8f686bf-hxqz6\" (UID: \"8785c31a-e73d-4904-9eb9-a64e1eedf7dc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hxqz6"
Sep 18 22:08:57.081162 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:57.081138    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-q5txd"
Sep 18 22:08:57.084988 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:08:57.084958    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-q5txd\" is forbidden: User \"system:node:ip-10-0-141-99.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-99.ec2.internal' and this object" podUID="3a259dda-42a7-4b33-8c95-bb34cf71a2da" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-q5txd"
Sep 18 22:08:57.087504 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:08:57.087481    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-nmt8r\" is forbidden: User \"system:node:ip-10-0-141-99.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-99.ec2.internal' and this object" podUID="b4bf058b-905d-481c-b4bd-15e25a5c9c76" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-nmt8r"
Sep 18 22:08:57.094943 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:57.094923    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-nmt8r"
Sep 18 22:08:57.097535 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:08:57.097504    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-q5txd\" is forbidden: User \"system:node:ip-10-0-141-99.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-99.ec2.internal' and this object" podUID="3a259dda-42a7-4b33-8c95-bb34cf71a2da" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-q5txd"
Sep 18 22:08:57.102366 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:08:57.102346    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-nmt8r\" is forbidden: User \"system:node:ip-10-0-141-99.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-99.ec2.internal' and this object" podUID="b4bf058b-905d-481c-b4bd-15e25a5c9c76" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-nmt8r"
Sep 18 22:08:57.107776 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:57.107756    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sm5rv\" (UniqueName: \"kubernetes.io/projected/989cf005-4244-4113-a129-d003828298b7-kube-api-access-sm5rv\") pod \"limitador-operator-controller-manager-74495c69f8-74rm8\" (UID: \"989cf005-4244-4113-a129-d003828298b7\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-74rm8"
Sep 18 22:08:57.131179 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:57.131154    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sm5rv\" (UniqueName: \"kubernetes.io/projected/989cf005-4244-4113-a129-d003828298b7-kube-api-access-sm5rv\") pod \"limitador-operator-controller-manager-74495c69f8-74rm8\" (UID: \"989cf005-4244-4113-a129-d003828298b7\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-74rm8"
Sep 18 22:08:57.208284 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:57.208255    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3a259dda-42a7-4b33-8c95-bb34cf71a2da-extensions-socket-volume\") pod \"3a259dda-42a7-4b33-8c95-bb34cf71a2da\" (UID: \"3a259dda-42a7-4b33-8c95-bb34cf71a2da\") "
Sep 18 22:08:57.208284 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:57.208285    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qh9hk\" (UniqueName: \"kubernetes.io/projected/b4bf058b-905d-481c-b4bd-15e25a5c9c76-kube-api-access-qh9hk\") pod \"b4bf058b-905d-481c-b4bd-15e25a5c9c76\" (UID: \"b4bf058b-905d-481c-b4bd-15e25a5c9c76\") "
Sep 18 22:08:57.208514 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:57.208345    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dvp7g\" (UniqueName: \"kubernetes.io/projected/3a259dda-42a7-4b33-8c95-bb34cf71a2da-kube-api-access-dvp7g\") pod \"3a259dda-42a7-4b33-8c95-bb34cf71a2da\" (UID: \"3a259dda-42a7-4b33-8c95-bb34cf71a2da\") "
Sep 18 22:08:57.208906 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:57.208877    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a259dda-42a7-4b33-8c95-bb34cf71a2da-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "3a259dda-42a7-4b33-8c95-bb34cf71a2da" (UID: "3a259dda-42a7-4b33-8c95-bb34cf71a2da"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:08:57.210740 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:57.210715    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4bf058b-905d-481c-b4bd-15e25a5c9c76-kube-api-access-qh9hk" (OuterVolumeSpecName: "kube-api-access-qh9hk") pod "b4bf058b-905d-481c-b4bd-15e25a5c9c76" (UID: "b4bf058b-905d-481c-b4bd-15e25a5c9c76"). InnerVolumeSpecName "kube-api-access-qh9hk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:08:57.210828 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:57.210737    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a259dda-42a7-4b33-8c95-bb34cf71a2da-kube-api-access-dvp7g" (OuterVolumeSpecName: "kube-api-access-dvp7g") pod "3a259dda-42a7-4b33-8c95-bb34cf71a2da" (UID: "3a259dda-42a7-4b33-8c95-bb34cf71a2da"). InnerVolumeSpecName "kube-api-access-dvp7g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:08:57.221920 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:57.221901    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hxqz6"
Sep 18 22:08:57.227019 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:57.227002    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-74rm8"
Sep 18 22:08:57.309348 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:57.309308    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dvp7g\" (UniqueName: \"kubernetes.io/projected/3a259dda-42a7-4b33-8c95-bb34cf71a2da-kube-api-access-dvp7g\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:08:57.309348 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:57.309345    2577 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3a259dda-42a7-4b33-8c95-bb34cf71a2da-extensions-socket-volume\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:08:57.309591 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:57.309362    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qh9hk\" (UniqueName: \"kubernetes.io/projected/b4bf058b-905d-481c-b4bd-15e25a5c9c76-kube-api-access-qh9hk\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:08:57.565366 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:57.565329    2577 generic.go:356] "Generic (PLEG): container finished" podID="3a259dda-42a7-4b33-8c95-bb34cf71a2da" containerID="0739f86226ee699fb1af7858294861bb0bf0af4ca6da86451de7640c473642a8" exitCode=0
Sep 18 22:08:57.565366 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:57.565366    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-q5txd"
Sep 18 22:08:57.565956 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:57.565447    2577 scope.go:117] "RemoveContainer" containerID="0739f86226ee699fb1af7858294861bb0bf0af4ca6da86451de7640c473642a8"
Sep 18 22:08:57.567619 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:57.567591    2577 generic.go:356] "Generic (PLEG): container finished" podID="b4bf058b-905d-481c-b4bd-15e25a5c9c76" containerID="c0592747f614ebe21f892ec9b70467723b119b2669fa7bc859898537917d1192" exitCode=0
Sep 18 22:08:57.567757 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:57.567635    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-nmt8r"
Sep 18 22:08:57.570206 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:57.570183    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hxqz6"]
Sep 18 22:08:57.575398 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:57.575375    2577 scope.go:117] "RemoveContainer" containerID="0739f86226ee699fb1af7858294861bb0bf0af4ca6da86451de7640c473642a8"
Sep 18 22:08:57.575913 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:08:57.575765    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0739f86226ee699fb1af7858294861bb0bf0af4ca6da86451de7640c473642a8\": container with ID starting with 0739f86226ee699fb1af7858294861bb0bf0af4ca6da86451de7640c473642a8 not found: ID does not exist" containerID="0739f86226ee699fb1af7858294861bb0bf0af4ca6da86451de7640c473642a8"
Sep 18 22:08:57.575913 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:57.575803    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0739f86226ee699fb1af7858294861bb0bf0af4ca6da86451de7640c473642a8"} err="failed to get container status \"0739f86226ee699fb1af7858294861bb0bf0af4ca6da86451de7640c473642a8\": rpc error: code = NotFound desc = could not find container \"0739f86226ee699fb1af7858294861bb0bf0af4ca6da86451de7640c473642a8\": container with ID starting with 0739f86226ee699fb1af7858294861bb0bf0af4ca6da86451de7640c473642a8 not found: ID does not exist"
Sep 18 22:08:57.575913 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:57.575830    2577 scope.go:117] "RemoveContainer" containerID="c0592747f614ebe21f892ec9b70467723b119b2669fa7bc859898537917d1192"
Sep 18 22:08:57.577011 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:08:57.576978    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8785c31a_e73d_4904_9eb9_a64e1eedf7dc.slice/crio-355067b0cb7f043a6ab7afcfbbd638026ae1b546033a27563d660c646b1dffa8 WatchSource:0}: Error finding container 355067b0cb7f043a6ab7afcfbbd638026ae1b546033a27563d660c646b1dffa8: Status 404 returned error can't find the container with id 355067b0cb7f043a6ab7afcfbbd638026ae1b546033a27563d660c646b1dffa8
Sep 18 22:08:57.585194 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:57.585173    2577 scope.go:117] "RemoveContainer" containerID="c0592747f614ebe21f892ec9b70467723b119b2669fa7bc859898537917d1192"
Sep 18 22:08:57.585500 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:08:57.585481    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c0592747f614ebe21f892ec9b70467723b119b2669fa7bc859898537917d1192\": container with ID starting with c0592747f614ebe21f892ec9b70467723b119b2669fa7bc859898537917d1192 not found: ID does not exist" containerID="c0592747f614ebe21f892ec9b70467723b119b2669fa7bc859898537917d1192"
Sep 18 22:08:57.585584 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:57.585505    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0592747f614ebe21f892ec9b70467723b119b2669fa7bc859898537917d1192"} err="failed to get container status \"c0592747f614ebe21f892ec9b70467723b119b2669fa7bc859898537917d1192\": rpc error: code = NotFound desc = could not find container \"c0592747f614ebe21f892ec9b70467723b119b2669fa7bc859898537917d1192\": container with ID starting with c0592747f614ebe21f892ec9b70467723b119b2669fa7bc859898537917d1192 not found: ID does not exist"
Sep 18 22:08:57.616363 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:57.616341    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-74rm8"]
Sep 18 22:08:57.618621 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:08:57.618600    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod989cf005_4244_4113_a129_d003828298b7.slice/crio-c37198a730710b8d12d50422116b879f3340c62ecd741a4ffdc01fe4a6d7f521 WatchSource:0}: Error finding container c37198a730710b8d12d50422116b879f3340c62ecd741a4ffdc01fe4a6d7f521: Status 404 returned error can't find the container with id c37198a730710b8d12d50422116b879f3340c62ecd741a4ffdc01fe4a6d7f521
Sep 18 22:08:58.574831 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:58.574796    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hxqz6" event={"ID":"8785c31a-e73d-4904-9eb9-a64e1eedf7dc","Type":"ContainerStarted","Data":"d928bd02288eef130f7b8f997b55311b46fffdc9a9e6570f98fc960cd2ccdb31"}
Sep 18 22:08:58.575294 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:58.574853    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hxqz6" event={"ID":"8785c31a-e73d-4904-9eb9-a64e1eedf7dc","Type":"ContainerStarted","Data":"355067b0cb7f043a6ab7afcfbbd638026ae1b546033a27563d660c646b1dffa8"}
Sep 18 22:08:58.575294 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:58.574997    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hxqz6"
Sep 18 22:08:58.578458 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:58.578436    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-74rm8" event={"ID":"989cf005-4244-4113-a129-d003828298b7","Type":"ContainerStarted","Data":"c277f3202cdc1cc5d40a7ace9b6b674c83677c8af423bd6c4493de34cf0fdc91"}
Sep 18 22:08:58.578705 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:58.578475    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-74rm8"
Sep 18 22:08:58.578705 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:58.578491    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-74rm8" event={"ID":"989cf005-4244-4113-a129-d003828298b7","Type":"ContainerStarted","Data":"c37198a730710b8d12d50422116b879f3340c62ecd741a4ffdc01fe4a6d7f521"}
Sep 18 22:08:58.622886 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:58.622836    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hxqz6" podStartSLOduration=2.6228195210000003 podStartE2EDuration="2.622819521s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:08:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:08:58.621161195 +0000 UTC m=+517.940833250" watchObservedRunningTime="2026-09-18 22:08:58.622819521 +0000 UTC m=+517.942491567"
Sep 18 22:08:58.656474 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:58.656377    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-74rm8" podStartSLOduration=2.65635686 podStartE2EDuration="2.65635686s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:08:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:08:58.655426755 +0000 UTC m=+517.975098811" watchObservedRunningTime="2026-09-18 22:08:58.65635686 +0000 UTC m=+517.976028916"
Sep 18 22:08:59.139316 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:59.139281    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a259dda-42a7-4b33-8c95-bb34cf71a2da" path="/var/lib/kubelet/pods/3a259dda-42a7-4b33-8c95-bb34cf71a2da/volumes"
Sep 18 22:08:59.139646 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:59.139633    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b4bf058b-905d-481c-b4bd-15e25a5c9c76" path="/var/lib/kubelet/pods/b4bf058b-905d-481c-b4bd-15e25a5c9c76/volumes"
Sep 18 22:08:59.158482 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:59.158453    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-gmb2m"]
Sep 18 22:08:59.161172 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:59.161157    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-gmb2m"
Sep 18 22:08:59.228309 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:59.228280    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkcfm\" (UniqueName: \"kubernetes.io/projected/6581201a-a056-4623-bec6-9640d66edf9e-kube-api-access-gkcfm\") pod \"kuadrant-operator-controller-manager-5769f99d9f-gmb2m\" (UID: \"6581201a-a056-4623-bec6-9640d66edf9e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-gmb2m"
Sep 18 22:08:59.228511 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:59.228342    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6581201a-a056-4623-bec6-9640d66edf9e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-gmb2m\" (UID: \"6581201a-a056-4623-bec6-9640d66edf9e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-gmb2m"
Sep 18 22:08:59.256957 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:59.256927    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-gmb2m"]
Sep 18 22:08:59.329875 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:59.329836    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkcfm\" (UniqueName: \"kubernetes.io/projected/6581201a-a056-4623-bec6-9640d66edf9e-kube-api-access-gkcfm\") pod \"kuadrant-operator-controller-manager-5769f99d9f-gmb2m\" (UID: \"6581201a-a056-4623-bec6-9640d66edf9e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-gmb2m"
Sep 18 22:08:59.330061 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:59.329928    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6581201a-a056-4623-bec6-9640d66edf9e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-gmb2m\" (UID: \"6581201a-a056-4623-bec6-9640d66edf9e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-gmb2m"
Sep 18 22:08:59.330350 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:59.330331    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6581201a-a056-4623-bec6-9640d66edf9e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-gmb2m\" (UID: \"6581201a-a056-4623-bec6-9640d66edf9e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-gmb2m"
Sep 18 22:08:59.347996 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:59.347961    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkcfm\" (UniqueName: \"kubernetes.io/projected/6581201a-a056-4623-bec6-9640d66edf9e-kube-api-access-gkcfm\") pod \"kuadrant-operator-controller-manager-5769f99d9f-gmb2m\" (UID: \"6581201a-a056-4623-bec6-9640d66edf9e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-gmb2m"
Sep 18 22:08:59.471395 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:59.471303    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-gmb2m"
Sep 18 22:08:59.785529 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:08:59.785501    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-gmb2m"]
Sep 18 22:08:59.786891 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:08:59.786860    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6581201a_a056_4623_bec6_9640d66edf9e.slice/crio-b3f125a543944eb53239307634ec50da51429da0ae3a27a77bc7fe940d3a688c WatchSource:0}: Error finding container b3f125a543944eb53239307634ec50da51429da0ae3a27a77bc7fe940d3a688c: Status 404 returned error can't find the container with id b3f125a543944eb53239307634ec50da51429da0ae3a27a77bc7fe940d3a688c
Sep 18 22:09:00.590570 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:00.590532    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-gmb2m" event={"ID":"6581201a-a056-4623-bec6-9640d66edf9e","Type":"ContainerStarted","Data":"e0965408a21aa36c8269798218de1459bee26718c4dafc87a3194c8eae5227d0"}
Sep 18 22:09:00.590770 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:00.590602    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-gmb2m" event={"ID":"6581201a-a056-4623-bec6-9640d66edf9e","Type":"ContainerStarted","Data":"b3f125a543944eb53239307634ec50da51429da0ae3a27a77bc7fe940d3a688c"}
Sep 18 22:09:00.590770 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:00.590629    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-gmb2m"
Sep 18 22:09:09.586091 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:09.586060    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-74rm8"
Sep 18 22:09:09.586609 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:09.586147    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hxqz6"
Sep 18 22:09:09.612649 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:09.612587    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-gmb2m" podStartSLOduration=10.612572293 podStartE2EDuration="10.612572293s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:08:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:09:00.672260929 +0000 UTC m=+519.991932994" watchObservedRunningTime="2026-09-18 22:09:09.612572293 +0000 UTC m=+528.932244428"
Sep 18 22:09:11.599133 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:11.599104    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-gmb2m"
Sep 18 22:09:11.677858 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:11.677819    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hxqz6"]
Sep 18 22:09:11.678101 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:11.678074    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hxqz6" podUID="8785c31a-e73d-4904-9eb9-a64e1eedf7dc" containerName="manager" containerID="cri-o://d928bd02288eef130f7b8f997b55311b46fffdc9a9e6570f98fc960cd2ccdb31" gracePeriod=10
Sep 18 22:09:11.920736 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:11.920712    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hxqz6"
Sep 18 22:09:12.039588 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:12.039560    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8785c31a-e73d-4904-9eb9-a64e1eedf7dc-extensions-socket-volume\") pod \"8785c31a-e73d-4904-9eb9-a64e1eedf7dc\" (UID: \"8785c31a-e73d-4904-9eb9-a64e1eedf7dc\") "
Sep 18 22:09:12.039745 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:12.039601    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xwwg6\" (UniqueName: \"kubernetes.io/projected/8785c31a-e73d-4904-9eb9-a64e1eedf7dc-kube-api-access-xwwg6\") pod \"8785c31a-e73d-4904-9eb9-a64e1eedf7dc\" (UID: \"8785c31a-e73d-4904-9eb9-a64e1eedf7dc\") "
Sep 18 22:09:12.039955 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:12.039937    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8785c31a-e73d-4904-9eb9-a64e1eedf7dc-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "8785c31a-e73d-4904-9eb9-a64e1eedf7dc" (UID: "8785c31a-e73d-4904-9eb9-a64e1eedf7dc"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:09:12.041713 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:12.041689    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8785c31a-e73d-4904-9eb9-a64e1eedf7dc-kube-api-access-xwwg6" (OuterVolumeSpecName: "kube-api-access-xwwg6") pod "8785c31a-e73d-4904-9eb9-a64e1eedf7dc" (UID: "8785c31a-e73d-4904-9eb9-a64e1eedf7dc"). InnerVolumeSpecName "kube-api-access-xwwg6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:09:12.140477 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:12.140446    2577 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8785c31a-e73d-4904-9eb9-a64e1eedf7dc-extensions-socket-volume\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:09:12.140477 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:12.140472    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xwwg6\" (UniqueName: \"kubernetes.io/projected/8785c31a-e73d-4904-9eb9-a64e1eedf7dc-kube-api-access-xwwg6\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:09:12.660974 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:12.660894    2577 generic.go:356] "Generic (PLEG): container finished" podID="8785c31a-e73d-4904-9eb9-a64e1eedf7dc" containerID="d928bd02288eef130f7b8f997b55311b46fffdc9a9e6570f98fc960cd2ccdb31" exitCode=0
Sep 18 22:09:12.660974 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:12.660935    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hxqz6"
Sep 18 22:09:12.661460 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:12.660972    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hxqz6" event={"ID":"8785c31a-e73d-4904-9eb9-a64e1eedf7dc","Type":"ContainerDied","Data":"d928bd02288eef130f7b8f997b55311b46fffdc9a9e6570f98fc960cd2ccdb31"}
Sep 18 22:09:12.661460 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:12.661031    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hxqz6" event={"ID":"8785c31a-e73d-4904-9eb9-a64e1eedf7dc","Type":"ContainerDied","Data":"355067b0cb7f043a6ab7afcfbbd638026ae1b546033a27563d660c646b1dffa8"}
Sep 18 22:09:12.661460 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:12.661054    2577 scope.go:117] "RemoveContainer" containerID="d928bd02288eef130f7b8f997b55311b46fffdc9a9e6570f98fc960cd2ccdb31"
Sep 18 22:09:12.670496 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:12.670454    2577 scope.go:117] "RemoveContainer" containerID="d928bd02288eef130f7b8f997b55311b46fffdc9a9e6570f98fc960cd2ccdb31"
Sep 18 22:09:12.670746 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:09:12.670729    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d928bd02288eef130f7b8f997b55311b46fffdc9a9e6570f98fc960cd2ccdb31\": container with ID starting with d928bd02288eef130f7b8f997b55311b46fffdc9a9e6570f98fc960cd2ccdb31 not found: ID does not exist" containerID="d928bd02288eef130f7b8f997b55311b46fffdc9a9e6570f98fc960cd2ccdb31"
Sep 18 22:09:12.670807 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:12.670754    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d928bd02288eef130f7b8f997b55311b46fffdc9a9e6570f98fc960cd2ccdb31"} err="failed to get container status \"d928bd02288eef130f7b8f997b55311b46fffdc9a9e6570f98fc960cd2ccdb31\": rpc error: code = NotFound desc = could not find container \"d928bd02288eef130f7b8f997b55311b46fffdc9a9e6570f98fc960cd2ccdb31\": container with ID starting with d928bd02288eef130f7b8f997b55311b46fffdc9a9e6570f98fc960cd2ccdb31 not found: ID does not exist"
Sep 18 22:09:12.683752 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:12.683732    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hxqz6"]
Sep 18 22:09:12.689176 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:12.689158    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hxqz6"]
Sep 18 22:09:13.139640 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:13.139611    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8785c31a-e73d-4904-9eb9-a64e1eedf7dc" path="/var/lib/kubelet/pods/8785c31a-e73d-4904-9eb9-a64e1eedf7dc/volumes"
Sep 18 22:09:28.097680 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:28.097646    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jzpjr"]
Sep 18 22:09:28.098207 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:28.098193    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8785c31a-e73d-4904-9eb9-a64e1eedf7dc" containerName="manager"
Sep 18 22:09:28.098253 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:28.098211    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8785c31a-e73d-4904-9eb9-a64e1eedf7dc" containerName="manager"
Sep 18 22:09:28.098307 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:28.098296    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="8785c31a-e73d-4904-9eb9-a64e1eedf7dc" containerName="manager"
Sep 18 22:09:28.117736 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:28.117707    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jzpjr"
Sep 18 22:09:28.120776 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:28.120746    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-l6b4f\""
Sep 18 22:09:28.123073 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:28.123049    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jzpjr"]
Sep 18 22:09:28.185599 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:28.185559    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/141b0cdb-5a28-40ae-88f4-17e9ab7e97e1-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jzpjr\" (UID: \"141b0cdb-5a28-40ae-88f4-17e9ab7e97e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jzpjr"
Sep 18 22:09:28.185800 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:28.185601    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tntkb\" (UniqueName: \"kubernetes.io/projected/141b0cdb-5a28-40ae-88f4-17e9ab7e97e1-kube-api-access-tntkb\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jzpjr\" (UID: \"141b0cdb-5a28-40ae-88f4-17e9ab7e97e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jzpjr"
Sep 18 22:09:28.185800 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:28.185728    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/141b0cdb-5a28-40ae-88f4-17e9ab7e97e1-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jzpjr\" (UID: \"141b0cdb-5a28-40ae-88f4-17e9ab7e97e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jzpjr"
Sep 18 22:09:28.185945 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:28.185826    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/141b0cdb-5a28-40ae-88f4-17e9ab7e97e1-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jzpjr\" (UID: \"141b0cdb-5a28-40ae-88f4-17e9ab7e97e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jzpjr"
Sep 18 22:09:28.185945 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:28.185862    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/141b0cdb-5a28-40ae-88f4-17e9ab7e97e1-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jzpjr\" (UID: \"141b0cdb-5a28-40ae-88f4-17e9ab7e97e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jzpjr"
Sep 18 22:09:28.186039 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:28.185939    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/141b0cdb-5a28-40ae-88f4-17e9ab7e97e1-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jzpjr\" (UID: \"141b0cdb-5a28-40ae-88f4-17e9ab7e97e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jzpjr"
Sep 18 22:09:28.186039 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:28.185973    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/141b0cdb-5a28-40ae-88f4-17e9ab7e97e1-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jzpjr\" (UID: \"141b0cdb-5a28-40ae-88f4-17e9ab7e97e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jzpjr"
Sep 18 22:09:28.186039 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:28.186015    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/141b0cdb-5a28-40ae-88f4-17e9ab7e97e1-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jzpjr\" (UID: \"141b0cdb-5a28-40ae-88f4-17e9ab7e97e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jzpjr"
Sep 18 22:09:28.186653 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:28.186614    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/141b0cdb-5a28-40ae-88f4-17e9ab7e97e1-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jzpjr\" (UID: \"141b0cdb-5a28-40ae-88f4-17e9ab7e97e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jzpjr"
Sep 18 22:09:28.287474 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:28.287438    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/141b0cdb-5a28-40ae-88f4-17e9ab7e97e1-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jzpjr\" (UID: \"141b0cdb-5a28-40ae-88f4-17e9ab7e97e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jzpjr"
Sep 18 22:09:28.287624 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:28.287517    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/141b0cdb-5a28-40ae-88f4-17e9ab7e97e1-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jzpjr\" (UID: \"141b0cdb-5a28-40ae-88f4-17e9ab7e97e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jzpjr"
Sep 18 22:09:28.287624 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:28.287542    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tntkb\" (UniqueName: \"kubernetes.io/projected/141b0cdb-5a28-40ae-88f4-17e9ab7e97e1-kube-api-access-tntkb\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jzpjr\" (UID: \"141b0cdb-5a28-40ae-88f4-17e9ab7e97e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jzpjr"
Sep 18 22:09:28.287624 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:28.287604    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/141b0cdb-5a28-40ae-88f4-17e9ab7e97e1-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jzpjr\" (UID: \"141b0cdb-5a28-40ae-88f4-17e9ab7e97e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jzpjr"
Sep 18 22:09:28.287784 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:28.287644    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/141b0cdb-5a28-40ae-88f4-17e9ab7e97e1-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jzpjr\" (UID: \"141b0cdb-5a28-40ae-88f4-17e9ab7e97e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jzpjr"
Sep 18 22:09:28.287784 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:28.287678    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/141b0cdb-5a28-40ae-88f4-17e9ab7e97e1-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jzpjr\" (UID: \"141b0cdb-5a28-40ae-88f4-17e9ab7e97e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jzpjr"
Sep 18 22:09:28.287784 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:28.287726    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/141b0cdb-5a28-40ae-88f4-17e9ab7e97e1-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jzpjr\" (UID: \"141b0cdb-5a28-40ae-88f4-17e9ab7e97e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jzpjr"
Sep 18 22:09:28.287784 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:28.287748    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/141b0cdb-5a28-40ae-88f4-17e9ab7e97e1-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jzpjr\" (UID: \"141b0cdb-5a28-40ae-88f4-17e9ab7e97e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jzpjr"
Sep 18 22:09:28.287995 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:28.287868    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/141b0cdb-5a28-40ae-88f4-17e9ab7e97e1-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jzpjr\" (UID: \"141b0cdb-5a28-40ae-88f4-17e9ab7e97e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jzpjr"
Sep 18 22:09:28.288050 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:28.287996    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/141b0cdb-5a28-40ae-88f4-17e9ab7e97e1-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jzpjr\" (UID: \"141b0cdb-5a28-40ae-88f4-17e9ab7e97e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jzpjr"
Sep 18 22:09:28.288168 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:28.288142    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/141b0cdb-5a28-40ae-88f4-17e9ab7e97e1-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jzpjr\" (UID: \"141b0cdb-5a28-40ae-88f4-17e9ab7e97e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jzpjr"
Sep 18 22:09:28.288252 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:28.288234    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/141b0cdb-5a28-40ae-88f4-17e9ab7e97e1-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jzpjr\" (UID: \"141b0cdb-5a28-40ae-88f4-17e9ab7e97e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jzpjr"
Sep 18 22:09:28.288796 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:28.288462    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/141b0cdb-5a28-40ae-88f4-17e9ab7e97e1-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jzpjr\" (UID: \"141b0cdb-5a28-40ae-88f4-17e9ab7e97e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jzpjr"
Sep 18 22:09:28.288796 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:28.288522    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/141b0cdb-5a28-40ae-88f4-17e9ab7e97e1-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jzpjr\" (UID: \"141b0cdb-5a28-40ae-88f4-17e9ab7e97e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jzpjr"
Sep 18 22:09:28.290329 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:28.290299    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/141b0cdb-5a28-40ae-88f4-17e9ab7e97e1-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jzpjr\" (UID: \"141b0cdb-5a28-40ae-88f4-17e9ab7e97e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jzpjr"
Sep 18 22:09:28.290922 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:28.290899    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/141b0cdb-5a28-40ae-88f4-17e9ab7e97e1-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jzpjr\" (UID: \"141b0cdb-5a28-40ae-88f4-17e9ab7e97e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jzpjr"
Sep 18 22:09:28.298127 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:28.298099    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/141b0cdb-5a28-40ae-88f4-17e9ab7e97e1-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jzpjr\" (UID: \"141b0cdb-5a28-40ae-88f4-17e9ab7e97e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jzpjr"
Sep 18 22:09:28.298289 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:28.298263    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tntkb\" (UniqueName: \"kubernetes.io/projected/141b0cdb-5a28-40ae-88f4-17e9ab7e97e1-kube-api-access-tntkb\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jzpjr\" (UID: \"141b0cdb-5a28-40ae-88f4-17e9ab7e97e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jzpjr"
Sep 18 22:09:28.430850 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:28.430759    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jzpjr"
Sep 18 22:09:28.724099 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:28.724006    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jzpjr"]
Sep 18 22:09:28.727252 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:09:28.727221    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod141b0cdb_5a28_40ae_88f4_17e9ab7e97e1.slice/crio-4bf3e4a2c3591aa3540c59c771f6cddd79da5342d1028138cc8813a0a28644a9 WatchSource:0}: Error finding container 4bf3e4a2c3591aa3540c59c771f6cddd79da5342d1028138cc8813a0a28644a9: Status 404 returned error can't find the container with id 4bf3e4a2c3591aa3540c59c771f6cddd79da5342d1028138cc8813a0a28644a9
Sep 18 22:09:28.729492 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:28.729452    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:09:28.729578 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:28.729538    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:09:28.729616 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:28.729580    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:09:28.752629 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:28.752603    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jzpjr" event={"ID":"141b0cdb-5a28-40ae-88f4-17e9ab7e97e1","Type":"ContainerStarted","Data":"4bf3e4a2c3591aa3540c59c771f6cddd79da5342d1028138cc8813a0a28644a9"}
Sep 18 22:09:29.760011 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:29.759975    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jzpjr" event={"ID":"141b0cdb-5a28-40ae-88f4-17e9ab7e97e1","Type":"ContainerStarted","Data":"ec479007be92e321578cd7431520926bf7338d34519e496cb5fe5a2066082460"}
Sep 18 22:09:29.781324 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:29.781275    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jzpjr" podStartSLOduration=1.781257584 podStartE2EDuration="1.781257584s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:09:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:09:29.780176021 +0000 UTC m=+549.099848087" watchObservedRunningTime="2026-09-18 22:09:29.781257584 +0000 UTC m=+549.100929638"
Sep 18 22:09:30.431438 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:30.431385    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jzpjr"
Sep 18 22:09:30.436208 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:30.436183    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jzpjr"
Sep 18 22:09:30.765484 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:30.765381    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jzpjr"
Sep 18 22:09:30.766485 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:30.766465    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jzpjr"
Sep 18 22:09:31.603949 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:31.603914    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-rmn5f"]
Sep 18 22:09:31.607749 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:31.607724    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-rmn5f"
Sep 18 22:09:31.610032 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:31.610009    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-pxwch\""
Sep 18 22:09:31.616477 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:31.616450    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-rmn5f"]
Sep 18 22:09:31.717645 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:31.717606    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fwwx\" (UniqueName: \"kubernetes.io/projected/39abd28f-8718-41f5-aef3-d9cefd7721ae-kube-api-access-2fwwx\") pod \"authorino-7bcfd8f9cd-rmn5f\" (UID: \"39abd28f-8718-41f5-aef3-d9cefd7721ae\") " pod="kuadrant-system/authorino-7bcfd8f9cd-rmn5f"
Sep 18 22:09:31.744000 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:31.743964    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-59c974bd48-xsnxr"]
Sep 18 22:09:31.748009 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:31.747983    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-xsnxr"
Sep 18 22:09:31.755936 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:31.755900    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-xsnxr"]
Sep 18 22:09:31.819064 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:31.819038    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fwwx\" (UniqueName: \"kubernetes.io/projected/39abd28f-8718-41f5-aef3-d9cefd7721ae-kube-api-access-2fwwx\") pod \"authorino-7bcfd8f9cd-rmn5f\" (UID: \"39abd28f-8718-41f5-aef3-d9cefd7721ae\") " pod="kuadrant-system/authorino-7bcfd8f9cd-rmn5f"
Sep 18 22:09:31.819532 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:31.819083    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhzw9\" (UniqueName: \"kubernetes.io/projected/60b83381-6549-4743-8b10-8ad6a33fb4d8-kube-api-access-dhzw9\") pod \"authorino-59c974bd48-xsnxr\" (UID: \"60b83381-6549-4743-8b10-8ad6a33fb4d8\") " pod="kuadrant-system/authorino-59c974bd48-xsnxr"
Sep 18 22:09:31.827459 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:31.827433    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fwwx\" (UniqueName: \"kubernetes.io/projected/39abd28f-8718-41f5-aef3-d9cefd7721ae-kube-api-access-2fwwx\") pod \"authorino-7bcfd8f9cd-rmn5f\" (UID: \"39abd28f-8718-41f5-aef3-d9cefd7721ae\") " pod="kuadrant-system/authorino-7bcfd8f9cd-rmn5f"
Sep 18 22:09:31.918884 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:31.918804    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-rmn5f"
Sep 18 22:09:31.920171 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:31.920151    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhzw9\" (UniqueName: \"kubernetes.io/projected/60b83381-6549-4743-8b10-8ad6a33fb4d8-kube-api-access-dhzw9\") pod \"authorino-59c974bd48-xsnxr\" (UID: \"60b83381-6549-4743-8b10-8ad6a33fb4d8\") " pod="kuadrant-system/authorino-59c974bd48-xsnxr"
Sep 18 22:09:31.928510 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:31.928449    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhzw9\" (UniqueName: \"kubernetes.io/projected/60b83381-6549-4743-8b10-8ad6a33fb4d8-kube-api-access-dhzw9\") pod \"authorino-59c974bd48-xsnxr\" (UID: \"60b83381-6549-4743-8b10-8ad6a33fb4d8\") " pod="kuadrant-system/authorino-59c974bd48-xsnxr"
Sep 18 22:09:32.062033 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:32.061996    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-xsnxr"
Sep 18 22:09:32.193191 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:32.193161    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-rmn5f"]
Sep 18 22:09:32.194577 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:09:32.194547    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod39abd28f_8718_41f5_aef3_d9cefd7721ae.slice/crio-47135c2d33d67d6931039b25c47e392ee122ffb09c52f4de3931df0017bd801e WatchSource:0}: Error finding container 47135c2d33d67d6931039b25c47e392ee122ffb09c52f4de3931df0017bd801e: Status 404 returned error can't find the container with id 47135c2d33d67d6931039b25c47e392ee122ffb09c52f4de3931df0017bd801e
Sep 18 22:09:32.336651 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:32.336626    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-xsnxr"]
Sep 18 22:09:32.338183 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:09:32.338159    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod60b83381_6549_4743_8b10_8ad6a33fb4d8.slice/crio-ff6d7ae0b23508b186d8618072df86897056646c7ac60c761a06edbc3ab18bcb WatchSource:0}: Error finding container ff6d7ae0b23508b186d8618072df86897056646c7ac60c761a06edbc3ab18bcb: Status 404 returned error can't find the container with id ff6d7ae0b23508b186d8618072df86897056646c7ac60c761a06edbc3ab18bcb
Sep 18 22:09:32.777527 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:32.777495    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-rmn5f" event={"ID":"39abd28f-8718-41f5-aef3-d9cefd7721ae","Type":"ContainerStarted","Data":"47135c2d33d67d6931039b25c47e392ee122ffb09c52f4de3931df0017bd801e"}
Sep 18 22:09:32.778817 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:32.778792    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-xsnxr" event={"ID":"60b83381-6549-4743-8b10-8ad6a33fb4d8","Type":"ContainerStarted","Data":"ff6d7ae0b23508b186d8618072df86897056646c7ac60c761a06edbc3ab18bcb"}
Sep 18 22:09:34.796125 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:34.796087    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-xsnxr" event={"ID":"60b83381-6549-4743-8b10-8ad6a33fb4d8","Type":"ContainerStarted","Data":"a81deb6cf2949515f16c0d6fb2f1968e478ef88317ef6313aede862c01df86a3"}
Sep 18 22:09:34.797785 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:34.797762    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-rmn5f" event={"ID":"39abd28f-8718-41f5-aef3-d9cefd7721ae","Type":"ContainerStarted","Data":"51507c9eb379ea228897ed346ac4c5e0750aa84b27c45b5524d5618704e2ccbc"}
Sep 18 22:09:34.813532 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:34.813479    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-59c974bd48-xsnxr" podStartSLOduration=2.056468445 podStartE2EDuration="3.8134647s" totalImagesPullingTime="1.756996255s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:09:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:09:34.810537651 +0000 UTC m=+554.130209706" watchObservedRunningTime="2026-09-18 22:09:34.8134647 +0000 UTC m=+554.133136746"
Sep 18 22:09:34.829363 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:34.829301    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7bcfd8f9cd-rmn5f" podStartSLOduration=1.933118906 podStartE2EDuration="3.829279338s" totalImagesPullingTime="1.896160432s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:09:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:09:34.826196628 +0000 UTC m=+554.145868684" watchObservedRunningTime="2026-09-18 22:09:34.829279338 +0000 UTC m=+554.148951394"
Sep 18 22:09:34.859751 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:34.859721    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-rmn5f"]
Sep 18 22:09:36.809052 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:36.808999    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7bcfd8f9cd-rmn5f" podUID="39abd28f-8718-41f5-aef3-d9cefd7721ae" containerName="authorino" containerID="cri-o://51507c9eb379ea228897ed346ac4c5e0750aa84b27c45b5524d5618704e2ccbc" gracePeriod=30
Sep 18 22:09:37.053124 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:37.053099    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-rmn5f"
Sep 18 22:09:37.168397 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:37.168308    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2fwwx\" (UniqueName: \"kubernetes.io/projected/39abd28f-8718-41f5-aef3-d9cefd7721ae-kube-api-access-2fwwx\") pod \"39abd28f-8718-41f5-aef3-d9cefd7721ae\" (UID: \"39abd28f-8718-41f5-aef3-d9cefd7721ae\") "
Sep 18 22:09:37.170518 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:37.170494    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39abd28f-8718-41f5-aef3-d9cefd7721ae-kube-api-access-2fwwx" (OuterVolumeSpecName: "kube-api-access-2fwwx") pod "39abd28f-8718-41f5-aef3-d9cefd7721ae" (UID: "39abd28f-8718-41f5-aef3-d9cefd7721ae"). InnerVolumeSpecName "kube-api-access-2fwwx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:09:37.269895 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:37.269858    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2fwwx\" (UniqueName: \"kubernetes.io/projected/39abd28f-8718-41f5-aef3-d9cefd7721ae-kube-api-access-2fwwx\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:09:37.815034 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:37.815004    2577 generic.go:356] "Generic (PLEG): container finished" podID="39abd28f-8718-41f5-aef3-d9cefd7721ae" containerID="51507c9eb379ea228897ed346ac4c5e0750aa84b27c45b5524d5618704e2ccbc" exitCode=0
Sep 18 22:09:37.815515 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:37.815050    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-rmn5f"
Sep 18 22:09:37.815515 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:37.815094    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-rmn5f" event={"ID":"39abd28f-8718-41f5-aef3-d9cefd7721ae","Type":"ContainerDied","Data":"51507c9eb379ea228897ed346ac4c5e0750aa84b27c45b5524d5618704e2ccbc"}
Sep 18 22:09:37.815515 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:37.815135    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-rmn5f" event={"ID":"39abd28f-8718-41f5-aef3-d9cefd7721ae","Type":"ContainerDied","Data":"47135c2d33d67d6931039b25c47e392ee122ffb09c52f4de3931df0017bd801e"}
Sep 18 22:09:37.815515 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:37.815152    2577 scope.go:117] "RemoveContainer" containerID="51507c9eb379ea228897ed346ac4c5e0750aa84b27c45b5524d5618704e2ccbc"
Sep 18 22:09:37.824335 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:37.824320    2577 scope.go:117] "RemoveContainer" containerID="51507c9eb379ea228897ed346ac4c5e0750aa84b27c45b5524d5618704e2ccbc"
Sep 18 22:09:37.824659 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:09:37.824641    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51507c9eb379ea228897ed346ac4c5e0750aa84b27c45b5524d5618704e2ccbc\": container with ID starting with 51507c9eb379ea228897ed346ac4c5e0750aa84b27c45b5524d5618704e2ccbc not found: ID does not exist" containerID="51507c9eb379ea228897ed346ac4c5e0750aa84b27c45b5524d5618704e2ccbc"
Sep 18 22:09:37.824716 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:37.824669    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51507c9eb379ea228897ed346ac4c5e0750aa84b27c45b5524d5618704e2ccbc"} err="failed to get container status \"51507c9eb379ea228897ed346ac4c5e0750aa84b27c45b5524d5618704e2ccbc\": rpc error: code = NotFound desc = could not find container \"51507c9eb379ea228897ed346ac4c5e0750aa84b27c45b5524d5618704e2ccbc\": container with ID starting with 51507c9eb379ea228897ed346ac4c5e0750aa84b27c45b5524d5618704e2ccbc not found: ID does not exist"
Sep 18 22:09:37.840660 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:37.840635    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-rmn5f"]
Sep 18 22:09:37.844787 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:37.844769    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-rmn5f"]
Sep 18 22:09:39.140369 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:39.140334    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="39abd28f-8718-41f5-aef3-d9cefd7721ae" path="/var/lib/kubelet/pods/39abd28f-8718-41f5-aef3-d9cefd7721ae/volumes"
Sep 18 22:09:47.365776 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:47.365746    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-t28vs"]
Sep 18 22:09:47.366220 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:47.366094    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39abd28f-8718-41f5-aef3-d9cefd7721ae" containerName="authorino"
Sep 18 22:09:47.366220 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:47.366105    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="39abd28f-8718-41f5-aef3-d9cefd7721ae" containerName="authorino"
Sep 18 22:09:47.366220 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:47.366179    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="39abd28f-8718-41f5-aef3-d9cefd7721ae" containerName="authorino"
Sep 18 22:09:47.369116 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:47.369099    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-t28vs"
Sep 18 22:09:47.372368 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:47.372342    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 18 22:09:47.372499 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:47.372478    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-5jkbp\""
Sep 18 22:09:47.372776 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:47.372749    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 18 22:09:47.372843 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:47.372826    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 18 22:09:47.389175 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:47.389150    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-t28vs"]
Sep 18 22:09:47.460734 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:47.460699    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/b2a0aec7-3ba9-46ec-b4db-39577851035c-data\") pod \"postgres-69fb4594cf-t28vs\" (UID: \"b2a0aec7-3ba9-46ec-b4db-39577851035c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-t28vs"
Sep 18 22:09:47.460891 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:47.460742    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bx6qs\" (UniqueName: \"kubernetes.io/projected/b2a0aec7-3ba9-46ec-b4db-39577851035c-kube-api-access-bx6qs\") pod \"postgres-69fb4594cf-t28vs\" (UID: \"b2a0aec7-3ba9-46ec-b4db-39577851035c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-t28vs"
Sep 18 22:09:47.562200 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:47.562166    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/b2a0aec7-3ba9-46ec-b4db-39577851035c-data\") pod \"postgres-69fb4594cf-t28vs\" (UID: \"b2a0aec7-3ba9-46ec-b4db-39577851035c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-t28vs"
Sep 18 22:09:47.562380 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:47.562215    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bx6qs\" (UniqueName: \"kubernetes.io/projected/b2a0aec7-3ba9-46ec-b4db-39577851035c-kube-api-access-bx6qs\") pod \"postgres-69fb4594cf-t28vs\" (UID: \"b2a0aec7-3ba9-46ec-b4db-39577851035c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-t28vs"
Sep 18 22:09:47.562631 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:47.562612    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/b2a0aec7-3ba9-46ec-b4db-39577851035c-data\") pod \"postgres-69fb4594cf-t28vs\" (UID: \"b2a0aec7-3ba9-46ec-b4db-39577851035c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-t28vs"
Sep 18 22:09:47.580309 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:47.580280    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bx6qs\" (UniqueName: \"kubernetes.io/projected/b2a0aec7-3ba9-46ec-b4db-39577851035c-kube-api-access-bx6qs\") pod \"postgres-69fb4594cf-t28vs\" (UID: \"b2a0aec7-3ba9-46ec-b4db-39577851035c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-t28vs"
Sep 18 22:09:47.679273 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:47.679184    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-t28vs"
Sep 18 22:09:47.954447 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:47.954223    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-t28vs"]
Sep 18 22:09:47.957356 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:09:47.957329    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2a0aec7_3ba9_46ec_b4db_39577851035c.slice/crio-795f103a82e9b25db26a2bed3db935bd24ab5cc2ed3a999f8139b718a85af6f9 WatchSource:0}: Error finding container 795f103a82e9b25db26a2bed3db935bd24ab5cc2ed3a999f8139b718a85af6f9: Status 404 returned error can't find the container with id 795f103a82e9b25db26a2bed3db935bd24ab5cc2ed3a999f8139b718a85af6f9
Sep 18 22:09:48.884965 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:48.884887    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-t28vs" event={"ID":"b2a0aec7-3ba9-46ec-b4db-39577851035c","Type":"ContainerStarted","Data":"795f103a82e9b25db26a2bed3db935bd24ab5cc2ed3a999f8139b718a85af6f9"}
Sep 18 22:09:52.910115 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:52.910070    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-t28vs" event={"ID":"b2a0aec7-3ba9-46ec-b4db-39577851035c","Type":"ContainerStarted","Data":"9c06fde1b99a737359d36d3402b035635b01dde70f4d53ee535ceea54b73b6df"}
Sep 18 22:09:52.910488 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:52.910181    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-t28vs"
Sep 18 22:09:52.930996 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:52.930950    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-t28vs" podStartSLOduration=1.132601047 podStartE2EDuration="5.930934709s" totalImagesPullingTime="4.798333662s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:09:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:09:52.928231202 +0000 UTC m=+572.247903263" watchObservedRunningTime="2026-09-18 22:09:52.930934709 +0000 UTC m=+572.250606805"
Sep 18 22:09:58.945362 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:58.945334    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-t28vs"
Sep 18 22:09:59.472578 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:59.472536    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-557f876f69-bvmr4"]
Sep 18 22:09:59.477270 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:59.477247    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-bvmr4"
Sep 18 22:09:59.485467 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:59.485449    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-557f876f69-bvmr4"]
Sep 18 22:09:59.575463 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:59.575398    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzh7d\" (UniqueName: \"kubernetes.io/projected/2954bb5a-294e-4676-a197-bad864321fd4-kube-api-access-zzh7d\") pod \"authorino-557f876f69-bvmr4\" (UID: \"2954bb5a-294e-4676-a197-bad864321fd4\") " pod="kuadrant-system/authorino-557f876f69-bvmr4"
Sep 18 22:09:59.676143 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:59.676110    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzh7d\" (UniqueName: \"kubernetes.io/projected/2954bb5a-294e-4676-a197-bad864321fd4-kube-api-access-zzh7d\") pod \"authorino-557f876f69-bvmr4\" (UID: \"2954bb5a-294e-4676-a197-bad864321fd4\") " pod="kuadrant-system/authorino-557f876f69-bvmr4"
Sep 18 22:09:59.687443 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:59.687404    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzh7d\" (UniqueName: \"kubernetes.io/projected/2954bb5a-294e-4676-a197-bad864321fd4-kube-api-access-zzh7d\") pod \"authorino-557f876f69-bvmr4\" (UID: \"2954bb5a-294e-4676-a197-bad864321fd4\") " pod="kuadrant-system/authorino-557f876f69-bvmr4"
Sep 18 22:09:59.710543 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:59.710514    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-bvmr4"]
Sep 18 22:09:59.710768 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:59.710758    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-bvmr4"
Sep 18 22:09:59.740343 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:59.740312    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-78dcd55bcc-9xssz"]
Sep 18 22:09:59.744818 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:59.744794    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-78dcd55bcc-9xssz"
Sep 18 22:09:59.752384 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:59.752328    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-78dcd55bcc-9xssz"]
Sep 18 22:09:59.798180 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:59.798151    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-78dcd55bcc-9xssz"]
Sep 18 22:09:59.798457 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:09:59.798436    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-q2dc8], unattached volumes=[], failed to process volumes=[kube-api-access-q2dc8]: context canceled" pod="kuadrant-system/authorino-78dcd55bcc-9xssz" podUID="40604c59-97a9-4930-a24e-a6a9d098c90c"
Sep 18 22:09:59.828673 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:59.828643    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7c444d74ff-pfgpl"]
Sep 18 22:09:59.832379 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:59.832354    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c444d74ff-pfgpl"
Sep 18 22:09:59.834657 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:59.834635    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Sep 18 22:09:59.845307 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:59.845284    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7c444d74ff-pfgpl"]
Sep 18 22:09:59.878113 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:59.878084    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2dc8\" (UniqueName: \"kubernetes.io/projected/40604c59-97a9-4930-a24e-a6a9d098c90c-kube-api-access-q2dc8\") pod \"authorino-78dcd55bcc-9xssz\" (UID: \"40604c59-97a9-4930-a24e-a6a9d098c90c\") " pod="kuadrant-system/authorino-78dcd55bcc-9xssz"
Sep 18 22:09:59.951108 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:59.951078    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-78dcd55bcc-9xssz"
Sep 18 22:09:59.958006 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:59.957984    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-78dcd55bcc-9xssz"
Sep 18 22:09:59.978803 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:59.978742    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2dc8\" (UniqueName: \"kubernetes.io/projected/40604c59-97a9-4930-a24e-a6a9d098c90c-kube-api-access-q2dc8\") pod \"authorino-78dcd55bcc-9xssz\" (UID: \"40604c59-97a9-4930-a24e-a6a9d098c90c\") " pod="kuadrant-system/authorino-78dcd55bcc-9xssz"
Sep 18 22:09:59.978921 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:59.978808    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjxh9\" (UniqueName: \"kubernetes.io/projected/f630338e-2def-418e-a730-42b3bd610ce1-kube-api-access-rjxh9\") pod \"authorino-7c444d74ff-pfgpl\" (UID: \"f630338e-2def-418e-a730-42b3bd610ce1\") " pod="kuadrant-system/authorino-7c444d74ff-pfgpl"
Sep 18 22:09:59.978921 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:59.978847    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f630338e-2def-418e-a730-42b3bd610ce1-tls-cert\") pod \"authorino-7c444d74ff-pfgpl\" (UID: \"f630338e-2def-418e-a730-42b3bd610ce1\") " pod="kuadrant-system/authorino-7c444d74ff-pfgpl"
Sep 18 22:09:59.988930 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:59.988909    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-bvmr4"]
Sep 18 22:09:59.989974 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:09:59.989949    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2dc8\" (UniqueName: \"kubernetes.io/projected/40604c59-97a9-4930-a24e-a6a9d098c90c-kube-api-access-q2dc8\") pod \"authorino-78dcd55bcc-9xssz\" (UID: \"40604c59-97a9-4930-a24e-a6a9d098c90c\") " pod="kuadrant-system/authorino-78dcd55bcc-9xssz"
Sep 18 22:09:59.991318 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:09:59.991297    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2954bb5a_294e_4676_a197_bad864321fd4.slice/crio-285ea0887739d06889ca4c603f5f35b2ca35613b0c97b0c380bb5691fa4895b8 WatchSource:0}: Error finding container 285ea0887739d06889ca4c603f5f35b2ca35613b0c97b0c380bb5691fa4895b8: Status 404 returned error can't find the container with id 285ea0887739d06889ca4c603f5f35b2ca35613b0c97b0c380bb5691fa4895b8
Sep 18 22:10:00.079579 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:10:00.079550    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q2dc8\" (UniqueName: \"kubernetes.io/projected/40604c59-97a9-4930-a24e-a6a9d098c90c-kube-api-access-q2dc8\") pod \"40604c59-97a9-4930-a24e-a6a9d098c90c\" (UID: \"40604c59-97a9-4930-a24e-a6a9d098c90c\") "
Sep 18 22:10:00.079734 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:10:00.079673    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f630338e-2def-418e-a730-42b3bd610ce1-tls-cert\") pod \"authorino-7c444d74ff-pfgpl\" (UID: \"f630338e-2def-418e-a730-42b3bd610ce1\") " pod="kuadrant-system/authorino-7c444d74ff-pfgpl"
Sep 18 22:10:00.079797 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:10:00.079777    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjxh9\" (UniqueName: \"kubernetes.io/projected/f630338e-2def-418e-a730-42b3bd610ce1-kube-api-access-rjxh9\") pod \"authorino-7c444d74ff-pfgpl\" (UID: \"f630338e-2def-418e-a730-42b3bd610ce1\") " pod="kuadrant-system/authorino-7c444d74ff-pfgpl"
Sep 18 22:10:00.081803 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:10:00.081776    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40604c59-97a9-4930-a24e-a6a9d098c90c-kube-api-access-q2dc8" (OuterVolumeSpecName: "kube-api-access-q2dc8") pod "40604c59-97a9-4930-a24e-a6a9d098c90c" (UID: "40604c59-97a9-4930-a24e-a6a9d098c90c"). InnerVolumeSpecName "kube-api-access-q2dc8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:10:00.082162 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:10:00.082142    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f630338e-2def-418e-a730-42b3bd610ce1-tls-cert\") pod \"authorino-7c444d74ff-pfgpl\" (UID: \"f630338e-2def-418e-a730-42b3bd610ce1\") " pod="kuadrant-system/authorino-7c444d74ff-pfgpl"
Sep 18 22:10:00.091183 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:10:00.091154    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjxh9\" (UniqueName: \"kubernetes.io/projected/f630338e-2def-418e-a730-42b3bd610ce1-kube-api-access-rjxh9\") pod \"authorino-7c444d74ff-pfgpl\" (UID: \"f630338e-2def-418e-a730-42b3bd610ce1\") " pod="kuadrant-system/authorino-7c444d74ff-pfgpl"
Sep 18 22:10:00.141369 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:10:00.141345    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c444d74ff-pfgpl"
Sep 18 22:10:00.181178 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:10:00.181147    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q2dc8\" (UniqueName: \"kubernetes.io/projected/40604c59-97a9-4930-a24e-a6a9d098c90c-kube-api-access-q2dc8\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:10:00.417658 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:10:00.417630    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7c444d74ff-pfgpl"]
Sep 18 22:10:00.420223 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:10:00.420197    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf630338e_2def_418e_a730_42b3bd610ce1.slice/crio-8c779b9e6fe501f829c201629a237c131b5c7588c15746f293b0c4b89a86ceb3 WatchSource:0}: Error finding container 8c779b9e6fe501f829c201629a237c131b5c7588c15746f293b0c4b89a86ceb3: Status 404 returned error can't find the container with id 8c779b9e6fe501f829c201629a237c131b5c7588c15746f293b0c4b89a86ceb3
Sep 18 22:10:00.960963 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:10:00.960829    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7c444d74ff-pfgpl" event={"ID":"f630338e-2def-418e-a730-42b3bd610ce1","Type":"ContainerStarted","Data":"d212f156461a96b8c9f772e83074ddb18f417e77125899cee1d76648c9f6a81f"}
Sep 18 22:10:00.960963 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:10:00.960888    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7c444d74ff-pfgpl" event={"ID":"f630338e-2def-418e-a730-42b3bd610ce1","Type":"ContainerStarted","Data":"8c779b9e6fe501f829c201629a237c131b5c7588c15746f293b0c4b89a86ceb3"}
Sep 18 22:10:00.962838 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:10:00.962815    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-78dcd55bcc-9xssz"
Sep 18 22:10:00.963007 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:10:00.962858    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-557f876f69-bvmr4" event={"ID":"2954bb5a-294e-4676-a197-bad864321fd4","Type":"ContainerStarted","Data":"78b5b50e1b64aa4b5adce713d9bec75820f9e187ef9461d55544cd896b640ab8"}
Sep 18 22:10:00.963007 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:10:00.962886    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-557f876f69-bvmr4" event={"ID":"2954bb5a-294e-4676-a197-bad864321fd4","Type":"ContainerStarted","Data":"285ea0887739d06889ca4c603f5f35b2ca35613b0c97b0c380bb5691fa4895b8"}
Sep 18 22:10:00.963007 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:10:00.962909    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-557f876f69-bvmr4" podUID="2954bb5a-294e-4676-a197-bad864321fd4" containerName="authorino" containerID="cri-o://78b5b50e1b64aa4b5adce713d9bec75820f9e187ef9461d55544cd896b640ab8" gracePeriod=30
Sep 18 22:10:00.982609 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:10:00.982562    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7c444d74ff-pfgpl" podStartSLOduration=1.603819683 podStartE2EDuration="1.982546975s" totalImagesPullingTime="378.727292ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:09:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:10:00.979788147 +0000 UTC m=+580.299460204" watchObservedRunningTime="2026-09-18 22:10:00.982546975 +0000 UTC m=+580.302219042"
Sep 18 22:10:01.011789 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:10:01.011758    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-78dcd55bcc-9xssz"]
Sep 18 22:10:01.022803 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:10:01.022779    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-xsnxr"]
Sep 18 22:10:01.023007 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:10:01.022984    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-59c974bd48-xsnxr" podUID="60b83381-6549-4743-8b10-8ad6a33fb4d8" containerName="authorino" containerID="cri-o://a81deb6cf2949515f16c0d6fb2f1968e478ef88317ef6313aede862c01df86a3" gracePeriod=30
Sep 18 22:10:01.029404 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:10:01.029381    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-78dcd55bcc-9xssz"]
Sep 18 22:10:01.051298 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:10:01.051243    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-557f876f69-bvmr4" podStartSLOduration=1.6945987439999999 podStartE2EDuration="2.051227096s" totalImagesPullingTime="356.628352ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:09:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:10:01.049283528 +0000 UTC m=+580.368955583" watchObservedRunningTime="2026-09-18 22:10:01.051227096 +0000 UTC m=+580.370899151"
Sep 18 22:10:01.140946 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:10:01.140915    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="40604c59-97a9-4930-a24e-a6a9d098c90c" path="/var/lib/kubelet/pods/40604c59-97a9-4930-a24e-a6a9d098c90c/volumes"
Sep 18 22:10:01.266832 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:10:01.266807    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-bvmr4"
Sep 18 22:10:01.298303 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:10:01.298280    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-xsnxr"
Sep 18 22:10:01.390866 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:10:01.390837    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dhzw9\" (UniqueName: \"kubernetes.io/projected/60b83381-6549-4743-8b10-8ad6a33fb4d8-kube-api-access-dhzw9\") pod \"60b83381-6549-4743-8b10-8ad6a33fb4d8\" (UID: \"60b83381-6549-4743-8b10-8ad6a33fb4d8\") "
Sep 18 22:10:01.390866 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:10:01.390870    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zzh7d\" (UniqueName: \"kubernetes.io/projected/2954bb5a-294e-4676-a197-bad864321fd4-kube-api-access-zzh7d\") pod \"2954bb5a-294e-4676-a197-bad864321fd4\" (UID: \"2954bb5a-294e-4676-a197-bad864321fd4\") "
Sep 18 22:10:01.393012 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:10:01.392969    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60b83381-6549-4743-8b10-8ad6a33fb4d8-kube-api-access-dhzw9" (OuterVolumeSpecName: "kube-api-access-dhzw9") pod "60b83381-6549-4743-8b10-8ad6a33fb4d8" (UID: "60b83381-6549-4743-8b10-8ad6a33fb4d8"). InnerVolumeSpecName "kube-api-access-dhzw9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:10:01.393012 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:10:01.392992    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2954bb5a-294e-4676-a197-bad864321fd4-kube-api-access-zzh7d" (OuterVolumeSpecName: "kube-api-access-zzh7d") pod "2954bb5a-294e-4676-a197-bad864321fd4" (UID: "2954bb5a-294e-4676-a197-bad864321fd4"). InnerVolumeSpecName "kube-api-access-zzh7d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:10:01.492378 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:10:01.492292    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dhzw9\" (UniqueName: \"kubernetes.io/projected/60b83381-6549-4743-8b10-8ad6a33fb4d8-kube-api-access-dhzw9\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:10:01.492378 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:10:01.492325    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zzh7d\" (UniqueName: \"kubernetes.io/projected/2954bb5a-294e-4676-a197-bad864321fd4-kube-api-access-zzh7d\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:10:01.969983 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:10:01.969944    2577 generic.go:356] "Generic (PLEG): container finished" podID="60b83381-6549-4743-8b10-8ad6a33fb4d8" containerID="a81deb6cf2949515f16c0d6fb2f1968e478ef88317ef6313aede862c01df86a3" exitCode=0
Sep 18 22:10:01.970513 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:10:01.969991    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-xsnxr"
Sep 18 22:10:01.970513 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:10:01.970037    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-xsnxr" event={"ID":"60b83381-6549-4743-8b10-8ad6a33fb4d8","Type":"ContainerDied","Data":"a81deb6cf2949515f16c0d6fb2f1968e478ef88317ef6313aede862c01df86a3"}
Sep 18 22:10:01.970513 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:10:01.970088    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-xsnxr" event={"ID":"60b83381-6549-4743-8b10-8ad6a33fb4d8","Type":"ContainerDied","Data":"ff6d7ae0b23508b186d8618072df86897056646c7ac60c761a06edbc3ab18bcb"}
Sep 18 22:10:01.970513 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:10:01.970112    2577 scope.go:117] "RemoveContainer" containerID="a81deb6cf2949515f16c0d6fb2f1968e478ef88317ef6313aede862c01df86a3"
Sep 18 22:10:01.971634 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:10:01.971612    2577 generic.go:356] "Generic (PLEG): container finished" podID="2954bb5a-294e-4676-a197-bad864321fd4" containerID="78b5b50e1b64aa4b5adce713d9bec75820f9e187ef9461d55544cd896b640ab8" exitCode=0
Sep 18 22:10:01.971698 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:10:01.971675    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-bvmr4"
Sep 18 22:10:01.971698 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:10:01.971674    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-557f876f69-bvmr4" event={"ID":"2954bb5a-294e-4676-a197-bad864321fd4","Type":"ContainerDied","Data":"78b5b50e1b64aa4b5adce713d9bec75820f9e187ef9461d55544cd896b640ab8"}
Sep 18 22:10:01.971806 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:10:01.971713    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-557f876f69-bvmr4" event={"ID":"2954bb5a-294e-4676-a197-bad864321fd4","Type":"ContainerDied","Data":"285ea0887739d06889ca4c603f5f35b2ca35613b0c97b0c380bb5691fa4895b8"}
Sep 18 22:10:01.980018 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:10:01.980004    2577 scope.go:117] "RemoveContainer" containerID="a81deb6cf2949515f16c0d6fb2f1968e478ef88317ef6313aede862c01df86a3"
Sep 18 22:10:01.980470 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:10:01.980444    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a81deb6cf2949515f16c0d6fb2f1968e478ef88317ef6313aede862c01df86a3\": container with ID starting with a81deb6cf2949515f16c0d6fb2f1968e478ef88317ef6313aede862c01df86a3 not found: ID does not exist" containerID="a81deb6cf2949515f16c0d6fb2f1968e478ef88317ef6313aede862c01df86a3"
Sep 18 22:10:01.980576 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:10:01.980481    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a81deb6cf2949515f16c0d6fb2f1968e478ef88317ef6313aede862c01df86a3"} err="failed to get container status \"a81deb6cf2949515f16c0d6fb2f1968e478ef88317ef6313aede862c01df86a3\": rpc error: code = NotFound desc = could not find container \"a81deb6cf2949515f16c0d6fb2f1968e478ef88317ef6313aede862c01df86a3\": container with ID starting with a81deb6cf2949515f16c0d6fb2f1968e478ef88317ef6313aede862c01df86a3 not found: ID does not exist"
Sep 18 22:10:01.980576 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:10:01.980502    2577 scope.go:117] "RemoveContainer" containerID="78b5b50e1b64aa4b5adce713d9bec75820f9e187ef9461d55544cd896b640ab8"
Sep 18 22:10:01.988868 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:10:01.988853    2577 scope.go:117] "RemoveContainer" containerID="78b5b50e1b64aa4b5adce713d9bec75820f9e187ef9461d55544cd896b640ab8"
Sep 18 22:10:01.989126 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:10:01.989111    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78b5b50e1b64aa4b5adce713d9bec75820f9e187ef9461d55544cd896b640ab8\": container with ID starting with 78b5b50e1b64aa4b5adce713d9bec75820f9e187ef9461d55544cd896b640ab8 not found: ID does not exist" containerID="78b5b50e1b64aa4b5adce713d9bec75820f9e187ef9461d55544cd896b640ab8"
Sep 18 22:10:01.989177 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:10:01.989131    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78b5b50e1b64aa4b5adce713d9bec75820f9e187ef9461d55544cd896b640ab8"} err="failed to get container status \"78b5b50e1b64aa4b5adce713d9bec75820f9e187ef9461d55544cd896b640ab8\": rpc error: code = NotFound desc = could not find container \"78b5b50e1b64aa4b5adce713d9bec75820f9e187ef9461d55544cd896b640ab8\": container with ID starting with 78b5b50e1b64aa4b5adce713d9bec75820f9e187ef9461d55544cd896b640ab8 not found: ID does not exist"
Sep 18 22:10:01.996213 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:10:01.996195    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-xsnxr"]
Sep 18 22:10:02.005576 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:10:02.005552    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-59c974bd48-xsnxr"]
Sep 18 22:10:02.016481 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:10:02.016386    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-bvmr4"]
Sep 18 22:10:02.019079 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:10:02.019059    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-557f876f69-bvmr4"]
Sep 18 22:10:03.140187 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:10:03.140151    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2954bb5a-294e-4676-a197-bad864321fd4" path="/var/lib/kubelet/pods/2954bb5a-294e-4676-a197-bad864321fd4/volumes"
Sep 18 22:10:03.140713 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:10:03.140651    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="60b83381-6549-4743-8b10-8ad6a33fb4d8" path="/var/lib/kubelet/pods/60b83381-6549-4743-8b10-8ad6a33fb4d8/volumes"
Sep 18 22:10:21.061378 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:10:21.061347    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-h2847_125d5bb0-54b7-4dff-aa80-e737f2791533/console-operator/1.log"
Sep 18 22:10:21.061851 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:10:21.061486    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-h2847_125d5bb0-54b7-4dff-aa80-e737f2791533/console-operator/1.log"
Sep 18 22:10:44.317852 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:10:44.317773    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-7229m"]
Sep 18 22:10:44.320216 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:10:44.318172    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2954bb5a-294e-4676-a197-bad864321fd4" containerName="authorino"
Sep 18 22:10:44.320216 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:10:44.318184    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="2954bb5a-294e-4676-a197-bad864321fd4" containerName="authorino"
Sep 18 22:10:44.320216 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:10:44.318203    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60b83381-6549-4743-8b10-8ad6a33fb4d8" containerName="authorino"
Sep 18 22:10:44.320216 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:10:44.318212    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="60b83381-6549-4743-8b10-8ad6a33fb4d8" containerName="authorino"
Sep 18 22:10:44.320216 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:10:44.318277    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="2954bb5a-294e-4676-a197-bad864321fd4" containerName="authorino"
Sep 18 22:10:44.320216 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:10:44.318293    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="60b83381-6549-4743-8b10-8ad6a33fb4d8" containerName="authorino"
Sep 18 22:10:44.321518 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:10:44.321503    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-7229m"
Sep 18 22:10:44.327271 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:10:44.327243    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-rdjmp\""
Sep 18 22:10:44.327619 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:10:44.327597    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 18 22:10:44.344767 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:10:44.344744    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-7229m"]
Sep 18 22:10:44.473172 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:10:44.473141    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e64b8957-d4a9-40e0-a010-a875bbae1e96-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-7229m\" (UID: \"e64b8957-d4a9-40e0-a010-a875bbae1e96\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-7229m"
Sep 18 22:10:44.473360 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:10:44.473229    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-484j4\" (UniqueName: \"kubernetes.io/projected/e64b8957-d4a9-40e0-a010-a875bbae1e96-kube-api-access-484j4\") pod \"payload-pre-processing-59fbc47bf8-7229m\" (UID: \"e64b8957-d4a9-40e0-a010-a875bbae1e96\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-7229m"
Sep 18 22:10:44.574367 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:10:44.574288    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-484j4\" (UniqueName: \"kubernetes.io/projected/e64b8957-d4a9-40e0-a010-a875bbae1e96-kube-api-access-484j4\") pod \"payload-pre-processing-59fbc47bf8-7229m\" (UID: \"e64b8957-d4a9-40e0-a010-a875bbae1e96\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-7229m"
Sep 18 22:10:44.574367 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:10:44.574345    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e64b8957-d4a9-40e0-a010-a875bbae1e96-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-7229m\" (UID: \"e64b8957-d4a9-40e0-a010-a875bbae1e96\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-7229m"
Sep 18 22:10:44.575077 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:10:44.575055    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e64b8957-d4a9-40e0-a010-a875bbae1e96-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-7229m\" (UID: \"e64b8957-d4a9-40e0-a010-a875bbae1e96\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-7229m"
Sep 18 22:10:44.602709 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:10:44.602678    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-484j4\" (UniqueName: \"kubernetes.io/projected/e64b8957-d4a9-40e0-a010-a875bbae1e96-kube-api-access-484j4\") pod \"payload-pre-processing-59fbc47bf8-7229m\" (UID: \"e64b8957-d4a9-40e0-a010-a875bbae1e96\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-7229m"
Sep 18 22:10:44.631502 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:10:44.631466    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-7229m"
Sep 18 22:10:44.937982 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:10:44.937958    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-7229m"]
Sep 18 22:10:44.940348 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:10:44.940320    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode64b8957_d4a9_40e0_a010_a875bbae1e96.slice/crio-97616d37629a5bfc7b8b711e2d19ce9c45c2d2f6ed5d45cba90db6d5f9164c10 WatchSource:0}: Error finding container 97616d37629a5bfc7b8b711e2d19ce9c45c2d2f6ed5d45cba90db6d5f9164c10: Status 404 returned error can't find the container with id 97616d37629a5bfc7b8b711e2d19ce9c45c2d2f6ed5d45cba90db6d5f9164c10
Sep 18 22:10:44.942371 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:10:44.942351    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 18 22:10:45.211470 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:10:45.211367    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-7229m" event={"ID":"e64b8957-d4a9-40e0-a010-a875bbae1e96","Type":"ContainerStarted","Data":"97616d37629a5bfc7b8b711e2d19ce9c45c2d2f6ed5d45cba90db6d5f9164c10"}
Sep 18 22:10:47.224513 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:10:47.224466    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-7229m" event={"ID":"e64b8957-d4a9-40e0-a010-a875bbae1e96","Type":"ContainerStarted","Data":"5038cd26dd3b65ee21ba8103dd4362ac5507969dcedea23a332a3324eafabad6"}
Sep 18 22:10:47.225063 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:10:47.225044    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-7229m"
Sep 18 22:10:47.255971 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:10:47.255908    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-7229m" podStartSLOduration=1.774010799 podStartE2EDuration="3.255873189s" totalImagesPullingTime="1.48186239s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:10:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:10:47.254296038 +0000 UTC m=+626.573968088" watchObservedRunningTime="2026-09-18 22:10:47.255873189 +0000 UTC m=+626.575545246"
Sep 18 22:10:54.267018 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:10:54.266944    2577 generic.go:356] "Generic (PLEG): container finished" podID="141b0cdb-5a28-40ae-88f4-17e9ab7e97e1" containerID="ec479007be92e321578cd7431520926bf7338d34519e496cb5fe5a2066082460" exitCode=0
Sep 18 22:10:54.267018 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:10:54.267003    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jzpjr" event={"ID":"141b0cdb-5a28-40ae-88f4-17e9ab7e97e1","Type":"ContainerDied","Data":"ec479007be92e321578cd7431520926bf7338d34519e496cb5fe5a2066082460"}
Sep 18 22:10:54.267723 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:10:54.267350    2577 scope.go:117] "RemoveContainer" containerID="ec479007be92e321578cd7431520926bf7338d34519e496cb5fe5a2066082460"
Sep 18 22:10:54.268376 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:10:54.268343    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:10:54.268473 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:10:54.268455    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:10:54.268528 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:10:54.268513    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:10:55.276179 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:10:55.276145    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jzpjr" event={"ID":"141b0cdb-5a28-40ae-88f4-17e9ab7e97e1","Type":"ContainerStarted","Data":"26cb7fc7ddd20bd4e5bc55e1d771fd9c368a798e4c71cf4599da907d5196348a"}
Sep 18 22:10:55.431503 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:10:55.431466    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jzpjr"
Sep 18 22:10:55.431735 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:10:55.431713    2577 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-jzpjr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Sep 18 22:10:55.431794 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:10:55.431777    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jzpjr" podUID="141b0cdb-5a28-40ae-88f4-17e9ab7e97e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Sep 18 22:10:56.431313 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:10:56.431279    2577 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-jzpjr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Sep 18 22:10:56.431823 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:10:56.431336    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jzpjr" podUID="141b0cdb-5a28-40ae-88f4-17e9ab7e97e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Sep 18 22:10:57.431852 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:10:57.431814    2577 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-jzpjr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Sep 18 22:10:57.432246 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:10:57.431865    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jzpjr" podUID="141b0cdb-5a28-40ae-88f4-17e9ab7e97e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Sep 18 22:10:58.431366 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:10:58.431330    2577 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-jzpjr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Sep 18 22:10:58.431553 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:10:58.431380    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jzpjr" podUID="141b0cdb-5a28-40ae-88f4-17e9ab7e97e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Sep 18 22:10:59.236290 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:10:59.236259    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-7229m"
Sep 18 22:10:59.431566 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:10:59.431536    2577 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-jzpjr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Sep 18 22:10:59.431736 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:10:59.431595    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jzpjr" podUID="141b0cdb-5a28-40ae-88f4-17e9ab7e97e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Sep 18 22:11:00.431918 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:11:00.431884    2577 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-jzpjr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Sep 18 22:11:00.432275 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:11:00.431951    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jzpjr" podUID="141b0cdb-5a28-40ae-88f4-17e9ab7e97e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Sep 18 22:11:00.765570 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:11:00.765483    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jzpjr"
Sep 18 22:11:01.435378 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:11:01.435347    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jzpjr"
Sep 18 22:11:01.436509 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:11:01.436489    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jzpjr"
Sep 18 22:13:35.110138 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:35.110099    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8d479bf8-8fndb"]
Sep 18 22:13:35.113640 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:35.113622    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8d479bf8-8fndb"
Sep 18 22:13:35.141510 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:35.141483    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8d479bf8-8fndb"]
Sep 18 22:13:35.190938 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:35.190901    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/45756c94-441d-4961-b9b7-5a382730412c-tls-cert\") pod \"authorino-8d479bf8-8fndb\" (UID: \"45756c94-441d-4961-b9b7-5a382730412c\") " pod="kuadrant-system/authorino-8d479bf8-8fndb"
Sep 18 22:13:35.191125 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:35.191087    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqs4d\" (UniqueName: \"kubernetes.io/projected/45756c94-441d-4961-b9b7-5a382730412c-kube-api-access-nqs4d\") pod \"authorino-8d479bf8-8fndb\" (UID: \"45756c94-441d-4961-b9b7-5a382730412c\") " pod="kuadrant-system/authorino-8d479bf8-8fndb"
Sep 18 22:13:35.291830 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:35.291793    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqs4d\" (UniqueName: \"kubernetes.io/projected/45756c94-441d-4961-b9b7-5a382730412c-kube-api-access-nqs4d\") pod \"authorino-8d479bf8-8fndb\" (UID: \"45756c94-441d-4961-b9b7-5a382730412c\") " pod="kuadrant-system/authorino-8d479bf8-8fndb"
Sep 18 22:13:35.292029 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:35.291867    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/45756c94-441d-4961-b9b7-5a382730412c-tls-cert\") pod \"authorino-8d479bf8-8fndb\" (UID: \"45756c94-441d-4961-b9b7-5a382730412c\") " pod="kuadrant-system/authorino-8d479bf8-8fndb"
Sep 18 22:13:35.294720 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:35.294690    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/45756c94-441d-4961-b9b7-5a382730412c-tls-cert\") pod \"authorino-8d479bf8-8fndb\" (UID: \"45756c94-441d-4961-b9b7-5a382730412c\") " pod="kuadrant-system/authorino-8d479bf8-8fndb"
Sep 18 22:13:35.301162 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:35.301136    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqs4d\" (UniqueName: \"kubernetes.io/projected/45756c94-441d-4961-b9b7-5a382730412c-kube-api-access-nqs4d\") pod \"authorino-8d479bf8-8fndb\" (UID: \"45756c94-441d-4961-b9b7-5a382730412c\") " pod="kuadrant-system/authorino-8d479bf8-8fndb"
Sep 18 22:13:35.423071 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:35.422988    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8d479bf8-8fndb"
Sep 18 22:13:35.717660 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:35.717580    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8d479bf8-8fndb"]
Sep 18 22:13:35.721264 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:13:35.721221    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod45756c94_441d_4961_b9b7_5a382730412c.slice/crio-010e7aa35e7e6805ab09f7ffa9af08ebf4558043355e6a29c553cbf5086c1723 WatchSource:0}: Error finding container 010e7aa35e7e6805ab09f7ffa9af08ebf4558043355e6a29c553cbf5086c1723: Status 404 returned error can't find the container with id 010e7aa35e7e6805ab09f7ffa9af08ebf4558043355e6a29c553cbf5086c1723
Sep 18 22:13:36.169099 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:36.169064    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8d479bf8-8fndb" event={"ID":"45756c94-441d-4961-b9b7-5a382730412c","Type":"ContainerStarted","Data":"010e7aa35e7e6805ab09f7ffa9af08ebf4558043355e6a29c553cbf5086c1723"}
Sep 18 22:13:37.178776 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:37.178681    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8d479bf8-8fndb" event={"ID":"45756c94-441d-4961-b9b7-5a382730412c","Type":"ContainerStarted","Data":"7aa7b2209f5281e79de9ebd00576759db793f0466a4ba6d3f7564508bbb062d4"}
Sep 18 22:13:37.232538 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:37.232474    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-8d479bf8-8fndb" podStartSLOduration=1.12199932 podStartE2EDuration="2.232451192s" totalImagesPullingTime="1.110451872s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:13:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:13:37.229523117 +0000 UTC m=+796.549195173" watchObservedRunningTime="2026-09-18 22:13:37.232451192 +0000 UTC m=+796.552123249"
Sep 18 22:13:37.298503 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:37.298464    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7c444d74ff-pfgpl"]
Sep 18 22:13:37.298778 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:37.298721    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7c444d74ff-pfgpl" podUID="f630338e-2def-418e-a730-42b3bd610ce1" containerName="authorino" containerID="cri-o://d212f156461a96b8c9f772e83074ddb18f417e77125899cee1d76648c9f6a81f" gracePeriod=30
Sep 18 22:13:37.568633 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:37.568605    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c444d74ff-pfgpl"
Sep 18 22:13:37.613221 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:37.613186    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rjxh9\" (UniqueName: \"kubernetes.io/projected/f630338e-2def-418e-a730-42b3bd610ce1-kube-api-access-rjxh9\") pod \"f630338e-2def-418e-a730-42b3bd610ce1\" (UID: \"f630338e-2def-418e-a730-42b3bd610ce1\") "
Sep 18 22:13:37.613405 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:37.613308    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f630338e-2def-418e-a730-42b3bd610ce1-tls-cert\") pod \"f630338e-2def-418e-a730-42b3bd610ce1\" (UID: \"f630338e-2def-418e-a730-42b3bd610ce1\") "
Sep 18 22:13:37.616060 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:37.616026    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f630338e-2def-418e-a730-42b3bd610ce1-kube-api-access-rjxh9" (OuterVolumeSpecName: "kube-api-access-rjxh9") pod "f630338e-2def-418e-a730-42b3bd610ce1" (UID: "f630338e-2def-418e-a730-42b3bd610ce1"). InnerVolumeSpecName "kube-api-access-rjxh9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:13:37.624962 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:37.624933    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f630338e-2def-418e-a730-42b3bd610ce1-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "f630338e-2def-418e-a730-42b3bd610ce1" (UID: "f630338e-2def-418e-a730-42b3bd610ce1"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 22:13:37.714564 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:37.714522    2577 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f630338e-2def-418e-a730-42b3bd610ce1-tls-cert\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:13:37.714564 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:37.714558    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rjxh9\" (UniqueName: \"kubernetes.io/projected/f630338e-2def-418e-a730-42b3bd610ce1-kube-api-access-rjxh9\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:13:38.185616 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:38.185509    2577 generic.go:356] "Generic (PLEG): container finished" podID="f630338e-2def-418e-a730-42b3bd610ce1" containerID="d212f156461a96b8c9f772e83074ddb18f417e77125899cee1d76648c9f6a81f" exitCode=0
Sep 18 22:13:38.185616 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:38.185607    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c444d74ff-pfgpl"
Sep 18 22:13:38.186131 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:38.185646    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7c444d74ff-pfgpl" event={"ID":"f630338e-2def-418e-a730-42b3bd610ce1","Type":"ContainerDied","Data":"d212f156461a96b8c9f772e83074ddb18f417e77125899cee1d76648c9f6a81f"}
Sep 18 22:13:38.186131 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:38.185691    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7c444d74ff-pfgpl" event={"ID":"f630338e-2def-418e-a730-42b3bd610ce1","Type":"ContainerDied","Data":"8c779b9e6fe501f829c201629a237c131b5c7588c15746f293b0c4b89a86ceb3"}
Sep 18 22:13:38.186131 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:38.185710    2577 scope.go:117] "RemoveContainer" containerID="d212f156461a96b8c9f772e83074ddb18f417e77125899cee1d76648c9f6a81f"
Sep 18 22:13:38.195953 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:38.195933    2577 scope.go:117] "RemoveContainer" containerID="d212f156461a96b8c9f772e83074ddb18f417e77125899cee1d76648c9f6a81f"
Sep 18 22:13:38.196217 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:13:38.196200    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d212f156461a96b8c9f772e83074ddb18f417e77125899cee1d76648c9f6a81f\": container with ID starting with d212f156461a96b8c9f772e83074ddb18f417e77125899cee1d76648c9f6a81f not found: ID does not exist" containerID="d212f156461a96b8c9f772e83074ddb18f417e77125899cee1d76648c9f6a81f"
Sep 18 22:13:38.196278 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:38.196227    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d212f156461a96b8c9f772e83074ddb18f417e77125899cee1d76648c9f6a81f"} err="failed to get container status \"d212f156461a96b8c9f772e83074ddb18f417e77125899cee1d76648c9f6a81f\": rpc error: code = NotFound desc = could not find container \"d212f156461a96b8c9f772e83074ddb18f417e77125899cee1d76648c9f6a81f\": container with ID starting with d212f156461a96b8c9f772e83074ddb18f417e77125899cee1d76648c9f6a81f not found: ID does not exist"
Sep 18 22:13:38.226995 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:38.226965    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7c444d74ff-pfgpl"]
Sep 18 22:13:38.235577 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:38.235547    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7c444d74ff-pfgpl"]
Sep 18 22:13:39.139824 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:39.139786    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f630338e-2def-418e-a730-42b3bd610ce1" path="/var/lib/kubelet/pods/f630338e-2def-418e-a730-42b3bd610ce1/volumes"
Sep 18 22:13:55.352727 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:55.352690    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-3d28c1-openshift-default-6745f5d8d8-mdxtn"]
Sep 18 22:13:55.353999 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:55.353965    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f630338e-2def-418e-a730-42b3bd610ce1" containerName="authorino"
Sep 18 22:13:55.353999 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:55.353993    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f630338e-2def-418e-a730-42b3bd610ce1" containerName="authorino"
Sep 18 22:13:55.354168 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:55.354096    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f630338e-2def-418e-a730-42b3bd610ce1" containerName="authorino"
Sep 18 22:13:55.357887 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:55.357861    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-3d28c1-openshift-default-6745f5d8d8-mdxtn"
Sep 18 22:13:55.361661 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:55.361635    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-3d28c1-openshift-default-dockercfg-krpfx\""
Sep 18 22:13:55.378373 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:55.378346    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-3d28c1-openshift-default-6745f5d8d8-mdxtn"]
Sep 18 22:13:55.461273 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:55.457613    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-59b357-openshift-default-84b8cd88c8-vjhfk"]
Sep 18 22:13:55.465103 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:55.465072    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-59b357-openshift-default-84b8cd88c8-vjhfk"
Sep 18 22:13:55.468115 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:55.468082    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-59b357-openshift-default-84b8cd88c8-vjhfk"]
Sep 18 22:13:55.470742 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:55.470719    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w4-59b357-openshift-default-dockercfg-ffcvd\""
Sep 18 22:13:55.474975 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:55.474332    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/01bdcd1e-7689-43dc-87e9-b1f98ce153ed-workload-socket\") pod \"e2e-inf-a-3d28c1-openshift-default-6745f5d8d8-mdxtn\" (UID: \"01bdcd1e-7689-43dc-87e9-b1f98ce153ed\") " pod="openshift-ingress/e2e-inf-a-3d28c1-openshift-default-6745f5d8d8-mdxtn"
Sep 18 22:13:55.474975 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:55.474740    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/01bdcd1e-7689-43dc-87e9-b1f98ce153ed-credential-socket\") pod \"e2e-inf-a-3d28c1-openshift-default-6745f5d8d8-mdxtn\" (UID: \"01bdcd1e-7689-43dc-87e9-b1f98ce153ed\") " pod="openshift-ingress/e2e-inf-a-3d28c1-openshift-default-6745f5d8d8-mdxtn"
Sep 18 22:13:55.474975 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:55.474831    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/01bdcd1e-7689-43dc-87e9-b1f98ce153ed-istio-token\") pod \"e2e-inf-a-3d28c1-openshift-default-6745f5d8d8-mdxtn\" (UID: \"01bdcd1e-7689-43dc-87e9-b1f98ce153ed\") " pod="openshift-ingress/e2e-inf-a-3d28c1-openshift-default-6745f5d8d8-mdxtn"
Sep 18 22:13:55.474975 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:55.474869    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/01bdcd1e-7689-43dc-87e9-b1f98ce153ed-istio-data\") pod \"e2e-inf-a-3d28c1-openshift-default-6745f5d8d8-mdxtn\" (UID: \"01bdcd1e-7689-43dc-87e9-b1f98ce153ed\") " pod="openshift-ingress/e2e-inf-a-3d28c1-openshift-default-6745f5d8d8-mdxtn"
Sep 18 22:13:55.474975 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:55.474931    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/01bdcd1e-7689-43dc-87e9-b1f98ce153ed-istio-podinfo\") pod \"e2e-inf-a-3d28c1-openshift-default-6745f5d8d8-mdxtn\" (UID: \"01bdcd1e-7689-43dc-87e9-b1f98ce153ed\") " pod="openshift-ingress/e2e-inf-a-3d28c1-openshift-default-6745f5d8d8-mdxtn"
Sep 18 22:13:55.475256 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:55.474977    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/01bdcd1e-7689-43dc-87e9-b1f98ce153ed-workload-certs\") pod \"e2e-inf-a-3d28c1-openshift-default-6745f5d8d8-mdxtn\" (UID: \"01bdcd1e-7689-43dc-87e9-b1f98ce153ed\") " pod="openshift-ingress/e2e-inf-a-3d28c1-openshift-default-6745f5d8d8-mdxtn"
Sep 18 22:13:55.475256 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:55.475008    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/01bdcd1e-7689-43dc-87e9-b1f98ce153ed-istiod-ca-cert\") pod \"e2e-inf-a-3d28c1-openshift-default-6745f5d8d8-mdxtn\" (UID: \"01bdcd1e-7689-43dc-87e9-b1f98ce153ed\") " pod="openshift-ingress/e2e-inf-a-3d28c1-openshift-default-6745f5d8d8-mdxtn"
Sep 18 22:13:55.475256 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:55.475080    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5lpj\" (UniqueName: \"kubernetes.io/projected/01bdcd1e-7689-43dc-87e9-b1f98ce153ed-kube-api-access-h5lpj\") pod \"e2e-inf-a-3d28c1-openshift-default-6745f5d8d8-mdxtn\" (UID: \"01bdcd1e-7689-43dc-87e9-b1f98ce153ed\") " pod="openshift-ingress/e2e-inf-a-3d28c1-openshift-default-6745f5d8d8-mdxtn"
Sep 18 22:13:55.475256 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:55.475216    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/01bdcd1e-7689-43dc-87e9-b1f98ce153ed-istio-envoy\") pod \"e2e-inf-a-3d28c1-openshift-default-6745f5d8d8-mdxtn\" (UID: \"01bdcd1e-7689-43dc-87e9-b1f98ce153ed\") " pod="openshift-ingress/e2e-inf-a-3d28c1-openshift-default-6745f5d8d8-mdxtn"
Sep 18 22:13:55.576253 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:55.576222    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/01bdcd1e-7689-43dc-87e9-b1f98ce153ed-istio-token\") pod \"e2e-inf-a-3d28c1-openshift-default-6745f5d8d8-mdxtn\" (UID: \"01bdcd1e-7689-43dc-87e9-b1f98ce153ed\") " pod="openshift-ingress/e2e-inf-a-3d28c1-openshift-default-6745f5d8d8-mdxtn"
Sep 18 22:13:55.576530 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:55.576256    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7967e7b5-3983-40bb-b739-b54755b69979-istiod-ca-cert\") pod \"e2e-worker-w4-59b357-openshift-default-84b8cd88c8-vjhfk\" (UID: \"7967e7b5-3983-40bb-b739-b54755b69979\") " pod="openshift-ingress/e2e-worker-w4-59b357-openshift-default-84b8cd88c8-vjhfk"
Sep 18 22:13:55.576530 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:55.576291    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/01bdcd1e-7689-43dc-87e9-b1f98ce153ed-istio-data\") pod \"e2e-inf-a-3d28c1-openshift-default-6745f5d8d8-mdxtn\" (UID: \"01bdcd1e-7689-43dc-87e9-b1f98ce153ed\") " pod="openshift-ingress/e2e-inf-a-3d28c1-openshift-default-6745f5d8d8-mdxtn"
Sep 18 22:13:55.576530 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:55.576331    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/01bdcd1e-7689-43dc-87e9-b1f98ce153ed-istio-podinfo\") pod \"e2e-inf-a-3d28c1-openshift-default-6745f5d8d8-mdxtn\" (UID: \"01bdcd1e-7689-43dc-87e9-b1f98ce153ed\") " pod="openshift-ingress/e2e-inf-a-3d28c1-openshift-default-6745f5d8d8-mdxtn"
Sep 18 22:13:55.576530 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:55.576356    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7967e7b5-3983-40bb-b739-b54755b69979-istio-envoy\") pod \"e2e-worker-w4-59b357-openshift-default-84b8cd88c8-vjhfk\" (UID: \"7967e7b5-3983-40bb-b739-b54755b69979\") " pod="openshift-ingress/e2e-worker-w4-59b357-openshift-default-84b8cd88c8-vjhfk"
Sep 18 22:13:55.576530 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:55.576472    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/01bdcd1e-7689-43dc-87e9-b1f98ce153ed-workload-certs\") pod \"e2e-inf-a-3d28c1-openshift-default-6745f5d8d8-mdxtn\" (UID: \"01bdcd1e-7689-43dc-87e9-b1f98ce153ed\") " pod="openshift-ingress/e2e-inf-a-3d28c1-openshift-default-6745f5d8d8-mdxtn"
Sep 18 22:13:55.576530 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:55.576507    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/01bdcd1e-7689-43dc-87e9-b1f98ce153ed-istiod-ca-cert\") pod \"e2e-inf-a-3d28c1-openshift-default-6745f5d8d8-mdxtn\" (UID: \"01bdcd1e-7689-43dc-87e9-b1f98ce153ed\") " pod="openshift-ingress/e2e-inf-a-3d28c1-openshift-default-6745f5d8d8-mdxtn"
Sep 18 22:13:55.576879 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:55.576548    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7967e7b5-3983-40bb-b739-b54755b69979-istio-data\") pod \"e2e-worker-w4-59b357-openshift-default-84b8cd88c8-vjhfk\" (UID: \"7967e7b5-3983-40bb-b739-b54755b69979\") " pod="openshift-ingress/e2e-worker-w4-59b357-openshift-default-84b8cd88c8-vjhfk"
Sep 18 22:13:55.576879 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:55.576604    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5lpj\" (UniqueName: \"kubernetes.io/projected/01bdcd1e-7689-43dc-87e9-b1f98ce153ed-kube-api-access-h5lpj\") pod \"e2e-inf-a-3d28c1-openshift-default-6745f5d8d8-mdxtn\" (UID: \"01bdcd1e-7689-43dc-87e9-b1f98ce153ed\") " pod="openshift-ingress/e2e-inf-a-3d28c1-openshift-default-6745f5d8d8-mdxtn"
Sep 18 22:13:55.576879 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:55.576666    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njdnw\" (UniqueName: \"kubernetes.io/projected/7967e7b5-3983-40bb-b739-b54755b69979-kube-api-access-njdnw\") pod \"e2e-worker-w4-59b357-openshift-default-84b8cd88c8-vjhfk\" (UID: \"7967e7b5-3983-40bb-b739-b54755b69979\") " pod="openshift-ingress/e2e-worker-w4-59b357-openshift-default-84b8cd88c8-vjhfk"
Sep 18 22:13:55.576879 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:55.576706    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/01bdcd1e-7689-43dc-87e9-b1f98ce153ed-istio-envoy\") pod \"e2e-inf-a-3d28c1-openshift-default-6745f5d8d8-mdxtn\" (UID: \"01bdcd1e-7689-43dc-87e9-b1f98ce153ed\") " pod="openshift-ingress/e2e-inf-a-3d28c1-openshift-default-6745f5d8d8-mdxtn"
Sep 18 22:13:55.576879 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:55.576732    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7967e7b5-3983-40bb-b739-b54755b69979-workload-certs\") pod \"e2e-worker-w4-59b357-openshift-default-84b8cd88c8-vjhfk\" (UID: \"7967e7b5-3983-40bb-b739-b54755b69979\") " pod="openshift-ingress/e2e-worker-w4-59b357-openshift-default-84b8cd88c8-vjhfk"
Sep 18 22:13:55.576879 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:55.576767    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7967e7b5-3983-40bb-b739-b54755b69979-workload-socket\") pod \"e2e-worker-w4-59b357-openshift-default-84b8cd88c8-vjhfk\" (UID: \"7967e7b5-3983-40bb-b739-b54755b69979\") " pod="openshift-ingress/e2e-worker-w4-59b357-openshift-default-84b8cd88c8-vjhfk"
Sep 18 22:13:55.576879 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:55.576795    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/01bdcd1e-7689-43dc-87e9-b1f98ce153ed-workload-socket\") pod \"e2e-inf-a-3d28c1-openshift-default-6745f5d8d8-mdxtn\" (UID: \"01bdcd1e-7689-43dc-87e9-b1f98ce153ed\") " pod="openshift-ingress/e2e-inf-a-3d28c1-openshift-default-6745f5d8d8-mdxtn"
Sep 18 22:13:55.576879 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:55.576819    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7967e7b5-3983-40bb-b739-b54755b69979-istio-podinfo\") pod \"e2e-worker-w4-59b357-openshift-default-84b8cd88c8-vjhfk\" (UID: \"7967e7b5-3983-40bb-b739-b54755b69979\") " pod="openshift-ingress/e2e-worker-w4-59b357-openshift-default-84b8cd88c8-vjhfk"
Sep 18 22:13:55.576879 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:55.576825    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/01bdcd1e-7689-43dc-87e9-b1f98ce153ed-istio-data\") pod \"e2e-inf-a-3d28c1-openshift-default-6745f5d8d8-mdxtn\" (UID: \"01bdcd1e-7689-43dc-87e9-b1f98ce153ed\") " pod="openshift-ingress/e2e-inf-a-3d28c1-openshift-default-6745f5d8d8-mdxtn"
Sep 18 22:13:55.576879 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:55.576849    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7967e7b5-3983-40bb-b739-b54755b69979-credential-socket\") pod \"e2e-worker-w4-59b357-openshift-default-84b8cd88c8-vjhfk\" (UID: \"7967e7b5-3983-40bb-b739-b54755b69979\") " pod="openshift-ingress/e2e-worker-w4-59b357-openshift-default-84b8cd88c8-vjhfk"
Sep 18 22:13:55.576879 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:55.576852    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/01bdcd1e-7689-43dc-87e9-b1f98ce153ed-workload-certs\") pod \"e2e-inf-a-3d28c1-openshift-default-6745f5d8d8-mdxtn\" (UID: \"01bdcd1e-7689-43dc-87e9-b1f98ce153ed\") " pod="openshift-ingress/e2e-inf-a-3d28c1-openshift-default-6745f5d8d8-mdxtn"
Sep 18 22:13:55.576879 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:55.576878    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7967e7b5-3983-40bb-b739-b54755b69979-istio-token\") pod \"e2e-worker-w4-59b357-openshift-default-84b8cd88c8-vjhfk\" (UID: \"7967e7b5-3983-40bb-b739-b54755b69979\") " pod="openshift-ingress/e2e-worker-w4-59b357-openshift-default-84b8cd88c8-vjhfk"
Sep 18 22:13:55.577563 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:55.576922    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/01bdcd1e-7689-43dc-87e9-b1f98ce153ed-credential-socket\") pod \"e2e-inf-a-3d28c1-openshift-default-6745f5d8d8-mdxtn\" (UID: \"01bdcd1e-7689-43dc-87e9-b1f98ce153ed\") " pod="openshift-ingress/e2e-inf-a-3d28c1-openshift-default-6745f5d8d8-mdxtn"
Sep 18 22:13:55.577563 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:55.577199    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/01bdcd1e-7689-43dc-87e9-b1f98ce153ed-workload-socket\") pod \"e2e-inf-a-3d28c1-openshift-default-6745f5d8d8-mdxtn\" (UID: \"01bdcd1e-7689-43dc-87e9-b1f98ce153ed\") " pod="openshift-ingress/e2e-inf-a-3d28c1-openshift-default-6745f5d8d8-mdxtn"
Sep 18 22:13:55.577563 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:55.577243    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/01bdcd1e-7689-43dc-87e9-b1f98ce153ed-credential-socket\") pod \"e2e-inf-a-3d28c1-openshift-default-6745f5d8d8-mdxtn\" (UID: \"01bdcd1e-7689-43dc-87e9-b1f98ce153ed\") " pod="openshift-ingress/e2e-inf-a-3d28c1-openshift-default-6745f5d8d8-mdxtn"
Sep 18 22:13:55.577563 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:55.577467    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/01bdcd1e-7689-43dc-87e9-b1f98ce153ed-istiod-ca-cert\") pod \"e2e-inf-a-3d28c1-openshift-default-6745f5d8d8-mdxtn\" (UID: \"01bdcd1e-7689-43dc-87e9-b1f98ce153ed\") " pod="openshift-ingress/e2e-inf-a-3d28c1-openshift-default-6745f5d8d8-mdxtn"
Sep 18 22:13:55.579349 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:55.579317    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/01bdcd1e-7689-43dc-87e9-b1f98ce153ed-istio-envoy\") pod \"e2e-inf-a-3d28c1-openshift-default-6745f5d8d8-mdxtn\" (UID: \"01bdcd1e-7689-43dc-87e9-b1f98ce153ed\") " pod="openshift-ingress/e2e-inf-a-3d28c1-openshift-default-6745f5d8d8-mdxtn"
Sep 18 22:13:55.579955 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:55.579936    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/01bdcd1e-7689-43dc-87e9-b1f98ce153ed-istio-podinfo\") pod \"e2e-inf-a-3d28c1-openshift-default-6745f5d8d8-mdxtn\" (UID: \"01bdcd1e-7689-43dc-87e9-b1f98ce153ed\") " pod="openshift-ingress/e2e-inf-a-3d28c1-openshift-default-6745f5d8d8-mdxtn"
Sep 18 22:13:55.590824 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:55.590798    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-a13357-openshift-default-6dbf49559b-zznj9"]
Sep 18 22:13:55.594767 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:55.594747    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-a13357-openshift-default-6dbf49559b-zznj9"
Sep 18 22:13:55.598575 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:55.598549    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w0-a13357-openshift-default-dockercfg-x4g72\""
Sep 18 22:13:55.643063 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:55.642940    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-a13357-openshift-default-6dbf49559b-zznj9"]
Sep 18 22:13:55.643063 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:55.642941    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5lpj\" (UniqueName: \"kubernetes.io/projected/01bdcd1e-7689-43dc-87e9-b1f98ce153ed-kube-api-access-h5lpj\") pod \"e2e-inf-a-3d28c1-openshift-default-6745f5d8d8-mdxtn\" (UID: \"01bdcd1e-7689-43dc-87e9-b1f98ce153ed\") " pod="openshift-ingress/e2e-inf-a-3d28c1-openshift-default-6745f5d8d8-mdxtn"
Sep 18 22:13:55.644858 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:55.643507    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/01bdcd1e-7689-43dc-87e9-b1f98ce153ed-istio-token\") pod \"e2e-inf-a-3d28c1-openshift-default-6745f5d8d8-mdxtn\" (UID: \"01bdcd1e-7689-43dc-87e9-b1f98ce153ed\") " pod="openshift-ingress/e2e-inf-a-3d28c1-openshift-default-6745f5d8d8-mdxtn"
Sep 18 22:13:55.670487 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:55.669765    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-3d28c1-openshift-default-6745f5d8d8-mdxtn"
Sep 18 22:13:55.677596 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:55.677549    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7967e7b5-3983-40bb-b739-b54755b69979-istiod-ca-cert\") pod \"e2e-worker-w4-59b357-openshift-default-84b8cd88c8-vjhfk\" (UID: \"7967e7b5-3983-40bb-b739-b54755b69979\") " pod="openshift-ingress/e2e-worker-w4-59b357-openshift-default-84b8cd88c8-vjhfk"
Sep 18 22:13:55.677596 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:55.677592    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ecc5b678-e35f-47f3-b50c-ee1a44680f88-istio-data\") pod \"e2e-worker-w0-a13357-openshift-default-6dbf49559b-zznj9\" (UID: \"ecc5b678-e35f-47f3-b50c-ee1a44680f88\") " pod="openshift-ingress/e2e-worker-w0-a13357-openshift-default-6dbf49559b-zznj9"
Sep 18 22:13:55.677806 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:55.677636    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svfsk\" (UniqueName: \"kubernetes.io/projected/ecc5b678-e35f-47f3-b50c-ee1a44680f88-kube-api-access-svfsk\") pod \"e2e-worker-w0-a13357-openshift-default-6dbf49559b-zznj9\" (UID: \"ecc5b678-e35f-47f3-b50c-ee1a44680f88\") " pod="openshift-ingress/e2e-worker-w0-a13357-openshift-default-6dbf49559b-zznj9"
Sep 18 22:13:55.677806 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:55.677664    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7967e7b5-3983-40bb-b739-b54755b69979-istio-envoy\") pod \"e2e-worker-w4-59b357-openshift-default-84b8cd88c8-vjhfk\" (UID: \"7967e7b5-3983-40bb-b739-b54755b69979\") " pod="openshift-ingress/e2e-worker-w4-59b357-openshift-default-84b8cd88c8-vjhfk"
Sep 18 22:13:55.677806 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:55.677698    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7967e7b5-3983-40bb-b739-b54755b69979-istio-data\") pod \"e2e-worker-w4-59b357-openshift-default-84b8cd88c8-vjhfk\" (UID: \"7967e7b5-3983-40bb-b739-b54755b69979\") " pod="openshift-ingress/e2e-worker-w4-59b357-openshift-default-84b8cd88c8-vjhfk"
Sep 18 22:13:55.677806 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:55.677723    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ecc5b678-e35f-47f3-b50c-ee1a44680f88-istio-podinfo\") pod \"e2e-worker-w0-a13357-openshift-default-6dbf49559b-zznj9\" (UID: \"ecc5b678-e35f-47f3-b50c-ee1a44680f88\") " pod="openshift-ingress/e2e-worker-w0-a13357-openshift-default-6dbf49559b-zznj9"
Sep 18 22:13:55.678461 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:55.678383    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7967e7b5-3983-40bb-b739-b54755b69979-istio-data\") pod \"e2e-worker-w4-59b357-openshift-default-84b8cd88c8-vjhfk\" (UID: \"7967e7b5-3983-40bb-b739-b54755b69979\") " pod="openshift-ingress/e2e-worker-w4-59b357-openshift-default-84b8cd88c8-vjhfk"
Sep 18 22:13:55.678602 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:55.678512    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7967e7b5-3983-40bb-b739-b54755b69979-istiod-ca-cert\") pod \"e2e-worker-w4-59b357-openshift-default-84b8cd88c8-vjhfk\" (UID: \"7967e7b5-3983-40bb-b739-b54755b69979\") " pod="openshift-ingress/e2e-worker-w4-59b357-openshift-default-84b8cd88c8-vjhfk"
Sep 18 22:13:55.678700 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:55.677747    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ecc5b678-e35f-47f3-b50c-ee1a44680f88-istio-token\") pod \"e2e-worker-w0-a13357-openshift-default-6dbf49559b-zznj9\" (UID: \"ecc5b678-e35f-47f3-b50c-ee1a44680f88\") " pod="openshift-ingress/e2e-worker-w0-a13357-openshift-default-6dbf49559b-zznj9"
Sep 18 22:13:55.678821 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:55.678726    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ecc5b678-e35f-47f3-b50c-ee1a44680f88-istiod-ca-cert\") pod \"e2e-worker-w0-a13357-openshift-default-6dbf49559b-zznj9\" (UID: \"ecc5b678-e35f-47f3-b50c-ee1a44680f88\") " pod="openshift-ingress/e2e-worker-w0-a13357-openshift-default-6dbf49559b-zznj9"
Sep 18 22:13:55.678821 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:55.678785    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ecc5b678-e35f-47f3-b50c-ee1a44680f88-credential-socket\") pod \"e2e-worker-w0-a13357-openshift-default-6dbf49559b-zznj9\" (UID: \"ecc5b678-e35f-47f3-b50c-ee1a44680f88\") " pod="openshift-ingress/e2e-worker-w0-a13357-openshift-default-6dbf49559b-zznj9"
Sep 18 22:13:55.678944 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:55.678820    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ecc5b678-e35f-47f3-b50c-ee1a44680f88-workload-socket\") pod \"e2e-worker-w0-a13357-openshift-default-6dbf49559b-zznj9\" (UID: \"ecc5b678-e35f-47f3-b50c-ee1a44680f88\") " pod="openshift-ingress/e2e-worker-w0-a13357-openshift-default-6dbf49559b-zznj9"
Sep 18 22:13:55.678944 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:55.678855    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ecc5b678-e35f-47f3-b50c-ee1a44680f88-istio-envoy\") pod \"e2e-worker-w0-a13357-openshift-default-6dbf49559b-zznj9\" (UID: \"ecc5b678-e35f-47f3-b50c-ee1a44680f88\") " pod="openshift-ingress/e2e-worker-w0-a13357-openshift-default-6dbf49559b-zznj9"
Sep 18 22:13:55.678944 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:55.678896    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njdnw\" (UniqueName: \"kubernetes.io/projected/7967e7b5-3983-40bb-b739-b54755b69979-kube-api-access-njdnw\") pod \"e2e-worker-w4-59b357-openshift-default-84b8cd88c8-vjhfk\" (UID: \"7967e7b5-3983-40bb-b739-b54755b69979\") " pod="openshift-ingress/e2e-worker-w4-59b357-openshift-default-84b8cd88c8-vjhfk"
Sep 18 22:13:55.678944 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:55.678932    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7967e7b5-3983-40bb-b739-b54755b69979-workload-certs\") pod \"e2e-worker-w4-59b357-openshift-default-84b8cd88c8-vjhfk\" (UID: \"7967e7b5-3983-40bb-b739-b54755b69979\") " pod="openshift-ingress/e2e-worker-w4-59b357-openshift-default-84b8cd88c8-vjhfk"
Sep 18 22:13:55.679154 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:55.678965    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7967e7b5-3983-40bb-b739-b54755b69979-workload-socket\") pod \"e2e-worker-w4-59b357-openshift-default-84b8cd88c8-vjhfk\" (UID: \"7967e7b5-3983-40bb-b739-b54755b69979\") " pod="openshift-ingress/e2e-worker-w4-59b357-openshift-default-84b8cd88c8-vjhfk"
Sep 18 22:13:55.679154 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:55.678992    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7967e7b5-3983-40bb-b739-b54755b69979-istio-podinfo\") pod \"e2e-worker-w4-59b357-openshift-default-84b8cd88c8-vjhfk\" (UID: \"7967e7b5-3983-40bb-b739-b54755b69979\") " pod="openshift-ingress/e2e-worker-w4-59b357-openshift-default-84b8cd88c8-vjhfk"
Sep 18 22:13:55.679154 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:55.679021    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7967e7b5-3983-40bb-b739-b54755b69979-credential-socket\") pod \"e2e-worker-w4-59b357-openshift-default-84b8cd88c8-vjhfk\" (UID: \"7967e7b5-3983-40bb-b739-b54755b69979\") " pod="openshift-ingress/e2e-worker-w4-59b357-openshift-default-84b8cd88c8-vjhfk"
Sep 18 22:13:55.679154 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:55.679050    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7967e7b5-3983-40bb-b739-b54755b69979-istio-token\") pod \"e2e-worker-w4-59b357-openshift-default-84b8cd88c8-vjhfk\" (UID: \"7967e7b5-3983-40bb-b739-b54755b69979\") " pod="openshift-ingress/e2e-worker-w4-59b357-openshift-default-84b8cd88c8-vjhfk"
Sep 18 22:13:55.679154 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:55.679073    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ecc5b678-e35f-47f3-b50c-ee1a44680f88-workload-certs\") pod \"e2e-worker-w0-a13357-openshift-default-6dbf49559b-zznj9\" (UID: \"ecc5b678-e35f-47f3-b50c-ee1a44680f88\") " pod="openshift-ingress/e2e-worker-w0-a13357-openshift-default-6dbf49559b-zznj9"
Sep 18 22:13:55.679726 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:55.679704    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7967e7b5-3983-40bb-b739-b54755b69979-workload-certs\") pod \"e2e-worker-w4-59b357-openshift-default-84b8cd88c8-vjhfk\" (UID: \"7967e7b5-3983-40bb-b739-b54755b69979\") " pod="openshift-ingress/e2e-worker-w4-59b357-openshift-default-84b8cd88c8-vjhfk"
Sep 18 22:13:55.679971 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:55.679952    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7967e7b5-3983-40bb-b739-b54755b69979-workload-socket\") pod \"e2e-worker-w4-59b357-openshift-default-84b8cd88c8-vjhfk\" (UID: \"7967e7b5-3983-40bb-b739-b54755b69979\") " pod="openshift-ingress/e2e-worker-w4-59b357-openshift-default-84b8cd88c8-vjhfk"
Sep 18 22:13:55.680592 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:55.680544    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7967e7b5-3983-40bb-b739-b54755b69979-credential-socket\") pod \"e2e-worker-w4-59b357-openshift-default-84b8cd88c8-vjhfk\" (UID: \"7967e7b5-3983-40bb-b739-b54755b69979\") " pod="openshift-ingress/e2e-worker-w4-59b357-openshift-default-84b8cd88c8-vjhfk"
Sep 18 22:13:55.681050 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:55.681018    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7967e7b5-3983-40bb-b739-b54755b69979-istio-envoy\") pod \"e2e-worker-w4-59b357-openshift-default-84b8cd88c8-vjhfk\" (UID: \"7967e7b5-3983-40bb-b739-b54755b69979\") " pod="openshift-ingress/e2e-worker-w4-59b357-openshift-default-84b8cd88c8-vjhfk"
Sep 18 22:13:55.683441 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:55.683386    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7967e7b5-3983-40bb-b739-b54755b69979-istio-podinfo\") pod \"e2e-worker-w4-59b357-openshift-default-84b8cd88c8-vjhfk\" (UID: \"7967e7b5-3983-40bb-b739-b54755b69979\") " pod="openshift-ingress/e2e-worker-w4-59b357-openshift-default-84b8cd88c8-vjhfk"
Sep 18 22:13:55.695981 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:55.695957    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-njdnw\" (UniqueName: \"kubernetes.io/projected/7967e7b5-3983-40bb-b739-b54755b69979-kube-api-access-njdnw\") pod \"e2e-worker-w4-59b357-openshift-default-84b8cd88c8-vjhfk\" (UID: \"7967e7b5-3983-40bb-b739-b54755b69979\") " pod="openshift-ingress/e2e-worker-w4-59b357-openshift-default-84b8cd88c8-vjhfk"
Sep 18 22:13:55.697667 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:55.697625    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7967e7b5-3983-40bb-b739-b54755b69979-istio-token\") pod \"e2e-worker-w4-59b357-openshift-default-84b8cd88c8-vjhfk\" (UID: \"7967e7b5-3983-40bb-b739-b54755b69979\") " pod="openshift-ingress/e2e-worker-w4-59b357-openshift-default-84b8cd88c8-vjhfk"
Sep 18 22:13:55.782840 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:55.781020    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-59b357-openshift-default-84b8cd88c8-vjhfk"
Sep 18 22:13:55.782840 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:55.781236    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ecc5b678-e35f-47f3-b50c-ee1a44680f88-workload-certs\") pod \"e2e-worker-w0-a13357-openshift-default-6dbf49559b-zznj9\" (UID: \"ecc5b678-e35f-47f3-b50c-ee1a44680f88\") " pod="openshift-ingress/e2e-worker-w0-a13357-openshift-default-6dbf49559b-zznj9"
Sep 18 22:13:55.782840 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:55.781338    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ecc5b678-e35f-47f3-b50c-ee1a44680f88-istio-data\") pod \"e2e-worker-w0-a13357-openshift-default-6dbf49559b-zznj9\" (UID: \"ecc5b678-e35f-47f3-b50c-ee1a44680f88\") " pod="openshift-ingress/e2e-worker-w0-a13357-openshift-default-6dbf49559b-zznj9"
Sep 18 22:13:55.782840 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:55.781726    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ecc5b678-e35f-47f3-b50c-ee1a44680f88-workload-certs\") pod \"e2e-worker-w0-a13357-openshift-default-6dbf49559b-zznj9\" (UID: \"ecc5b678-e35f-47f3-b50c-ee1a44680f88\") " pod="openshift-ingress/e2e-worker-w0-a13357-openshift-default-6dbf49559b-zznj9"
Sep 18 22:13:55.782840 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:55.781401    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svfsk\" (UniqueName: \"kubernetes.io/projected/ecc5b678-e35f-47f3-b50c-ee1a44680f88-kube-api-access-svfsk\") pod \"e2e-worker-w0-a13357-openshift-default-6dbf49559b-zznj9\" (UID: \"ecc5b678-e35f-47f3-b50c-ee1a44680f88\") " pod="openshift-ingress/e2e-worker-w0-a13357-openshift-default-6dbf49559b-zznj9"
Sep 18 22:13:55.782840 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:55.781817    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ecc5b678-e35f-47f3-b50c-ee1a44680f88-istio-podinfo\") pod \"e2e-worker-w0-a13357-openshift-default-6dbf49559b-zznj9\" (UID: \"ecc5b678-e35f-47f3-b50c-ee1a44680f88\") " pod="openshift-ingress/e2e-worker-w0-a13357-openshift-default-6dbf49559b-zznj9"
Sep 18 22:13:55.782840 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:55.781841    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ecc5b678-e35f-47f3-b50c-ee1a44680f88-istio-token\") pod \"e2e-worker-w0-a13357-openshift-default-6dbf49559b-zznj9\" (UID: \"ecc5b678-e35f-47f3-b50c-ee1a44680f88\") " pod="openshift-ingress/e2e-worker-w0-a13357-openshift-default-6dbf49559b-zznj9"
Sep 18 22:13:55.782840 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:55.782219    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ecc5b678-e35f-47f3-b50c-ee1a44680f88-istio-data\") pod \"e2e-worker-w0-a13357-openshift-default-6dbf49559b-zznj9\" (UID: \"ecc5b678-e35f-47f3-b50c-ee1a44680f88\") " pod="openshift-ingress/e2e-worker-w0-a13357-openshift-default-6dbf49559b-zznj9"
Sep 18 22:13:55.782840 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:55.782303    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ecc5b678-e35f-47f3-b50c-ee1a44680f88-istiod-ca-cert\") pod \"e2e-worker-w0-a13357-openshift-default-6dbf49559b-zznj9\" (UID: \"ecc5b678-e35f-47f3-b50c-ee1a44680f88\") " pod="openshift-ingress/e2e-worker-w0-a13357-openshift-default-6dbf49559b-zznj9"
Sep 18 22:13:55.782840 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:55.782346    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ecc5b678-e35f-47f3-b50c-ee1a44680f88-credential-socket\") pod \"e2e-worker-w0-a13357-openshift-default-6dbf49559b-zznj9\" (UID: \"ecc5b678-e35f-47f3-b50c-ee1a44680f88\") " pod="openshift-ingress/e2e-worker-w0-a13357-openshift-default-6dbf49559b-zznj9"
Sep 18 22:13:55.782840 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:55.782384    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ecc5b678-e35f-47f3-b50c-ee1a44680f88-workload-socket\") pod \"e2e-worker-w0-a13357-openshift-default-6dbf49559b-zznj9\" (UID: \"ecc5b678-e35f-47f3-b50c-ee1a44680f88\") " pod="openshift-ingress/e2e-worker-w0-a13357-openshift-default-6dbf49559b-zznj9"
Sep 18 22:13:55.782840 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:55.782472    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ecc5b678-e35f-47f3-b50c-ee1a44680f88-istio-envoy\") pod \"e2e-worker-w0-a13357-openshift-default-6dbf49559b-zznj9\" (UID: \"ecc5b678-e35f-47f3-b50c-ee1a44680f88\") " pod="openshift-ingress/e2e-worker-w0-a13357-openshift-default-6dbf49559b-zznj9"
Sep 18 22:13:55.783783 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:55.782889    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ecc5b678-e35f-47f3-b50c-ee1a44680f88-credential-socket\") pod \"e2e-worker-w0-a13357-openshift-default-6dbf49559b-zznj9\" (UID: \"ecc5b678-e35f-47f3-b50c-ee1a44680f88\") " pod="openshift-ingress/e2e-worker-w0-a13357-openshift-default-6dbf49559b-zznj9"
Sep 18 22:13:55.783783 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:55.783087    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ecc5b678-e35f-47f3-b50c-ee1a44680f88-istiod-ca-cert\") pod \"e2e-worker-w0-a13357-openshift-default-6dbf49559b-zznj9\" (UID: \"ecc5b678-e35f-47f3-b50c-ee1a44680f88\") " pod="openshift-ingress/e2e-worker-w0-a13357-openshift-default-6dbf49559b-zznj9"
Sep 18 22:13:55.783783 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:55.783121    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ecc5b678-e35f-47f3-b50c-ee1a44680f88-workload-socket\") pod \"e2e-worker-w0-a13357-openshift-default-6dbf49559b-zznj9\" (UID: \"ecc5b678-e35f-47f3-b50c-ee1a44680f88\") " pod="openshift-ingress/e2e-worker-w0-a13357-openshift-default-6dbf49559b-zznj9"
Sep 18 22:13:55.803175 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:55.802100    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-svfsk\" (UniqueName: \"kubernetes.io/projected/ecc5b678-e35f-47f3-b50c-ee1a44680f88-kube-api-access-svfsk\") pod \"e2e-worker-w0-a13357-openshift-default-6dbf49559b-zznj9\" (UID: \"ecc5b678-e35f-47f3-b50c-ee1a44680f88\") " pod="openshift-ingress/e2e-worker-w0-a13357-openshift-default-6dbf49559b-zznj9"
Sep 18 22:13:55.803175 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:55.802588    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ecc5b678-e35f-47f3-b50c-ee1a44680f88-istio-envoy\") pod \"e2e-worker-w0-a13357-openshift-default-6dbf49559b-zznj9\" (UID: \"ecc5b678-e35f-47f3-b50c-ee1a44680f88\") " pod="openshift-ingress/e2e-worker-w0-a13357-openshift-default-6dbf49559b-zznj9"
Sep 18 22:13:55.803175 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:55.803113    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ecc5b678-e35f-47f3-b50c-ee1a44680f88-istio-podinfo\") pod \"e2e-worker-w0-a13357-openshift-default-6dbf49559b-zznj9\" (UID: \"ecc5b678-e35f-47f3-b50c-ee1a44680f88\") " pod="openshift-ingress/e2e-worker-w0-a13357-openshift-default-6dbf49559b-zznj9"
Sep 18 22:13:55.806293 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:55.806112    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ecc5b678-e35f-47f3-b50c-ee1a44680f88-istio-token\") pod \"e2e-worker-w0-a13357-openshift-default-6dbf49559b-zznj9\" (UID: \"ecc5b678-e35f-47f3-b50c-ee1a44680f88\") " pod="openshift-ingress/e2e-worker-w0-a13357-openshift-default-6dbf49559b-zznj9"
Sep 18 22:13:55.906988 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:55.906955    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-a13357-openshift-default-6dbf49559b-zznj9"
Sep 18 22:13:55.965835 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:55.965284    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-3d28c1-openshift-default-6745f5d8d8-mdxtn"]
Sep 18 22:13:55.968721 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:13:55.968624    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01bdcd1e_7689_43dc_87e9_b1f98ce153ed.slice/crio-b7c822d006b36a068c2e9307508664c2cc2f20b610ffd7c3da4b9fa0abe9a192 WatchSource:0}: Error finding container b7c822d006b36a068c2e9307508664c2cc2f20b610ffd7c3da4b9fa0abe9a192: Status 404 returned error can't find the container with id b7c822d006b36a068c2e9307508664c2cc2f20b610ffd7c3da4b9fa0abe9a192
Sep 18 22:13:55.975594 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:55.975116    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:13:55.975594 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:55.975205    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:13:55.975594 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:55.975245    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:13:56.092781 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:56.092739    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-59b357-openshift-default-84b8cd88c8-vjhfk"]
Sep 18 22:13:56.094309 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:13:56.094281    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7967e7b5_3983_40bb_b739_b54755b69979.slice/crio-5c90ea2b94029896a05523346f758cbee6cf3851bc37c72f29e0e60a2c27b83c WatchSource:0}: Error finding container 5c90ea2b94029896a05523346f758cbee6cf3851bc37c72f29e0e60a2c27b83c: Status 404 returned error can't find the container with id 5c90ea2b94029896a05523346f758cbee6cf3851bc37c72f29e0e60a2c27b83c
Sep 18 22:13:56.096970 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:56.096933    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:13:56.097063 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:56.097012    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:13:56.097115 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:56.097064    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:13:56.209975 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:56.209947    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-a13357-openshift-default-6dbf49559b-zznj9"]
Sep 18 22:13:56.212775 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:13:56.212736    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecc5b678_e35f_47f3_b50c_ee1a44680f88.slice/crio-29d9c72482042a6abb2323a1f3dfa4e9cca5d0bb5ec35f98c65806b450c57f8b WatchSource:0}: Error finding container 29d9c72482042a6abb2323a1f3dfa4e9cca5d0bb5ec35f98c65806b450c57f8b: Status 404 returned error can't find the container with id 29d9c72482042a6abb2323a1f3dfa4e9cca5d0bb5ec35f98c65806b450c57f8b
Sep 18 22:13:56.217282 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:56.216735    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:13:56.217282 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:56.216830    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:13:56.217282 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:56.216879    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:13:56.295100 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:56.295066    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-a13357-openshift-default-6dbf49559b-zznj9" event={"ID":"ecc5b678-e35f-47f3-b50c-ee1a44680f88","Type":"ContainerStarted","Data":"29d9c72482042a6abb2323a1f3dfa4e9cca5d0bb5ec35f98c65806b450c57f8b"}
Sep 18 22:13:56.297659 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:56.297623    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-59b357-openshift-default-84b8cd88c8-vjhfk" event={"ID":"7967e7b5-3983-40bb-b739-b54755b69979","Type":"ContainerStarted","Data":"d19bcb384c1bd5fa144827669a012b6057a6bb637b72fc4e67337ea1dfbe9b14"}
Sep 18 22:13:56.297791 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:56.297684    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-59b357-openshift-default-84b8cd88c8-vjhfk" event={"ID":"7967e7b5-3983-40bb-b739-b54755b69979","Type":"ContainerStarted","Data":"5c90ea2b94029896a05523346f758cbee6cf3851bc37c72f29e0e60a2c27b83c"}
Sep 18 22:13:56.300832 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:56.300808    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-3d28c1-openshift-default-6745f5d8d8-mdxtn" event={"ID":"01bdcd1e-7689-43dc-87e9-b1f98ce153ed","Type":"ContainerStarted","Data":"4a877e70e9e928b025ae81356b464803ec50f4279153bebd89e884f5ba160ea7"}
Sep 18 22:13:56.300946 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:56.300857    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-3d28c1-openshift-default-6745f5d8d8-mdxtn" event={"ID":"01bdcd1e-7689-43dc-87e9-b1f98ce153ed","Type":"ContainerStarted","Data":"b7c822d006b36a068c2e9307508664c2cc2f20b610ffd7c3da4b9fa0abe9a192"}
Sep 18 22:13:56.337623 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:56.337250    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-59b357-openshift-default-84b8cd88c8-vjhfk" podStartSLOduration=1.337226863 podStartE2EDuration="1.337226863s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:13:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:13:56.336264086 +0000 UTC m=+815.655936143" watchObservedRunningTime="2026-09-18 22:13:56.337226863 +0000 UTC m=+815.656898919"
Sep 18 22:13:56.390864 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:56.390742    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-3d28c1-openshift-default-6745f5d8d8-mdxtn" podStartSLOduration=1.390722368 podStartE2EDuration="1.390722368s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:13:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:13:56.386382379 +0000 UTC m=+815.706054437" watchObservedRunningTime="2026-09-18 22:13:56.390722368 +0000 UTC m=+815.710394424"
Sep 18 22:13:56.670828 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:56.670744    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-3d28c1-openshift-default-6745f5d8d8-mdxtn"
Sep 18 22:13:56.781949 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:56.781910    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-59b357-openshift-default-84b8cd88c8-vjhfk"
Sep 18 22:13:57.308284 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:57.308244    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-a13357-openshift-default-6dbf49559b-zznj9" event={"ID":"ecc5b678-e35f-47f3-b50c-ee1a44680f88","Type":"ContainerStarted","Data":"ae1c0d7532985bedf9ccabd8806679597f9f49950e250295a18c3b04cb1a56d3"}
Sep 18 22:13:57.335930 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:57.335880    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-a13357-openshift-default-6dbf49559b-zznj9" podStartSLOduration=2.335863603 podStartE2EDuration="2.335863603s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:13:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:13:57.333595516 +0000 UTC m=+816.653267571" watchObservedRunningTime="2026-09-18 22:13:57.335863603 +0000 UTC m=+816.655535656"
Sep 18 22:13:57.676565 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:57.676487    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-3d28c1-openshift-default-6745f5d8d8-mdxtn"
Sep 18 22:13:57.787617 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:57.787583    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-59b357-openshift-default-84b8cd88c8-vjhfk"
Sep 18 22:13:57.907766 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:57.907723    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-a13357-openshift-default-6dbf49559b-zznj9"
Sep 18 22:13:57.912769 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:57.912747    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-a13357-openshift-default-6dbf49559b-zznj9"
Sep 18 22:13:58.314563 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:58.314447    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-59b357-openshift-default-84b8cd88c8-vjhfk"
Sep 18 22:13:58.314563 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:58.314501    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-a13357-openshift-default-6dbf49559b-zznj9"
Sep 18 22:13:58.314563 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:58.314527    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-3d28c1-openshift-default-6745f5d8d8-mdxtn"
Sep 18 22:13:58.315231 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:58.315211    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-a13357-openshift-default-6dbf49559b-zznj9"
Sep 18 22:13:58.315391 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:58.315372    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-59b357-openshift-default-84b8cd88c8-vjhfk"
Sep 18 22:13:58.315475 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:13:58.315450    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-3d28c1-openshift-default-6745f5d8d8-mdxtn"
Sep 18 22:14:01.397782 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:01.397751    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7651-bbe2bb"]
Sep 18 22:14:01.401889 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:01.401861    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7651-bbe2bb"
Sep 18 22:14:01.404260 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:01.404237    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-t97qt\""
Sep 18 22:14:01.413358 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:01.413309    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7651-bbe2bb"]
Sep 18 22:14:01.452702 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:01.447946    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-424m9\" (UniqueName: \"kubernetes.io/projected/ed76d888-6fb1-4af4-8663-4c6c3b96bb19-kube-api-access-424m9\") pod \"test-curl-7651-bbe2bb\" (UID: \"ed76d888-6fb1-4af4-8663-4c6c3b96bb19\") " pod="opendatahub/test-curl-7651-bbe2bb"
Sep 18 22:14:01.549124 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:01.549085    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-424m9\" (UniqueName: \"kubernetes.io/projected/ed76d888-6fb1-4af4-8663-4c6c3b96bb19-kube-api-access-424m9\") pod \"test-curl-7651-bbe2bb\" (UID: \"ed76d888-6fb1-4af4-8663-4c6c3b96bb19\") " pod="opendatahub/test-curl-7651-bbe2bb"
Sep 18 22:14:01.565898 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:01.565862    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-424m9\" (UniqueName: \"kubernetes.io/projected/ed76d888-6fb1-4af4-8663-4c6c3b96bb19-kube-api-access-424m9\") pod \"test-curl-7651-bbe2bb\" (UID: \"ed76d888-6fb1-4af4-8663-4c6c3b96bb19\") " pod="opendatahub/test-curl-7651-bbe2bb"
Sep 18 22:14:01.713324 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:01.713226    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7651-bbe2bb"
Sep 18 22:14:02.015137 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:02.015109    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7651-bbe2bb"]
Sep 18 22:14:02.018226 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:14:02.018201    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poded76d888_6fb1_4af4_8663_4c6c3b96bb19.slice/crio-aaad3f0c4ba8d6b3044da112429298a07e29f84d7b99773b1ae980165c0dde29 WatchSource:0}: Error finding container aaad3f0c4ba8d6b3044da112429298a07e29f84d7b99773b1ae980165c0dde29: Status 404 returned error can't find the container with id aaad3f0c4ba8d6b3044da112429298a07e29f84d7b99773b1ae980165c0dde29
Sep 18 22:14:02.341174 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:02.341138    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7651-bbe2bb" event={"ID":"ed76d888-6fb1-4af4-8663-4c6c3b96bb19","Type":"ContainerStarted","Data":"aaad3f0c4ba8d6b3044da112429298a07e29f84d7b99773b1ae980165c0dde29"}
Sep 18 22:14:03.349342 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:03.349303    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7651-bbe2bb" event={"ID":"ed76d888-6fb1-4af4-8663-4c6c3b96bb19","Type":"ContainerStarted","Data":"d3684ff67bf8b6ec0ac5b1950d37f2de191422fa4560a75da9b35319a4f0dc2a"}
Sep 18 22:14:03.380537 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:03.380476    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7651-bbe2bb" podStartSLOduration=1.7636831750000002 podStartE2EDuration="2.380461281s" totalImagesPullingTime="616.778106ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:14:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:14:03.379426861 +0000 UTC m=+822.699098910" watchObservedRunningTime="2026-09-18 22:14:03.380461281 +0000 UTC m=+822.700133330"
Sep 18 22:14:04.386862 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:04.386830    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7651-bbe2bb"]
Sep 18 22:14:04.391046 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:04.391021    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7651-bbe2bb"]
Sep 18 22:14:05.281035 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:05.280993    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h"]
Sep 18 22:14:05.281509 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:05.281489    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed76d888-6fb1-4af4-8663-4c6c3b96bb19" containerName="test-curl-7651-bbe2bb"
Sep 18 22:14:05.281509 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:05.281509    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed76d888-6fb1-4af4-8663-4c6c3b96bb19" containerName="test-curl-7651-bbe2bb"
Sep 18 22:14:05.281704 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:05.281602    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed76d888-6fb1-4af4-8663-4c6c3b96bb19" containerName="test-curl-7651-bbe2bb"
Sep 18 22:14:05.284740 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:05.284722    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h"
Sep 18 22:14:05.288080 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:05.288060    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-autores-0ffe43-openshift-default-dockercfg-pm7ln\""
Sep 18 22:14:05.305618 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:05.305585    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h"]
Sep 18 22:14:05.366670 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:05.366629    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7651-bbe2bb" podUID="ed76d888-6fb1-4af4-8663-4c6c3b96bb19" containerName="test-curl-7651-bbe2bb" containerID="cri-o://d3684ff67bf8b6ec0ac5b1950d37f2de191422fa4560a75da9b35319a4f0dc2a" gracePeriod=2
Sep 18 22:14:05.389313 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:05.389280    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/88740ac0-7237-4035-a68d-74d4d7dc7619-istiod-ca-cert\") pod \"e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h\" (UID: \"88740ac0-7237-4035-a68d-74d4d7dc7619\") " pod="openshift-ingress/e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h"
Sep 18 22:14:05.389887 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:05.389863    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/88740ac0-7237-4035-a68d-74d4d7dc7619-workload-certs\") pod \"e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h\" (UID: \"88740ac0-7237-4035-a68d-74d4d7dc7619\") " pod="openshift-ingress/e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h"
Sep 18 22:14:05.390044 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:05.390029    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/88740ac0-7237-4035-a68d-74d4d7dc7619-istio-envoy\") pod \"e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h\" (UID: \"88740ac0-7237-4035-a68d-74d4d7dc7619\") " pod="openshift-ingress/e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h"
Sep 18 22:14:05.390191 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:05.390177    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/88740ac0-7237-4035-a68d-74d4d7dc7619-istio-podinfo\") pod \"e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h\" (UID: \"88740ac0-7237-4035-a68d-74d4d7dc7619\") " pod="openshift-ingress/e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h"
Sep 18 22:14:05.390292 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:05.390280    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/88740ac0-7237-4035-a68d-74d4d7dc7619-workload-socket\") pod \"e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h\" (UID: \"88740ac0-7237-4035-a68d-74d4d7dc7619\") " pod="openshift-ingress/e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h"
Sep 18 22:14:05.390395 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:05.390383    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/88740ac0-7237-4035-a68d-74d4d7dc7619-istio-data\") pod \"e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h\" (UID: \"88740ac0-7237-4035-a68d-74d4d7dc7619\") " pod="openshift-ingress/e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h"
Sep 18 22:14:05.390657 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:05.390629    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/88740ac0-7237-4035-a68d-74d4d7dc7619-credential-socket\") pod \"e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h\" (UID: \"88740ac0-7237-4035-a68d-74d4d7dc7619\") " pod="openshift-ingress/e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h"
Sep 18 22:14:05.390739 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:05.390663    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/88740ac0-7237-4035-a68d-74d4d7dc7619-istio-token\") pod \"e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h\" (UID: \"88740ac0-7237-4035-a68d-74d4d7dc7619\") " pod="openshift-ingress/e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h"
Sep 18 22:14:05.390739 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:05.390705    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcxnw\" (UniqueName: \"kubernetes.io/projected/88740ac0-7237-4035-a68d-74d4d7dc7619-kube-api-access-qcxnw\") pod \"e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h\" (UID: \"88740ac0-7237-4035-a68d-74d4d7dc7619\") " pod="openshift-ingress/e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h"
Sep 18 22:14:05.491369 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:05.491335    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/88740ac0-7237-4035-a68d-74d4d7dc7619-istiod-ca-cert\") pod \"e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h\" (UID: \"88740ac0-7237-4035-a68d-74d4d7dc7619\") " pod="openshift-ingress/e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h"
Sep 18 22:14:05.491576 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:05.491376    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/88740ac0-7237-4035-a68d-74d4d7dc7619-workload-certs\") pod \"e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h\" (UID: \"88740ac0-7237-4035-a68d-74d4d7dc7619\") " pod="openshift-ingress/e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h"
Sep 18 22:14:05.491576 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:05.491461    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/88740ac0-7237-4035-a68d-74d4d7dc7619-istio-envoy\") pod \"e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h\" (UID: \"88740ac0-7237-4035-a68d-74d4d7dc7619\") " pod="openshift-ingress/e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h"
Sep 18 22:14:05.491576 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:05.491517    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/88740ac0-7237-4035-a68d-74d4d7dc7619-istio-podinfo\") pod \"e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h\" (UID: \"88740ac0-7237-4035-a68d-74d4d7dc7619\") " pod="openshift-ingress/e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h"
Sep 18 22:14:05.491576 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:05.491546    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/88740ac0-7237-4035-a68d-74d4d7dc7619-workload-socket\") pod \"e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h\" (UID: \"88740ac0-7237-4035-a68d-74d4d7dc7619\") " pod="openshift-ingress/e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h"
Sep 18 22:14:05.491576 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:05.491573    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/88740ac0-7237-4035-a68d-74d4d7dc7619-istio-data\") pod \"e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h\" (UID: \"88740ac0-7237-4035-a68d-74d4d7dc7619\") " pod="openshift-ingress/e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h"
Sep 18 22:14:05.491852 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:05.491664    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/88740ac0-7237-4035-a68d-74d4d7dc7619-credential-socket\") pod \"e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h\" (UID: \"88740ac0-7237-4035-a68d-74d4d7dc7619\") " pod="openshift-ingress/e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h"
Sep 18 22:14:05.491852 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:05.491689    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/88740ac0-7237-4035-a68d-74d4d7dc7619-istio-token\") pod \"e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h\" (UID: \"88740ac0-7237-4035-a68d-74d4d7dc7619\") " pod="openshift-ingress/e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h"
Sep 18 22:14:05.491852 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:05.491736    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcxnw\" (UniqueName: \"kubernetes.io/projected/88740ac0-7237-4035-a68d-74d4d7dc7619-kube-api-access-qcxnw\") pod \"e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h\" (UID: \"88740ac0-7237-4035-a68d-74d4d7dc7619\") " pod="openshift-ingress/e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h"
Sep 18 22:14:05.491989 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:05.491925    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/88740ac0-7237-4035-a68d-74d4d7dc7619-workload-certs\") pod \"e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h\" (UID: \"88740ac0-7237-4035-a68d-74d4d7dc7619\") " pod="openshift-ingress/e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h"
Sep 18 22:14:05.492095 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:05.492063    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/88740ac0-7237-4035-a68d-74d4d7dc7619-workload-socket\") pod \"e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h\" (UID: \"88740ac0-7237-4035-a68d-74d4d7dc7619\") " pod="openshift-ingress/e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h"
Sep 18 22:14:05.492142 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:05.492107    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/88740ac0-7237-4035-a68d-74d4d7dc7619-credential-socket\") pod \"e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h\" (UID: \"88740ac0-7237-4035-a68d-74d4d7dc7619\") " pod="openshift-ingress/e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h"
Sep 18 22:14:05.492178 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:05.492140    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/88740ac0-7237-4035-a68d-74d4d7dc7619-istiod-ca-cert\") pod \"e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h\" (UID: \"88740ac0-7237-4035-a68d-74d4d7dc7619\") " pod="openshift-ingress/e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h"
Sep 18 22:14:05.492178 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:05.492157    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/88740ac0-7237-4035-a68d-74d4d7dc7619-istio-data\") pod \"e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h\" (UID: \"88740ac0-7237-4035-a68d-74d4d7dc7619\") " pod="openshift-ingress/e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h"
Sep 18 22:14:05.494066 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:05.494047    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/88740ac0-7237-4035-a68d-74d4d7dc7619-istio-envoy\") pod \"e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h\" (UID: \"88740ac0-7237-4035-a68d-74d4d7dc7619\") " pod="openshift-ingress/e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h"
Sep 18 22:14:05.494541 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:05.494524    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/88740ac0-7237-4035-a68d-74d4d7dc7619-istio-podinfo\") pod \"e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h\" (UID: \"88740ac0-7237-4035-a68d-74d4d7dc7619\") " pod="openshift-ingress/e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h"
Sep 18 22:14:05.506605 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:05.506583    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/88740ac0-7237-4035-a68d-74d4d7dc7619-istio-token\") pod \"e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h\" (UID: \"88740ac0-7237-4035-a68d-74d4d7dc7619\") " pod="openshift-ingress/e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h"
Sep 18 22:14:05.511259 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:05.511234    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcxnw\" (UniqueName: \"kubernetes.io/projected/88740ac0-7237-4035-a68d-74d4d7dc7619-kube-api-access-qcxnw\") pod \"e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h\" (UID: \"88740ac0-7237-4035-a68d-74d4d7dc7619\") " pod="openshift-ingress/e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h"
Sep 18 22:14:05.595489 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:05.595460    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h"
Sep 18 22:14:05.892306 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:05.892281    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h"]
Sep 18 22:14:05.894397 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:14:05.894264    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88740ac0_7237_4035_a68d_74d4d7dc7619.slice/crio-9544a3e5203b9cf4bcc854294389b95254e192c519cac421b68903d46242547f WatchSource:0}: Error finding container 9544a3e5203b9cf4bcc854294389b95254e192c519cac421b68903d46242547f: Status 404 returned error can't find the container with id 9544a3e5203b9cf4bcc854294389b95254e192c519cac421b68903d46242547f
Sep 18 22:14:05.897038 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:05.896997    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:14:05.897117 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:05.897079    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:14:05.897117 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:05.897109    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:14:06.180790 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:06.180656    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-a13357-7b6898dccd-gzcx5"]
Sep 18 22:14:06.184904 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:06.184879    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-a13357-7b6898dccd-gzcx5"
Sep 18 22:14:06.187395 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:06.187373    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w0-a13357\""
Sep 18 22:14:06.187560 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:06.187483    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w0-a13357-dockercfg-hkklw\""
Sep 18 22:14:06.205224 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:06.205199    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-a13357-7b6898dccd-gzcx5"]
Sep 18 22:14:06.300115 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:06.300082    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7656s\" (UniqueName: \"kubernetes.io/projected/4ca8691f-514c-4ff7-a9d7-94dce9b61f68-kube-api-access-7656s\") pod \"payload-pre-processing-e2e-worker-w0-a13357-7b6898dccd-gzcx5\" (UID: \"4ca8691f-514c-4ff7-a9d7-94dce9b61f68\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-a13357-7b6898dccd-gzcx5"
Sep 18 22:14:06.300299 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:06.300183    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4ca8691f-514c-4ff7-a9d7-94dce9b61f68-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-a13357-7b6898dccd-gzcx5\" (UID: \"4ca8691f-514c-4ff7-a9d7-94dce9b61f68\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-a13357-7b6898dccd-gzcx5"
Sep 18 22:14:06.382327 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:06.382282    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h" event={"ID":"88740ac0-7237-4035-a68d-74d4d7dc7619","Type":"ContainerStarted","Data":"c3c3546f984c7a8b1f680ea87a275fce7e1f1e490e65ff6e3b1a644ca18eb414"}
Sep 18 22:14:06.382535 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:06.382372    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h" event={"ID":"88740ac0-7237-4035-a68d-74d4d7dc7619","Type":"ContainerStarted","Data":"9544a3e5203b9cf4bcc854294389b95254e192c519cac421b68903d46242547f"}
Sep 18 22:14:06.401801 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:06.401768    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7656s\" (UniqueName: \"kubernetes.io/projected/4ca8691f-514c-4ff7-a9d7-94dce9b61f68-kube-api-access-7656s\") pod \"payload-pre-processing-e2e-worker-w0-a13357-7b6898dccd-gzcx5\" (UID: \"4ca8691f-514c-4ff7-a9d7-94dce9b61f68\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-a13357-7b6898dccd-gzcx5"
Sep 18 22:14:06.402161 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:06.401857    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4ca8691f-514c-4ff7-a9d7-94dce9b61f68-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-a13357-7b6898dccd-gzcx5\" (UID: \"4ca8691f-514c-4ff7-a9d7-94dce9b61f68\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-a13357-7b6898dccd-gzcx5"
Sep 18 22:14:06.402751 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:06.402731    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4ca8691f-514c-4ff7-a9d7-94dce9b61f68-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-a13357-7b6898dccd-gzcx5\" (UID: \"4ca8691f-514c-4ff7-a9d7-94dce9b61f68\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-a13357-7b6898dccd-gzcx5"
Sep 18 22:14:06.411160 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:06.411139    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7656s\" (UniqueName: \"kubernetes.io/projected/4ca8691f-514c-4ff7-a9d7-94dce9b61f68-kube-api-access-7656s\") pod \"payload-pre-processing-e2e-worker-w0-a13357-7b6898dccd-gzcx5\" (UID: \"4ca8691f-514c-4ff7-a9d7-94dce9b61f68\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-a13357-7b6898dccd-gzcx5"
Sep 18 22:14:06.414449 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:06.414382    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h" podStartSLOduration=1.414366804 podStartE2EDuration="1.414366804s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:14:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:14:06.412056664 +0000 UTC m=+825.731728719" watchObservedRunningTime="2026-09-18 22:14:06.414366804 +0000 UTC m=+825.734038860"
Sep 18 22:14:06.497061 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:06.496958    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-a13357-7b6898dccd-gzcx5"
Sep 18 22:14:06.595869 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:06.595833    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h"
Sep 18 22:14:06.597698 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:06.597389    2577 patch_prober.go:28] interesting pod/e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Sep 18 22:14:06.597698 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:06.597501    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h" podUID="88740ac0-7237-4035-a68d-74d4d7dc7619" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Sep 18 22:14:06.817982 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:06.817953    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-a13357-7b6898dccd-gzcx5"]
Sep 18 22:14:06.818953 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:14:06.818925    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ca8691f_514c_4ff7_a9d7_94dce9b61f68.slice/crio-fa2998362ca72e1778669671cc5531dcde8ae36845f811d42ae09006303d75ab WatchSource:0}: Error finding container fa2998362ca72e1778669671cc5531dcde8ae36845f811d42ae09006303d75ab: Status 404 returned error can't find the container with id fa2998362ca72e1778669671cc5531dcde8ae36845f811d42ae09006303d75ab
Sep 18 22:14:07.390479 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:07.390437    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-a13357-7b6898dccd-gzcx5" event={"ID":"4ca8691f-514c-4ff7-a9d7-94dce9b61f68","Type":"ContainerStarted","Data":"e96f191ce8c49a1da1d5ea47abf00f6878e111351e90ea9549510f46619bdebb"}
Sep 18 22:14:07.390600 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:07.390507    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-a13357-7b6898dccd-gzcx5" event={"ID":"4ca8691f-514c-4ff7-a9d7-94dce9b61f68","Type":"ContainerStarted","Data":"fa2998362ca72e1778669671cc5531dcde8ae36845f811d42ae09006303d75ab"}
Sep 18 22:14:07.390720 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:07.390698    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-a13357-7b6898dccd-gzcx5"
Sep 18 22:14:07.414854 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:07.414810    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-a13357-7b6898dccd-gzcx5" podStartSLOduration=1.414795367 podStartE2EDuration="1.414795367s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:14:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:14:07.412809102 +0000 UTC m=+826.732481156" watchObservedRunningTime="2026-09-18 22:14:07.414795367 +0000 UTC m=+826.734467421"
Sep 18 22:14:07.584249 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:07.584221    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7651-bbe2bb"
Sep 18 22:14:07.596314 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:07.596281    2577 patch_prober.go:28] interesting pod/e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Sep 18 22:14:07.596478 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:07.596340    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h" podUID="88740ac0-7237-4035-a68d-74d4d7dc7619" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Sep 18 22:14:07.707161 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:07.707076    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-82b6dcec-openshift-default-844946c46-5s98v"]
Sep 18 22:14:07.710922 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:07.710899    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-82b6dcec-openshift-default-844946c46-5s98v"
Sep 18 22:14:07.715499 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:07.715474    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-424m9\" (UniqueName: \"kubernetes.io/projected/ed76d888-6fb1-4af4-8663-4c6c3b96bb19-kube-api-access-424m9\") pod \"ed76d888-6fb1-4af4-8663-4c6c3b96bb19\" (UID: \"ed76d888-6fb1-4af4-8663-4c6c3b96bb19\") "
Sep 18 22:14:07.718340 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:07.718311    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed76d888-6fb1-4af4-8663-4c6c3b96bb19-kube-api-access-424m9" (OuterVolumeSpecName: "kube-api-access-424m9") pod "ed76d888-6fb1-4af4-8663-4c6c3b96bb19" (UID: "ed76d888-6fb1-4af4-8663-4c6c3b96bb19"). InnerVolumeSpecName "kube-api-access-424m9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:14:07.729065 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:07.729046    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-82b6dcec-openshift-default-dockercfg-llqb2\""
Sep 18 22:14:07.753441 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:07.753386    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-82b6dcec-openshift-default-844946c46-5s98v"]
Sep 18 22:14:07.816939 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:07.816910    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bfdfcfc7-867a-458b-a2af-dd4928659ae0-workload-certs\") pod \"e2e-ait-82b6dcec-openshift-default-844946c46-5s98v\" (UID: \"bfdfcfc7-867a-458b-a2af-dd4928659ae0\") " pod="openshift-ingress/e2e-ait-82b6dcec-openshift-default-844946c46-5s98v"
Sep 18 22:14:07.817115 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:07.816952    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bfdfcfc7-867a-458b-a2af-dd4928659ae0-istio-token\") pod \"e2e-ait-82b6dcec-openshift-default-844946c46-5s98v\" (UID: \"bfdfcfc7-867a-458b-a2af-dd4928659ae0\") " pod="openshift-ingress/e2e-ait-82b6dcec-openshift-default-844946c46-5s98v"
Sep 18 22:14:07.817115 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:07.816973    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bfdfcfc7-867a-458b-a2af-dd4928659ae0-workload-socket\") pod \"e2e-ait-82b6dcec-openshift-default-844946c46-5s98v\" (UID: \"bfdfcfc7-867a-458b-a2af-dd4928659ae0\") " pod="openshift-ingress/e2e-ait-82b6dcec-openshift-default-844946c46-5s98v"
Sep 18 22:14:07.817115 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:07.817054    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bfdfcfc7-867a-458b-a2af-dd4928659ae0-credential-socket\") pod \"e2e-ait-82b6dcec-openshift-default-844946c46-5s98v\" (UID: \"bfdfcfc7-867a-458b-a2af-dd4928659ae0\") " pod="openshift-ingress/e2e-ait-82b6dcec-openshift-default-844946c46-5s98v"
Sep 18 22:14:07.817229 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:07.817125    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bfdfcfc7-867a-458b-a2af-dd4928659ae0-istio-data\") pod \"e2e-ait-82b6dcec-openshift-default-844946c46-5s98v\" (UID: \"bfdfcfc7-867a-458b-a2af-dd4928659ae0\") " pod="openshift-ingress/e2e-ait-82b6dcec-openshift-default-844946c46-5s98v"
Sep 18 22:14:07.817229 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:07.817152    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkjzm\" (UniqueName: \"kubernetes.io/projected/bfdfcfc7-867a-458b-a2af-dd4928659ae0-kube-api-access-qkjzm\") pod \"e2e-ait-82b6dcec-openshift-default-844946c46-5s98v\" (UID: \"bfdfcfc7-867a-458b-a2af-dd4928659ae0\") " pod="openshift-ingress/e2e-ait-82b6dcec-openshift-default-844946c46-5s98v"
Sep 18 22:14:07.817291 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:07.817249    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bfdfcfc7-867a-458b-a2af-dd4928659ae0-istio-podinfo\") pod \"e2e-ait-82b6dcec-openshift-default-844946c46-5s98v\" (UID: \"bfdfcfc7-867a-458b-a2af-dd4928659ae0\") " pod="openshift-ingress/e2e-ait-82b6dcec-openshift-default-844946c46-5s98v"
Sep 18 22:14:07.817291 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:07.817279    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bfdfcfc7-867a-458b-a2af-dd4928659ae0-istio-envoy\") pod \"e2e-ait-82b6dcec-openshift-default-844946c46-5s98v\" (UID: \"bfdfcfc7-867a-458b-a2af-dd4928659ae0\") " pod="openshift-ingress/e2e-ait-82b6dcec-openshift-default-844946c46-5s98v"
Sep 18 22:14:07.817353 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:07.817337    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bfdfcfc7-867a-458b-a2af-dd4928659ae0-istiod-ca-cert\") pod \"e2e-ait-82b6dcec-openshift-default-844946c46-5s98v\" (UID: \"bfdfcfc7-867a-458b-a2af-dd4928659ae0\") " pod="openshift-ingress/e2e-ait-82b6dcec-openshift-default-844946c46-5s98v"
Sep 18 22:14:07.817445 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:07.817403    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-424m9\" (UniqueName: \"kubernetes.io/projected/ed76d888-6fb1-4af4-8663-4c6c3b96bb19-kube-api-access-424m9\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:14:07.919072 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:07.919035    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bfdfcfc7-867a-458b-a2af-dd4928659ae0-istiod-ca-cert\") pod \"e2e-ait-82b6dcec-openshift-default-844946c46-5s98v\" (UID: \"bfdfcfc7-867a-458b-a2af-dd4928659ae0\") " pod="openshift-ingress/e2e-ait-82b6dcec-openshift-default-844946c46-5s98v"
Sep 18 22:14:07.919269 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:07.919087    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bfdfcfc7-867a-458b-a2af-dd4928659ae0-workload-certs\") pod \"e2e-ait-82b6dcec-openshift-default-844946c46-5s98v\" (UID: \"bfdfcfc7-867a-458b-a2af-dd4928659ae0\") " pod="openshift-ingress/e2e-ait-82b6dcec-openshift-default-844946c46-5s98v"
Sep 18 22:14:07.919269 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:07.919139    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bfdfcfc7-867a-458b-a2af-dd4928659ae0-istio-token\") pod \"e2e-ait-82b6dcec-openshift-default-844946c46-5s98v\" (UID: \"bfdfcfc7-867a-458b-a2af-dd4928659ae0\") " pod="openshift-ingress/e2e-ait-82b6dcec-openshift-default-844946c46-5s98v"
Sep 18 22:14:07.919269 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:07.919167    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bfdfcfc7-867a-458b-a2af-dd4928659ae0-workload-socket\") pod \"e2e-ait-82b6dcec-openshift-default-844946c46-5s98v\" (UID: \"bfdfcfc7-867a-458b-a2af-dd4928659ae0\") " pod="openshift-ingress/e2e-ait-82b6dcec-openshift-default-844946c46-5s98v"
Sep 18 22:14:07.919269 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:07.919207    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bfdfcfc7-867a-458b-a2af-dd4928659ae0-credential-socket\") pod \"e2e-ait-82b6dcec-openshift-default-844946c46-5s98v\" (UID: \"bfdfcfc7-867a-458b-a2af-dd4928659ae0\") " pod="openshift-ingress/e2e-ait-82b6dcec-openshift-default-844946c46-5s98v"
Sep 18 22:14:07.919269 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:07.919266    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bfdfcfc7-867a-458b-a2af-dd4928659ae0-istio-data\") pod \"e2e-ait-82b6dcec-openshift-default-844946c46-5s98v\" (UID: \"bfdfcfc7-867a-458b-a2af-dd4928659ae0\") " pod="openshift-ingress/e2e-ait-82b6dcec-openshift-default-844946c46-5s98v"
Sep 18 22:14:07.919583 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:07.919288    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkjzm\" (UniqueName: \"kubernetes.io/projected/bfdfcfc7-867a-458b-a2af-dd4928659ae0-kube-api-access-qkjzm\") pod \"e2e-ait-82b6dcec-openshift-default-844946c46-5s98v\" (UID: \"bfdfcfc7-867a-458b-a2af-dd4928659ae0\") " pod="openshift-ingress/e2e-ait-82b6dcec-openshift-default-844946c46-5s98v"
Sep 18 22:14:07.919583 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:07.919375    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bfdfcfc7-867a-458b-a2af-dd4928659ae0-istio-podinfo\") pod \"e2e-ait-82b6dcec-openshift-default-844946c46-5s98v\" (UID: \"bfdfcfc7-867a-458b-a2af-dd4928659ae0\") " pod="openshift-ingress/e2e-ait-82b6dcec-openshift-default-844946c46-5s98v"
Sep 18 22:14:07.919583 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:07.919445    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bfdfcfc7-867a-458b-a2af-dd4928659ae0-istio-envoy\") pod \"e2e-ait-82b6dcec-openshift-default-844946c46-5s98v\" (UID: \"bfdfcfc7-867a-458b-a2af-dd4928659ae0\") " pod="openshift-ingress/e2e-ait-82b6dcec-openshift-default-844946c46-5s98v"
Sep 18 22:14:07.919755 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:07.919575    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bfdfcfc7-867a-458b-a2af-dd4928659ae0-workload-certs\") pod \"e2e-ait-82b6dcec-openshift-default-844946c46-5s98v\" (UID: \"bfdfcfc7-867a-458b-a2af-dd4928659ae0\") " pod="openshift-ingress/e2e-ait-82b6dcec-openshift-default-844946c46-5s98v"
Sep 18 22:14:07.919755 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:07.919628    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bfdfcfc7-867a-458b-a2af-dd4928659ae0-workload-socket\") pod \"e2e-ait-82b6dcec-openshift-default-844946c46-5s98v\" (UID: \"bfdfcfc7-867a-458b-a2af-dd4928659ae0\") " pod="openshift-ingress/e2e-ait-82b6dcec-openshift-default-844946c46-5s98v"
Sep 18 22:14:07.919894 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:07.919871    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bfdfcfc7-867a-458b-a2af-dd4928659ae0-istiod-ca-cert\") pod \"e2e-ait-82b6dcec-openshift-default-844946c46-5s98v\" (UID: \"bfdfcfc7-867a-458b-a2af-dd4928659ae0\") " pod="openshift-ingress/e2e-ait-82b6dcec-openshift-default-844946c46-5s98v"
Sep 18 22:14:07.919983 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:07.919964    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bfdfcfc7-867a-458b-a2af-dd4928659ae0-istio-data\") pod \"e2e-ait-82b6dcec-openshift-default-844946c46-5s98v\" (UID: \"bfdfcfc7-867a-458b-a2af-dd4928659ae0\") " pod="openshift-ingress/e2e-ait-82b6dcec-openshift-default-844946c46-5s98v"
Sep 18 22:14:07.920034 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:07.920003    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bfdfcfc7-867a-458b-a2af-dd4928659ae0-credential-socket\") pod \"e2e-ait-82b6dcec-openshift-default-844946c46-5s98v\" (UID: \"bfdfcfc7-867a-458b-a2af-dd4928659ae0\") " pod="openshift-ingress/e2e-ait-82b6dcec-openshift-default-844946c46-5s98v"
Sep 18 22:14:07.922029 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:07.921998    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bfdfcfc7-867a-458b-a2af-dd4928659ae0-istio-envoy\") pod \"e2e-ait-82b6dcec-openshift-default-844946c46-5s98v\" (UID: \"bfdfcfc7-867a-458b-a2af-dd4928659ae0\") " pod="openshift-ingress/e2e-ait-82b6dcec-openshift-default-844946c46-5s98v"
Sep 18 22:14:07.922249 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:07.922227    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bfdfcfc7-867a-458b-a2af-dd4928659ae0-istio-podinfo\") pod \"e2e-ait-82b6dcec-openshift-default-844946c46-5s98v\" (UID: \"bfdfcfc7-867a-458b-a2af-dd4928659ae0\") " pod="openshift-ingress/e2e-ait-82b6dcec-openshift-default-844946c46-5s98v"
Sep 18 22:14:07.931930 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:07.931908    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bfdfcfc7-867a-458b-a2af-dd4928659ae0-istio-token\") pod \"e2e-ait-82b6dcec-openshift-default-844946c46-5s98v\" (UID: \"bfdfcfc7-867a-458b-a2af-dd4928659ae0\") " pod="openshift-ingress/e2e-ait-82b6dcec-openshift-default-844946c46-5s98v"
Sep 18 22:14:07.935948 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:07.935925    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkjzm\" (UniqueName: \"kubernetes.io/projected/bfdfcfc7-867a-458b-a2af-dd4928659ae0-kube-api-access-qkjzm\") pod \"e2e-ait-82b6dcec-openshift-default-844946c46-5s98v\" (UID: \"bfdfcfc7-867a-458b-a2af-dd4928659ae0\") " pod="openshift-ingress/e2e-ait-82b6dcec-openshift-default-844946c46-5s98v"
Sep 18 22:14:08.028863 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:08.028780    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-82b6dcec-openshift-default-844946c46-5s98v"
Sep 18 22:14:08.355944 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:08.355920    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-82b6dcec-openshift-default-844946c46-5s98v"]
Sep 18 22:14:08.357343 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:14:08.357315    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfdfcfc7_867a_458b_a2af_dd4928659ae0.slice/crio-603181f0b7648a08a367123a57ff80d4a1ac2670174233be26a0d38d4945bd71 WatchSource:0}: Error finding container 603181f0b7648a08a367123a57ff80d4a1ac2670174233be26a0d38d4945bd71: Status 404 returned error can't find the container with id 603181f0b7648a08a367123a57ff80d4a1ac2670174233be26a0d38d4945bd71
Sep 18 22:14:08.359668 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:08.359636    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:14:08.359746 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:08.359701    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:14:08.359746 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:08.359731    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:14:08.398388 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:08.398352    2577 generic.go:356] "Generic (PLEG): container finished" podID="ed76d888-6fb1-4af4-8663-4c6c3b96bb19" containerID="d3684ff67bf8b6ec0ac5b1950d37f2de191422fa4560a75da9b35319a4f0dc2a" exitCode=137
Sep 18 22:14:08.398560 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:08.398392    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7651-bbe2bb"
Sep 18 22:14:08.398560 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:08.398469    2577 scope.go:117] "RemoveContainer" containerID="d3684ff67bf8b6ec0ac5b1950d37f2de191422fa4560a75da9b35319a4f0dc2a"
Sep 18 22:14:08.400369 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:08.400345    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-82b6dcec-openshift-default-844946c46-5s98v" event={"ID":"bfdfcfc7-867a-458b-a2af-dd4928659ae0","Type":"ContainerStarted","Data":"603181f0b7648a08a367123a57ff80d4a1ac2670174233be26a0d38d4945bd71"}
Sep 18 22:14:08.409561 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:08.409536    2577 scope.go:117] "RemoveContainer" containerID="d3684ff67bf8b6ec0ac5b1950d37f2de191422fa4560a75da9b35319a4f0dc2a"
Sep 18 22:14:08.409907 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:14:08.409884    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3684ff67bf8b6ec0ac5b1950d37f2de191422fa4560a75da9b35319a4f0dc2a\": container with ID starting with d3684ff67bf8b6ec0ac5b1950d37f2de191422fa4560a75da9b35319a4f0dc2a not found: ID does not exist" containerID="d3684ff67bf8b6ec0ac5b1950d37f2de191422fa4560a75da9b35319a4f0dc2a"
Sep 18 22:14:08.410017 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:08.409921    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3684ff67bf8b6ec0ac5b1950d37f2de191422fa4560a75da9b35319a4f0dc2a"} err="failed to get container status \"d3684ff67bf8b6ec0ac5b1950d37f2de191422fa4560a75da9b35319a4f0dc2a\": rpc error: code = NotFound desc = could not find container \"d3684ff67bf8b6ec0ac5b1950d37f2de191422fa4560a75da9b35319a4f0dc2a\": container with ID starting with d3684ff67bf8b6ec0ac5b1950d37f2de191422fa4560a75da9b35319a4f0dc2a not found: ID does not exist"
Sep 18 22:14:08.416594 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:14:08.416567    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7651-bbe2bb\" is forbidden: User \"system:node:ip-10-0-141-99.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-141-99.ec2.internal' and this object" podUID="ed76d888-6fb1-4af4-8663-4c6c3b96bb19" pod="opendatahub/test-curl-7651-bbe2bb"
Sep 18 22:14:08.609657 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:08.609555    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h"
Sep 18 22:14:08.621465 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:14:08.612592    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7651-bbe2bb\" is forbidden: User \"system:node:ip-10-0-141-99.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-141-99.ec2.internal' and this object" podUID="ed76d888-6fb1-4af4-8663-4c6c3b96bb19" pod="opendatahub/test-curl-7651-bbe2bb"
Sep 18 22:14:09.141282 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:09.141246    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed76d888-6fb1-4af4-8663-4c6c3b96bb19" path="/var/lib/kubelet/pods/ed76d888-6fb1-4af4-8663-4c6c3b96bb19/volumes"
Sep 18 22:14:09.414035 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:09.413930    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-82b6dcec-openshift-default-844946c46-5s98v" event={"ID":"bfdfcfc7-867a-458b-a2af-dd4928659ae0","Type":"ContainerStarted","Data":"5e04668772a213db910f9576f289eeaffc76f53d2a402c25c1d2b311b3851e48"}
Sep 18 22:14:09.417564 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:09.417538    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h"
Sep 18 22:14:09.422885 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:09.422861    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h"
Sep 18 22:14:09.487233 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:09.487159    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-82b6dcec-openshift-default-844946c46-5s98v" podStartSLOduration=2.487133483 podStartE2EDuration="2.487133483s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:14:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:14:09.450090792 +0000 UTC m=+828.769762848" watchObservedRunningTime="2026-09-18 22:14:09.487133483 +0000 UTC m=+828.806805534"
Sep 18 22:14:10.029541 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:10.029504    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-82b6dcec-openshift-default-844946c46-5s98v"
Sep 18 22:14:10.034122 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:10.034097    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-82b6dcec-openshift-default-844946c46-5s98v"
Sep 18 22:14:10.422503 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:10.422470    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-82b6dcec-openshift-default-844946c46-5s98v"
Sep 18 22:14:10.423469 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:10.423452    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-82b6dcec-openshift-default-844946c46-5s98v"
Sep 18 22:14:18.139483 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:18.139452    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-82b6dcec-7fddd48d94-fkxns"]
Sep 18 22:14:18.142319 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:18.142296    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-82b6dcec-7fddd48d94-fkxns"
Sep 18 22:14:18.148384 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:18.148353    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-82b6dcec\""
Sep 18 22:14:18.159528 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:18.159505    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-82b6dcec-7fddd48d94-fkxns"]
Sep 18 22:14:18.181471 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:18.181440    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/11cbbb23-ce3e-46f6-a448-4fff4e8975c0-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-82b6dcec-7fddd48d94-fkxns\" (UID: \"11cbbb23-ce3e-46f6-a448-4fff4e8975c0\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-82b6dcec-7fddd48d94-fkxns"
Sep 18 22:14:18.181856 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:18.181831    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdwln\" (UniqueName: \"kubernetes.io/projected/11cbbb23-ce3e-46f6-a448-4fff4e8975c0-kube-api-access-gdwln\") pod \"payload-pre-processing-e2e-ait-82b6dcec-7fddd48d94-fkxns\" (UID: \"11cbbb23-ce3e-46f6-a448-4fff4e8975c0\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-82b6dcec-7fddd48d94-fkxns"
Sep 18 22:14:18.282604 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:18.282573    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/11cbbb23-ce3e-46f6-a448-4fff4e8975c0-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-82b6dcec-7fddd48d94-fkxns\" (UID: \"11cbbb23-ce3e-46f6-a448-4fff4e8975c0\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-82b6dcec-7fddd48d94-fkxns"
Sep 18 22:14:18.282730 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:18.282716    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdwln\" (UniqueName: \"kubernetes.io/projected/11cbbb23-ce3e-46f6-a448-4fff4e8975c0-kube-api-access-gdwln\") pod \"payload-pre-processing-e2e-ait-82b6dcec-7fddd48d94-fkxns\" (UID: \"11cbbb23-ce3e-46f6-a448-4fff4e8975c0\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-82b6dcec-7fddd48d94-fkxns"
Sep 18 22:14:18.283384 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:18.283362    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/11cbbb23-ce3e-46f6-a448-4fff4e8975c0-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-82b6dcec-7fddd48d94-fkxns\" (UID: \"11cbbb23-ce3e-46f6-a448-4fff4e8975c0\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-82b6dcec-7fddd48d94-fkxns"
Sep 18 22:14:18.293585 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:18.293552    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdwln\" (UniqueName: \"kubernetes.io/projected/11cbbb23-ce3e-46f6-a448-4fff4e8975c0-kube-api-access-gdwln\") pod \"payload-pre-processing-e2e-ait-82b6dcec-7fddd48d94-fkxns\" (UID: \"11cbbb23-ce3e-46f6-a448-4fff4e8975c0\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-82b6dcec-7fddd48d94-fkxns"
Sep 18 22:14:18.402813 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:18.402726    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-a13357-7b6898dccd-gzcx5"
Sep 18 22:14:18.455402 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:18.455370    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-82b6dcec-7fddd48d94-fkxns"
Sep 18 22:14:18.483476 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:18.483442    2577 generic.go:356] "Generic (PLEG): container finished" podID="7967e7b5-3983-40bb-b739-b54755b69979" containerID="d19bcb384c1bd5fa144827669a012b6057a6bb637b72fc4e67337ea1dfbe9b14" exitCode=0
Sep 18 22:14:18.483607 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:18.483446    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-59b357-openshift-default-84b8cd88c8-vjhfk" event={"ID":"7967e7b5-3983-40bb-b739-b54755b69979","Type":"ContainerDied","Data":"d19bcb384c1bd5fa144827669a012b6057a6bb637b72fc4e67337ea1dfbe9b14"}
Sep 18 22:14:18.484483 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:18.484038    2577 scope.go:117] "RemoveContainer" containerID="d19bcb384c1bd5fa144827669a012b6057a6bb637b72fc4e67337ea1dfbe9b14"
Sep 18 22:14:18.485579 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:18.485533    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:14:18.485715 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:18.485617    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:14:18.485715 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:18.485671    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:14:18.486226 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:18.486196    2577 generic.go:356] "Generic (PLEG): container finished" podID="01bdcd1e-7689-43dc-87e9-b1f98ce153ed" containerID="4a877e70e9e928b025ae81356b464803ec50f4279153bebd89e884f5ba160ea7" exitCode=0
Sep 18 22:14:18.486341 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:18.486263    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-3d28c1-openshift-default-6745f5d8d8-mdxtn" event={"ID":"01bdcd1e-7689-43dc-87e9-b1f98ce153ed","Type":"ContainerDied","Data":"4a877e70e9e928b025ae81356b464803ec50f4279153bebd89e884f5ba160ea7"}
Sep 18 22:14:18.486765 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:18.486673    2577 scope.go:117] "RemoveContainer" containerID="4a877e70e9e928b025ae81356b464803ec50f4279153bebd89e884f5ba160ea7"
Sep 18 22:14:18.487898 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:18.487871    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:14:18.488081 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:18.488043    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:14:18.488143 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:18.488122    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:14:18.769869 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:18.768995    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-82b6dcec-7fddd48d94-fkxns"]
Sep 18 22:14:18.984769 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:18.982637    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-ab559b-openshift-default-6b94d48488-hx84d"]
Sep 18 22:14:18.985905 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:18.985887    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-ab559b-openshift-default-6b94d48488-hx84d"
Sep 18 22:14:18.989114 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:18.988840    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-ab559b-openshift-default-dockercfg-bc7hs\""
Sep 18 22:14:19.017770 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:19.017745    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-ab559b-openshift-default-6b94d48488-hx84d"]
Sep 18 22:14:19.092382 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:19.092342    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ebab4845-1c9a-483e-aff6-dc86da22da83-istio-envoy\") pod \"e2e-inf-b-ab559b-openshift-default-6b94d48488-hx84d\" (UID: \"ebab4845-1c9a-483e-aff6-dc86da22da83\") " pod="openshift-ingress/e2e-inf-b-ab559b-openshift-default-6b94d48488-hx84d"
Sep 18 22:14:19.092593 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:19.092455    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebab4845-1c9a-483e-aff6-dc86da22da83-credential-socket\") pod \"e2e-inf-b-ab559b-openshift-default-6b94d48488-hx84d\" (UID: \"ebab4845-1c9a-483e-aff6-dc86da22da83\") " pod="openshift-ingress/e2e-inf-b-ab559b-openshift-default-6b94d48488-hx84d"
Sep 18 22:14:19.092593 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:19.092485    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ebab4845-1c9a-483e-aff6-dc86da22da83-istiod-ca-cert\") pod \"e2e-inf-b-ab559b-openshift-default-6b94d48488-hx84d\" (UID: \"ebab4845-1c9a-483e-aff6-dc86da22da83\") " pod="openshift-ingress/e2e-inf-b-ab559b-openshift-default-6b94d48488-hx84d"
Sep 18 22:14:19.092593 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:19.092532    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebab4845-1c9a-483e-aff6-dc86da22da83-workload-socket\") pod \"e2e-inf-b-ab559b-openshift-default-6b94d48488-hx84d\" (UID: \"ebab4845-1c9a-483e-aff6-dc86da22da83\") " pod="openshift-ingress/e2e-inf-b-ab559b-openshift-default-6b94d48488-hx84d"
Sep 18 22:14:19.092719 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:19.092591    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwxlv\" (UniqueName: \"kubernetes.io/projected/ebab4845-1c9a-483e-aff6-dc86da22da83-kube-api-access-jwxlv\") pod \"e2e-inf-b-ab559b-openshift-default-6b94d48488-hx84d\" (UID: \"ebab4845-1c9a-483e-aff6-dc86da22da83\") " pod="openshift-ingress/e2e-inf-b-ab559b-openshift-default-6b94d48488-hx84d"
Sep 18 22:14:19.092719 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:19.092618    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ebab4845-1c9a-483e-aff6-dc86da22da83-istio-data\") pod \"e2e-inf-b-ab559b-openshift-default-6b94d48488-hx84d\" (UID: \"ebab4845-1c9a-483e-aff6-dc86da22da83\") " pod="openshift-ingress/e2e-inf-b-ab559b-openshift-default-6b94d48488-hx84d"
Sep 18 22:14:19.092719 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:19.092666    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ebab4845-1c9a-483e-aff6-dc86da22da83-istio-token\") pod \"e2e-inf-b-ab559b-openshift-default-6b94d48488-hx84d\" (UID: \"ebab4845-1c9a-483e-aff6-dc86da22da83\") " pod="openshift-ingress/e2e-inf-b-ab559b-openshift-default-6b94d48488-hx84d"
Sep 18 22:14:19.092719 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:19.092690    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ebab4845-1c9a-483e-aff6-dc86da22da83-istio-podinfo\") pod \"e2e-inf-b-ab559b-openshift-default-6b94d48488-hx84d\" (UID: \"ebab4845-1c9a-483e-aff6-dc86da22da83\") " pod="openshift-ingress/e2e-inf-b-ab559b-openshift-default-6b94d48488-hx84d"
Sep 18 22:14:19.092871 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:19.092746    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ebab4845-1c9a-483e-aff6-dc86da22da83-workload-certs\") pod \"e2e-inf-b-ab559b-openshift-default-6b94d48488-hx84d\" (UID: \"ebab4845-1c9a-483e-aff6-dc86da22da83\") " pod="openshift-ingress/e2e-inf-b-ab559b-openshift-default-6b94d48488-hx84d"
Sep 18 22:14:19.193863 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:19.193833    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ebab4845-1c9a-483e-aff6-dc86da22da83-istio-data\") pod \"e2e-inf-b-ab559b-openshift-default-6b94d48488-hx84d\" (UID: \"ebab4845-1c9a-483e-aff6-dc86da22da83\") " pod="openshift-ingress/e2e-inf-b-ab559b-openshift-default-6b94d48488-hx84d"
Sep 18 22:14:19.194489 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:19.193875    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ebab4845-1c9a-483e-aff6-dc86da22da83-istio-token\") pod \"e2e-inf-b-ab559b-openshift-default-6b94d48488-hx84d\" (UID: \"ebab4845-1c9a-483e-aff6-dc86da22da83\") " pod="openshift-ingress/e2e-inf-b-ab559b-openshift-default-6b94d48488-hx84d"
Sep 18 22:14:19.194489 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:19.193895    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ebab4845-1c9a-483e-aff6-dc86da22da83-istio-podinfo\") pod \"e2e-inf-b-ab559b-openshift-default-6b94d48488-hx84d\" (UID: \"ebab4845-1c9a-483e-aff6-dc86da22da83\") " pod="openshift-ingress/e2e-inf-b-ab559b-openshift-default-6b94d48488-hx84d"
Sep 18 22:14:19.194489 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:19.193919    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ebab4845-1c9a-483e-aff6-dc86da22da83-workload-certs\") pod \"e2e-inf-b-ab559b-openshift-default-6b94d48488-hx84d\" (UID: \"ebab4845-1c9a-483e-aff6-dc86da22da83\") " pod="openshift-ingress/e2e-inf-b-ab559b-openshift-default-6b94d48488-hx84d"
Sep 18 22:14:19.194489 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:19.194005    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ebab4845-1c9a-483e-aff6-dc86da22da83-istio-envoy\") pod \"e2e-inf-b-ab559b-openshift-default-6b94d48488-hx84d\" (UID: \"ebab4845-1c9a-483e-aff6-dc86da22da83\") " pod="openshift-ingress/e2e-inf-b-ab559b-openshift-default-6b94d48488-hx84d"
Sep 18 22:14:19.194489 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:19.194104    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebab4845-1c9a-483e-aff6-dc86da22da83-credential-socket\") pod \"e2e-inf-b-ab559b-openshift-default-6b94d48488-hx84d\" (UID: \"ebab4845-1c9a-483e-aff6-dc86da22da83\") " pod="openshift-ingress/e2e-inf-b-ab559b-openshift-default-6b94d48488-hx84d"
Sep 18 22:14:19.194489 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:19.194147    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ebab4845-1c9a-483e-aff6-dc86da22da83-istiod-ca-cert\") pod \"e2e-inf-b-ab559b-openshift-default-6b94d48488-hx84d\" (UID: \"ebab4845-1c9a-483e-aff6-dc86da22da83\") " pod="openshift-ingress/e2e-inf-b-ab559b-openshift-default-6b94d48488-hx84d"
Sep 18 22:14:19.194489 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:19.194190    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebab4845-1c9a-483e-aff6-dc86da22da83-workload-socket\") pod \"e2e-inf-b-ab559b-openshift-default-6b94d48488-hx84d\" (UID: \"ebab4845-1c9a-483e-aff6-dc86da22da83\") " pod="openshift-ingress/e2e-inf-b-ab559b-openshift-default-6b94d48488-hx84d"
Sep 18 22:14:19.194489 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:19.194280    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwxlv\" (UniqueName: \"kubernetes.io/projected/ebab4845-1c9a-483e-aff6-dc86da22da83-kube-api-access-jwxlv\") pod \"e2e-inf-b-ab559b-openshift-default-6b94d48488-hx84d\" (UID: \"ebab4845-1c9a-483e-aff6-dc86da22da83\") " pod="openshift-ingress/e2e-inf-b-ab559b-openshift-default-6b94d48488-hx84d"
Sep 18 22:14:19.194489 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:19.194305    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ebab4845-1c9a-483e-aff6-dc86da22da83-istio-data\") pod \"e2e-inf-b-ab559b-openshift-default-6b94d48488-hx84d\" (UID: \"ebab4845-1c9a-483e-aff6-dc86da22da83\") " pod="openshift-ingress/e2e-inf-b-ab559b-openshift-default-6b94d48488-hx84d"
Sep 18 22:14:19.194489 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:19.194373    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ebab4845-1c9a-483e-aff6-dc86da22da83-workload-certs\") pod \"e2e-inf-b-ab559b-openshift-default-6b94d48488-hx84d\" (UID: \"ebab4845-1c9a-483e-aff6-dc86da22da83\") " pod="openshift-ingress/e2e-inf-b-ab559b-openshift-default-6b94d48488-hx84d"
Sep 18 22:14:19.194946 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:19.194637    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebab4845-1c9a-483e-aff6-dc86da22da83-workload-socket\") pod \"e2e-inf-b-ab559b-openshift-default-6b94d48488-hx84d\" (UID: \"ebab4845-1c9a-483e-aff6-dc86da22da83\") " pod="openshift-ingress/e2e-inf-b-ab559b-openshift-default-6b94d48488-hx84d"
Sep 18 22:14:19.194946 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:19.194726    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebab4845-1c9a-483e-aff6-dc86da22da83-credential-socket\") pod \"e2e-inf-b-ab559b-openshift-default-6b94d48488-hx84d\" (UID: \"ebab4845-1c9a-483e-aff6-dc86da22da83\") " pod="openshift-ingress/e2e-inf-b-ab559b-openshift-default-6b94d48488-hx84d"
Sep 18 22:14:19.195061 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:19.195035    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ebab4845-1c9a-483e-aff6-dc86da22da83-istiod-ca-cert\") pod \"e2e-inf-b-ab559b-openshift-default-6b94d48488-hx84d\" (UID: \"ebab4845-1c9a-483e-aff6-dc86da22da83\") " pod="openshift-ingress/e2e-inf-b-ab559b-openshift-default-6b94d48488-hx84d"
Sep 18 22:14:19.197126 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:19.197106    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ebab4845-1c9a-483e-aff6-dc86da22da83-istio-podinfo\") pod \"e2e-inf-b-ab559b-openshift-default-6b94d48488-hx84d\" (UID: \"ebab4845-1c9a-483e-aff6-dc86da22da83\") " pod="openshift-ingress/e2e-inf-b-ab559b-openshift-default-6b94d48488-hx84d"
Sep 18 22:14:19.197314 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:19.197270    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ebab4845-1c9a-483e-aff6-dc86da22da83-istio-envoy\") pod \"e2e-inf-b-ab559b-openshift-default-6b94d48488-hx84d\" (UID: \"ebab4845-1c9a-483e-aff6-dc86da22da83\") " pod="openshift-ingress/e2e-inf-b-ab559b-openshift-default-6b94d48488-hx84d"
Sep 18 22:14:19.223328 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:19.223298    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ebab4845-1c9a-483e-aff6-dc86da22da83-istio-token\") pod \"e2e-inf-b-ab559b-openshift-default-6b94d48488-hx84d\" (UID: \"ebab4845-1c9a-483e-aff6-dc86da22da83\") " pod="openshift-ingress/e2e-inf-b-ab559b-openshift-default-6b94d48488-hx84d"
Sep 18 22:14:19.223581 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:19.223533    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwxlv\" (UniqueName: \"kubernetes.io/projected/ebab4845-1c9a-483e-aff6-dc86da22da83-kube-api-access-jwxlv\") pod \"e2e-inf-b-ab559b-openshift-default-6b94d48488-hx84d\" (UID: \"ebab4845-1c9a-483e-aff6-dc86da22da83\") " pod="openshift-ingress/e2e-inf-b-ab559b-openshift-default-6b94d48488-hx84d"
Sep 18 22:14:19.300606 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:19.300576    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-ab559b-openshift-default-6b94d48488-hx84d"
Sep 18 22:14:19.494320 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:19.494288    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-82b6dcec-7fddd48d94-fkxns" event={"ID":"11cbbb23-ce3e-46f6-a448-4fff4e8975c0","Type":"ContainerStarted","Data":"c15dcd211728cfe8cf0ef1c1b91e635488f7ff22de12f15ed40471145def5b3b"}
Sep 18 22:14:19.494546 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:19.494346    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-82b6dcec-7fddd48d94-fkxns" event={"ID":"11cbbb23-ce3e-46f6-a448-4fff4e8975c0","Type":"ContainerStarted","Data":"0ce2c24729a03a697d4d51bbb4fedda9dfbecc23405e5c13b01d1e687e441c19"}
Sep 18 22:14:19.494546 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:19.494441    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-82b6dcec-7fddd48d94-fkxns"
Sep 18 22:14:19.496459 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:19.496405    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-59b357-openshift-default-84b8cd88c8-vjhfk" event={"ID":"7967e7b5-3983-40bb-b739-b54755b69979","Type":"ContainerStarted","Data":"571d200eb286d4c086a75d5299085c4f275303d95cb8a6f514bdfa77f52b0273"}
Sep 18 22:14:19.498605 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:19.498581    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-3d28c1-openshift-default-6745f5d8d8-mdxtn" event={"ID":"01bdcd1e-7689-43dc-87e9-b1f98ce153ed","Type":"ContainerStarted","Data":"c48a80f8ad6e2a20eb23686265742cc1460ba1cc563b1886455fd0fbb96d0ebc"}
Sep 18 22:14:19.517092 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:19.517055    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-82b6dcec-7fddd48d94-fkxns" podStartSLOduration=1.517035492 podStartE2EDuration="1.517035492s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:14:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:14:19.514993909 +0000 UTC m=+838.834665964" watchObservedRunningTime="2026-09-18 22:14:19.517035492 +0000 UTC m=+838.836707524"
Sep 18 22:14:19.601155 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:19.601128    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-ab559b-openshift-default-6b94d48488-hx84d"]
Sep 18 22:14:19.602098 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:14:19.602074    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebab4845_1c9a_483e_aff6_dc86da22da83.slice/crio-8e29cec131048cb37cef2d016aa1bc95ef6c18d4e3e52fda102b23123276ec98 WatchSource:0}: Error finding container 8e29cec131048cb37cef2d016aa1bc95ef6c18d4e3e52fda102b23123276ec98: Status 404 returned error can't find the container with id 8e29cec131048cb37cef2d016aa1bc95ef6c18d4e3e52fda102b23123276ec98
Sep 18 22:14:19.604370 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:19.604339    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:14:19.604471 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:19.604397    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:14:19.604471 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:19.604449    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:14:19.670558 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:19.670533    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-3d28c1-openshift-default-6745f5d8d8-mdxtn"
Sep 18 22:14:19.670764 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:19.670743    2577 patch_prober.go:28] interesting pod/e2e-inf-a-3d28c1-openshift-default-6745f5d8d8-mdxtn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Sep 18 22:14:19.670861 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:19.670796    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-3d28c1-openshift-default-6745f5d8d8-mdxtn" podUID="01bdcd1e-7689-43dc-87e9-b1f98ce153ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Sep 18 22:14:19.782106 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:19.782067    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-59b357-openshift-default-84b8cd88c8-vjhfk"
Sep 18 22:14:19.782327 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:19.782190    2577 patch_prober.go:28] interesting pod/e2e-worker-w4-59b357-openshift-default-84b8cd88c8-vjhfk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Sep 18 22:14:19.782327 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:19.782235    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-59b357-openshift-default-84b8cd88c8-vjhfk" podUID="7967e7b5-3983-40bb-b739-b54755b69979" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Sep 18 22:14:20.511635 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:20.511589    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-ab559b-openshift-default-6b94d48488-hx84d" event={"ID":"ebab4845-1c9a-483e-aff6-dc86da22da83","Type":"ContainerStarted","Data":"9799fb3f9703e6a782f1ef0077809c6e0a96f4d52c18b1ac3406b4b217f7bb5c"}
Sep 18 22:14:20.512006 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:20.511688    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-ab559b-openshift-default-6b94d48488-hx84d" event={"ID":"ebab4845-1c9a-483e-aff6-dc86da22da83","Type":"ContainerStarted","Data":"8e29cec131048cb37cef2d016aa1bc95ef6c18d4e3e52fda102b23123276ec98"}
Sep 18 22:14:20.670935 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:20.670895    2577 patch_prober.go:28] interesting pod/e2e-inf-a-3d28c1-openshift-default-6745f5d8d8-mdxtn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Sep 18 22:14:20.671243 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:20.671206    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-3d28c1-openshift-default-6745f5d8d8-mdxtn" podUID="01bdcd1e-7689-43dc-87e9-b1f98ce153ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Sep 18 22:14:20.782220 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:20.782119    2577 patch_prober.go:28] interesting pod/e2e-worker-w4-59b357-openshift-default-84b8cd88c8-vjhfk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Sep 18 22:14:20.782521 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:20.782491    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-59b357-openshift-default-84b8cd88c8-vjhfk" podUID="7967e7b5-3983-40bb-b739-b54755b69979" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Sep 18 22:14:21.310757 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:21.310662    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-ab559b-openshift-default-6b94d48488-hx84d"
Sep 18 22:14:21.317715 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:21.317684    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-ab559b-openshift-default-6b94d48488-hx84d"
Sep 18 22:14:21.390702 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:21.389338    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-ab559b-openshift-default-6b94d48488-hx84d" podStartSLOduration=3.389316017 podStartE2EDuration="3.389316017s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:14:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:14:20.647490694 +0000 UTC m=+839.967162751" watchObservedRunningTime="2026-09-18 22:14:21.389316017 +0000 UTC m=+840.708988073"
Sep 18 22:14:21.518840 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:21.518752    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-ab559b-openshift-default-6b94d48488-hx84d"
Sep 18 22:14:21.519785 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:21.519763    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-ab559b-openshift-default-6b94d48488-hx84d"
Sep 18 22:14:21.680441 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:21.679859    2577 patch_prober.go:28] interesting pod/e2e-inf-a-3d28c1-openshift-default-6745f5d8d8-mdxtn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Sep 18 22:14:21.680441 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:21.679918    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-3d28c1-openshift-default-6745f5d8d8-mdxtn" podUID="01bdcd1e-7689-43dc-87e9-b1f98ce153ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Sep 18 22:14:21.782036 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:21.781924    2577 patch_prober.go:28] interesting pod/e2e-worker-w4-59b357-openshift-default-84b8cd88c8-vjhfk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Sep 18 22:14:21.782036 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:21.782013    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-59b357-openshift-default-84b8cd88c8-vjhfk" podUID="7967e7b5-3983-40bb-b739-b54755b69979" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Sep 18 22:14:22.670453 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:22.670399    2577 patch_prober.go:28] interesting pod/e2e-inf-a-3d28c1-openshift-default-6745f5d8d8-mdxtn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Sep 18 22:14:22.671055 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:22.671026    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-3d28c1-openshift-default-6745f5d8d8-mdxtn" podUID="01bdcd1e-7689-43dc-87e9-b1f98ce153ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Sep 18 22:14:22.782170 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:22.782131    2577 patch_prober.go:28] interesting pod/e2e-worker-w4-59b357-openshift-default-84b8cd88c8-vjhfk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Sep 18 22:14:22.782497 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:22.782462    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-59b357-openshift-default-84b8cd88c8-vjhfk" podUID="7967e7b5-3983-40bb-b739-b54755b69979" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Sep 18 22:14:23.671261 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:23.671218    2577 patch_prober.go:28] interesting pod/e2e-inf-a-3d28c1-openshift-default-6745f5d8d8-mdxtn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Sep 18 22:14:23.671802 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:23.671308    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-3d28c1-openshift-default-6745f5d8d8-mdxtn" podUID="01bdcd1e-7689-43dc-87e9-b1f98ce153ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Sep 18 22:14:23.782854 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:23.782818    2577 patch_prober.go:28] interesting pod/e2e-worker-w4-59b357-openshift-default-84b8cd88c8-vjhfk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Sep 18 22:14:23.783170 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:23.783140    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-59b357-openshift-default-84b8cd88c8-vjhfk" podUID="7967e7b5-3983-40bb-b739-b54755b69979" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Sep 18 22:14:24.671931 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:24.671489    2577 patch_prober.go:28] interesting pod/e2e-inf-a-3d28c1-openshift-default-6745f5d8d8-mdxtn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Sep 18 22:14:24.671931 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:24.671562    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-3d28c1-openshift-default-6745f5d8d8-mdxtn" podUID="01bdcd1e-7689-43dc-87e9-b1f98ce153ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Sep 18 22:14:24.784993 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:24.784946    2577 patch_prober.go:28] interesting pod/e2e-worker-w4-59b357-openshift-default-84b8cd88c8-vjhfk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Sep 18 22:14:24.785312 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:24.785258    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-59b357-openshift-default-84b8cd88c8-vjhfk" podUID="7967e7b5-3983-40bb-b739-b54755b69979" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Sep 18 22:14:25.670564 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:25.670527    2577 patch_prober.go:28] interesting pod/e2e-inf-a-3d28c1-openshift-default-6745f5d8d8-mdxtn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Sep 18 22:14:25.670882 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:25.670856    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-3d28c1-openshift-default-6745f5d8d8-mdxtn" podUID="01bdcd1e-7689-43dc-87e9-b1f98ce153ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Sep 18 22:14:25.782535 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:25.782482    2577 patch_prober.go:28] interesting pod/e2e-worker-w4-59b357-openshift-default-84b8cd88c8-vjhfk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Sep 18 22:14:25.783034 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:25.782563    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-59b357-openshift-default-84b8cd88c8-vjhfk" podUID="7967e7b5-3983-40bb-b739-b54755b69979" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Sep 18 22:14:26.739711 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:26.739677    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-3d28c1-openshift-default-6745f5d8d8-mdxtn"
Sep 18 22:14:26.740326 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:26.740271    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-3d28c1-openshift-default-6745f5d8d8-mdxtn"
Sep 18 22:14:26.742458 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:26.742442    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-3d28c1-openshift-default-6745f5d8d8-mdxtn"
Sep 18 22:14:26.937910 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:26.937857    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-59b357-openshift-default-84b8cd88c8-vjhfk"
Sep 18 22:14:26.938956 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:26.938926    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-59b357-openshift-default-84b8cd88c8-vjhfk"
Sep 18 22:14:26.940607 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:26.940589    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-59b357-openshift-default-84b8cd88c8-vjhfk"
Sep 18 22:14:30.185840 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:30.185802    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-ab559b-79b445f574-f5dhw"]
Sep 18 22:14:30.189770 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:30.189746    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ab559b-79b445f574-f5dhw"
Sep 18 22:14:30.192268 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:30.192245    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-ab559b-dockercfg-rk868\""
Sep 18 22:14:30.192379 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:30.192294    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-ab559b\""
Sep 18 22:14:30.203154 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:30.203130    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-ab559b-69c6fb8479-4m56j"]
Sep 18 22:14:30.206113 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:30.206080    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-ab559b-69c6fb8479-4m56j"
Sep 18 22:14:30.208104 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:30.208080    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-ab559b-79b445f574-f5dhw"]
Sep 18 22:14:30.227678 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:30.227638    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-ab559b-69c6fb8479-4m56j"]
Sep 18 22:14:30.252319 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:30.251990    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ca6dbb78-23e8-45e9-b524-e66713ec8514-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-ab559b-79b445f574-f5dhw\" (UID: \"ca6dbb78-23e8-45e9-b524-e66713ec8514\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ab559b-79b445f574-f5dhw"
Sep 18 22:14:30.252319 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:30.252074    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wll9\" (UniqueName: \"kubernetes.io/projected/ca6dbb78-23e8-45e9-b524-e66713ec8514-kube-api-access-6wll9\") pod \"payload-pre-processing-e2e-inf-b-ab559b-79b445f574-f5dhw\" (UID: \"ca6dbb78-23e8-45e9-b524-e66713ec8514\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ab559b-79b445f574-f5dhw"
Sep 18 22:14:30.252319 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:30.252124    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fcd7c065-e05c-4c76-88de-5706c9bd45ec-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-ab559b-69c6fb8479-4m56j\" (UID: \"fcd7c065-e05c-4c76-88de-5706c9bd45ec\") " pod="openshift-ingress/payload-processing-e2e-inf-b-ab559b-69c6fb8479-4m56j"
Sep 18 22:14:30.252319 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:30.252230    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqgbq\" (UniqueName: \"kubernetes.io/projected/fcd7c065-e05c-4c76-88de-5706c9bd45ec-kube-api-access-bqgbq\") pod \"payload-processing-e2e-inf-b-ab559b-69c6fb8479-4m56j\" (UID: \"fcd7c065-e05c-4c76-88de-5706c9bd45ec\") " pod="openshift-ingress/payload-processing-e2e-inf-b-ab559b-69c6fb8479-4m56j"
Sep 18 22:14:30.353691 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:30.353254    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wll9\" (UniqueName: \"kubernetes.io/projected/ca6dbb78-23e8-45e9-b524-e66713ec8514-kube-api-access-6wll9\") pod \"payload-pre-processing-e2e-inf-b-ab559b-79b445f574-f5dhw\" (UID: \"ca6dbb78-23e8-45e9-b524-e66713ec8514\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ab559b-79b445f574-f5dhw"
Sep 18 22:14:30.353691 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:30.353311    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fcd7c065-e05c-4c76-88de-5706c9bd45ec-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-ab559b-69c6fb8479-4m56j\" (UID: \"fcd7c065-e05c-4c76-88de-5706c9bd45ec\") " pod="openshift-ingress/payload-processing-e2e-inf-b-ab559b-69c6fb8479-4m56j"
Sep 18 22:14:30.353691 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:30.353499    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqgbq\" (UniqueName: \"kubernetes.io/projected/fcd7c065-e05c-4c76-88de-5706c9bd45ec-kube-api-access-bqgbq\") pod \"payload-processing-e2e-inf-b-ab559b-69c6fb8479-4m56j\" (UID: \"fcd7c065-e05c-4c76-88de-5706c9bd45ec\") " pod="openshift-ingress/payload-processing-e2e-inf-b-ab559b-69c6fb8479-4m56j"
Sep 18 22:14:30.353691 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:30.353602    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ca6dbb78-23e8-45e9-b524-e66713ec8514-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-ab559b-79b445f574-f5dhw\" (UID: \"ca6dbb78-23e8-45e9-b524-e66713ec8514\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ab559b-79b445f574-f5dhw"
Sep 18 22:14:30.354136 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:30.354114    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fcd7c065-e05c-4c76-88de-5706c9bd45ec-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-ab559b-69c6fb8479-4m56j\" (UID: \"fcd7c065-e05c-4c76-88de-5706c9bd45ec\") " pod="openshift-ingress/payload-processing-e2e-inf-b-ab559b-69c6fb8479-4m56j"
Sep 18 22:14:30.354365 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:30.354346    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ca6dbb78-23e8-45e9-b524-e66713ec8514-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-ab559b-79b445f574-f5dhw\" (UID: \"ca6dbb78-23e8-45e9-b524-e66713ec8514\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ab559b-79b445f574-f5dhw"
Sep 18 22:14:30.365170 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:30.365070    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wll9\" (UniqueName: \"kubernetes.io/projected/ca6dbb78-23e8-45e9-b524-e66713ec8514-kube-api-access-6wll9\") pod \"payload-pre-processing-e2e-inf-b-ab559b-79b445f574-f5dhw\" (UID: \"ca6dbb78-23e8-45e9-b524-e66713ec8514\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ab559b-79b445f574-f5dhw"
Sep 18 22:14:30.365443 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:30.365388    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqgbq\" (UniqueName: \"kubernetes.io/projected/fcd7c065-e05c-4c76-88de-5706c9bd45ec-kube-api-access-bqgbq\") pod \"payload-processing-e2e-inf-b-ab559b-69c6fb8479-4m56j\" (UID: \"fcd7c065-e05c-4c76-88de-5706c9bd45ec\") " pod="openshift-ingress/payload-processing-e2e-inf-b-ab559b-69c6fb8479-4m56j"
Sep 18 22:14:30.503453 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:30.503332    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ab559b-79b445f574-f5dhw"
Sep 18 22:14:30.513910 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:30.513885    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-82b6dcec-7fddd48d94-fkxns"
Sep 18 22:14:30.523043 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:30.523018    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-ab559b-69c6fb8479-4m56j"
Sep 18 22:14:30.823461 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:14:30.823429    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca6dbb78_23e8_45e9_b524_e66713ec8514.slice/crio-16cba5b9b55d9b6479867186394071be52d03373863ae7d26267e8550acc860d WatchSource:0}: Error finding container 16cba5b9b55d9b6479867186394071be52d03373863ae7d26267e8550acc860d: Status 404 returned error can't find the container with id 16cba5b9b55d9b6479867186394071be52d03373863ae7d26267e8550acc860d
Sep 18 22:14:30.823645 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:30.823619    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-ab559b-79b445f574-f5dhw"]
Sep 18 22:14:30.839685 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:30.839658    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-ab559b-69c6fb8479-4m56j"]
Sep 18 22:14:30.841453 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:14:30.841404    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcd7c065_e05c_4c76_88de_5706c9bd45ec.slice/crio-69548fd6f053f846b407b887bd580aca55bb229f945e6bb5c26441bdd7b72c9b WatchSource:0}: Error finding container 69548fd6f053f846b407b887bd580aca55bb229f945e6bb5c26441bdd7b72c9b: Status 404 returned error can't find the container with id 69548fd6f053f846b407b887bd580aca55bb229f945e6bb5c26441bdd7b72c9b
Sep 18 22:14:31.632716 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:31.632674    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ab559b-79b445f574-f5dhw" event={"ID":"ca6dbb78-23e8-45e9-b524-e66713ec8514","Type":"ContainerStarted","Data":"f48ee18fd2bd56124989350d1ab8ae6b8146b7541a9c7cbcfc17392391c5fcc5"}
Sep 18 22:14:31.633222 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:31.632749    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ab559b-79b445f574-f5dhw"
Sep 18 22:14:31.633222 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:31.632776    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ab559b-79b445f574-f5dhw" event={"ID":"ca6dbb78-23e8-45e9-b524-e66713ec8514","Type":"ContainerStarted","Data":"16cba5b9b55d9b6479867186394071be52d03373863ae7d26267e8550acc860d"}
Sep 18 22:14:31.634944 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:31.634916    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-ab559b-69c6fb8479-4m56j" event={"ID":"fcd7c065-e05c-4c76-88de-5706c9bd45ec","Type":"ContainerStarted","Data":"22b06674abafe18f47c06f3bf2674bc389e4076a75787bcec900472d15543270"}
Sep 18 22:14:31.635084 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:31.634968    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-ab559b-69c6fb8479-4m56j" event={"ID":"fcd7c065-e05c-4c76-88de-5706c9bd45ec","Type":"ContainerStarted","Data":"69548fd6f053f846b407b887bd580aca55bb229f945e6bb5c26441bdd7b72c9b"}
Sep 18 22:14:31.635084 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:31.635021    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-ab559b-69c6fb8479-4m56j"
Sep 18 22:14:31.675375 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:31.675313    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ab559b-79b445f574-f5dhw" podStartSLOduration=1.6752931 podStartE2EDuration="1.6752931s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:14:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:14:31.650977645 +0000 UTC m=+850.970649700" watchObservedRunningTime="2026-09-18 22:14:31.6752931 +0000 UTC m=+850.994965156"
Sep 18 22:14:31.677331 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:31.677281    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-ab559b-69c6fb8479-4m56j" podStartSLOduration=1.677265333 podStartE2EDuration="1.677265333s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:14:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:14:31.673577231 +0000 UTC m=+850.993249288" watchObservedRunningTime="2026-09-18 22:14:31.677265333 +0000 UTC m=+850.996937393"
Sep 18 22:14:32.643476 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:32.643440    2577 generic.go:356] "Generic (PLEG): container finished" podID="88740ac0-7237-4035-a68d-74d4d7dc7619" containerID="c3c3546f984c7a8b1f680ea87a275fce7e1f1e490e65ff6e3b1a644ca18eb414" exitCode=0
Sep 18 22:14:32.644827 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:32.643512    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h" event={"ID":"88740ac0-7237-4035-a68d-74d4d7dc7619","Type":"ContainerDied","Data":"c3c3546f984c7a8b1f680ea87a275fce7e1f1e490e65ff6e3b1a644ca18eb414"}
Sep 18 22:14:32.644827 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:32.644071    2577 scope.go:117] "RemoveContainer" containerID="c3c3546f984c7a8b1f680ea87a275fce7e1f1e490e65ff6e3b1a644ca18eb414"
Sep 18 22:14:32.645513 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:32.645473    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:14:32.645613 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:32.645565    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:14:32.645613 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:32.645605    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:14:33.656209 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:33.656167    2577 generic.go:356] "Generic (PLEG): container finished" podID="ecc5b678-e35f-47f3-b50c-ee1a44680f88" containerID="ae1c0d7532985bedf9ccabd8806679597f9f49950e250295a18c3b04cb1a56d3" exitCode=0
Sep 18 22:14:33.656732 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:33.656440    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-a13357-openshift-default-6dbf49559b-zznj9" event={"ID":"ecc5b678-e35f-47f3-b50c-ee1a44680f88","Type":"ContainerDied","Data":"ae1c0d7532985bedf9ccabd8806679597f9f49950e250295a18c3b04cb1a56d3"}
Sep 18 22:14:33.657002 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:33.656975    2577 scope.go:117] "RemoveContainer" containerID="ae1c0d7532985bedf9ccabd8806679597f9f49950e250295a18c3b04cb1a56d3"
Sep 18 22:14:33.660869 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:33.660830    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h" event={"ID":"88740ac0-7237-4035-a68d-74d4d7dc7619","Type":"ContainerStarted","Data":"c63aff3f701baa74c729097a48e3395d345ab910245f0668e9f41ceaff6dbb3e"}
Sep 18 22:14:33.662301 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:33.662212    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:14:33.662434 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:33.662370    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:14:33.662504 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:33.662452    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:14:34.596092 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:34.596054    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h"
Sep 18 22:14:34.596613 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:34.596592    2577 patch_prober.go:28] interesting pod/e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Sep 18 22:14:34.596673 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:34.596648    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h" podUID="88740ac0-7237-4035-a68d-74d4d7dc7619" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Sep 18 22:14:34.675536 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:34.675495    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-a13357-openshift-default-6dbf49559b-zznj9" event={"ID":"ecc5b678-e35f-47f3-b50c-ee1a44680f88","Type":"ContainerStarted","Data":"03c3423bc03be169aa04b8b69c40aebdab193652d95d2b158b4cca7006856771"}
Sep 18 22:14:34.908124 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:34.908028    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-a13357-openshift-default-6dbf49559b-zznj9"
Sep 18 22:14:34.908720 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:34.908693    2577 patch_prober.go:28] interesting pod/e2e-worker-w0-a13357-openshift-default-6dbf49559b-zznj9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Sep 18 22:14:34.908850 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:34.908744    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-a13357-openshift-default-6dbf49559b-zznj9" podUID="ecc5b678-e35f-47f3-b50c-ee1a44680f88" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Sep 18 22:14:35.596728 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:35.596678    2577 patch_prober.go:28] interesting pod/e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Sep 18 22:14:35.596996 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:35.596780    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h" podUID="88740ac0-7237-4035-a68d-74d4d7dc7619" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Sep 18 22:14:35.907914 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:35.907822    2577 patch_prober.go:28] interesting pod/e2e-worker-w0-a13357-openshift-default-6dbf49559b-zznj9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Sep 18 22:14:35.908359 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:35.907909    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-a13357-openshift-default-6dbf49559b-zznj9" podUID="ecc5b678-e35f-47f3-b50c-ee1a44680f88" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Sep 18 22:14:36.596652 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:36.596614    2577 patch_prober.go:28] interesting pod/e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Sep 18 22:14:36.597434 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:36.596952    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h" podUID="88740ac0-7237-4035-a68d-74d4d7dc7619" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Sep 18 22:14:36.907829 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:36.907742    2577 patch_prober.go:28] interesting pod/e2e-worker-w0-a13357-openshift-default-6dbf49559b-zznj9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Sep 18 22:14:36.907829 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:36.907806    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-a13357-openshift-default-6dbf49559b-zznj9" podUID="ecc5b678-e35f-47f3-b50c-ee1a44680f88" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Sep 18 22:14:37.596925 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:37.596886    2577 patch_prober.go:28] interesting pod/e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Sep 18 22:14:37.597253 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:37.597222    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h" podUID="88740ac0-7237-4035-a68d-74d4d7dc7619" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Sep 18 22:14:37.907827 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:37.907732    2577 patch_prober.go:28] interesting pod/e2e-worker-w0-a13357-openshift-default-6dbf49559b-zznj9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Sep 18 22:14:37.908049 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:37.908027    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-a13357-openshift-default-6dbf49559b-zznj9" podUID="ecc5b678-e35f-47f3-b50c-ee1a44680f88" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Sep 18 22:14:38.596372 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:38.596314    2577 patch_prober.go:28] interesting pod/e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Sep 18 22:14:38.596746 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:38.596688    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h" podUID="88740ac0-7237-4035-a68d-74d4d7dc7619" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Sep 18 22:14:38.908264 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:38.908167    2577 patch_prober.go:28] interesting pod/e2e-worker-w0-a13357-openshift-default-6dbf49559b-zznj9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Sep 18 22:14:38.908870 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:38.908836    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-a13357-openshift-default-6dbf49559b-zznj9" podUID="ecc5b678-e35f-47f3-b50c-ee1a44680f88" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Sep 18 22:14:39.418011 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:39.417968    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h"
Sep 18 22:14:39.610338 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:39.610304    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h"
Sep 18 22:14:39.738948 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:39.738853    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h"
Sep 18 22:14:39.911903 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:39.911866    2577 patch_prober.go:28] interesting pod/e2e-worker-w0-a13357-openshift-default-6dbf49559b-zznj9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Sep 18 22:14:39.912528 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:39.912492    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-a13357-openshift-default-6dbf49559b-zznj9" podUID="ecc5b678-e35f-47f3-b50c-ee1a44680f88" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Sep 18 22:14:40.907812 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:40.907768    2577 patch_prober.go:28] interesting pod/e2e-worker-w0-a13357-openshift-default-6dbf49559b-zznj9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Sep 18 22:14:40.908000 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:40.907851    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-a13357-openshift-default-6dbf49559b-zznj9" podUID="ecc5b678-e35f-47f3-b50c-ee1a44680f88" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Sep 18 22:14:41.912069 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:41.912040    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-a13357-openshift-default-6dbf49559b-zznj9"
Sep 18 22:14:41.912471 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:41.912446    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-a13357-openshift-default-6dbf49559b-zznj9"
Sep 18 22:14:41.913276 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:41.913259    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-a13357-openshift-default-6dbf49559b-zznj9"
Sep 18 22:14:42.129454 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:42.129394    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-82b6dcec-7fddd48d94-fkxns"]
Sep 18 22:14:42.129714 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:42.129684    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-82b6dcec-7fddd48d94-fkxns" podUID="11cbbb23-ce3e-46f6-a448-4fff4e8975c0" containerName="payload-pre-processing" containerID="cri-o://c15dcd211728cfe8cf0ef1c1b91e635488f7ff22de12f15ed40471145def5b3b" gracePeriod=30
Sep 18 22:14:42.619731 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:42.619690    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-82b6dcec-openshift-default-844946c46-5s98v"]
Sep 18 22:14:42.620080 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:42.620034    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-82b6dcec-openshift-default-844946c46-5s98v" podUID="bfdfcfc7-867a-458b-a2af-dd4928659ae0" containerName="istio-proxy" containerID="cri-o://5e04668772a213db910f9576f289eeaffc76f53d2a402c25c1d2b311b3851e48" gracePeriod=30
Sep 18 22:14:42.657639 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:42.656865    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ab559b-79b445f574-f5dhw"
Sep 18 22:14:42.681056 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:42.670663    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-ab559b-69c6fb8479-4m56j"
Sep 18 22:14:42.735360 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:42.735274    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-82b6dcec-7fddd48d94-fkxns"
Sep 18 22:14:42.782169 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:42.780800    2577 generic.go:356] "Generic (PLEG): container finished" podID="11cbbb23-ce3e-46f6-a448-4fff4e8975c0" containerID="c15dcd211728cfe8cf0ef1c1b91e635488f7ff22de12f15ed40471145def5b3b" exitCode=0
Sep 18 22:14:42.782169 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:42.781814    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-82b6dcec-7fddd48d94-fkxns"
Sep 18 22:14:42.782169 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:42.781940    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-82b6dcec-7fddd48d94-fkxns" event={"ID":"11cbbb23-ce3e-46f6-a448-4fff4e8975c0","Type":"ContainerDied","Data":"c15dcd211728cfe8cf0ef1c1b91e635488f7ff22de12f15ed40471145def5b3b"}
Sep 18 22:14:42.782169 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:42.781983    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-82b6dcec-7fddd48d94-fkxns" event={"ID":"11cbbb23-ce3e-46f6-a448-4fff4e8975c0","Type":"ContainerDied","Data":"0ce2c24729a03a697d4d51bbb4fedda9dfbecc23405e5c13b01d1e687e441c19"}
Sep 18 22:14:42.782169 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:42.782014    2577 scope.go:117] "RemoveContainer" containerID="c15dcd211728cfe8cf0ef1c1b91e635488f7ff22de12f15ed40471145def5b3b"
Sep 18 22:14:42.805682 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:42.805555    2577 scope.go:117] "RemoveContainer" containerID="c15dcd211728cfe8cf0ef1c1b91e635488f7ff22de12f15ed40471145def5b3b"
Sep 18 22:14:42.810964 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:14:42.810883    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c15dcd211728cfe8cf0ef1c1b91e635488f7ff22de12f15ed40471145def5b3b\": container with ID starting with c15dcd211728cfe8cf0ef1c1b91e635488f7ff22de12f15ed40471145def5b3b not found: ID does not exist" containerID="c15dcd211728cfe8cf0ef1c1b91e635488f7ff22de12f15ed40471145def5b3b"
Sep 18 22:14:42.811162 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:42.810927    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c15dcd211728cfe8cf0ef1c1b91e635488f7ff22de12f15ed40471145def5b3b"} err="failed to get container status \"c15dcd211728cfe8cf0ef1c1b91e635488f7ff22de12f15ed40471145def5b3b\": rpc error: code = NotFound desc = could not find container \"c15dcd211728cfe8cf0ef1c1b91e635488f7ff22de12f15ed40471145def5b3b\": container with ID starting with c15dcd211728cfe8cf0ef1c1b91e635488f7ff22de12f15ed40471145def5b3b not found: ID does not exist"
Sep 18 22:14:42.832248 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:42.832218    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gdwln\" (UniqueName: \"kubernetes.io/projected/11cbbb23-ce3e-46f6-a448-4fff4e8975c0-kube-api-access-gdwln\") pod \"11cbbb23-ce3e-46f6-a448-4fff4e8975c0\" (UID: \"11cbbb23-ce3e-46f6-a448-4fff4e8975c0\") "
Sep 18 22:14:42.832448 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:42.832283    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/11cbbb23-ce3e-46f6-a448-4fff4e8975c0-plugins-config-volume\") pod \"11cbbb23-ce3e-46f6-a448-4fff4e8975c0\" (UID: \"11cbbb23-ce3e-46f6-a448-4fff4e8975c0\") "
Sep 18 22:14:42.832802 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:42.832773    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11cbbb23-ce3e-46f6-a448-4fff4e8975c0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "11cbbb23-ce3e-46f6-a448-4fff4e8975c0" (UID: "11cbbb23-ce3e-46f6-a448-4fff4e8975c0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:14:42.835164 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:42.835047    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11cbbb23-ce3e-46f6-a448-4fff4e8975c0-kube-api-access-gdwln" (OuterVolumeSpecName: "kube-api-access-gdwln") pod "11cbbb23-ce3e-46f6-a448-4fff4e8975c0" (UID: "11cbbb23-ce3e-46f6-a448-4fff4e8975c0"). InnerVolumeSpecName "kube-api-access-gdwln". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:14:42.933426 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:42.933322    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gdwln\" (UniqueName: \"kubernetes.io/projected/11cbbb23-ce3e-46f6-a448-4fff4e8975c0-kube-api-access-gdwln\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:14:42.933426 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:42.933355    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/11cbbb23-ce3e-46f6-a448-4fff4e8975c0-plugins-config-volume\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:14:43.153293 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:43.153255    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-82b6dcec-7fddd48d94-fkxns"]
Sep 18 22:14:43.172548 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:43.172512    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-82b6dcec-7fddd48d94-fkxns"]
Sep 18 22:14:43.692186 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:43.692145    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d-bwrbf"]
Sep 18 22:14:43.693259 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:43.693232    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11cbbb23-ce3e-46f6-a448-4fff4e8975c0" containerName="payload-pre-processing"
Sep 18 22:14:43.693439 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:43.693426    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="11cbbb23-ce3e-46f6-a448-4fff4e8975c0" containerName="payload-pre-processing"
Sep 18 22:14:43.694208 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:43.694187    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="11cbbb23-ce3e-46f6-a448-4fff4e8975c0" containerName="payload-pre-processing"
Sep 18 22:14:43.698664 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:43.698645    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d-bwrbf"
Sep 18 22:14:43.703341 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:43.703319    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-8ed3d70b-gw-openshift-default-dockercfg-2h97h\""
Sep 18 22:14:43.714980 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:43.714934    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d-bwrbf"]
Sep 18 22:14:43.742440 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:43.742367    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a26df0a-3a34-432b-88e5-985dcaf0f7ff-workload-certs\") pod \"e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d-bwrbf\" (UID: \"1a26df0a-3a34-432b-88e5-985dcaf0f7ff\") " pod="openshift-ingress/e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d-bwrbf"
Sep 18 22:14:43.742776 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:43.742750    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1a26df0a-3a34-432b-88e5-985dcaf0f7ff-istio-podinfo\") pod \"e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d-bwrbf\" (UID: \"1a26df0a-3a34-432b-88e5-985dcaf0f7ff\") " pod="openshift-ingress/e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d-bwrbf"
Sep 18 22:14:43.742993 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:43.742972    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1a26df0a-3a34-432b-88e5-985dcaf0f7ff-istio-data\") pod \"e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d-bwrbf\" (UID: \"1a26df0a-3a34-432b-88e5-985dcaf0f7ff\") " pod="openshift-ingress/e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d-bwrbf"
Sep 18 22:14:43.743252 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:43.743131    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1a26df0a-3a34-432b-88e5-985dcaf0f7ff-istio-envoy\") pod \"e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d-bwrbf\" (UID: \"1a26df0a-3a34-432b-88e5-985dcaf0f7ff\") " pod="openshift-ingress/e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d-bwrbf"
Sep 18 22:14:43.743692 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:43.743478    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a26df0a-3a34-432b-88e5-985dcaf0f7ff-workload-socket\") pod \"e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d-bwrbf\" (UID: \"1a26df0a-3a34-432b-88e5-985dcaf0f7ff\") " pod="openshift-ingress/e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d-bwrbf"
Sep 18 22:14:43.743913 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:43.743894    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a26df0a-3a34-432b-88e5-985dcaf0f7ff-credential-socket\") pod \"e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d-bwrbf\" (UID: \"1a26df0a-3a34-432b-88e5-985dcaf0f7ff\") " pod="openshift-ingress/e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d-bwrbf"
Sep 18 22:14:43.744028 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:43.744016    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1a26df0a-3a34-432b-88e5-985dcaf0f7ff-istiod-ca-cert\") pod \"e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d-bwrbf\" (UID: \"1a26df0a-3a34-432b-88e5-985dcaf0f7ff\") " pod="openshift-ingress/e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d-bwrbf"
Sep 18 22:14:43.745239 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:43.745198    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqpds\" (UniqueName: \"kubernetes.io/projected/1a26df0a-3a34-432b-88e5-985dcaf0f7ff-kube-api-access-jqpds\") pod \"e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d-bwrbf\" (UID: \"1a26df0a-3a34-432b-88e5-985dcaf0f7ff\") " pod="openshift-ingress/e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d-bwrbf"
Sep 18 22:14:43.745492 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:43.745474    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a26df0a-3a34-432b-88e5-985dcaf0f7ff-istio-token\") pod \"e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d-bwrbf\" (UID: \"1a26df0a-3a34-432b-88e5-985dcaf0f7ff\") " pod="openshift-ingress/e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d-bwrbf"
Sep 18 22:14:43.858687 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:43.857052    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqpds\" (UniqueName: \"kubernetes.io/projected/1a26df0a-3a34-432b-88e5-985dcaf0f7ff-kube-api-access-jqpds\") pod \"e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d-bwrbf\" (UID: \"1a26df0a-3a34-432b-88e5-985dcaf0f7ff\") " pod="openshift-ingress/e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d-bwrbf"
Sep 18 22:14:43.858687 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:43.857151    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a26df0a-3a34-432b-88e5-985dcaf0f7ff-istio-token\") pod \"e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d-bwrbf\" (UID: \"1a26df0a-3a34-432b-88e5-985dcaf0f7ff\") " pod="openshift-ingress/e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d-bwrbf"
Sep 18 22:14:43.858687 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:43.857195    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a26df0a-3a34-432b-88e5-985dcaf0f7ff-workload-certs\") pod \"e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d-bwrbf\" (UID: \"1a26df0a-3a34-432b-88e5-985dcaf0f7ff\") " pod="openshift-ingress/e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d-bwrbf"
Sep 18 22:14:43.858687 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:43.857280    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1a26df0a-3a34-432b-88e5-985dcaf0f7ff-istio-podinfo\") pod \"e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d-bwrbf\" (UID: \"1a26df0a-3a34-432b-88e5-985dcaf0f7ff\") " pod="openshift-ingress/e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d-bwrbf"
Sep 18 22:14:43.858687 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:43.857314    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1a26df0a-3a34-432b-88e5-985dcaf0f7ff-istio-data\") pod \"e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d-bwrbf\" (UID: \"1a26df0a-3a34-432b-88e5-985dcaf0f7ff\") " pod="openshift-ingress/e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d-bwrbf"
Sep 18 22:14:43.858687 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:43.857358    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1a26df0a-3a34-432b-88e5-985dcaf0f7ff-istio-envoy\") pod \"e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d-bwrbf\" (UID: \"1a26df0a-3a34-432b-88e5-985dcaf0f7ff\") " pod="openshift-ingress/e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d-bwrbf"
Sep 18 22:14:43.858687 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:43.857450    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a26df0a-3a34-432b-88e5-985dcaf0f7ff-workload-socket\") pod \"e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d-bwrbf\" (UID: \"1a26df0a-3a34-432b-88e5-985dcaf0f7ff\") " pod="openshift-ingress/e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d-bwrbf"
Sep 18 22:14:43.858687 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:43.857543    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a26df0a-3a34-432b-88e5-985dcaf0f7ff-credential-socket\") pod \"e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d-bwrbf\" (UID: \"1a26df0a-3a34-432b-88e5-985dcaf0f7ff\") " pod="openshift-ingress/e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d-bwrbf"
Sep 18 22:14:43.858687 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:43.857576    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1a26df0a-3a34-432b-88e5-985dcaf0f7ff-istiod-ca-cert\") pod \"e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d-bwrbf\" (UID: \"1a26df0a-3a34-432b-88e5-985dcaf0f7ff\") " pod="openshift-ingress/e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d-bwrbf"
Sep 18 22:14:43.858687 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:43.858095    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1a26df0a-3a34-432b-88e5-985dcaf0f7ff-istio-data\") pod \"e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d-bwrbf\" (UID: \"1a26df0a-3a34-432b-88e5-985dcaf0f7ff\") " pod="openshift-ingress/e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d-bwrbf"
Sep 18 22:14:43.858687 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:43.858374    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1a26df0a-3a34-432b-88e5-985dcaf0f7ff-istiod-ca-cert\") pod \"e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d-bwrbf\" (UID: \"1a26df0a-3a34-432b-88e5-985dcaf0f7ff\") " pod="openshift-ingress/e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d-bwrbf"
Sep 18 22:14:43.858687 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:43.858453    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a26df0a-3a34-432b-88e5-985dcaf0f7ff-workload-certs\") pod \"e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d-bwrbf\" (UID: \"1a26df0a-3a34-432b-88e5-985dcaf0f7ff\") " pod="openshift-ingress/e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d-bwrbf"
Sep 18 22:14:43.859482 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:43.858788    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a26df0a-3a34-432b-88e5-985dcaf0f7ff-credential-socket\") pod \"e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d-bwrbf\" (UID: \"1a26df0a-3a34-432b-88e5-985dcaf0f7ff\") " pod="openshift-ingress/e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d-bwrbf"
Sep 18 22:14:43.859482 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:43.858925    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a26df0a-3a34-432b-88e5-985dcaf0f7ff-workload-socket\") pod \"e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d-bwrbf\" (UID: \"1a26df0a-3a34-432b-88e5-985dcaf0f7ff\") " pod="openshift-ingress/e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d-bwrbf"
Sep 18 22:14:43.878189 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:43.877659    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1a26df0a-3a34-432b-88e5-985dcaf0f7ff-istio-envoy\") pod \"e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d-bwrbf\" (UID: \"1a26df0a-3a34-432b-88e5-985dcaf0f7ff\") " pod="openshift-ingress/e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d-bwrbf"
Sep 18 22:14:43.878189 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:43.877798    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1a26df0a-3a34-432b-88e5-985dcaf0f7ff-istio-podinfo\") pod \"e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d-bwrbf\" (UID: \"1a26df0a-3a34-432b-88e5-985dcaf0f7ff\") " pod="openshift-ingress/e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d-bwrbf"
Sep 18 22:14:43.883012 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:43.882961    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqpds\" (UniqueName: \"kubernetes.io/projected/1a26df0a-3a34-432b-88e5-985dcaf0f7ff-kube-api-access-jqpds\") pod \"e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d-bwrbf\" (UID: \"1a26df0a-3a34-432b-88e5-985dcaf0f7ff\") " pod="openshift-ingress/e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d-bwrbf"
Sep 18 22:14:43.885681 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:43.885658    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a26df0a-3a34-432b-88e5-985dcaf0f7ff-istio-token\") pod \"e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d-bwrbf\" (UID: \"1a26df0a-3a34-432b-88e5-985dcaf0f7ff\") " pod="openshift-ingress/e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d-bwrbf"
Sep 18 22:14:44.015057 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:44.014963    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d-bwrbf"
Sep 18 22:14:44.362364 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:44.362326    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d-bwrbf"]
Sep 18 22:14:44.366920 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:14:44.366888    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a26df0a_3a34_432b_88e5_985dcaf0f7ff.slice/crio-9f63f48864ead2afb4a7e930dc9d6bb4f9665f85ed16e2cbaaae1ea250f02bfe WatchSource:0}: Error finding container 9f63f48864ead2afb4a7e930dc9d6bb4f9665f85ed16e2cbaaae1ea250f02bfe: Status 404 returned error can't find the container with id 9f63f48864ead2afb4a7e930dc9d6bb4f9665f85ed16e2cbaaae1ea250f02bfe
Sep 18 22:14:44.369495 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:44.369450    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:14:44.369591 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:44.369546    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:14:44.369631 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:44.369596    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:14:44.815221 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:44.815181    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d-bwrbf" event={"ID":"1a26df0a-3a34-432b-88e5-985dcaf0f7ff","Type":"ContainerStarted","Data":"ddc8c9f6d6e53ad07e9d83aabf8b41f3ac847a6c146124d8c3552a655d5cece6"}
Sep 18 22:14:44.815402 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:44.815254    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d-bwrbf" event={"ID":"1a26df0a-3a34-432b-88e5-985dcaf0f7ff","Type":"ContainerStarted","Data":"9f63f48864ead2afb4a7e930dc9d6bb4f9665f85ed16e2cbaaae1ea250f02bfe"}
Sep 18 22:14:44.876936 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:44.876872    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d-bwrbf" podStartSLOduration=1.876850595 podStartE2EDuration="1.876850595s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:14:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:14:44.87582869 +0000 UTC m=+864.195500749" watchObservedRunningTime="2026-09-18 22:14:44.876850595 +0000 UTC m=+864.196522683"
Sep 18 22:14:45.016045 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:45.016018    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d-bwrbf"
Sep 18 22:14:45.022625 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:45.022592    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d-bwrbf"
Sep 18 22:14:45.142952 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:45.142855    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11cbbb23-ce3e-46f6-a448-4fff4e8975c0" path="/var/lib/kubelet/pods/11cbbb23-ce3e-46f6-a448-4fff4e8975c0/volumes"
Sep 18 22:14:45.824049 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:45.824018    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d-bwrbf"
Sep 18 22:14:45.825180 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:45.825152    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d-bwrbf"
Sep 18 22:14:47.597093 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:47.597065    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-82b6dcec-openshift-default-844946c46-5s98v"
Sep 18 22:14:47.706049 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:47.705201    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bfdfcfc7-867a-458b-a2af-dd4928659ae0-istio-token\") pod \"bfdfcfc7-867a-458b-a2af-dd4928659ae0\" (UID: \"bfdfcfc7-867a-458b-a2af-dd4928659ae0\") "
Sep 18 22:14:47.706049 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:47.705248    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bfdfcfc7-867a-458b-a2af-dd4928659ae0-istio-envoy\") pod \"bfdfcfc7-867a-458b-a2af-dd4928659ae0\" (UID: \"bfdfcfc7-867a-458b-a2af-dd4928659ae0\") "
Sep 18 22:14:47.706049 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:47.705308    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bfdfcfc7-867a-458b-a2af-dd4928659ae0-credential-socket\") pod \"bfdfcfc7-867a-458b-a2af-dd4928659ae0\" (UID: \"bfdfcfc7-867a-458b-a2af-dd4928659ae0\") "
Sep 18 22:14:47.706049 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:47.705392    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bfdfcfc7-867a-458b-a2af-dd4928659ae0-istio-data\") pod \"bfdfcfc7-867a-458b-a2af-dd4928659ae0\" (UID: \"bfdfcfc7-867a-458b-a2af-dd4928659ae0\") "
Sep 18 22:14:47.706049 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:47.705461    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bfdfcfc7-867a-458b-a2af-dd4928659ae0-istiod-ca-cert\") pod \"bfdfcfc7-867a-458b-a2af-dd4928659ae0\" (UID: \"bfdfcfc7-867a-458b-a2af-dd4928659ae0\") "
Sep 18 22:14:47.706049 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:47.705510    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bfdfcfc7-867a-458b-a2af-dd4928659ae0-workload-certs\") pod \"bfdfcfc7-867a-458b-a2af-dd4928659ae0\" (UID: \"bfdfcfc7-867a-458b-a2af-dd4928659ae0\") "
Sep 18 22:14:47.706049 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:47.705537    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qkjzm\" (UniqueName: \"kubernetes.io/projected/bfdfcfc7-867a-458b-a2af-dd4928659ae0-kube-api-access-qkjzm\") pod \"bfdfcfc7-867a-458b-a2af-dd4928659ae0\" (UID: \"bfdfcfc7-867a-458b-a2af-dd4928659ae0\") "
Sep 18 22:14:47.706049 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:47.705566    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bfdfcfc7-867a-458b-a2af-dd4928659ae0-workload-socket\") pod \"bfdfcfc7-867a-458b-a2af-dd4928659ae0\" (UID: \"bfdfcfc7-867a-458b-a2af-dd4928659ae0\") "
Sep 18 22:14:47.706049 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:47.705598    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bfdfcfc7-867a-458b-a2af-dd4928659ae0-istio-podinfo\") pod \"bfdfcfc7-867a-458b-a2af-dd4928659ae0\" (UID: \"bfdfcfc7-867a-458b-a2af-dd4928659ae0\") "
Sep 18 22:14:47.706049 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:47.705874    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bfdfcfc7-867a-458b-a2af-dd4928659ae0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "bfdfcfc7-867a-458b-a2af-dd4928659ae0" (UID: "bfdfcfc7-867a-458b-a2af-dd4928659ae0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:14:47.706049 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:47.706052    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bfdfcfc7-867a-458b-a2af-dd4928659ae0-istiod-ca-cert\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:14:47.706753 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:47.706209    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfdfcfc7-867a-458b-a2af-dd4928659ae0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "bfdfcfc7-867a-458b-a2af-dd4928659ae0" (UID: "bfdfcfc7-867a-458b-a2af-dd4928659ae0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:14:47.706753 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:47.706227    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfdfcfc7-867a-458b-a2af-dd4928659ae0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "bfdfcfc7-867a-458b-a2af-dd4928659ae0" (UID: "bfdfcfc7-867a-458b-a2af-dd4928659ae0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:14:47.706753 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:47.706348    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfdfcfc7-867a-458b-a2af-dd4928659ae0-istio-data" (OuterVolumeSpecName: "istio-data") pod "bfdfcfc7-867a-458b-a2af-dd4928659ae0" (UID: "bfdfcfc7-867a-458b-a2af-dd4928659ae0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:14:47.706753 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:47.706534    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfdfcfc7-867a-458b-a2af-dd4928659ae0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "bfdfcfc7-867a-458b-a2af-dd4928659ae0" (UID: "bfdfcfc7-867a-458b-a2af-dd4928659ae0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:14:47.708462 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:47.708386    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfdfcfc7-867a-458b-a2af-dd4928659ae0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "bfdfcfc7-867a-458b-a2af-dd4928659ae0" (UID: "bfdfcfc7-867a-458b-a2af-dd4928659ae0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:14:47.708462 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:47.708401    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bfdfcfc7-867a-458b-a2af-dd4928659ae0-istio-token" (OuterVolumeSpecName: "istio-token") pod "bfdfcfc7-867a-458b-a2af-dd4928659ae0" (UID: "bfdfcfc7-867a-458b-a2af-dd4928659ae0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:14:47.708661 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:47.708641    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bfdfcfc7-867a-458b-a2af-dd4928659ae0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "bfdfcfc7-867a-458b-a2af-dd4928659ae0" (UID: "bfdfcfc7-867a-458b-a2af-dd4928659ae0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 18 22:14:47.709337 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:47.709204    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bfdfcfc7-867a-458b-a2af-dd4928659ae0-kube-api-access-qkjzm" (OuterVolumeSpecName: "kube-api-access-qkjzm") pod "bfdfcfc7-867a-458b-a2af-dd4928659ae0" (UID: "bfdfcfc7-867a-458b-a2af-dd4928659ae0"). InnerVolumeSpecName "kube-api-access-qkjzm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:14:47.806776 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:47.806744    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bfdfcfc7-867a-458b-a2af-dd4928659ae0-credential-socket\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:14:47.806776 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:47.806771    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bfdfcfc7-867a-458b-a2af-dd4928659ae0-istio-data\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:14:47.806776 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:47.806779    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bfdfcfc7-867a-458b-a2af-dd4928659ae0-workload-certs\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:14:47.807010 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:47.806787    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qkjzm\" (UniqueName: \"kubernetes.io/projected/bfdfcfc7-867a-458b-a2af-dd4928659ae0-kube-api-access-qkjzm\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:14:47.807010 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:47.806795    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bfdfcfc7-867a-458b-a2af-dd4928659ae0-workload-socket\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:14:47.807010 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:47.806803    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bfdfcfc7-867a-458b-a2af-dd4928659ae0-istio-podinfo\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:14:47.807010 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:47.806812    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bfdfcfc7-867a-458b-a2af-dd4928659ae0-istio-token\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:14:47.807010 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:47.806820    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bfdfcfc7-867a-458b-a2af-dd4928659ae0-istio-envoy\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:14:47.839749 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:47.839715    2577 generic.go:356] "Generic (PLEG): container finished" podID="bfdfcfc7-867a-458b-a2af-dd4928659ae0" containerID="5e04668772a213db910f9576f289eeaffc76f53d2a402c25c1d2b311b3851e48" exitCode=0
Sep 18 22:14:47.839935 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:47.839765    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-82b6dcec-openshift-default-844946c46-5s98v"
Sep 18 22:14:47.839935 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:47.839799    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-82b6dcec-openshift-default-844946c46-5s98v" event={"ID":"bfdfcfc7-867a-458b-a2af-dd4928659ae0","Type":"ContainerDied","Data":"5e04668772a213db910f9576f289eeaffc76f53d2a402c25c1d2b311b3851e48"}
Sep 18 22:14:47.839935 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:47.839855    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-82b6dcec-openshift-default-844946c46-5s98v" event={"ID":"bfdfcfc7-867a-458b-a2af-dd4928659ae0","Type":"ContainerDied","Data":"603181f0b7648a08a367123a57ff80d4a1ac2670174233be26a0d38d4945bd71"}
Sep 18 22:14:47.839935 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:47.839870    2577 scope.go:117] "RemoveContainer" containerID="5e04668772a213db910f9576f289eeaffc76f53d2a402c25c1d2b311b3851e48"
Sep 18 22:14:47.841676 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:47.841652    2577 generic.go:356] "Generic (PLEG): container finished" podID="ebab4845-1c9a-483e-aff6-dc86da22da83" containerID="9799fb3f9703e6a782f1ef0077809c6e0a96f4d52c18b1ac3406b4b217f7bb5c" exitCode=0
Sep 18 22:14:47.841781 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:47.841740    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-ab559b-openshift-default-6b94d48488-hx84d" event={"ID":"ebab4845-1c9a-483e-aff6-dc86da22da83","Type":"ContainerDied","Data":"9799fb3f9703e6a782f1ef0077809c6e0a96f4d52c18b1ac3406b4b217f7bb5c"}
Sep 18 22:14:47.842241 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:47.842227    2577 scope.go:117] "RemoveContainer" containerID="9799fb3f9703e6a782f1ef0077809c6e0a96f4d52c18b1ac3406b4b217f7bb5c"
Sep 18 22:14:47.843563 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:47.843527    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:14:47.843651 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:47.843621    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:14:47.843698 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:47.843670    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:14:47.855525 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:47.855507    2577 scope.go:117] "RemoveContainer" containerID="5e04668772a213db910f9576f289eeaffc76f53d2a402c25c1d2b311b3851e48"
Sep 18 22:14:47.856277 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:14:47.856255    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e04668772a213db910f9576f289eeaffc76f53d2a402c25c1d2b311b3851e48\": container with ID starting with 5e04668772a213db910f9576f289eeaffc76f53d2a402c25c1d2b311b3851e48 not found: ID does not exist" containerID="5e04668772a213db910f9576f289eeaffc76f53d2a402c25c1d2b311b3851e48"
Sep 18 22:14:47.856366 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:47.856286    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e04668772a213db910f9576f289eeaffc76f53d2a402c25c1d2b311b3851e48"} err="failed to get container status \"5e04668772a213db910f9576f289eeaffc76f53d2a402c25c1d2b311b3851e48\": rpc error: code = NotFound desc = could not find container \"5e04668772a213db910f9576f289eeaffc76f53d2a402c25c1d2b311b3851e48\": container with ID starting with 5e04668772a213db910f9576f289eeaffc76f53d2a402c25c1d2b311b3851e48 not found: ID does not exist"
Sep 18 22:14:47.943986 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:47.943947    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-82b6dcec-openshift-default-844946c46-5s98v"]
Sep 18 22:14:47.957512 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:47.957395    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-82b6dcec-openshift-default-844946c46-5s98v"]
Sep 18 22:14:48.854646 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:48.854608    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-ab559b-openshift-default-6b94d48488-hx84d" event={"ID":"ebab4845-1c9a-483e-aff6-dc86da22da83","Type":"ContainerStarted","Data":"9cc60e2f7301a3081b664e7d3d955ad4373f027147827a69d3d5e9427256065b"}
Sep 18 22:14:49.140215 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:49.140128    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bfdfcfc7-867a-458b-a2af-dd4928659ae0" path="/var/lib/kubelet/pods/bfdfcfc7-867a-458b-a2af-dd4928659ae0/volumes"
Sep 18 22:14:49.301358 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:49.301322    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-ab559b-openshift-default-6b94d48488-hx84d"
Sep 18 22:14:49.302159 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:49.302139    2577 patch_prober.go:28] interesting pod/e2e-inf-b-ab559b-openshift-default-6b94d48488-hx84d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Sep 18 22:14:49.302215 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:49.302187    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-ab559b-openshift-default-6b94d48488-hx84d" podUID="ebab4845-1c9a-483e-aff6-dc86da22da83" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Sep 18 22:14:50.301859 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:50.301818    2577 patch_prober.go:28] interesting pod/e2e-inf-b-ab559b-openshift-default-6b94d48488-hx84d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Sep 18 22:14:50.302343 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:50.301884    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-ab559b-openshift-default-6b94d48488-hx84d" podUID="ebab4845-1c9a-483e-aff6-dc86da22da83" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Sep 18 22:14:51.301352 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:51.301314    2577 patch_prober.go:28] interesting pod/e2e-inf-b-ab559b-openshift-default-6b94d48488-hx84d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Sep 18 22:14:51.301553 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:51.301375    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-ab559b-openshift-default-6b94d48488-hx84d" podUID="ebab4845-1c9a-483e-aff6-dc86da22da83" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Sep 18 22:14:51.519565 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:51.519530    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-ab559b-openshift-default-6b94d48488-hx84d"
Sep 18 22:14:52.301927 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:52.301897    2577 patch_prober.go:28] interesting pod/e2e-inf-b-ab559b-openshift-default-6b94d48488-hx84d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Sep 18 22:14:52.302115 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:52.301952    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-ab559b-openshift-default-6b94d48488-hx84d" podUID="ebab4845-1c9a-483e-aff6-dc86da22da83" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Sep 18 22:14:53.302063 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:53.302025    2577 patch_prober.go:28] interesting pod/e2e-inf-b-ab559b-openshift-default-6b94d48488-hx84d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Sep 18 22:14:53.302579 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:53.302093    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-ab559b-openshift-default-6b94d48488-hx84d" podUID="ebab4845-1c9a-483e-aff6-dc86da22da83" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Sep 18 22:14:54.306103 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:54.306077    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-ab559b-openshift-default-6b94d48488-hx84d"
Sep 18 22:14:54.307530 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:14:54.307505    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-ab559b-openshift-default-6b94d48488-hx84d"
Sep 18 22:15:00.157167 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:00.157127    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-ab559b-29829495-42rhv"]
Sep 18 22:15:00.157612 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:00.157598    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfdfcfc7-867a-458b-a2af-dd4928659ae0" containerName="istio-proxy"
Sep 18 22:15:00.157657 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:00.157613    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfdfcfc7-867a-458b-a2af-dd4928659ae0" containerName="istio-proxy"
Sep 18 22:15:00.157696 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:00.157688    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="bfdfcfc7-867a-458b-a2af-dd4928659ae0" containerName="istio-proxy"
Sep 18 22:15:00.159851 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:00.159835    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-ab559b-29829495-42rhv"
Sep 18 22:15:00.165204 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:00.165178    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-9g7m4\""
Sep 18 22:15:00.166144 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:00.166118    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-59b357-29829495-vx8qx"]
Sep 18 22:15:00.169128 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:00.169104    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-59b357-29829495-vx8qx"
Sep 18 22:15:00.170953 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:00.170928    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-autores-0ffe43-29829495-c55w9"]
Sep 18 22:15:00.173732 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:00.173712    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-autores-0ffe43-29829495-c55w9"
Sep 18 22:15:00.174036 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:00.174015    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-ab559b-29829495-42rhv"]
Sep 18 22:15:00.174592 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:00.174571    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-ab559b-29829495-42rhv"
Sep 18 22:15:00.181614 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:00.181585    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-59b357-29829495-vx8qx"]
Sep 18 22:15:00.187680 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:00.187653    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-autores-0ffe43-29829495-c55w9"]
Sep 18 22:15:00.194316 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:00.194290    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-59b357-29829495-vx8qx"
Sep 18 22:15:00.206844 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:00.206817    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a13357-29829495-z7zgj"]
Sep 18 22:15:00.211009 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:00.210777    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a13357-29829495-z7zgj"
Sep 18 22:15:00.226859 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:00.226641    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-autores-0ffe43-29829495-c55w9"
Sep 18 22:15:00.257661 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:00.257612    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a13357-29829495-z7zgj"
Sep 18 22:15:00.261470 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:00.260625    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a13357-29829495-z7zgj"]
Sep 18 22:15:00.501805 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:00.501778    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-59b357-29829495-vx8qx"]
Sep 18 22:15:00.503635 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:15:00.503529    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a2f0aa1_ad17_42fa_b5eb_e25f2942963e.slice/crio-7c3a0ec92d63bf78908a16d4b1ff92bfa958ce40f325b480e7c166b44bd2145c WatchSource:0}: Error finding container 7c3a0ec92d63bf78908a16d4b1ff92bfa958ce40f325b480e7c166b44bd2145c: Status 404 returned error can't find the container with id 7c3a0ec92d63bf78908a16d4b1ff92bfa958ce40f325b480e7c166b44bd2145c
Sep 18 22:15:00.507764 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:00.507741    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-ab559b-29829495-42rhv"]
Sep 18 22:15:00.508896 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:15:00.508820    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f9cb321_ccf0_4cb8_b3d7_c8ea27f032df.slice/crio-12bfd187397dc9f1c9c04cc6863097455d4ec4b7514d188be3d657c4b89b84d1 WatchSource:0}: Error finding container 12bfd187397dc9f1c9c04cc6863097455d4ec4b7514d188be3d657c4b89b84d1: Status 404 returned error can't find the container with id 12bfd187397dc9f1c9c04cc6863097455d4ec4b7514d188be3d657c4b89b84d1
Sep 18 22:15:00.576825 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:00.576792    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-autores-0ffe43-29829495-c55w9"]
Sep 18 22:15:00.577483 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:15:00.577429    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a07f9fd_9d7c_4ed7_907b_238c7a72981e.slice/crio-ab71a7a563207087bd1ad071ff551a16d6c9fd0474eeff13a4616d2c3ec5b1a1 WatchSource:0}: Error finding container ab71a7a563207087bd1ad071ff551a16d6c9fd0474eeff13a4616d2c3ec5b1a1: Status 404 returned error can't find the container with id ab71a7a563207087bd1ad071ff551a16d6c9fd0474eeff13a4616d2c3ec5b1a1
Sep 18 22:15:00.591780 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:00.591756    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a13357-29829495-z7zgj"]
Sep 18 22:15:00.591876 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:15:00.591833    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2b1f0a4_fe83_4c26_9c1b_452b67bb0f86.slice/crio-dbb2f1ea3fde91b8588027acc53599582816666d9130deeeb3a5af3b46729a3e WatchSource:0}: Error finding container dbb2f1ea3fde91b8588027acc53599582816666d9130deeeb3a5af3b46729a3e: Status 404 returned error can't find the container with id dbb2f1ea3fde91b8588027acc53599582816666d9130deeeb3a5af3b46729a3e
Sep 18 22:15:00.953740 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:00.953702    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-autores-0ffe43-29829495-c55w9" event={"ID":"7a07f9fd-9d7c-4ed7-907b-238c7a72981e","Type":"ContainerStarted","Data":"ab71a7a563207087bd1ad071ff551a16d6c9fd0474eeff13a4616d2c3ec5b1a1"}
Sep 18 22:15:00.955084 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:00.955054    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-59b357-29829495-vx8qx" event={"ID":"5a2f0aa1-ad17-42fa-b5eb-e25f2942963e","Type":"ContainerStarted","Data":"7c3a0ec92d63bf78908a16d4b1ff92bfa958ce40f325b480e7c166b44bd2145c"}
Sep 18 22:15:00.956449 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:00.956423    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a13357-29829495-z7zgj" event={"ID":"c2b1f0a4-fe83-4c26-9c1b-452b67bb0f86","Type":"ContainerStarted","Data":"dbb2f1ea3fde91b8588027acc53599582816666d9130deeeb3a5af3b46729a3e"}
Sep 18 22:15:00.957775 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:00.957751    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-ab559b-29829495-42rhv" event={"ID":"5f9cb321-ccf0-4cb8-b3d7-c8ea27f032df","Type":"ContainerStarted","Data":"12bfd187397dc9f1c9c04cc6863097455d4ec4b7514d188be3d657c4b89b84d1"}
Sep 18 22:15:04.015484 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:04.015361    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-59b357-29829495-vx8qx" event={"ID":"5a2f0aa1-ad17-42fa-b5eb-e25f2942963e","Type":"ContainerStarted","Data":"caccbf94c5a96a975e1976ffa6b14be849a4e94076f7f48bfc80fd3b09fc07e3"}
Sep 18 22:15:04.017791 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:04.017759    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a13357-29829495-z7zgj" event={"ID":"c2b1f0a4-fe83-4c26-9c1b-452b67bb0f86","Type":"ContainerStarted","Data":"faafaecd600e77dfd2888985dcfed8ae76a7e8f7c1d1ae070ee99e48c5f7c5db"}
Sep 18 22:15:04.020469 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:04.020402    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-ab559b-29829495-42rhv" event={"ID":"5f9cb321-ccf0-4cb8-b3d7-c8ea27f032df","Type":"ContainerStarted","Data":"fce87f650812386f1b3be7b727eed17d33faf0f32e38c7088d849699babe16b0"}
Sep 18 22:15:04.022051 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:04.022030    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-autores-0ffe43-29829495-c55w9" event={"ID":"7a07f9fd-9d7c-4ed7-907b-238c7a72981e","Type":"ContainerStarted","Data":"d12c943a9aa764811851702d58827c53ade3d6dfa41ca402a1ef4aff91ad518e"}
Sep 18 22:15:04.052450 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:04.047170    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-59b357-29829495-vx8qx" podStartSLOduration=1.421871403 podStartE2EDuration="4.047147033s" totalImagesPullingTime="2.62527563s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:15:04.044895636 +0000 UTC m=+883.364567690" watchObservedRunningTime="2026-09-18 22:15:04.047147033 +0000 UTC m=+883.366819090"
Sep 18 22:15:04.070514 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:04.070354    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-autores-0ffe43-29829495-c55w9" podStartSLOduration=1.498068932 podStartE2EDuration="4.070333775s" totalImagesPullingTime="2.572264843s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:15:04.064232675 +0000 UTC m=+883.383904731" watchObservedRunningTime="2026-09-18 22:15:04.070333775 +0000 UTC m=+883.390005831"
Sep 18 22:15:04.087072 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:04.086995    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a13357-29829495-z7zgj" podStartSLOduration=1.536633584 podStartE2EDuration="4.086972551s" totalImagesPullingTime="2.550338967s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:15:04.080904627 +0000 UTC m=+883.400576674" watchObservedRunningTime="2026-09-18 22:15:04.086972551 +0000 UTC m=+883.406644609"
Sep 18 22:15:04.098692 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:04.098620    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-ab559b-29829495-42rhv" podStartSLOduration=1.464372347 podStartE2EDuration="4.098600193s" totalImagesPullingTime="2.634227846s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:15:04.095336209 +0000 UTC m=+883.415008274" watchObservedRunningTime="2026-09-18 22:15:04.098600193 +0000 UTC m=+883.418272251"
Sep 18 22:15:05.029678 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:05.029599    2577 generic.go:356] "Generic (PLEG): container finished" podID="7a07f9fd-9d7c-4ed7-907b-238c7a72981e" containerID="d12c943a9aa764811851702d58827c53ade3d6dfa41ca402a1ef4aff91ad518e" exitCode=0
Sep 18 22:15:05.030076 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:05.029682    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-autores-0ffe43-29829495-c55w9" event={"ID":"7a07f9fd-9d7c-4ed7-907b-238c7a72981e","Type":"ContainerDied","Data":"d12c943a9aa764811851702d58827c53ade3d6dfa41ca402a1ef4aff91ad518e"}
Sep 18 22:15:05.031433 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:05.031386    2577 generic.go:356] "Generic (PLEG): container finished" podID="5a2f0aa1-ad17-42fa-b5eb-e25f2942963e" containerID="caccbf94c5a96a975e1976ffa6b14be849a4e94076f7f48bfc80fd3b09fc07e3" exitCode=0
Sep 18 22:15:05.031563 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:05.031429    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-59b357-29829495-vx8qx" event={"ID":"5a2f0aa1-ad17-42fa-b5eb-e25f2942963e","Type":"ContainerDied","Data":"caccbf94c5a96a975e1976ffa6b14be849a4e94076f7f48bfc80fd3b09fc07e3"}
Sep 18 22:15:05.033070 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:05.033041    2577 generic.go:356] "Generic (PLEG): container finished" podID="c2b1f0a4-fe83-4c26-9c1b-452b67bb0f86" containerID="faafaecd600e77dfd2888985dcfed8ae76a7e8f7c1d1ae070ee99e48c5f7c5db" exitCode=0
Sep 18 22:15:05.033165 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:05.033128    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a13357-29829495-z7zgj" event={"ID":"c2b1f0a4-fe83-4c26-9c1b-452b67bb0f86","Type":"ContainerDied","Data":"faafaecd600e77dfd2888985dcfed8ae76a7e8f7c1d1ae070ee99e48c5f7c5db"}
Sep 18 22:15:05.034950 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:05.034931    2577 generic.go:356] "Generic (PLEG): container finished" podID="5f9cb321-ccf0-4cb8-b3d7-c8ea27f032df" containerID="fce87f650812386f1b3be7b727eed17d33faf0f32e38c7088d849699babe16b0" exitCode=0
Sep 18 22:15:05.035040 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:05.035020    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-ab559b-29829495-42rhv" event={"ID":"5f9cb321-ccf0-4cb8-b3d7-c8ea27f032df","Type":"ContainerDied","Data":"fce87f650812386f1b3be7b727eed17d33faf0f32e38c7088d849699babe16b0"}
Sep 18 22:15:06.292018 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:06.291855    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a13357-29829495-z7zgj"
Sep 18 22:15:06.380084 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:06.380053    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-ab559b-29829495-42rhv"
Sep 18 22:15:06.385001 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:06.384976    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-59b357-29829495-vx8qx"
Sep 18 22:15:06.388471 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:06.388406    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-autores-0ffe43-29829495-c55w9"
Sep 18 22:15:07.058435 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:07.052727    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-autores-0ffe43-29829495-c55w9" event={"ID":"7a07f9fd-9d7c-4ed7-907b-238c7a72981e","Type":"ContainerDied","Data":"ab71a7a563207087bd1ad071ff551a16d6c9fd0474eeff13a4616d2c3ec5b1a1"}
Sep 18 22:15:07.058435 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:07.052786    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ab71a7a563207087bd1ad071ff551a16d6c9fd0474eeff13a4616d2c3ec5b1a1"
Sep 18 22:15:07.058435 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:07.052862    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-autores-0ffe43-29829495-c55w9"
Sep 18 22:15:07.070980 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:07.070936    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-59b357-29829495-vx8qx" event={"ID":"5a2f0aa1-ad17-42fa-b5eb-e25f2942963e","Type":"ContainerDied","Data":"7c3a0ec92d63bf78908a16d4b1ff92bfa958ce40f325b480e7c166b44bd2145c"}
Sep 18 22:15:07.071149 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:07.071007    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7c3a0ec92d63bf78908a16d4b1ff92bfa958ce40f325b480e7c166b44bd2145c"
Sep 18 22:15:07.071149 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:07.071086    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-59b357-29829495-vx8qx"
Sep 18 22:15:07.077778 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:07.077732    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a13357-29829495-z7zgj" event={"ID":"c2b1f0a4-fe83-4c26-9c1b-452b67bb0f86","Type":"ContainerDied","Data":"dbb2f1ea3fde91b8588027acc53599582816666d9130deeeb3a5af3b46729a3e"}
Sep 18 22:15:07.077929 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:07.077796    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dbb2f1ea3fde91b8588027acc53599582816666d9130deeeb3a5af3b46729a3e"
Sep 18 22:15:07.077929 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:07.077742    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a13357-29829495-z7zgj"
Sep 18 22:15:07.079896 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:07.079657    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-ab559b-29829495-42rhv"
Sep 18 22:15:07.079896 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:07.079708    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-ab559b-29829495-42rhv" event={"ID":"5f9cb321-ccf0-4cb8-b3d7-c8ea27f032df","Type":"ContainerDied","Data":"12bfd187397dc9f1c9c04cc6863097455d4ec4b7514d188be3d657c4b89b84d1"}
Sep 18 22:15:07.079896 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:07.079747    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="12bfd187397dc9f1c9c04cc6863097455d4ec4b7514d188be3d657c4b89b84d1"
Sep 18 22:15:14.134804 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:14.134772    2577 generic.go:356] "Generic (PLEG): container finished" podID="1a26df0a-3a34-432b-88e5-985dcaf0f7ff" containerID="ddc8c9f6d6e53ad07e9d83aabf8b41f3ac847a6c146124d8c3552a655d5cece6" exitCode=0
Sep 18 22:15:14.135241 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:14.134831    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d-bwrbf" event={"ID":"1a26df0a-3a34-432b-88e5-985dcaf0f7ff","Type":"ContainerDied","Data":"ddc8c9f6d6e53ad07e9d83aabf8b41f3ac847a6c146124d8c3552a655d5cece6"}
Sep 18 22:15:14.135285 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:14.135276    2577 scope.go:117] "RemoveContainer" containerID="ddc8c9f6d6e53ad07e9d83aabf8b41f3ac847a6c146124d8c3552a655d5cece6"
Sep 18 22:15:14.136481 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:14.136453    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:15:14.136543 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:14.136522    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:15:14.136579 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:14.136554    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:15:15.142663 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:15.142630    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d-bwrbf" event={"ID":"1a26df0a-3a34-432b-88e5-985dcaf0f7ff","Type":"ContainerStarted","Data":"177b2e0d9cc2b89c15009927e7abcb17c808fe5d03ed4a8c5fa876eb02296d18"}
Sep 18 22:15:15.824067 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:15.824035    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d-bwrbf"
Sep 18 22:15:16.015332 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:16.015292    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d-bwrbf"
Sep 18 22:15:16.016585 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:16.016561    2577 patch_prober.go:28] interesting pod/e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d-bwrbf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Sep 18 22:15:16.016641 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:16.016612    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d-bwrbf" podUID="1a26df0a-3a34-432b-88e5-985dcaf0f7ff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Sep 18 22:15:17.015731 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:17.015692    2577 patch_prober.go:28] interesting pod/e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d-bwrbf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Sep 18 22:15:17.016172 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:17.015747    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d-bwrbf" podUID="1a26df0a-3a34-432b-88e5-985dcaf0f7ff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Sep 18 22:15:18.016364 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:18.016332    2577 patch_prober.go:28] interesting pod/e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d-bwrbf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Sep 18 22:15:18.016876 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:18.016546    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d-bwrbf" podUID="1a26df0a-3a34-432b-88e5-985dcaf0f7ff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Sep 18 22:15:19.016094 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:19.016055    2577 patch_prober.go:28] interesting pod/e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d-bwrbf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Sep 18 22:15:19.016276 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:19.016138    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d-bwrbf" podUID="1a26df0a-3a34-432b-88e5-985dcaf0f7ff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Sep 18 22:15:20.015852 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:20.015815    2577 patch_prober.go:28] interesting pod/e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d-bwrbf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Sep 18 22:15:20.016310 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:20.015873    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d-bwrbf" podUID="1a26df0a-3a34-432b-88e5-985dcaf0f7ff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Sep 18 22:15:21.015692 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:21.015642    2577 patch_prober.go:28] interesting pod/e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d-bwrbf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Sep 18 22:15:21.015872 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:21.015726    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d-bwrbf" podUID="1a26df0a-3a34-432b-88e5-985dcaf0f7ff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Sep 18 22:15:21.117113 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:21.117082    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-h2847_125d5bb0-54b7-4dff-aa80-e737f2791533/console-operator/1.log"
Sep 18 22:15:21.117382 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:21.117364    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-h2847_125d5bb0-54b7-4dff-aa80-e737f2791533/console-operator/1.log"
Sep 18 22:15:21.644104 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:21.644074    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8ed3d70b-7h2bw"]
Sep 18 22:15:21.644666 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:21.644647    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a07f9fd-9d7c-4ed7-907b-238c7a72981e" containerName="cleanup"
Sep 18 22:15:21.644782 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:21.644668    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a07f9fd-9d7c-4ed7-907b-238c7a72981e" containerName="cleanup"
Sep 18 22:15:21.644782 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:21.644681    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f9cb321-ccf0-4cb8-b3d7-c8ea27f032df" containerName="cleanup"
Sep 18 22:15:21.644782 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:21.644691    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f9cb321-ccf0-4cb8-b3d7-c8ea27f032df" containerName="cleanup"
Sep 18 22:15:21.644782 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:21.644709    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2b1f0a4-fe83-4c26-9c1b-452b67bb0f86" containerName="cleanup"
Sep 18 22:15:21.644782 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:21.644717    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2b1f0a4-fe83-4c26-9c1b-452b67bb0f86" containerName="cleanup"
Sep 18 22:15:21.644782 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:21.644729    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a2f0aa1-ad17-42fa-b5eb-e25f2942963e" containerName="cleanup"
Sep 18 22:15:21.644782 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:21.644738    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a2f0aa1-ad17-42fa-b5eb-e25f2942963e" containerName="cleanup"
Sep 18 22:15:21.645146 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:21.644861    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f9cb321-ccf0-4cb8-b3d7-c8ea27f032df" containerName="cleanup"
Sep 18 22:15:21.645146 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:21.644877    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a2f0aa1-ad17-42fa-b5eb-e25f2942963e" containerName="cleanup"
Sep 18 22:15:21.645146 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:21.644885    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a07f9fd-9d7c-4ed7-907b-238c7a72981e" containerName="cleanup"
Sep 18 22:15:21.645146 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:21.644894    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2b1f0a4-fe83-4c26-9c1b-452b67bb0f86" containerName="cleanup"
Sep 18 22:15:21.651876 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:21.651853    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8ed3d70b-7h2bw"
Sep 18 22:15:21.654881 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:21.654859    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-9g7m4\""
Sep 18 22:15:21.666070 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:21.666043    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8ed3d70b-7h2bw"]
Sep 18 22:15:21.716838 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:21.716805    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f1c0f2a-f47f-4c42-922a-c7694833afbb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-8ed3d70b-7h2bw\" (UID: \"7f1c0f2a-f47f-4c42-922a-c7694833afbb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8ed3d70b-7h2bw"
Sep 18 22:15:21.817509 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:21.817471    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f1c0f2a-f47f-4c42-922a-c7694833afbb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-8ed3d70b-7h2bw\" (UID: \"7f1c0f2a-f47f-4c42-922a-c7694833afbb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8ed3d70b-7h2bw"
Sep 18 22:15:21.818063 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:21.818043    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f1c0f2a-f47f-4c42-922a-c7694833afbb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-8ed3d70b-7h2bw\" (UID: \"7f1c0f2a-f47f-4c42-922a-c7694833afbb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8ed3d70b-7h2bw"
Sep 18 22:15:21.961922 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:21.961836    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8ed3d70b-7h2bw"
Sep 18 22:15:22.033803 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:22.025563    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d-bwrbf"
Sep 18 22:15:22.033803 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:22.030109    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d-bwrbf"
Sep 18 22:15:22.246878 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:22.245670    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8ed3d70b-7h2bw"]
Sep 18 22:15:22.246878 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:15:22.246870    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f1c0f2a_f47f_4c42_922a_c7694833afbb.slice/crio-2fca295425e18a5112b71e8b7f92a50a8f824173c85cae0b5eabd5dea892de15 WatchSource:0}: Error finding container 2fca295425e18a5112b71e8b7f92a50a8f824173c85cae0b5eabd5dea892de15: Status 404 returned error can't find the container with id 2fca295425e18a5112b71e8b7f92a50a8f824173c85cae0b5eabd5dea892de15
Sep 18 22:15:23.217673 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:23.217586    2577 generic.go:356] "Generic (PLEG): container finished" podID="7f1c0f2a-f47f-4c42-922a-c7694833afbb" containerID="3ff20f1d8ff9b5a221aa0d3a5b540119afd2bd04dae4d52e288decd9f0856d99" exitCode=0
Sep 18 22:15:23.217673 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:23.217657    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8ed3d70b-7h2bw" event={"ID":"7f1c0f2a-f47f-4c42-922a-c7694833afbb","Type":"ContainerDied","Data":"3ff20f1d8ff9b5a221aa0d3a5b540119afd2bd04dae4d52e288decd9f0856d99"}
Sep 18 22:15:23.218067 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:23.217703    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8ed3d70b-7h2bw" event={"ID":"7f1c0f2a-f47f-4c42-922a-c7694833afbb","Type":"ContainerStarted","Data":"2fca295425e18a5112b71e8b7f92a50a8f824173c85cae0b5eabd5dea892de15"}
Sep 18 22:15:24.379363 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:24.379333    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8ed3d70b-7h2bw"
Sep 18 22:15:24.451849 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:24.451814    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f1c0f2a-f47f-4c42-922a-c7694833afbb-maas-api-service-ca\") pod \"7f1c0f2a-f47f-4c42-922a-c7694833afbb\" (UID: \"7f1c0f2a-f47f-4c42-922a-c7694833afbb\") "
Sep 18 22:15:24.452163 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:24.452139    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f1c0f2a-f47f-4c42-922a-c7694833afbb-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7f1c0f2a-f47f-4c42-922a-c7694833afbb" (UID: "7f1c0f2a-f47f-4c42-922a-c7694833afbb"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:15:24.552651 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:24.552570    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f1c0f2a-f47f-4c42-922a-c7694833afbb-maas-api-service-ca\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:15:25.237620 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:25.237591    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8ed3d70b-7h2bw"
Sep 18 22:15:25.237620 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:25.237610    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8ed3d70b-7h2bw" event={"ID":"7f1c0f2a-f47f-4c42-922a-c7694833afbb","Type":"ContainerDied","Data":"2fca295425e18a5112b71e8b7f92a50a8f824173c85cae0b5eabd5dea892de15"}
Sep 18 22:15:25.237945 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:25.237655    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2fca295425e18a5112b71e8b7f92a50a8f824173c85cae0b5eabd5dea892de15"
Sep 18 22:15:32.942624 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:32.942584    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8ed3d70b-7h2bw"]
Sep 18 22:15:32.945352 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:32.945306    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8ed3d70b-7h2bw"]
Sep 18 22:15:33.086982 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:33.086949    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d-bwrbf"]
Sep 18 22:15:33.087239 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:33.087197    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d-bwrbf" podUID="1a26df0a-3a34-432b-88e5-985dcaf0f7ff" containerName="istio-proxy" containerID="cri-o://177b2e0d9cc2b89c15009927e7abcb17c808fe5d03ed4a8c5fa876eb02296d18" gracePeriod=30
Sep 18 22:15:33.140643 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:33.140610    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f1c0f2a-f47f-4c42-922a-c7694833afbb" path="/var/lib/kubelet/pods/7f1c0f2a-f47f-4c42-922a-c7694833afbb/volumes"
Sep 18 22:15:33.861611 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:33.861575    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-0144e4de-openshift-default-86cb848f5d-wrgv9"]
Sep 18 22:15:33.862090 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:33.862072    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f1c0f2a-f47f-4c42-922a-c7694833afbb" containerName="revoke-keys"
Sep 18 22:15:33.862194 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:33.862094    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f1c0f2a-f47f-4c42-922a-c7694833afbb" containerName="revoke-keys"
Sep 18 22:15:33.862275 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:33.862247    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f1c0f2a-f47f-4c42-922a-c7694833afbb" containerName="revoke-keys"
Sep 18 22:15:33.865997 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:33.865976    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0144e4de-openshift-default-86cb848f5d-wrgv9"
Sep 18 22:15:33.868339 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:33.868319    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-0144e4de-openshift-default-dockercfg-cd5zn\""
Sep 18 22:15:33.885008 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:33.884986    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-0144e4de-openshift-default-86cb848f5d-wrgv9"]
Sep 18 22:15:33.950855 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:33.950808    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c25c0be-6d0f-4c0d-8973-4e509c720484-credential-socket\") pod \"e2e-ait-0144e4de-openshift-default-86cb848f5d-wrgv9\" (UID: \"4c25c0be-6d0f-4c0d-8973-4e509c720484\") " pod="openshift-ingress/e2e-ait-0144e4de-openshift-default-86cb848f5d-wrgv9"
Sep 18 22:15:33.951367 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:33.950888    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c25c0be-6d0f-4c0d-8973-4e509c720484-istio-token\") pod \"e2e-ait-0144e4de-openshift-default-86cb848f5d-wrgv9\" (UID: \"4c25c0be-6d0f-4c0d-8973-4e509c720484\") " pod="openshift-ingress/e2e-ait-0144e4de-openshift-default-86cb848f5d-wrgv9"
Sep 18 22:15:33.951367 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:33.950919    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhww6\" (UniqueName: \"kubernetes.io/projected/4c25c0be-6d0f-4c0d-8973-4e509c720484-kube-api-access-mhww6\") pod \"e2e-ait-0144e4de-openshift-default-86cb848f5d-wrgv9\" (UID: \"4c25c0be-6d0f-4c0d-8973-4e509c720484\") " pod="openshift-ingress/e2e-ait-0144e4de-openshift-default-86cb848f5d-wrgv9"
Sep 18 22:15:33.951367 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:33.950999    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c25c0be-6d0f-4c0d-8973-4e509c720484-istio-envoy\") pod \"e2e-ait-0144e4de-openshift-default-86cb848f5d-wrgv9\" (UID: \"4c25c0be-6d0f-4c0d-8973-4e509c720484\") " pod="openshift-ingress/e2e-ait-0144e4de-openshift-default-86cb848f5d-wrgv9"
Sep 18 22:15:33.951367 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:33.951027    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c25c0be-6d0f-4c0d-8973-4e509c720484-istio-data\") pod \"e2e-ait-0144e4de-openshift-default-86cb848f5d-wrgv9\" (UID: \"4c25c0be-6d0f-4c0d-8973-4e509c720484\") " pod="openshift-ingress/e2e-ait-0144e4de-openshift-default-86cb848f5d-wrgv9"
Sep 18 22:15:33.951367 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:33.951065    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c25c0be-6d0f-4c0d-8973-4e509c720484-istio-podinfo\") pod \"e2e-ait-0144e4de-openshift-default-86cb848f5d-wrgv9\" (UID: \"4c25c0be-6d0f-4c0d-8973-4e509c720484\") " pod="openshift-ingress/e2e-ait-0144e4de-openshift-default-86cb848f5d-wrgv9"
Sep 18 22:15:33.951367 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:33.951097    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c25c0be-6d0f-4c0d-8973-4e509c720484-workload-certs\") pod \"e2e-ait-0144e4de-openshift-default-86cb848f5d-wrgv9\" (UID: \"4c25c0be-6d0f-4c0d-8973-4e509c720484\") " pod="openshift-ingress/e2e-ait-0144e4de-openshift-default-86cb848f5d-wrgv9"
Sep 18 22:15:33.951367 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:33.951146    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c25c0be-6d0f-4c0d-8973-4e509c720484-workload-socket\") pod \"e2e-ait-0144e4de-openshift-default-86cb848f5d-wrgv9\" (UID: \"4c25c0be-6d0f-4c0d-8973-4e509c720484\") " pod="openshift-ingress/e2e-ait-0144e4de-openshift-default-86cb848f5d-wrgv9"
Sep 18 22:15:33.951367 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:33.951207    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c25c0be-6d0f-4c0d-8973-4e509c720484-istiod-ca-cert\") pod \"e2e-ait-0144e4de-openshift-default-86cb848f5d-wrgv9\" (UID: \"4c25c0be-6d0f-4c0d-8973-4e509c720484\") " pod="openshift-ingress/e2e-ait-0144e4de-openshift-default-86cb848f5d-wrgv9"
Sep 18 22:15:34.051815 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:34.051773    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c25c0be-6d0f-4c0d-8973-4e509c720484-istio-podinfo\") pod \"e2e-ait-0144e4de-openshift-default-86cb848f5d-wrgv9\" (UID: \"4c25c0be-6d0f-4c0d-8973-4e509c720484\") " pod="openshift-ingress/e2e-ait-0144e4de-openshift-default-86cb848f5d-wrgv9"
Sep 18 22:15:34.052027 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:34.051822    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c25c0be-6d0f-4c0d-8973-4e509c720484-workload-certs\") pod \"e2e-ait-0144e4de-openshift-default-86cb848f5d-wrgv9\" (UID: \"4c25c0be-6d0f-4c0d-8973-4e509c720484\") " pod="openshift-ingress/e2e-ait-0144e4de-openshift-default-86cb848f5d-wrgv9"
Sep 18 22:15:34.052027 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:34.051862    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c25c0be-6d0f-4c0d-8973-4e509c720484-workload-socket\") pod \"e2e-ait-0144e4de-openshift-default-86cb848f5d-wrgv9\" (UID: \"4c25c0be-6d0f-4c0d-8973-4e509c720484\") " pod="openshift-ingress/e2e-ait-0144e4de-openshift-default-86cb848f5d-wrgv9"
Sep 18 22:15:34.052027 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:34.051907    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c25c0be-6d0f-4c0d-8973-4e509c720484-istiod-ca-cert\") pod \"e2e-ait-0144e4de-openshift-default-86cb848f5d-wrgv9\" (UID: \"4c25c0be-6d0f-4c0d-8973-4e509c720484\") " pod="openshift-ingress/e2e-ait-0144e4de-openshift-default-86cb848f5d-wrgv9"
Sep 18 22:15:34.052027 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:34.051972    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c25c0be-6d0f-4c0d-8973-4e509c720484-credential-socket\") pod \"e2e-ait-0144e4de-openshift-default-86cb848f5d-wrgv9\" (UID: \"4c25c0be-6d0f-4c0d-8973-4e509c720484\") " pod="openshift-ingress/e2e-ait-0144e4de-openshift-default-86cb848f5d-wrgv9"
Sep 18 22:15:34.052027 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:34.052014    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c25c0be-6d0f-4c0d-8973-4e509c720484-istio-token\") pod \"e2e-ait-0144e4de-openshift-default-86cb848f5d-wrgv9\" (UID: \"4c25c0be-6d0f-4c0d-8973-4e509c720484\") " pod="openshift-ingress/e2e-ait-0144e4de-openshift-default-86cb848f5d-wrgv9"
Sep 18 22:15:34.052303 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:34.052038    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhww6\" (UniqueName: \"kubernetes.io/projected/4c25c0be-6d0f-4c0d-8973-4e509c720484-kube-api-access-mhww6\") pod \"e2e-ait-0144e4de-openshift-default-86cb848f5d-wrgv9\" (UID: \"4c25c0be-6d0f-4c0d-8973-4e509c720484\") " pod="openshift-ingress/e2e-ait-0144e4de-openshift-default-86cb848f5d-wrgv9"
Sep 18 22:15:34.052303 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:34.052112    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c25c0be-6d0f-4c0d-8973-4e509c720484-istio-envoy\") pod \"e2e-ait-0144e4de-openshift-default-86cb848f5d-wrgv9\" (UID: \"4c25c0be-6d0f-4c0d-8973-4e509c720484\") " pod="openshift-ingress/e2e-ait-0144e4de-openshift-default-86cb848f5d-wrgv9"
Sep 18 22:15:34.052303 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:34.052140    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c25c0be-6d0f-4c0d-8973-4e509c720484-istio-data\") pod \"e2e-ait-0144e4de-openshift-default-86cb848f5d-wrgv9\" (UID: \"4c25c0be-6d0f-4c0d-8973-4e509c720484\") " pod="openshift-ingress/e2e-ait-0144e4de-openshift-default-86cb848f5d-wrgv9"
Sep 18 22:15:34.052511 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:34.052322    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c25c0be-6d0f-4c0d-8973-4e509c720484-workload-certs\") pod \"e2e-ait-0144e4de-openshift-default-86cb848f5d-wrgv9\" (UID: \"4c25c0be-6d0f-4c0d-8973-4e509c720484\") " pod="openshift-ingress/e2e-ait-0144e4de-openshift-default-86cb848f5d-wrgv9"
Sep 18 22:15:34.052511 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:34.052367    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c25c0be-6d0f-4c0d-8973-4e509c720484-workload-socket\") pod \"e2e-ait-0144e4de-openshift-default-86cb848f5d-wrgv9\" (UID: \"4c25c0be-6d0f-4c0d-8973-4e509c720484\") " pod="openshift-ingress/e2e-ait-0144e4de-openshift-default-86cb848f5d-wrgv9"
Sep 18 22:15:34.052624 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:34.052555    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c25c0be-6d0f-4c0d-8973-4e509c720484-istio-data\") pod \"e2e-ait-0144e4de-openshift-default-86cb848f5d-wrgv9\" (UID: \"4c25c0be-6d0f-4c0d-8973-4e509c720484\") " pod="openshift-ingress/e2e-ait-0144e4de-openshift-default-86cb848f5d-wrgv9"
Sep 18 22:15:34.052953 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:34.052922    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c25c0be-6d0f-4c0d-8973-4e509c720484-istiod-ca-cert\") pod \"e2e-ait-0144e4de-openshift-default-86cb848f5d-wrgv9\" (UID: \"4c25c0be-6d0f-4c0d-8973-4e509c720484\") " pod="openshift-ingress/e2e-ait-0144e4de-openshift-default-86cb848f5d-wrgv9"
Sep 18 22:15:34.053097 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:34.052955    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c25c0be-6d0f-4c0d-8973-4e509c720484-credential-socket\") pod \"e2e-ait-0144e4de-openshift-default-86cb848f5d-wrgv9\" (UID: \"4c25c0be-6d0f-4c0d-8973-4e509c720484\") " pod="openshift-ingress/e2e-ait-0144e4de-openshift-default-86cb848f5d-wrgv9"
Sep 18 22:15:34.054733 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:34.054712    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c25c0be-6d0f-4c0d-8973-4e509c720484-istio-envoy\") pod \"e2e-ait-0144e4de-openshift-default-86cb848f5d-wrgv9\" (UID: \"4c25c0be-6d0f-4c0d-8973-4e509c720484\") " pod="openshift-ingress/e2e-ait-0144e4de-openshift-default-86cb848f5d-wrgv9"
Sep 18 22:15:34.054975 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:34.054960    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c25c0be-6d0f-4c0d-8973-4e509c720484-istio-podinfo\") pod \"e2e-ait-0144e4de-openshift-default-86cb848f5d-wrgv9\" (UID: \"4c25c0be-6d0f-4c0d-8973-4e509c720484\") " pod="openshift-ingress/e2e-ait-0144e4de-openshift-default-86cb848f5d-wrgv9"
Sep 18 22:15:34.060809 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:34.060784    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c25c0be-6d0f-4c0d-8973-4e509c720484-istio-token\") pod \"e2e-ait-0144e4de-openshift-default-86cb848f5d-wrgv9\" (UID: \"4c25c0be-6d0f-4c0d-8973-4e509c720484\") " pod="openshift-ingress/e2e-ait-0144e4de-openshift-default-86cb848f5d-wrgv9"
Sep 18 22:15:34.060982 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:34.060963    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhww6\" (UniqueName: \"kubernetes.io/projected/4c25c0be-6d0f-4c0d-8973-4e509c720484-kube-api-access-mhww6\") pod \"e2e-ait-0144e4de-openshift-default-86cb848f5d-wrgv9\" (UID: \"4c25c0be-6d0f-4c0d-8973-4e509c720484\") " pod="openshift-ingress/e2e-ait-0144e4de-openshift-default-86cb848f5d-wrgv9"
Sep 18 22:15:34.177018 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:34.176930    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0144e4de-openshift-default-86cb848f5d-wrgv9"
Sep 18 22:15:34.476528 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:34.476504    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-0144e4de-openshift-default-86cb848f5d-wrgv9"]
Sep 18 22:15:34.478369 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:15:34.478343    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c25c0be_6d0f_4c0d_8973_4e509c720484.slice/crio-f2a21b68a7aee626b0979684ea5172eb8c042e7b393ff9e54cb2286720d732f0 WatchSource:0}: Error finding container f2a21b68a7aee626b0979684ea5172eb8c042e7b393ff9e54cb2286720d732f0: Status 404 returned error can't find the container with id f2a21b68a7aee626b0979684ea5172eb8c042e7b393ff9e54cb2286720d732f0
Sep 18 22:15:34.480768 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:34.480731    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:15:34.480877 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:34.480797    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:15:34.480877 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:34.480822    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:15:35.304237 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:35.304198    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0144e4de-openshift-default-86cb848f5d-wrgv9" event={"ID":"4c25c0be-6d0f-4c0d-8973-4e509c720484","Type":"ContainerStarted","Data":"8fa3b04608297bf16f35f2284caab4401c66a1a2f648325a7fd5df47e44ed655"}
Sep 18 22:15:35.304777 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:35.304261    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0144e4de-openshift-default-86cb848f5d-wrgv9" event={"ID":"4c25c0be-6d0f-4c0d-8973-4e509c720484","Type":"ContainerStarted","Data":"f2a21b68a7aee626b0979684ea5172eb8c042e7b393ff9e54cb2286720d732f0"}
Sep 18 22:15:35.331797 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:35.331734    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-0144e4de-openshift-default-86cb848f5d-wrgv9" podStartSLOduration=2.331714907 podStartE2EDuration="2.331714907s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:15:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:15:35.330521774 +0000 UTC m=+914.650193833" watchObservedRunningTime="2026-09-18 22:15:35.331714907 +0000 UTC m=+914.651386964"
Sep 18 22:15:36.178091 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:36.178052    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-0144e4de-openshift-default-86cb848f5d-wrgv9"
Sep 18 22:15:36.183445 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:36.183407    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-0144e4de-openshift-default-86cb848f5d-wrgv9"
Sep 18 22:15:36.311720 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:36.311696    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-0144e4de-openshift-default-86cb848f5d-wrgv9"
Sep 18 22:15:36.312784 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:36.312767    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-0144e4de-openshift-default-86cb848f5d-wrgv9"
Sep 18 22:15:37.029132 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:37.029088    2577 patch_prober.go:28] interesting pod/e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d-bwrbf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 18 22:15:37.029312 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:37.029161    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d-bwrbf" podUID="1a26df0a-3a34-432b-88e5-985dcaf0f7ff" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 22:15:38.327042 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:38.327014    2577 generic.go:356] "Generic (PLEG): container finished" podID="1a26df0a-3a34-432b-88e5-985dcaf0f7ff" containerID="177b2e0d9cc2b89c15009927e7abcb17c808fe5d03ed4a8c5fa876eb02296d18" exitCode=0
Sep 18 22:15:38.327390 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:38.327086    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d-bwrbf" event={"ID":"1a26df0a-3a34-432b-88e5-985dcaf0f7ff","Type":"ContainerDied","Data":"177b2e0d9cc2b89c15009927e7abcb17c808fe5d03ed4a8c5fa876eb02296d18"}
Sep 18 22:15:38.327390 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:38.327150    2577 scope.go:117] "RemoveContainer" containerID="ddc8c9f6d6e53ad07e9d83aabf8b41f3ac847a6c146124d8c3552a655d5cece6"
Sep 18 22:15:38.344711 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:38.344681    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d-bwrbf"
Sep 18 22:15:38.501254 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:38.501171    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1a26df0a-3a34-432b-88e5-985dcaf0f7ff-istio-podinfo\") pod \"1a26df0a-3a34-432b-88e5-985dcaf0f7ff\" (UID: \"1a26df0a-3a34-432b-88e5-985dcaf0f7ff\") "
Sep 18 22:15:38.501470 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:38.501272    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1a26df0a-3a34-432b-88e5-985dcaf0f7ff-istio-data\") pod \"1a26df0a-3a34-432b-88e5-985dcaf0f7ff\" (UID: \"1a26df0a-3a34-432b-88e5-985dcaf0f7ff\") "
Sep 18 22:15:38.501470 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:38.501294    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1a26df0a-3a34-432b-88e5-985dcaf0f7ff-istiod-ca-cert\") pod \"1a26df0a-3a34-432b-88e5-985dcaf0f7ff\" (UID: \"1a26df0a-3a34-432b-88e5-985dcaf0f7ff\") "
Sep 18 22:15:38.501470 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:38.501324    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1a26df0a-3a34-432b-88e5-985dcaf0f7ff-istio-envoy\") pod \"1a26df0a-3a34-432b-88e5-985dcaf0f7ff\" (UID: \"1a26df0a-3a34-432b-88e5-985dcaf0f7ff\") "
Sep 18 22:15:38.501470 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:38.501340    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a26df0a-3a34-432b-88e5-985dcaf0f7ff-workload-socket\") pod \"1a26df0a-3a34-432b-88e5-985dcaf0f7ff\" (UID: \"1a26df0a-3a34-432b-88e5-985dcaf0f7ff\") "
Sep 18 22:15:38.501470 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:38.501361    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a26df0a-3a34-432b-88e5-985dcaf0f7ff-workload-certs\") pod \"1a26df0a-3a34-432b-88e5-985dcaf0f7ff\" (UID: \"1a26df0a-3a34-432b-88e5-985dcaf0f7ff\") "
Sep 18 22:15:38.501470 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:38.501381    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jqpds\" (UniqueName: \"kubernetes.io/projected/1a26df0a-3a34-432b-88e5-985dcaf0f7ff-kube-api-access-jqpds\") pod \"1a26df0a-3a34-432b-88e5-985dcaf0f7ff\" (UID: \"1a26df0a-3a34-432b-88e5-985dcaf0f7ff\") "
Sep 18 22:15:38.501789 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:38.501478    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a26df0a-3a34-432b-88e5-985dcaf0f7ff-credential-socket\") pod \"1a26df0a-3a34-432b-88e5-985dcaf0f7ff\" (UID: \"1a26df0a-3a34-432b-88e5-985dcaf0f7ff\") "
Sep 18 22:15:38.501789 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:38.501511    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a26df0a-3a34-432b-88e5-985dcaf0f7ff-istio-token\") pod \"1a26df0a-3a34-432b-88e5-985dcaf0f7ff\" (UID: \"1a26df0a-3a34-432b-88e5-985dcaf0f7ff\") "
Sep 18 22:15:38.501789 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:38.501598    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a26df0a-3a34-432b-88e5-985dcaf0f7ff-istio-data" (OuterVolumeSpecName: "istio-data") pod "1a26df0a-3a34-432b-88e5-985dcaf0f7ff" (UID: "1a26df0a-3a34-432b-88e5-985dcaf0f7ff"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:15:38.501789 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:38.501688    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a26df0a-3a34-432b-88e5-985dcaf0f7ff-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1a26df0a-3a34-432b-88e5-985dcaf0f7ff" (UID: "1a26df0a-3a34-432b-88e5-985dcaf0f7ff"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:15:38.501789 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:38.501735    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a26df0a-3a34-432b-88e5-985dcaf0f7ff-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1a26df0a-3a34-432b-88e5-985dcaf0f7ff" (UID: "1a26df0a-3a34-432b-88e5-985dcaf0f7ff"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:15:38.501980 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:38.501789    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a26df0a-3a34-432b-88e5-985dcaf0f7ff-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1a26df0a-3a34-432b-88e5-985dcaf0f7ff" (UID: "1a26df0a-3a34-432b-88e5-985dcaf0f7ff"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:15:38.501980 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:38.501932    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a26df0a-3a34-432b-88e5-985dcaf0f7ff-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1a26df0a-3a34-432b-88e5-985dcaf0f7ff" (UID: "1a26df0a-3a34-432b-88e5-985dcaf0f7ff"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:15:38.502404 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:38.502331    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a26df0a-3a34-432b-88e5-985dcaf0f7ff-workload-socket\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:15:38.502404 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:38.502357    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a26df0a-3a34-432b-88e5-985dcaf0f7ff-workload-certs\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:15:38.502404 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:38.502372    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a26df0a-3a34-432b-88e5-985dcaf0f7ff-credential-socket\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:15:38.502404 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:38.502385    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1a26df0a-3a34-432b-88e5-985dcaf0f7ff-istio-data\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:15:38.502404 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:38.502398    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1a26df0a-3a34-432b-88e5-985dcaf0f7ff-istiod-ca-cert\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:15:38.503928 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:38.503898    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a26df0a-3a34-432b-88e5-985dcaf0f7ff-kube-api-access-jqpds" (OuterVolumeSpecName: "kube-api-access-jqpds") pod "1a26df0a-3a34-432b-88e5-985dcaf0f7ff" (UID: "1a26df0a-3a34-432b-88e5-985dcaf0f7ff"). InnerVolumeSpecName "kube-api-access-jqpds". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:15:38.503928 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:38.503914    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1a26df0a-3a34-432b-88e5-985dcaf0f7ff-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1a26df0a-3a34-432b-88e5-985dcaf0f7ff" (UID: "1a26df0a-3a34-432b-88e5-985dcaf0f7ff"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 18 22:15:38.504061 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:38.503932    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a26df0a-3a34-432b-88e5-985dcaf0f7ff-istio-token" (OuterVolumeSpecName: "istio-token") pod "1a26df0a-3a34-432b-88e5-985dcaf0f7ff" (UID: "1a26df0a-3a34-432b-88e5-985dcaf0f7ff"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:15:38.504061 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:38.504004    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a26df0a-3a34-432b-88e5-985dcaf0f7ff-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1a26df0a-3a34-432b-88e5-985dcaf0f7ff" (UID: "1a26df0a-3a34-432b-88e5-985dcaf0f7ff"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:15:38.603609 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:38.603576    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1a26df0a-3a34-432b-88e5-985dcaf0f7ff-istio-envoy\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:15:38.603609 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:38.603604    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jqpds\" (UniqueName: \"kubernetes.io/projected/1a26df0a-3a34-432b-88e5-985dcaf0f7ff-kube-api-access-jqpds\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:15:38.603609 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:38.603613    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a26df0a-3a34-432b-88e5-985dcaf0f7ff-istio-token\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:15:38.603828 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:38.603621    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1a26df0a-3a34-432b-88e5-985dcaf0f7ff-istio-podinfo\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:15:39.334555 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:39.334529    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d-bwrbf"
Sep 18 22:15:39.334989 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:39.334583    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d-bwrbf" event={"ID":"1a26df0a-3a34-432b-88e5-985dcaf0f7ff","Type":"ContainerDied","Data":"9f63f48864ead2afb4a7e930dc9d6bb4f9665f85ed16e2cbaaae1ea250f02bfe"}
Sep 18 22:15:39.334989 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:39.334638    2577 scope.go:117] "RemoveContainer" containerID="177b2e0d9cc2b89c15009927e7abcb17c808fe5d03ed4a8c5fa876eb02296d18"
Sep 18 22:15:39.382324 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:39.382289    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d-bwrbf"]
Sep 18 22:15:39.385078 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:39.385050    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d-bwrbf"]
Sep 18 22:15:41.142153 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:15:41.142124    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1a26df0a-3a34-432b-88e5-985dcaf0f7ff" path="/var/lib/kubelet/pods/1a26df0a-3a34-432b-88e5-985dcaf0f7ff/volumes"
Sep 18 22:16:02.506276 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:02.506242    2577 generic.go:356] "Generic (PLEG): container finished" podID="4c25c0be-6d0f-4c0d-8973-4e509c720484" containerID="8fa3b04608297bf16f35f2284caab4401c66a1a2f648325a7fd5df47e44ed655" exitCode=0
Sep 18 22:16:02.506709 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:02.506312    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0144e4de-openshift-default-86cb848f5d-wrgv9" event={"ID":"4c25c0be-6d0f-4c0d-8973-4e509c720484","Type":"ContainerDied","Data":"8fa3b04608297bf16f35f2284caab4401c66a1a2f648325a7fd5df47e44ed655"}
Sep 18 22:16:02.506760 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:02.506728    2577 scope.go:117] "RemoveContainer" containerID="8fa3b04608297bf16f35f2284caab4401c66a1a2f648325a7fd5df47e44ed655"
Sep 18 22:16:02.507868 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:02.507841    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:16:02.507925 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:02.507903    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:16:02.507960 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:02.507935    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:16:03.515255 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:03.515223    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0144e4de-openshift-default-86cb848f5d-wrgv9" event={"ID":"4c25c0be-6d0f-4c0d-8973-4e509c720484","Type":"ContainerStarted","Data":"814ffe360adaaae3a54c3bd3fbff8d538d4701de88370ca8142ae853f6d5cfdb"}
Sep 18 22:16:04.177762 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:04.177724    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-0144e4de-openshift-default-86cb848f5d-wrgv9"
Sep 18 22:16:04.178895 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:04.178869    2577 patch_prober.go:28] interesting pod/e2e-ait-0144e4de-openshift-default-86cb848f5d-wrgv9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Sep 18 22:16:04.179027 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:04.178927    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-0144e4de-openshift-default-86cb848f5d-wrgv9" podUID="4c25c0be-6d0f-4c0d-8973-4e509c720484" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Sep 18 22:16:05.177609 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:05.177571    2577 patch_prober.go:28] interesting pod/e2e-ait-0144e4de-openshift-default-86cb848f5d-wrgv9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Sep 18 22:16:05.178096 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:05.177640    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-0144e4de-openshift-default-86cb848f5d-wrgv9" podUID="4c25c0be-6d0f-4c0d-8973-4e509c720484" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Sep 18 22:16:06.177586 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:06.177546    2577 patch_prober.go:28] interesting pod/e2e-ait-0144e4de-openshift-default-86cb848f5d-wrgv9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Sep 18 22:16:06.177781 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:06.177606    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-0144e4de-openshift-default-86cb848f5d-wrgv9" podUID="4c25c0be-6d0f-4c0d-8973-4e509c720484" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Sep 18 22:16:06.312240 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:06.312205    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-0144e4de-openshift-default-86cb848f5d-wrgv9"
Sep 18 22:16:07.178175 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:07.178143    2577 patch_prober.go:28] interesting pod/e2e-ait-0144e4de-openshift-default-86cb848f5d-wrgv9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Sep 18 22:16:07.178612 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:07.178199    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-0144e4de-openshift-default-86cb848f5d-wrgv9" podUID="4c25c0be-6d0f-4c0d-8973-4e509c720484" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Sep 18 22:16:07.630287 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:07.630249    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0144e4de-5s6zl"]
Sep 18 22:16:07.630753 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:07.630738    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a26df0a-3a34-432b-88e5-985dcaf0f7ff" containerName="istio-proxy"
Sep 18 22:16:07.630802 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:07.630755    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a26df0a-3a34-432b-88e5-985dcaf0f7ff" containerName="istio-proxy"
Sep 18 22:16:07.630845 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:07.630837    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a26df0a-3a34-432b-88e5-985dcaf0f7ff" containerName="istio-proxy"
Sep 18 22:16:07.630880 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:07.630849    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a26df0a-3a34-432b-88e5-985dcaf0f7ff" containerName="istio-proxy"
Sep 18 22:16:07.633113 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:07.633094    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0144e4de-5s6zl"
Sep 18 22:16:07.637047 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:07.637014    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-9g7m4\""
Sep 18 22:16:07.660132 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:07.660096    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0144e4de-5s6zl"]
Sep 18 22:16:07.715290 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:07.715252    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f1ae226-7d8f-4e05-a7a5-5b2e78010a61-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-0144e4de-5s6zl\" (UID: \"4f1ae226-7d8f-4e05-a7a5-5b2e78010a61\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0144e4de-5s6zl"
Sep 18 22:16:07.816502 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:07.816470    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f1ae226-7d8f-4e05-a7a5-5b2e78010a61-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-0144e4de-5s6zl\" (UID: \"4f1ae226-7d8f-4e05-a7a5-5b2e78010a61\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0144e4de-5s6zl"
Sep 18 22:16:07.817132 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:07.817106    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f1ae226-7d8f-4e05-a7a5-5b2e78010a61-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-0144e4de-5s6zl\" (UID: \"4f1ae226-7d8f-4e05-a7a5-5b2e78010a61\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0144e4de-5s6zl"
Sep 18 22:16:07.945249 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:07.945159    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0144e4de-5s6zl"
Sep 18 22:16:08.177941 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:08.177513    2577 patch_prober.go:28] interesting pod/e2e-ait-0144e4de-openshift-default-86cb848f5d-wrgv9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Sep 18 22:16:08.177941 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:08.177572    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-0144e4de-openshift-default-86cb848f5d-wrgv9" podUID="4c25c0be-6d0f-4c0d-8973-4e509c720484" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Sep 18 22:16:08.273433 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:08.262253    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0144e4de-5s6zl"]
Sep 18 22:16:08.276079 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:16:08.276040    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f1ae226_7d8f_4e05_a7a5_5b2e78010a61.slice/crio-7b36e2681569cefa881673fc8f004180fa7f7c92c5c380182f951b913ad4cf4b WatchSource:0}: Error finding container 7b36e2681569cefa881673fc8f004180fa7f7c92c5c380182f951b913ad4cf4b: Status 404 returned error can't find the container with id 7b36e2681569cefa881673fc8f004180fa7f7c92c5c380182f951b913ad4cf4b
Sep 18 22:16:08.568882 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:08.568835    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0144e4de-5s6zl" event={"ID":"4f1ae226-7d8f-4e05-a7a5-5b2e78010a61","Type":"ContainerStarted","Data":"7b36e2681569cefa881673fc8f004180fa7f7c92c5c380182f951b913ad4cf4b"}
Sep 18 22:16:09.190017 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:09.189987    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-0144e4de-openshift-default-86cb848f5d-wrgv9"
Sep 18 22:16:09.191227 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:09.191204    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-0144e4de-openshift-default-86cb848f5d-wrgv9"
Sep 18 22:16:09.577083 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:09.577051    2577 generic.go:356] "Generic (PLEG): container finished" podID="4f1ae226-7d8f-4e05-a7a5-5b2e78010a61" containerID="cd431a5f85f9113620cf5e847eea47c80d582c2130105ae063a2b52d7d9125fb" exitCode=0
Sep 18 22:16:09.577508 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:09.577142    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0144e4de-5s6zl" event={"ID":"4f1ae226-7d8f-4e05-a7a5-5b2e78010a61","Type":"ContainerDied","Data":"cd431a5f85f9113620cf5e847eea47c80d582c2130105ae063a2b52d7d9125fb"}
Sep 18 22:16:10.719026 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:10.718997    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0144e4de-5s6zl"
Sep 18 22:16:10.853017 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:10.852929    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f1ae226-7d8f-4e05-a7a5-5b2e78010a61-maas-api-service-ca\") pod \"4f1ae226-7d8f-4e05-a7a5-5b2e78010a61\" (UID: \"4f1ae226-7d8f-4e05-a7a5-5b2e78010a61\") "
Sep 18 22:16:10.853300 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:10.853271    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f1ae226-7d8f-4e05-a7a5-5b2e78010a61-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4f1ae226-7d8f-4e05-a7a5-5b2e78010a61" (UID: "4f1ae226-7d8f-4e05-a7a5-5b2e78010a61"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:16:10.853562 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:10.853529    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f1ae226-7d8f-4e05-a7a5-5b2e78010a61-maas-api-service-ca\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:16:11.591497 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:11.591472    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0144e4de-5s6zl"
Sep 18 22:16:11.591497 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:11.591483    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0144e4de-5s6zl" event={"ID":"4f1ae226-7d8f-4e05-a7a5-5b2e78010a61","Type":"ContainerDied","Data":"7b36e2681569cefa881673fc8f004180fa7f7c92c5c380182f951b913ad4cf4b"}
Sep 18 22:16:11.591746 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:11.591528    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7b36e2681569cefa881673fc8f004180fa7f7c92c5c380182f951b913ad4cf4b"
Sep 18 22:16:19.456022 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:19.455986    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0144e4de-5s6zl"]
Sep 18 22:16:19.458989 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:19.458964    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0144e4de-5s6zl"]
Sep 18 22:16:20.608025 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:20.607994    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-0144e4de-openshift-default-86cb848f5d-wrgv9"]
Sep 18 22:16:20.608473 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:20.608238    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-0144e4de-openshift-default-86cb848f5d-wrgv9" podUID="4c25c0be-6d0f-4c0d-8973-4e509c720484" containerName="istio-proxy" containerID="cri-o://814ffe360adaaae3a54c3bd3fbff8d538d4701de88370ca8142ae853f6d5cfdb" gracePeriod=30
Sep 18 22:16:21.141768 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:21.141732    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f1ae226-7d8f-4e05-a7a5-5b2e78010a61" path="/var/lib/kubelet/pods/4f1ae226-7d8f-4e05-a7a5-5b2e78010a61/volumes"
Sep 18 22:16:21.421215 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:21.421135    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-35758849-openshift-default-5bd7d4f6d8-s7kh7"]
Sep 18 22:16:21.421840 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:21.421824    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f1ae226-7d8f-4e05-a7a5-5b2e78010a61" containerName="revoke-keys"
Sep 18 22:16:21.421888 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:21.421844    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f1ae226-7d8f-4e05-a7a5-5b2e78010a61" containerName="revoke-keys"
Sep 18 22:16:21.421888 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:21.421870    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a26df0a-3a34-432b-88e5-985dcaf0f7ff" containerName="istio-proxy"
Sep 18 22:16:21.421888 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:21.421879    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a26df0a-3a34-432b-88e5-985dcaf0f7ff" containerName="istio-proxy"
Sep 18 22:16:21.422023 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:21.422013    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f1ae226-7d8f-4e05-a7a5-5b2e78010a61" containerName="revoke-keys"
Sep 18 22:16:21.426974 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:21.426957    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-35758849-openshift-default-5bd7d4f6d8-s7kh7"
Sep 18 22:16:21.429860 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:21.429838    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-35758849-openshift-default-dockercfg-s87hj\""
Sep 18 22:16:21.456224 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:21.456200    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-35758849-openshift-default-5bd7d4f6d8-s7kh7"]
Sep 18 22:16:21.564835 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:21.564793    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/26ff9791-76db-4aa7-af4a-a66a9fb968a1-workload-socket\") pod \"e2e-derive-35758849-openshift-default-5bd7d4f6d8-s7kh7\" (UID: \"26ff9791-76db-4aa7-af4a-a66a9fb968a1\") " pod="openshift-ingress/e2e-derive-35758849-openshift-default-5bd7d4f6d8-s7kh7"
Sep 18 22:16:21.565018 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:21.564844    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cg47b\" (UniqueName: \"kubernetes.io/projected/26ff9791-76db-4aa7-af4a-a66a9fb968a1-kube-api-access-cg47b\") pod \"e2e-derive-35758849-openshift-default-5bd7d4f6d8-s7kh7\" (UID: \"26ff9791-76db-4aa7-af4a-a66a9fb968a1\") " pod="openshift-ingress/e2e-derive-35758849-openshift-default-5bd7d4f6d8-s7kh7"
Sep 18 22:16:21.565018 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:21.564923    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/26ff9791-76db-4aa7-af4a-a66a9fb968a1-istio-data\") pod \"e2e-derive-35758849-openshift-default-5bd7d4f6d8-s7kh7\" (UID: \"26ff9791-76db-4aa7-af4a-a66a9fb968a1\") " pod="openshift-ingress/e2e-derive-35758849-openshift-default-5bd7d4f6d8-s7kh7"
Sep 18 22:16:21.565111 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:21.565011    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/26ff9791-76db-4aa7-af4a-a66a9fb968a1-istio-podinfo\") pod \"e2e-derive-35758849-openshift-default-5bd7d4f6d8-s7kh7\" (UID: \"26ff9791-76db-4aa7-af4a-a66a9fb968a1\") " pod="openshift-ingress/e2e-derive-35758849-openshift-default-5bd7d4f6d8-s7kh7"
Sep 18 22:16:21.565111 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:21.565051    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/26ff9791-76db-4aa7-af4a-a66a9fb968a1-credential-socket\") pod \"e2e-derive-35758849-openshift-default-5bd7d4f6d8-s7kh7\" (UID: \"26ff9791-76db-4aa7-af4a-a66a9fb968a1\") " pod="openshift-ingress/e2e-derive-35758849-openshift-default-5bd7d4f6d8-s7kh7"
Sep 18 22:16:21.565181 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:21.565115    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/26ff9791-76db-4aa7-af4a-a66a9fb968a1-workload-certs\") pod \"e2e-derive-35758849-openshift-default-5bd7d4f6d8-s7kh7\" (UID: \"26ff9791-76db-4aa7-af4a-a66a9fb968a1\") " pod="openshift-ingress/e2e-derive-35758849-openshift-default-5bd7d4f6d8-s7kh7"
Sep 18 22:16:21.565181 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:21.565142    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/26ff9791-76db-4aa7-af4a-a66a9fb968a1-istio-envoy\") pod \"e2e-derive-35758849-openshift-default-5bd7d4f6d8-s7kh7\" (UID: \"26ff9791-76db-4aa7-af4a-a66a9fb968a1\") " pod="openshift-ingress/e2e-derive-35758849-openshift-default-5bd7d4f6d8-s7kh7"
Sep 18 22:16:21.565244 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:21.565192    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/26ff9791-76db-4aa7-af4a-a66a9fb968a1-istiod-ca-cert\") pod \"e2e-derive-35758849-openshift-default-5bd7d4f6d8-s7kh7\" (UID: \"26ff9791-76db-4aa7-af4a-a66a9fb968a1\") " pod="openshift-ingress/e2e-derive-35758849-openshift-default-5bd7d4f6d8-s7kh7"
Sep 18 22:16:21.565244 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:21.565241    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/26ff9791-76db-4aa7-af4a-a66a9fb968a1-istio-token\") pod \"e2e-derive-35758849-openshift-default-5bd7d4f6d8-s7kh7\" (UID: \"26ff9791-76db-4aa7-af4a-a66a9fb968a1\") " pod="openshift-ingress/e2e-derive-35758849-openshift-default-5bd7d4f6d8-s7kh7"
Sep 18 22:16:21.665967 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:21.665930    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/26ff9791-76db-4aa7-af4a-a66a9fb968a1-istio-token\") pod \"e2e-derive-35758849-openshift-default-5bd7d4f6d8-s7kh7\" (UID: \"26ff9791-76db-4aa7-af4a-a66a9fb968a1\") " pod="openshift-ingress/e2e-derive-35758849-openshift-default-5bd7d4f6d8-s7kh7"
Sep 18 22:16:21.666453 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:21.665989    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/26ff9791-76db-4aa7-af4a-a66a9fb968a1-workload-socket\") pod \"e2e-derive-35758849-openshift-default-5bd7d4f6d8-s7kh7\" (UID: \"26ff9791-76db-4aa7-af4a-a66a9fb968a1\") " pod="openshift-ingress/e2e-derive-35758849-openshift-default-5bd7d4f6d8-s7kh7"
Sep 18 22:16:21.666453 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:21.666023    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cg47b\" (UniqueName: \"kubernetes.io/projected/26ff9791-76db-4aa7-af4a-a66a9fb968a1-kube-api-access-cg47b\") pod \"e2e-derive-35758849-openshift-default-5bd7d4f6d8-s7kh7\" (UID: \"26ff9791-76db-4aa7-af4a-a66a9fb968a1\") " pod="openshift-ingress/e2e-derive-35758849-openshift-default-5bd7d4f6d8-s7kh7"
Sep 18 22:16:21.666453 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:21.666083    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/26ff9791-76db-4aa7-af4a-a66a9fb968a1-istio-data\") pod \"e2e-derive-35758849-openshift-default-5bd7d4f6d8-s7kh7\" (UID: \"26ff9791-76db-4aa7-af4a-a66a9fb968a1\") " pod="openshift-ingress/e2e-derive-35758849-openshift-default-5bd7d4f6d8-s7kh7"
Sep 18 22:16:21.666453 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:21.666162    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/26ff9791-76db-4aa7-af4a-a66a9fb968a1-istio-podinfo\") pod \"e2e-derive-35758849-openshift-default-5bd7d4f6d8-s7kh7\" (UID: \"26ff9791-76db-4aa7-af4a-a66a9fb968a1\") " pod="openshift-ingress/e2e-derive-35758849-openshift-default-5bd7d4f6d8-s7kh7"
Sep 18 22:16:21.666453 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:21.666212    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/26ff9791-76db-4aa7-af4a-a66a9fb968a1-credential-socket\") pod \"e2e-derive-35758849-openshift-default-5bd7d4f6d8-s7kh7\" (UID: \"26ff9791-76db-4aa7-af4a-a66a9fb968a1\") " pod="openshift-ingress/e2e-derive-35758849-openshift-default-5bd7d4f6d8-s7kh7"
Sep 18 22:16:21.666453 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:21.666274    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/26ff9791-76db-4aa7-af4a-a66a9fb968a1-workload-certs\") pod \"e2e-derive-35758849-openshift-default-5bd7d4f6d8-s7kh7\" (UID: \"26ff9791-76db-4aa7-af4a-a66a9fb968a1\") " pod="openshift-ingress/e2e-derive-35758849-openshift-default-5bd7d4f6d8-s7kh7"
Sep 18 22:16:21.666453 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:21.666306    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/26ff9791-76db-4aa7-af4a-a66a9fb968a1-istio-envoy\") pod \"e2e-derive-35758849-openshift-default-5bd7d4f6d8-s7kh7\" (UID: \"26ff9791-76db-4aa7-af4a-a66a9fb968a1\") " pod="openshift-ingress/e2e-derive-35758849-openshift-default-5bd7d4f6d8-s7kh7"
Sep 18 22:16:21.666453 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:21.666343    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/26ff9791-76db-4aa7-af4a-a66a9fb968a1-istiod-ca-cert\") pod \"e2e-derive-35758849-openshift-default-5bd7d4f6d8-s7kh7\" (UID: \"26ff9791-76db-4aa7-af4a-a66a9fb968a1\") " pod="openshift-ingress/e2e-derive-35758849-openshift-default-5bd7d4f6d8-s7kh7"
Sep 18 22:16:21.666938 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:21.666517    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/26ff9791-76db-4aa7-af4a-a66a9fb968a1-workload-socket\") pod \"e2e-derive-35758849-openshift-default-5bd7d4f6d8-s7kh7\" (UID: \"26ff9791-76db-4aa7-af4a-a66a9fb968a1\") " pod="openshift-ingress/e2e-derive-35758849-openshift-default-5bd7d4f6d8-s7kh7"
Sep 18 22:16:21.666938 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:21.666666    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/26ff9791-76db-4aa7-af4a-a66a9fb968a1-workload-certs\") pod \"e2e-derive-35758849-openshift-default-5bd7d4f6d8-s7kh7\" (UID: \"26ff9791-76db-4aa7-af4a-a66a9fb968a1\") " pod="openshift-ingress/e2e-derive-35758849-openshift-default-5bd7d4f6d8-s7kh7"
Sep 18 22:16:21.666938 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:21.666739    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/26ff9791-76db-4aa7-af4a-a66a9fb968a1-credential-socket\") pod \"e2e-derive-35758849-openshift-default-5bd7d4f6d8-s7kh7\" (UID: \"26ff9791-76db-4aa7-af4a-a66a9fb968a1\") " pod="openshift-ingress/e2e-derive-35758849-openshift-default-5bd7d4f6d8-s7kh7"
Sep 18 22:16:21.666938 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:21.666881    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/26ff9791-76db-4aa7-af4a-a66a9fb968a1-istio-data\") pod \"e2e-derive-35758849-openshift-default-5bd7d4f6d8-s7kh7\" (UID: \"26ff9791-76db-4aa7-af4a-a66a9fb968a1\") " pod="openshift-ingress/e2e-derive-35758849-openshift-default-5bd7d4f6d8-s7kh7"
Sep 18 22:16:21.667116 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:21.667029    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/26ff9791-76db-4aa7-af4a-a66a9fb968a1-istiod-ca-cert\") pod \"e2e-derive-35758849-openshift-default-5bd7d4f6d8-s7kh7\" (UID: \"26ff9791-76db-4aa7-af4a-a66a9fb968a1\") " pod="openshift-ingress/e2e-derive-35758849-openshift-default-5bd7d4f6d8-s7kh7"
Sep 18 22:16:21.669367 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:21.669347    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/26ff9791-76db-4aa7-af4a-a66a9fb968a1-istio-envoy\") pod \"e2e-derive-35758849-openshift-default-5bd7d4f6d8-s7kh7\" (UID: \"26ff9791-76db-4aa7-af4a-a66a9fb968a1\") " pod="openshift-ingress/e2e-derive-35758849-openshift-default-5bd7d4f6d8-s7kh7"
Sep 18 22:16:21.669721 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:21.669690    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/26ff9791-76db-4aa7-af4a-a66a9fb968a1-istio-podinfo\") pod \"e2e-derive-35758849-openshift-default-5bd7d4f6d8-s7kh7\" (UID: \"26ff9791-76db-4aa7-af4a-a66a9fb968a1\") " pod="openshift-ingress/e2e-derive-35758849-openshift-default-5bd7d4f6d8-s7kh7"
Sep 18 22:16:21.678984 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:21.678932    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/26ff9791-76db-4aa7-af4a-a66a9fb968a1-istio-token\") pod \"e2e-derive-35758849-openshift-default-5bd7d4f6d8-s7kh7\" (UID: \"26ff9791-76db-4aa7-af4a-a66a9fb968a1\") " pod="openshift-ingress/e2e-derive-35758849-openshift-default-5bd7d4f6d8-s7kh7"
Sep 18 22:16:21.682217 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:21.682197    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cg47b\" (UniqueName: \"kubernetes.io/projected/26ff9791-76db-4aa7-af4a-a66a9fb968a1-kube-api-access-cg47b\") pod \"e2e-derive-35758849-openshift-default-5bd7d4f6d8-s7kh7\" (UID: \"26ff9791-76db-4aa7-af4a-a66a9fb968a1\") " pod="openshift-ingress/e2e-derive-35758849-openshift-default-5bd7d4f6d8-s7kh7"
Sep 18 22:16:21.737256 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:21.737226    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-35758849-openshift-default-5bd7d4f6d8-s7kh7"
Sep 18 22:16:22.025744 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:22.025721    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-35758849-openshift-default-5bd7d4f6d8-s7kh7"]
Sep 18 22:16:22.026308 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:16:22.026289    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26ff9791_76db_4aa7_af4a_a66a9fb968a1.slice/crio-77a96e9339683b76a591000e3b8dcda8cc25caefe5a361f4c15256af93ce98d0 WatchSource:0}: Error finding container 77a96e9339683b76a591000e3b8dcda8cc25caefe5a361f4c15256af93ce98d0: Status 404 returned error can't find the container with id 77a96e9339683b76a591000e3b8dcda8cc25caefe5a361f4c15256af93ce98d0
Sep 18 22:16:22.028739 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:22.028703    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:16:22.028796 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:22.028769    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:16:22.028836 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:22.028797    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:16:22.665468 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:22.665432    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-35758849-openshift-default-5bd7d4f6d8-s7kh7" event={"ID":"26ff9791-76db-4aa7-af4a-a66a9fb968a1","Type":"ContainerStarted","Data":"d371ec329d5f05fd4f2939014e8f37178e3f302f05a879ed54a660ec6ec80866"}
Sep 18 22:16:22.665644 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:22.665489    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-35758849-openshift-default-5bd7d4f6d8-s7kh7" event={"ID":"26ff9791-76db-4aa7-af4a-a66a9fb968a1","Type":"ContainerStarted","Data":"77a96e9339683b76a591000e3b8dcda8cc25caefe5a361f4c15256af93ce98d0"}
Sep 18 22:16:22.693728 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:22.693675    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-35758849-openshift-default-5bd7d4f6d8-s7kh7" podStartSLOduration=1.6936600149999999 podStartE2EDuration="1.693660015s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:16:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:16:22.691044938 +0000 UTC m=+962.010716995" watchObservedRunningTime="2026-09-18 22:16:22.693660015 +0000 UTC m=+962.013332070"
Sep 18 22:16:22.738350 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:22.738312    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-35758849-openshift-default-5bd7d4f6d8-s7kh7"
Sep 18 22:16:23.743114 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:23.743083    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-35758849-openshift-default-5bd7d4f6d8-s7kh7"
Sep 18 22:16:24.193381 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:24.193343    2577 patch_prober.go:28] interesting pod/e2e-ait-0144e4de-openshift-default-86cb848f5d-wrgv9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 18 22:16:24.193580 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:24.193401    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-0144e4de-openshift-default-86cb848f5d-wrgv9" podUID="4c25c0be-6d0f-4c0d-8973-4e509c720484" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 22:16:24.678573 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:24.678538    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-35758849-openshift-default-5bd7d4f6d8-s7kh7"
Sep 18 22:16:24.679691 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:24.679660    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-35758849-openshift-default-5bd7d4f6d8-s7kh7"
Sep 18 22:16:25.863191 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:25.863168    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0144e4de-openshift-default-86cb848f5d-wrgv9"
Sep 18 22:16:26.014794 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:26.014705    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c25c0be-6d0f-4c0d-8973-4e509c720484-istiod-ca-cert\") pod \"4c25c0be-6d0f-4c0d-8973-4e509c720484\" (UID: \"4c25c0be-6d0f-4c0d-8973-4e509c720484\") "
Sep 18 22:16:26.014794 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:26.014760    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c25c0be-6d0f-4c0d-8973-4e509c720484-istio-data\") pod \"4c25c0be-6d0f-4c0d-8973-4e509c720484\" (UID: \"4c25c0be-6d0f-4c0d-8973-4e509c720484\") "
Sep 18 22:16:26.014794 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:26.014787    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mhww6\" (UniqueName: \"kubernetes.io/projected/4c25c0be-6d0f-4c0d-8973-4e509c720484-kube-api-access-mhww6\") pod \"4c25c0be-6d0f-4c0d-8973-4e509c720484\" (UID: \"4c25c0be-6d0f-4c0d-8973-4e509c720484\") "
Sep 18 22:16:26.015088 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:26.014838    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c25c0be-6d0f-4c0d-8973-4e509c720484-credential-socket\") pod \"4c25c0be-6d0f-4c0d-8973-4e509c720484\" (UID: \"4c25c0be-6d0f-4c0d-8973-4e509c720484\") "
Sep 18 22:16:26.015088 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:26.014854    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c25c0be-6d0f-4c0d-8973-4e509c720484-workload-certs\") pod \"4c25c0be-6d0f-4c0d-8973-4e509c720484\" (UID: \"4c25c0be-6d0f-4c0d-8973-4e509c720484\") "
Sep 18 22:16:26.015088 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:26.014887    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c25c0be-6d0f-4c0d-8973-4e509c720484-istio-envoy\") pod \"4c25c0be-6d0f-4c0d-8973-4e509c720484\" (UID: \"4c25c0be-6d0f-4c0d-8973-4e509c720484\") "
Sep 18 22:16:26.015088 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:26.015006    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c25c0be-6d0f-4c0d-8973-4e509c720484-istio-data" (OuterVolumeSpecName: "istio-data") pod "4c25c0be-6d0f-4c0d-8973-4e509c720484" (UID: "4c25c0be-6d0f-4c0d-8973-4e509c720484"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:16:26.015088 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:26.015067    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c25c0be-6d0f-4c0d-8973-4e509c720484-istio-podinfo\") pod \"4c25c0be-6d0f-4c0d-8973-4e509c720484\" (UID: \"4c25c0be-6d0f-4c0d-8973-4e509c720484\") "
Sep 18 22:16:26.015343 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:26.015139    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c25c0be-6d0f-4c0d-8973-4e509c720484-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4c25c0be-6d0f-4c0d-8973-4e509c720484" (UID: "4c25c0be-6d0f-4c0d-8973-4e509c720484"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:16:26.015343 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:26.015195    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c25c0be-6d0f-4c0d-8973-4e509c720484-workload-socket\") pod \"4c25c0be-6d0f-4c0d-8973-4e509c720484\" (UID: \"4c25c0be-6d0f-4c0d-8973-4e509c720484\") "
Sep 18 22:16:26.015343 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:26.015208    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c25c0be-6d0f-4c0d-8973-4e509c720484-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4c25c0be-6d0f-4c0d-8973-4e509c720484" (UID: "4c25c0be-6d0f-4c0d-8973-4e509c720484"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:16:26.015343 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:26.015239    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c25c0be-6d0f-4c0d-8973-4e509c720484-istio-token\") pod \"4c25c0be-6d0f-4c0d-8973-4e509c720484\" (UID: \"4c25c0be-6d0f-4c0d-8973-4e509c720484\") "
Sep 18 22:16:26.015343 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:26.015256    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c25c0be-6d0f-4c0d-8973-4e509c720484-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4c25c0be-6d0f-4c0d-8973-4e509c720484" (UID: "4c25c0be-6d0f-4c0d-8973-4e509c720484"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:16:26.015641 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:26.015405    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c25c0be-6d0f-4c0d-8973-4e509c720484-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4c25c0be-6d0f-4c0d-8973-4e509c720484" (UID: "4c25c0be-6d0f-4c0d-8973-4e509c720484"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:16:26.015865 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:26.015673    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c25c0be-6d0f-4c0d-8973-4e509c720484-credential-socket\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:16:26.015865 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:26.015694    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c25c0be-6d0f-4c0d-8973-4e509c720484-workload-certs\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:16:26.015865 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:26.015710    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c25c0be-6d0f-4c0d-8973-4e509c720484-workload-socket\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:16:26.015865 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:26.015722    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c25c0be-6d0f-4c0d-8973-4e509c720484-istiod-ca-cert\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:16:26.015865 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:26.015734    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c25c0be-6d0f-4c0d-8973-4e509c720484-istio-data\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:16:26.017340 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:26.017315    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c25c0be-6d0f-4c0d-8973-4e509c720484-kube-api-access-mhww6" (OuterVolumeSpecName: "kube-api-access-mhww6") pod "4c25c0be-6d0f-4c0d-8973-4e509c720484" (UID: "4c25c0be-6d0f-4c0d-8973-4e509c720484"). InnerVolumeSpecName "kube-api-access-mhww6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:16:26.017340 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:26.017322    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4c25c0be-6d0f-4c0d-8973-4e509c720484-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4c25c0be-6d0f-4c0d-8973-4e509c720484" (UID: "4c25c0be-6d0f-4c0d-8973-4e509c720484"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 18 22:16:26.017499 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:26.017364    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c25c0be-6d0f-4c0d-8973-4e509c720484-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4c25c0be-6d0f-4c0d-8973-4e509c720484" (UID: "4c25c0be-6d0f-4c0d-8973-4e509c720484"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:16:26.017535 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:26.017525    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c25c0be-6d0f-4c0d-8973-4e509c720484-istio-token" (OuterVolumeSpecName: "istio-token") pod "4c25c0be-6d0f-4c0d-8973-4e509c720484" (UID: "4c25c0be-6d0f-4c0d-8973-4e509c720484"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:16:26.116888 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:26.116857    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mhww6\" (UniqueName: \"kubernetes.io/projected/4c25c0be-6d0f-4c0d-8973-4e509c720484-kube-api-access-mhww6\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:16:26.116888 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:26.116885    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c25c0be-6d0f-4c0d-8973-4e509c720484-istio-envoy\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:16:26.116888 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:26.116894    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c25c0be-6d0f-4c0d-8973-4e509c720484-istio-podinfo\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:16:26.117118 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:26.116902    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c25c0be-6d0f-4c0d-8973-4e509c720484-istio-token\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:16:26.692181 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:26.692149    2577 generic.go:356] "Generic (PLEG): container finished" podID="4c25c0be-6d0f-4c0d-8973-4e509c720484" containerID="814ffe360adaaae3a54c3bd3fbff8d538d4701de88370ca8142ae853f6d5cfdb" exitCode=0
Sep 18 22:16:26.692368 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:26.692198    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0144e4de-openshift-default-86cb848f5d-wrgv9"
Sep 18 22:16:26.692368 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:26.692240    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0144e4de-openshift-default-86cb848f5d-wrgv9" event={"ID":"4c25c0be-6d0f-4c0d-8973-4e509c720484","Type":"ContainerDied","Data":"814ffe360adaaae3a54c3bd3fbff8d538d4701de88370ca8142ae853f6d5cfdb"}
Sep 18 22:16:26.692368 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:26.692299    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0144e4de-openshift-default-86cb848f5d-wrgv9" event={"ID":"4c25c0be-6d0f-4c0d-8973-4e509c720484","Type":"ContainerDied","Data":"f2a21b68a7aee626b0979684ea5172eb8c042e7b393ff9e54cb2286720d732f0"}
Sep 18 22:16:26.692368 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:26.692325    2577 scope.go:117] "RemoveContainer" containerID="814ffe360adaaae3a54c3bd3fbff8d538d4701de88370ca8142ae853f6d5cfdb"
Sep 18 22:16:26.702775 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:26.702762    2577 scope.go:117] "RemoveContainer" containerID="8fa3b04608297bf16f35f2284caab4401c66a1a2f648325a7fd5df47e44ed655"
Sep 18 22:16:26.711455 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:26.711435    2577 scope.go:117] "RemoveContainer" containerID="814ffe360adaaae3a54c3bd3fbff8d538d4701de88370ca8142ae853f6d5cfdb"
Sep 18 22:16:26.711731 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:16:26.711713    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"814ffe360adaaae3a54c3bd3fbff8d538d4701de88370ca8142ae853f6d5cfdb\": container with ID starting with 814ffe360adaaae3a54c3bd3fbff8d538d4701de88370ca8142ae853f6d5cfdb not found: ID does not exist" containerID="814ffe360adaaae3a54c3bd3fbff8d538d4701de88370ca8142ae853f6d5cfdb"
Sep 18 22:16:26.711798 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:26.711737    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"814ffe360adaaae3a54c3bd3fbff8d538d4701de88370ca8142ae853f6d5cfdb"} err="failed to get container status \"814ffe360adaaae3a54c3bd3fbff8d538d4701de88370ca8142ae853f6d5cfdb\": rpc error: code = NotFound desc = could not find container \"814ffe360adaaae3a54c3bd3fbff8d538d4701de88370ca8142ae853f6d5cfdb\": container with ID starting with 814ffe360adaaae3a54c3bd3fbff8d538d4701de88370ca8142ae853f6d5cfdb not found: ID does not exist"
Sep 18 22:16:26.711798 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:26.711753    2577 scope.go:117] "RemoveContainer" containerID="8fa3b04608297bf16f35f2284caab4401c66a1a2f648325a7fd5df47e44ed655"
Sep 18 22:16:26.712090 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:16:26.712028    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8fa3b04608297bf16f35f2284caab4401c66a1a2f648325a7fd5df47e44ed655\": container with ID starting with 8fa3b04608297bf16f35f2284caab4401c66a1a2f648325a7fd5df47e44ed655 not found: ID does not exist" containerID="8fa3b04608297bf16f35f2284caab4401c66a1a2f648325a7fd5df47e44ed655"
Sep 18 22:16:26.712090 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:26.712068    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8fa3b04608297bf16f35f2284caab4401c66a1a2f648325a7fd5df47e44ed655"} err="failed to get container status \"8fa3b04608297bf16f35f2284caab4401c66a1a2f648325a7fd5df47e44ed655\": rpc error: code = NotFound desc = could not find container \"8fa3b04608297bf16f35f2284caab4401c66a1a2f648325a7fd5df47e44ed655\": container with ID starting with 8fa3b04608297bf16f35f2284caab4401c66a1a2f648325a7fd5df47e44ed655 not found: ID does not exist"
Sep 18 22:16:26.716100 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:26.716078    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-0144e4de-openshift-default-86cb848f5d-wrgv9"]
Sep 18 22:16:26.719945 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:26.719926    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-0144e4de-openshift-default-86cb848f5d-wrgv9"]
Sep 18 22:16:27.140068 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:27.140034    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c25c0be-6d0f-4c0d-8973-4e509c720484" path="/var/lib/kubelet/pods/4c25c0be-6d0f-4c0d-8973-4e509c720484/volumes"
Sep 18 22:16:33.126856 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:33.126814    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-autores-0ffe43-29829495-c55w9"]
Sep 18 22:16:33.129622 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:33.129598    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-autores-0ffe43-29829495-c55w9"]
Sep 18 22:16:33.140890 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:33.140865    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a07f9fd-9d7c-4ed7-907b-238c7a72981e" path="/var/lib/kubelet/pods/7a07f9fd-9d7c-4ed7-907b-238c7a72981e/volumes"
Sep 18 22:16:46.844549 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:46.844511    2577 generic.go:356] "Generic (PLEG): container finished" podID="26ff9791-76db-4aa7-af4a-a66a9fb968a1" containerID="d371ec329d5f05fd4f2939014e8f37178e3f302f05a879ed54a660ec6ec80866" exitCode=0
Sep 18 22:16:46.845089 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:46.844591    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-35758849-openshift-default-5bd7d4f6d8-s7kh7" event={"ID":"26ff9791-76db-4aa7-af4a-a66a9fb968a1","Type":"ContainerDied","Data":"d371ec329d5f05fd4f2939014e8f37178e3f302f05a879ed54a660ec6ec80866"}
Sep 18 22:16:46.845158 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:46.845111    2577 scope.go:117] "RemoveContainer" containerID="d371ec329d5f05fd4f2939014e8f37178e3f302f05a879ed54a660ec6ec80866"
Sep 18 22:16:46.846566 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:46.846521    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:16:46.846697 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:46.846625    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:16:46.846697 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:46.846674    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:16:47.859473 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:47.859433    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-35758849-openshift-default-5bd7d4f6d8-s7kh7" event={"ID":"26ff9791-76db-4aa7-af4a-a66a9fb968a1","Type":"ContainerStarted","Data":"b6507edaad557f611fe635945a098f729cde05f1754b8185f6e9150b038407c1"}
Sep 18 22:16:48.738153 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:48.738117    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-35758849-openshift-default-5bd7d4f6d8-s7kh7"
Sep 18 22:16:48.738378 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:48.738356    2577 patch_prober.go:28] interesting pod/e2e-derive-35758849-openshift-default-5bd7d4f6d8-s7kh7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Sep 18 22:16:48.738454 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:48.738407    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-35758849-openshift-default-5bd7d4f6d8-s7kh7" podUID="26ff9791-76db-4aa7-af4a-a66a9fb968a1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Sep 18 22:16:49.738163 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:49.738128    2577 patch_prober.go:28] interesting pod/e2e-derive-35758849-openshift-default-5bd7d4f6d8-s7kh7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Sep 18 22:16:49.738569 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:49.738201    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-35758849-openshift-default-5bd7d4f6d8-s7kh7" podUID="26ff9791-76db-4aa7-af4a-a66a9fb968a1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Sep 18 22:16:50.738063 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:50.738030    2577 patch_prober.go:28] interesting pod/e2e-derive-35758849-openshift-default-5bd7d4f6d8-s7kh7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Sep 18 22:16:50.738252 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:50.738094    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-35758849-openshift-default-5bd7d4f6d8-s7kh7" podUID="26ff9791-76db-4aa7-af4a-a66a9fb968a1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Sep 18 22:16:51.737760 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:51.737723    2577 patch_prober.go:28] interesting pod/e2e-derive-35758849-openshift-default-5bd7d4f6d8-s7kh7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Sep 18 22:16:51.737948 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:51.737795    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-35758849-openshift-default-5bd7d4f6d8-s7kh7" podUID="26ff9791-76db-4aa7-af4a-a66a9fb968a1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Sep 18 22:16:52.738472 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:52.738406    2577 patch_prober.go:28] interesting pod/e2e-derive-35758849-openshift-default-5bd7d4f6d8-s7kh7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Sep 18 22:16:52.738874 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:52.738498    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-35758849-openshift-default-5bd7d4f6d8-s7kh7" podUID="26ff9791-76db-4aa7-af4a-a66a9fb968a1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Sep 18 22:16:53.742583 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:53.742554    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-35758849-openshift-default-5bd7d4f6d8-s7kh7"
Sep 18 22:16:53.743045 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:53.742838    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-35758849-openshift-default-5bd7d4f6d8-s7kh7"
Sep 18 22:16:53.743511 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:53.743492    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-35758849-openshift-default-5bd7d4f6d8-s7kh7"
Sep 18 22:16:54.059509 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:54.059482    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-35758849-44j5l"]
Sep 18 22:16:54.059947 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:54.059934    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c25c0be-6d0f-4c0d-8973-4e509c720484" containerName="istio-proxy"
Sep 18 22:16:54.060019 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:54.059949    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c25c0be-6d0f-4c0d-8973-4e509c720484" containerName="istio-proxy"
Sep 18 22:16:54.060019 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:54.059961    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c25c0be-6d0f-4c0d-8973-4e509c720484" containerName="istio-proxy"
Sep 18 22:16:54.060019 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:54.059966    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c25c0be-6d0f-4c0d-8973-4e509c720484" containerName="istio-proxy"
Sep 18 22:16:54.060175 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:54.060036    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c25c0be-6d0f-4c0d-8973-4e509c720484" containerName="istio-proxy"
Sep 18 22:16:54.063263 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:54.063243    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-35758849-44j5l"
Sep 18 22:16:54.066562 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:54.066537    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-9g7m4\""
Sep 18 22:16:54.075743 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:54.075715    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-35758849-44j5l"]
Sep 18 22:16:54.129212 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:54.129183    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b6d1336-bf07-4e4b-a822-b37d8bb2f097-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-35758849-44j5l\" (UID: \"2b6d1336-bf07-4e4b-a822-b37d8bb2f097\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-35758849-44j5l"
Sep 18 22:16:54.230662 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:54.230615    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b6d1336-bf07-4e4b-a822-b37d8bb2f097-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-35758849-44j5l\" (UID: \"2b6d1336-bf07-4e4b-a822-b37d8bb2f097\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-35758849-44j5l"
Sep 18 22:16:54.231215 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:54.231193    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b6d1336-bf07-4e4b-a822-b37d8bb2f097-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-35758849-44j5l\" (UID: \"2b6d1336-bf07-4e4b-a822-b37d8bb2f097\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-35758849-44j5l"
Sep 18 22:16:54.377172 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:54.377068    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-35758849-44j5l"
Sep 18 22:16:54.658924 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:54.658886    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-35758849-44j5l"]
Sep 18 22:16:54.659230 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:16:54.659208    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b6d1336_bf07_4e4b_a822_b37d8bb2f097.slice/crio-27d04b3c58987102e094fa9d642301686ac7afaaaa0b82775521f8467d29166e WatchSource:0}: Error finding container 27d04b3c58987102e094fa9d642301686ac7afaaaa0b82775521f8467d29166e: Status 404 returned error can't find the container with id 27d04b3c58987102e094fa9d642301686ac7afaaaa0b82775521f8467d29166e
Sep 18 22:16:54.933268 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:54.933185    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-35758849-44j5l" event={"ID":"2b6d1336-bf07-4e4b-a822-b37d8bb2f097","Type":"ContainerStarted","Data":"b2d96f0d43d200be21fc362e14521d2fb6e8b924efff2be49ef846da588bce3b"}
Sep 18 22:16:54.933268 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:54.933253    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-35758849-44j5l" event={"ID":"2b6d1336-bf07-4e4b-a822-b37d8bb2f097","Type":"ContainerStarted","Data":"27d04b3c58987102e094fa9d642301686ac7afaaaa0b82775521f8467d29166e"}
Sep 18 22:16:54.957733 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:54.957686    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-35758849-44j5l" podStartSLOduration=0.957671239 podStartE2EDuration="957.671239ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:16:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:16:54.952115627 +0000 UTC m=+994.271787676" watchObservedRunningTime="2026-09-18 22:16:54.957671239 +0000 UTC m=+994.277343294"
Sep 18 22:16:55.941783 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:55.941748    2577 generic.go:356] "Generic (PLEG): container finished" podID="2b6d1336-bf07-4e4b-a822-b37d8bb2f097" containerID="b2d96f0d43d200be21fc362e14521d2fb6e8b924efff2be49ef846da588bce3b" exitCode=0
Sep 18 22:16:55.942168 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:55.941792    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-35758849-44j5l" event={"ID":"2b6d1336-bf07-4e4b-a822-b37d8bb2f097","Type":"ContainerDied","Data":"b2d96f0d43d200be21fc362e14521d2fb6e8b924efff2be49ef846da588bce3b"}
Sep 18 22:16:57.097512 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:57.097485    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-35758849-44j5l"
Sep 18 22:16:57.160665 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:57.160638    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b6d1336-bf07-4e4b-a822-b37d8bb2f097-maas-api-service-ca\") pod \"2b6d1336-bf07-4e4b-a822-b37d8bb2f097\" (UID: \"2b6d1336-bf07-4e4b-a822-b37d8bb2f097\") "
Sep 18 22:16:57.161039 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:57.161006    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b6d1336-bf07-4e4b-a822-b37d8bb2f097-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2b6d1336-bf07-4e4b-a822-b37d8bb2f097" (UID: "2b6d1336-bf07-4e4b-a822-b37d8bb2f097"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:16:57.161140 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:57.161124    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b6d1336-bf07-4e4b-a822-b37d8bb2f097-maas-api-service-ca\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:16:57.958356 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:57.958319    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-35758849-44j5l"
Sep 18 22:16:57.958559 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:57.958359    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-35758849-44j5l" event={"ID":"2b6d1336-bf07-4e4b-a822-b37d8bb2f097","Type":"ContainerDied","Data":"27d04b3c58987102e094fa9d642301686ac7afaaaa0b82775521f8467d29166e"}
Sep 18 22:16:57.958559 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:16:57.958465    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="27d04b3c58987102e094fa9d642301686ac7afaaaa0b82775521f8467d29166e"
Sep 18 22:17:06.774071 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:06.774035    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-35758849-44j5l"]
Sep 18 22:17:06.783131 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:06.783108    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-35758849-44j5l"]
Sep 18 22:17:06.918924 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:06.918891    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-35758849-openshift-default-5bd7d4f6d8-s7kh7"]
Sep 18 22:17:06.919163 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:06.919136    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-35758849-openshift-default-5bd7d4f6d8-s7kh7" podUID="26ff9791-76db-4aa7-af4a-a66a9fb968a1" containerName="istio-proxy" containerID="cri-o://b6507edaad557f611fe635945a098f729cde05f1754b8185f6e9150b038407c1" gracePeriod=30
Sep 18 22:17:07.143567 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:07.143530    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b6d1336-bf07-4e4b-a822-b37d8bb2f097" path="/var/lib/kubelet/pods/2b6d1336-bf07-4e4b-a822-b37d8bb2f097/volumes"
Sep 18 22:17:08.746491 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:08.746453    2577 patch_prober.go:28] interesting pod/e2e-derive-35758849-openshift-default-5bd7d4f6d8-s7kh7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 18 22:17:08.746990 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:08.746557    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-35758849-openshift-default-5bd7d4f6d8-s7kh7" podUID="26ff9791-76db-4aa7-af4a-a66a9fb968a1" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 22:17:12.066766 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:12.066724    2577 generic.go:356] "Generic (PLEG): container finished" podID="26ff9791-76db-4aa7-af4a-a66a9fb968a1" containerID="b6507edaad557f611fe635945a098f729cde05f1754b8185f6e9150b038407c1" exitCode=0
Sep 18 22:17:12.067271 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:12.066794    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-35758849-openshift-default-5bd7d4f6d8-s7kh7" event={"ID":"26ff9791-76db-4aa7-af4a-a66a9fb968a1","Type":"ContainerDied","Data":"b6507edaad557f611fe635945a098f729cde05f1754b8185f6e9150b038407c1"}
Sep 18 22:17:12.067271 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:12.066859    2577 scope.go:117] "RemoveContainer" containerID="d371ec329d5f05fd4f2939014e8f37178e3f302f05a879ed54a660ec6ec80866"
Sep 18 22:17:12.183225 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:12.183165    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-35758849-openshift-default-5bd7d4f6d8-s7kh7"
Sep 18 22:17:12.315581 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:12.315547    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/26ff9791-76db-4aa7-af4a-a66a9fb968a1-istio-data\") pod \"26ff9791-76db-4aa7-af4a-a66a9fb968a1\" (UID: \"26ff9791-76db-4aa7-af4a-a66a9fb968a1\") "
Sep 18 22:17:12.315785 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:12.315641    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/26ff9791-76db-4aa7-af4a-a66a9fb968a1-workload-certs\") pod \"26ff9791-76db-4aa7-af4a-a66a9fb968a1\" (UID: \"26ff9791-76db-4aa7-af4a-a66a9fb968a1\") "
Sep 18 22:17:12.315785 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:12.315692    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/26ff9791-76db-4aa7-af4a-a66a9fb968a1-istiod-ca-cert\") pod \"26ff9791-76db-4aa7-af4a-a66a9fb968a1\" (UID: \"26ff9791-76db-4aa7-af4a-a66a9fb968a1\") "
Sep 18 22:17:12.315785 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:12.315779    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cg47b\" (UniqueName: \"kubernetes.io/projected/26ff9791-76db-4aa7-af4a-a66a9fb968a1-kube-api-access-cg47b\") pod \"26ff9791-76db-4aa7-af4a-a66a9fb968a1\" (UID: \"26ff9791-76db-4aa7-af4a-a66a9fb968a1\") "
Sep 18 22:17:12.316037 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:12.315805    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/26ff9791-76db-4aa7-af4a-a66a9fb968a1-istio-podinfo\") pod \"26ff9791-76db-4aa7-af4a-a66a9fb968a1\" (UID: \"26ff9791-76db-4aa7-af4a-a66a9fb968a1\") "
Sep 18 22:17:12.316037 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:12.315835    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/26ff9791-76db-4aa7-af4a-a66a9fb968a1-istio-envoy\") pod \"26ff9791-76db-4aa7-af4a-a66a9fb968a1\" (UID: \"26ff9791-76db-4aa7-af4a-a66a9fb968a1\") "
Sep 18 22:17:12.316037 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:12.315858    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/26ff9791-76db-4aa7-af4a-a66a9fb968a1-istio-token\") pod \"26ff9791-76db-4aa7-af4a-a66a9fb968a1\" (UID: \"26ff9791-76db-4aa7-af4a-a66a9fb968a1\") "
Sep 18 22:17:12.316037 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:12.315830    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26ff9791-76db-4aa7-af4a-a66a9fb968a1-istio-data" (OuterVolumeSpecName: "istio-data") pod "26ff9791-76db-4aa7-af4a-a66a9fb968a1" (UID: "26ff9791-76db-4aa7-af4a-a66a9fb968a1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:17:12.316037 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:12.315937    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26ff9791-76db-4aa7-af4a-a66a9fb968a1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "26ff9791-76db-4aa7-af4a-a66a9fb968a1" (UID: "26ff9791-76db-4aa7-af4a-a66a9fb968a1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:17:12.316037 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:12.315995    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/26ff9791-76db-4aa7-af4a-a66a9fb968a1-workload-socket\") pod \"26ff9791-76db-4aa7-af4a-a66a9fb968a1\" (UID: \"26ff9791-76db-4aa7-af4a-a66a9fb968a1\") "
Sep 18 22:17:12.316328 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:12.316043    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/26ff9791-76db-4aa7-af4a-a66a9fb968a1-credential-socket\") pod \"26ff9791-76db-4aa7-af4a-a66a9fb968a1\" (UID: \"26ff9791-76db-4aa7-af4a-a66a9fb968a1\") "
Sep 18 22:17:12.316328 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:12.316261    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26ff9791-76db-4aa7-af4a-a66a9fb968a1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "26ff9791-76db-4aa7-af4a-a66a9fb968a1" (UID: "26ff9791-76db-4aa7-af4a-a66a9fb968a1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:17:12.316530 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:12.316502    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26ff9791-76db-4aa7-af4a-a66a9fb968a1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "26ff9791-76db-4aa7-af4a-a66a9fb968a1" (UID: "26ff9791-76db-4aa7-af4a-a66a9fb968a1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:17:12.316530 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:12.316510    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/26ff9791-76db-4aa7-af4a-a66a9fb968a1-istio-data\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:17:12.316717 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:12.316558    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/26ff9791-76db-4aa7-af4a-a66a9fb968a1-workload-certs\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:17:12.316717 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:12.316573    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/26ff9791-76db-4aa7-af4a-a66a9fb968a1-istiod-ca-cert\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:17:12.316717 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:12.316702    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26ff9791-76db-4aa7-af4a-a66a9fb968a1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "26ff9791-76db-4aa7-af4a-a66a9fb968a1" (UID: "26ff9791-76db-4aa7-af4a-a66a9fb968a1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:17:12.318314 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:12.318282    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26ff9791-76db-4aa7-af4a-a66a9fb968a1-istio-token" (OuterVolumeSpecName: "istio-token") pod "26ff9791-76db-4aa7-af4a-a66a9fb968a1" (UID: "26ff9791-76db-4aa7-af4a-a66a9fb968a1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:17:12.318453 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:12.318320    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/26ff9791-76db-4aa7-af4a-a66a9fb968a1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "26ff9791-76db-4aa7-af4a-a66a9fb968a1" (UID: "26ff9791-76db-4aa7-af4a-a66a9fb968a1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 18 22:17:12.318453 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:12.318365    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26ff9791-76db-4aa7-af4a-a66a9fb968a1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "26ff9791-76db-4aa7-af4a-a66a9fb968a1" (UID: "26ff9791-76db-4aa7-af4a-a66a9fb968a1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:17:12.318568 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:12.318532    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26ff9791-76db-4aa7-af4a-a66a9fb968a1-kube-api-access-cg47b" (OuterVolumeSpecName: "kube-api-access-cg47b") pod "26ff9791-76db-4aa7-af4a-a66a9fb968a1" (UID: "26ff9791-76db-4aa7-af4a-a66a9fb968a1"). InnerVolumeSpecName "kube-api-access-cg47b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:17:12.417264 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:12.417226    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cg47b\" (UniqueName: \"kubernetes.io/projected/26ff9791-76db-4aa7-af4a-a66a9fb968a1-kube-api-access-cg47b\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:17:12.417264 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:12.417260    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/26ff9791-76db-4aa7-af4a-a66a9fb968a1-istio-podinfo\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:17:12.417264 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:12.417270    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/26ff9791-76db-4aa7-af4a-a66a9fb968a1-istio-envoy\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:17:12.417531 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:12.417279    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/26ff9791-76db-4aa7-af4a-a66a9fb968a1-istio-token\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:17:12.417531 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:12.417287    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/26ff9791-76db-4aa7-af4a-a66a9fb968a1-workload-socket\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:17:12.417531 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:12.417294    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/26ff9791-76db-4aa7-af4a-a66a9fb968a1-credential-socket\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:17:13.074736 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:13.074710    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-35758849-openshift-default-5bd7d4f6d8-s7kh7"
Sep 18 22:17:13.075191 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:13.074752    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-35758849-openshift-default-5bd7d4f6d8-s7kh7" event={"ID":"26ff9791-76db-4aa7-af4a-a66a9fb968a1","Type":"ContainerDied","Data":"77a96e9339683b76a591000e3b8dcda8cc25caefe5a361f4c15256af93ce98d0"}
Sep 18 22:17:13.075191 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:13.074804    2577 scope.go:117] "RemoveContainer" containerID="b6507edaad557f611fe635945a098f729cde05f1754b8185f6e9150b038407c1"
Sep 18 22:17:13.100439 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:13.100382    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-35758849-openshift-default-5bd7d4f6d8-s7kh7"]
Sep 18 22:17:13.104699 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:13.104674    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-35758849-openshift-default-5bd7d4f6d8-s7kh7"]
Sep 18 22:17:13.140585 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:13.140559    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26ff9791-76db-4aa7-af4a-a66a9fb968a1" path="/var/lib/kubelet/pods/26ff9791-76db-4aa7-af4a-a66a9fb968a1/volumes"
Sep 18 22:17:21.563882 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:21.563849    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h"]
Sep 18 22:17:21.564275 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:21.564119    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h" podUID="88740ac0-7237-4035-a68d-74d4d7dc7619" containerName="istio-proxy" containerID="cri-o://c63aff3f701baa74c729097a48e3395d345ab910245f0668e9f41ceaff6dbb3e" gracePeriod=30
Sep 18 22:17:22.476459 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:22.476422    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-explicit-4209a4-openshift-default-57976f4696-7tn9n"]
Sep 18 22:17:22.476901 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:22.476887    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b6d1336-bf07-4e4b-a822-b37d8bb2f097" containerName="revoke-keys"
Sep 18 22:17:22.476901 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:22.476903    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b6d1336-bf07-4e4b-a822-b37d8bb2f097" containerName="revoke-keys"
Sep 18 22:17:22.477021 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:22.476917    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26ff9791-76db-4aa7-af4a-a66a9fb968a1" containerName="istio-proxy"
Sep 18 22:17:22.477021 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:22.476923    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="26ff9791-76db-4aa7-af4a-a66a9fb968a1" containerName="istio-proxy"
Sep 18 22:17:22.477021 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:22.476934    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26ff9791-76db-4aa7-af4a-a66a9fb968a1" containerName="istio-proxy"
Sep 18 22:17:22.477021 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:22.476939    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="26ff9791-76db-4aa7-af4a-a66a9fb968a1" containerName="istio-proxy"
Sep 18 22:17:22.477021 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:22.477019    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="26ff9791-76db-4aa7-af4a-a66a9fb968a1" containerName="istio-proxy"
Sep 18 22:17:22.477280 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:22.477034    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b6d1336-bf07-4e4b-a822-b37d8bb2f097" containerName="revoke-keys"
Sep 18 22:17:22.477280 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:22.477042    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c25c0be-6d0f-4c0d-8973-4e509c720484" containerName="istio-proxy"
Sep 18 22:17:22.481535 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:22.481509    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-4209a4-openshift-default-57976f4696-7tn9n"
Sep 18 22:17:22.484988 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:22.484972    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-explicit-4209a4-openshift-default-dockercfg-kdsmf\""
Sep 18 22:17:22.532582 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:22.532538    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-4209a4-openshift-default-57976f4696-7tn9n"]
Sep 18 22:17:22.613559 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:22.613523    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c93ed92f-bf02-4351-8e94-389c64a30005-workload-certs\") pod \"e2e-explicit-4209a4-openshift-default-57976f4696-7tn9n\" (UID: \"c93ed92f-bf02-4351-8e94-389c64a30005\") " pod="openshift-ingress/e2e-explicit-4209a4-openshift-default-57976f4696-7tn9n"
Sep 18 22:17:22.613984 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:22.613575    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c93ed92f-bf02-4351-8e94-389c64a30005-workload-socket\") pod \"e2e-explicit-4209a4-openshift-default-57976f4696-7tn9n\" (UID: \"c93ed92f-bf02-4351-8e94-389c64a30005\") " pod="openshift-ingress/e2e-explicit-4209a4-openshift-default-57976f4696-7tn9n"
Sep 18 22:17:22.613984 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:22.613684    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c93ed92f-bf02-4351-8e94-389c64a30005-istio-podinfo\") pod \"e2e-explicit-4209a4-openshift-default-57976f4696-7tn9n\" (UID: \"c93ed92f-bf02-4351-8e94-389c64a30005\") " pod="openshift-ingress/e2e-explicit-4209a4-openshift-default-57976f4696-7tn9n"
Sep 18 22:17:22.613984 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:22.613729    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xndpz\" (UniqueName: \"kubernetes.io/projected/c93ed92f-bf02-4351-8e94-389c64a30005-kube-api-access-xndpz\") pod \"e2e-explicit-4209a4-openshift-default-57976f4696-7tn9n\" (UID: \"c93ed92f-bf02-4351-8e94-389c64a30005\") " pod="openshift-ingress/e2e-explicit-4209a4-openshift-default-57976f4696-7tn9n"
Sep 18 22:17:22.613984 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:22.613796    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c93ed92f-bf02-4351-8e94-389c64a30005-credential-socket\") pod \"e2e-explicit-4209a4-openshift-default-57976f4696-7tn9n\" (UID: \"c93ed92f-bf02-4351-8e94-389c64a30005\") " pod="openshift-ingress/e2e-explicit-4209a4-openshift-default-57976f4696-7tn9n"
Sep 18 22:17:22.613984 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:22.613839    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c93ed92f-bf02-4351-8e94-389c64a30005-istio-envoy\") pod \"e2e-explicit-4209a4-openshift-default-57976f4696-7tn9n\" (UID: \"c93ed92f-bf02-4351-8e94-389c64a30005\") " pod="openshift-ingress/e2e-explicit-4209a4-openshift-default-57976f4696-7tn9n"
Sep 18 22:17:22.613984 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:22.613855    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c93ed92f-bf02-4351-8e94-389c64a30005-istio-token\") pod \"e2e-explicit-4209a4-openshift-default-57976f4696-7tn9n\" (UID: \"c93ed92f-bf02-4351-8e94-389c64a30005\") " pod="openshift-ingress/e2e-explicit-4209a4-openshift-default-57976f4696-7tn9n"
Sep 18 22:17:22.613984 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:22.613875    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c93ed92f-bf02-4351-8e94-389c64a30005-istiod-ca-cert\") pod \"e2e-explicit-4209a4-openshift-default-57976f4696-7tn9n\" (UID: \"c93ed92f-bf02-4351-8e94-389c64a30005\") " pod="openshift-ingress/e2e-explicit-4209a4-openshift-default-57976f4696-7tn9n"
Sep 18 22:17:22.613984 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:22.613958    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c93ed92f-bf02-4351-8e94-389c64a30005-istio-data\") pod \"e2e-explicit-4209a4-openshift-default-57976f4696-7tn9n\" (UID: \"c93ed92f-bf02-4351-8e94-389c64a30005\") " pod="openshift-ingress/e2e-explicit-4209a4-openshift-default-57976f4696-7tn9n"
Sep 18 22:17:22.714998 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:22.714961    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c93ed92f-bf02-4351-8e94-389c64a30005-istio-data\") pod \"e2e-explicit-4209a4-openshift-default-57976f4696-7tn9n\" (UID: \"c93ed92f-bf02-4351-8e94-389c64a30005\") " pod="openshift-ingress/e2e-explicit-4209a4-openshift-default-57976f4696-7tn9n"
Sep 18 22:17:22.715184 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:22.715013    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c93ed92f-bf02-4351-8e94-389c64a30005-workload-certs\") pod \"e2e-explicit-4209a4-openshift-default-57976f4696-7tn9n\" (UID: \"c93ed92f-bf02-4351-8e94-389c64a30005\") " pod="openshift-ingress/e2e-explicit-4209a4-openshift-default-57976f4696-7tn9n"
Sep 18 22:17:22.715184 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:22.715050    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c93ed92f-bf02-4351-8e94-389c64a30005-workload-socket\") pod \"e2e-explicit-4209a4-openshift-default-57976f4696-7tn9n\" (UID: \"c93ed92f-bf02-4351-8e94-389c64a30005\") " pod="openshift-ingress/e2e-explicit-4209a4-openshift-default-57976f4696-7tn9n"
Sep 18 22:17:22.715184 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:22.715099    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c93ed92f-bf02-4351-8e94-389c64a30005-istio-podinfo\") pod \"e2e-explicit-4209a4-openshift-default-57976f4696-7tn9n\" (UID: \"c93ed92f-bf02-4351-8e94-389c64a30005\") " pod="openshift-ingress/e2e-explicit-4209a4-openshift-default-57976f4696-7tn9n"
Sep 18 22:17:22.715184 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:22.715130    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xndpz\" (UniqueName: \"kubernetes.io/projected/c93ed92f-bf02-4351-8e94-389c64a30005-kube-api-access-xndpz\") pod \"e2e-explicit-4209a4-openshift-default-57976f4696-7tn9n\" (UID: \"c93ed92f-bf02-4351-8e94-389c64a30005\") " pod="openshift-ingress/e2e-explicit-4209a4-openshift-default-57976f4696-7tn9n"
Sep 18 22:17:22.715184 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:22.715179    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c93ed92f-bf02-4351-8e94-389c64a30005-credential-socket\") pod \"e2e-explicit-4209a4-openshift-default-57976f4696-7tn9n\" (UID: \"c93ed92f-bf02-4351-8e94-389c64a30005\") " pod="openshift-ingress/e2e-explicit-4209a4-openshift-default-57976f4696-7tn9n"
Sep 18 22:17:22.715496 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:22.715219    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c93ed92f-bf02-4351-8e94-389c64a30005-istio-envoy\") pod \"e2e-explicit-4209a4-openshift-default-57976f4696-7tn9n\" (UID: \"c93ed92f-bf02-4351-8e94-389c64a30005\") " pod="openshift-ingress/e2e-explicit-4209a4-openshift-default-57976f4696-7tn9n"
Sep 18 22:17:22.715496 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:22.715468    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c93ed92f-bf02-4351-8e94-389c64a30005-istio-data\") pod \"e2e-explicit-4209a4-openshift-default-57976f4696-7tn9n\" (UID: \"c93ed92f-bf02-4351-8e94-389c64a30005\") " pod="openshift-ingress/e2e-explicit-4209a4-openshift-default-57976f4696-7tn9n"
Sep 18 22:17:22.715610 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:22.715542    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c93ed92f-bf02-4351-8e94-389c64a30005-istio-token\") pod \"e2e-explicit-4209a4-openshift-default-57976f4696-7tn9n\" (UID: \"c93ed92f-bf02-4351-8e94-389c64a30005\") " pod="openshift-ingress/e2e-explicit-4209a4-openshift-default-57976f4696-7tn9n"
Sep 18 22:17:22.715610 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:22.715592    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c93ed92f-bf02-4351-8e94-389c64a30005-istiod-ca-cert\") pod \"e2e-explicit-4209a4-openshift-default-57976f4696-7tn9n\" (UID: \"c93ed92f-bf02-4351-8e94-389c64a30005\") " pod="openshift-ingress/e2e-explicit-4209a4-openshift-default-57976f4696-7tn9n"
Sep 18 22:17:22.715764 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:22.715742    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c93ed92f-bf02-4351-8e94-389c64a30005-workload-certs\") pod \"e2e-explicit-4209a4-openshift-default-57976f4696-7tn9n\" (UID: \"c93ed92f-bf02-4351-8e94-389c64a30005\") " pod="openshift-ingress/e2e-explicit-4209a4-openshift-default-57976f4696-7tn9n"
Sep 18 22:17:22.715838 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:22.715749    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c93ed92f-bf02-4351-8e94-389c64a30005-credential-socket\") pod \"e2e-explicit-4209a4-openshift-default-57976f4696-7tn9n\" (UID: \"c93ed92f-bf02-4351-8e94-389c64a30005\") " pod="openshift-ingress/e2e-explicit-4209a4-openshift-default-57976f4696-7tn9n"
Sep 18 22:17:22.715904 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:22.715836    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c93ed92f-bf02-4351-8e94-389c64a30005-workload-socket\") pod \"e2e-explicit-4209a4-openshift-default-57976f4696-7tn9n\" (UID: \"c93ed92f-bf02-4351-8e94-389c64a30005\") " pod="openshift-ingress/e2e-explicit-4209a4-openshift-default-57976f4696-7tn9n"
Sep 18 22:17:22.716225 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:22.716203    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c93ed92f-bf02-4351-8e94-389c64a30005-istiod-ca-cert\") pod \"e2e-explicit-4209a4-openshift-default-57976f4696-7tn9n\" (UID: \"c93ed92f-bf02-4351-8e94-389c64a30005\") " pod="openshift-ingress/e2e-explicit-4209a4-openshift-default-57976f4696-7tn9n"
Sep 18 22:17:22.717653 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:22.717633    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c93ed92f-bf02-4351-8e94-389c64a30005-istio-envoy\") pod \"e2e-explicit-4209a4-openshift-default-57976f4696-7tn9n\" (UID: \"c93ed92f-bf02-4351-8e94-389c64a30005\") " pod="openshift-ingress/e2e-explicit-4209a4-openshift-default-57976f4696-7tn9n"
Sep 18 22:17:22.717813 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:22.717795    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c93ed92f-bf02-4351-8e94-389c64a30005-istio-podinfo\") pod \"e2e-explicit-4209a4-openshift-default-57976f4696-7tn9n\" (UID: \"c93ed92f-bf02-4351-8e94-389c64a30005\") " pod="openshift-ingress/e2e-explicit-4209a4-openshift-default-57976f4696-7tn9n"
Sep 18 22:17:22.735794 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:22.735738    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xndpz\" (UniqueName: \"kubernetes.io/projected/c93ed92f-bf02-4351-8e94-389c64a30005-kube-api-access-xndpz\") pod \"e2e-explicit-4209a4-openshift-default-57976f4696-7tn9n\" (UID: \"c93ed92f-bf02-4351-8e94-389c64a30005\") " pod="openshift-ingress/e2e-explicit-4209a4-openshift-default-57976f4696-7tn9n"
Sep 18 22:17:22.737731 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:22.737711    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c93ed92f-bf02-4351-8e94-389c64a30005-istio-token\") pod \"e2e-explicit-4209a4-openshift-default-57976f4696-7tn9n\" (UID: \"c93ed92f-bf02-4351-8e94-389c64a30005\") " pod="openshift-ingress/e2e-explicit-4209a4-openshift-default-57976f4696-7tn9n"
Sep 18 22:17:22.795529 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:22.795500    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-4209a4-openshift-default-57976f4696-7tn9n"
Sep 18 22:17:23.097701 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:23.097674    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-4209a4-openshift-default-57976f4696-7tn9n"]
Sep 18 22:17:23.098642 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:17:23.098620    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc93ed92f_bf02_4351_8e94_389c64a30005.slice/crio-75eabb2a6e89724cd0c4cb4d17db45db0a4f8a551a04ad14cd7b9b219d380b1d WatchSource:0}: Error finding container 75eabb2a6e89724cd0c4cb4d17db45db0a4f8a551a04ad14cd7b9b219d380b1d: Status 404 returned error can't find the container with id 75eabb2a6e89724cd0c4cb4d17db45db0a4f8a551a04ad14cd7b9b219d380b1d
Sep 18 22:17:23.100917 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:23.100885    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:17:23.101004 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:23.100950    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:17:23.101004 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:23.100978    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:17:23.142774 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:23.142751    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-4209a4-openshift-default-57976f4696-7tn9n" event={"ID":"c93ed92f-bf02-4351-8e94-389c64a30005","Type":"ContainerStarted","Data":"75eabb2a6e89724cd0c4cb4d17db45db0a4f8a551a04ad14cd7b9b219d380b1d"}
Sep 18 22:17:24.153065 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:24.153033    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-4209a4-openshift-default-57976f4696-7tn9n" event={"ID":"c93ed92f-bf02-4351-8e94-389c64a30005","Type":"ContainerStarted","Data":"af06e6bea06e912f53794cc6ee6d23c58507731da112ba0497a08ce4ef8f827e"}
Sep 18 22:17:24.181159 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:24.181108    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-explicit-4209a4-openshift-default-57976f4696-7tn9n" podStartSLOduration=2.181092235 podStartE2EDuration="2.181092235s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:17:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:17:24.178284783 +0000 UTC m=+1023.497956852" watchObservedRunningTime="2026-09-18 22:17:24.181092235 +0000 UTC m=+1023.500764290"
Sep 18 22:17:24.741034 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:24.740991    2577 patch_prober.go:28] interesting pod/e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 18 22:17:24.741215 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:24.741059    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h" podUID="88740ac0-7237-4035-a68d-74d4d7dc7619" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 22:17:24.796544 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:24.796516    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-4209a4-openshift-default-57976f4696-7tn9n"
Sep 18 22:17:24.801649 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:24.801624    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-4209a4-openshift-default-57976f4696-7tn9n"
Sep 18 22:17:25.160336 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:25.160303    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-4209a4-openshift-default-57976f4696-7tn9n"
Sep 18 22:17:25.161883 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:25.161857    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-4209a4-openshift-default-57976f4696-7tn9n"
Sep 18 22:17:26.813572 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:26.813547    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h"
Sep 18 22:17:26.961776 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:26.961687    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qcxnw\" (UniqueName: \"kubernetes.io/projected/88740ac0-7237-4035-a68d-74d4d7dc7619-kube-api-access-qcxnw\") pod \"88740ac0-7237-4035-a68d-74d4d7dc7619\" (UID: \"88740ac0-7237-4035-a68d-74d4d7dc7619\") "
Sep 18 22:17:26.961949 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:26.961805    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/88740ac0-7237-4035-a68d-74d4d7dc7619-istio-token\") pod \"88740ac0-7237-4035-a68d-74d4d7dc7619\" (UID: \"88740ac0-7237-4035-a68d-74d4d7dc7619\") "
Sep 18 22:17:26.961949 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:26.961902    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/88740ac0-7237-4035-a68d-74d4d7dc7619-istiod-ca-cert\") pod \"88740ac0-7237-4035-a68d-74d4d7dc7619\" (UID: \"88740ac0-7237-4035-a68d-74d4d7dc7619\") "
Sep 18 22:17:26.961949 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:26.961944    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/88740ac0-7237-4035-a68d-74d4d7dc7619-istio-podinfo\") pod \"88740ac0-7237-4035-a68d-74d4d7dc7619\" (UID: \"88740ac0-7237-4035-a68d-74d4d7dc7619\") "
Sep 18 22:17:26.962128 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:26.961997    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/88740ac0-7237-4035-a68d-74d4d7dc7619-istio-data\") pod \"88740ac0-7237-4035-a68d-74d4d7dc7619\" (UID: \"88740ac0-7237-4035-a68d-74d4d7dc7619\") "
Sep 18 22:17:26.962128 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:26.962022    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/88740ac0-7237-4035-a68d-74d4d7dc7619-workload-certs\") pod \"88740ac0-7237-4035-a68d-74d4d7dc7619\" (UID: \"88740ac0-7237-4035-a68d-74d4d7dc7619\") "
Sep 18 22:17:26.962128 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:26.962100    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/88740ac0-7237-4035-a68d-74d4d7dc7619-istio-envoy\") pod \"88740ac0-7237-4035-a68d-74d4d7dc7619\" (UID: \"88740ac0-7237-4035-a68d-74d4d7dc7619\") "
Sep 18 22:17:26.962279 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:26.962135    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/88740ac0-7237-4035-a68d-74d4d7dc7619-credential-socket\") pod \"88740ac0-7237-4035-a68d-74d4d7dc7619\" (UID: \"88740ac0-7237-4035-a68d-74d4d7dc7619\") "
Sep 18 22:17:26.962279 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:26.962164    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/88740ac0-7237-4035-a68d-74d4d7dc7619-workload-socket\") pod \"88740ac0-7237-4035-a68d-74d4d7dc7619\" (UID: \"88740ac0-7237-4035-a68d-74d4d7dc7619\") "
Sep 18 22:17:26.962279 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:26.962248    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88740ac0-7237-4035-a68d-74d4d7dc7619-istio-data" (OuterVolumeSpecName: "istio-data") pod "88740ac0-7237-4035-a68d-74d4d7dc7619" (UID: "88740ac0-7237-4035-a68d-74d4d7dc7619"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:17:26.962279 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:26.962255    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/88740ac0-7237-4035-a68d-74d4d7dc7619-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "88740ac0-7237-4035-a68d-74d4d7dc7619" (UID: "88740ac0-7237-4035-a68d-74d4d7dc7619"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:17:26.962583 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:26.962366    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88740ac0-7237-4035-a68d-74d4d7dc7619-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "88740ac0-7237-4035-a68d-74d4d7dc7619" (UID: "88740ac0-7237-4035-a68d-74d4d7dc7619"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:17:26.962583 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:26.962456    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88740ac0-7237-4035-a68d-74d4d7dc7619-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "88740ac0-7237-4035-a68d-74d4d7dc7619" (UID: "88740ac0-7237-4035-a68d-74d4d7dc7619"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:17:26.962790 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:26.962702    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88740ac0-7237-4035-a68d-74d4d7dc7619-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "88740ac0-7237-4035-a68d-74d4d7dc7619" (UID: "88740ac0-7237-4035-a68d-74d4d7dc7619"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:17:26.962967 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:26.962833    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/88740ac0-7237-4035-a68d-74d4d7dc7619-istiod-ca-cert\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:17:26.962967 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:26.962854    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/88740ac0-7237-4035-a68d-74d4d7dc7619-istio-data\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:17:26.962967 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:26.962867    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/88740ac0-7237-4035-a68d-74d4d7dc7619-workload-certs\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:17:26.962967 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:26.962881    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/88740ac0-7237-4035-a68d-74d4d7dc7619-credential-socket\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:17:26.962967 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:26.962896    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/88740ac0-7237-4035-a68d-74d4d7dc7619-workload-socket\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:17:26.964271 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:26.964243    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/88740ac0-7237-4035-a68d-74d4d7dc7619-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "88740ac0-7237-4035-a68d-74d4d7dc7619" (UID: "88740ac0-7237-4035-a68d-74d4d7dc7619"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 18 22:17:26.964271 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:26.964260    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88740ac0-7237-4035-a68d-74d4d7dc7619-istio-token" (OuterVolumeSpecName: "istio-token") pod "88740ac0-7237-4035-a68d-74d4d7dc7619" (UID: "88740ac0-7237-4035-a68d-74d4d7dc7619"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:17:26.964478 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:26.964457    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88740ac0-7237-4035-a68d-74d4d7dc7619-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "88740ac0-7237-4035-a68d-74d4d7dc7619" (UID: "88740ac0-7237-4035-a68d-74d4d7dc7619"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:17:26.964566 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:26.964550    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88740ac0-7237-4035-a68d-74d4d7dc7619-kube-api-access-qcxnw" (OuterVolumeSpecName: "kube-api-access-qcxnw") pod "88740ac0-7237-4035-a68d-74d4d7dc7619" (UID: "88740ac0-7237-4035-a68d-74d4d7dc7619"). InnerVolumeSpecName "kube-api-access-qcxnw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:17:27.063700 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:27.063671    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/88740ac0-7237-4035-a68d-74d4d7dc7619-istio-envoy\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:17:27.063700 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:27.063697    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qcxnw\" (UniqueName: \"kubernetes.io/projected/88740ac0-7237-4035-a68d-74d4d7dc7619-kube-api-access-qcxnw\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:17:27.063700 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:27.063707    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/88740ac0-7237-4035-a68d-74d4d7dc7619-istio-token\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:17:27.063922 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:27.063716    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/88740ac0-7237-4035-a68d-74d4d7dc7619-istio-podinfo\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:17:27.175834 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:27.175807    2577 generic.go:356] "Generic (PLEG): container finished" podID="88740ac0-7237-4035-a68d-74d4d7dc7619" containerID="c63aff3f701baa74c729097a48e3395d345ab910245f0668e9f41ceaff6dbb3e" exitCode=0
Sep 18 22:17:27.175979 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:27.175856    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h"
Sep 18 22:17:27.175979 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:27.175894    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h" event={"ID":"88740ac0-7237-4035-a68d-74d4d7dc7619","Type":"ContainerDied","Data":"c63aff3f701baa74c729097a48e3395d345ab910245f0668e9f41ceaff6dbb3e"}
Sep 18 22:17:27.175979 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:27.175952    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h" event={"ID":"88740ac0-7237-4035-a68d-74d4d7dc7619","Type":"ContainerDied","Data":"9544a3e5203b9cf4bcc854294389b95254e192c519cac421b68903d46242547f"}
Sep 18 22:17:27.175979 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:27.175978    2577 scope.go:117] "RemoveContainer" containerID="c63aff3f701baa74c729097a48e3395d345ab910245f0668e9f41ceaff6dbb3e"
Sep 18 22:17:27.185986 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:27.185954    2577 scope.go:117] "RemoveContainer" containerID="c3c3546f984c7a8b1f680ea87a275fce7e1f1e490e65ff6e3b1a644ca18eb414"
Sep 18 22:17:27.195123 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:27.195096    2577 scope.go:117] "RemoveContainer" containerID="c63aff3f701baa74c729097a48e3395d345ab910245f0668e9f41ceaff6dbb3e"
Sep 18 22:17:27.195451 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:17:27.195383    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c63aff3f701baa74c729097a48e3395d345ab910245f0668e9f41ceaff6dbb3e\": container with ID starting with c63aff3f701baa74c729097a48e3395d345ab910245f0668e9f41ceaff6dbb3e not found: ID does not exist" containerID="c63aff3f701baa74c729097a48e3395d345ab910245f0668e9f41ceaff6dbb3e"
Sep 18 22:17:27.195451 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:27.195428    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c63aff3f701baa74c729097a48e3395d345ab910245f0668e9f41ceaff6dbb3e"} err="failed to get container status \"c63aff3f701baa74c729097a48e3395d345ab910245f0668e9f41ceaff6dbb3e\": rpc error: code = NotFound desc = could not find container \"c63aff3f701baa74c729097a48e3395d345ab910245f0668e9f41ceaff6dbb3e\": container with ID starting with c63aff3f701baa74c729097a48e3395d345ab910245f0668e9f41ceaff6dbb3e not found: ID does not exist"
Sep 18 22:17:27.195451 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:27.195448    2577 scope.go:117] "RemoveContainer" containerID="c3c3546f984c7a8b1f680ea87a275fce7e1f1e490e65ff6e3b1a644ca18eb414"
Sep 18 22:17:27.195718 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:17:27.195701    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3c3546f984c7a8b1f680ea87a275fce7e1f1e490e65ff6e3b1a644ca18eb414\": container with ID starting with c3c3546f984c7a8b1f680ea87a275fce7e1f1e490e65ff6e3b1a644ca18eb414 not found: ID does not exist" containerID="c3c3546f984c7a8b1f680ea87a275fce7e1f1e490e65ff6e3b1a644ca18eb414"
Sep 18 22:17:27.195757 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:27.195725    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3c3546f984c7a8b1f680ea87a275fce7e1f1e490e65ff6e3b1a644ca18eb414"} err="failed to get container status \"c3c3546f984c7a8b1f680ea87a275fce7e1f1e490e65ff6e3b1a644ca18eb414\": rpc error: code = NotFound desc = could not find container \"c3c3546f984c7a8b1f680ea87a275fce7e1f1e490e65ff6e3b1a644ca18eb414\": container with ID starting with c3c3546f984c7a8b1f680ea87a275fce7e1f1e490e65ff6e3b1a644ca18eb414 not found: ID does not exist"
Sep 18 22:17:27.206932 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:27.206910    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h"]
Sep 18 22:17:27.212373 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:27.212318    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h"]
Sep 18 22:17:29.139864 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:29.139829    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="88740ac0-7237-4035-a68d-74d4d7dc7619" path="/var/lib/kubelet/pods/88740ac0-7237-4035-a68d-74d4d7dc7619/volumes"
Sep 18 22:17:41.030706 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:41.030677    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a13357-29829495-z7zgj"]
Sep 18 22:17:41.038816 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:41.038784    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a13357-29829495-z7zgj"]
Sep 18 22:17:41.109522 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:41.109482    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-a13357-7b6898dccd-gzcx5"]
Sep 18 22:17:41.109769 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:41.109725    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-a13357-7b6898dccd-gzcx5" podUID="4ca8691f-514c-4ff7-a9d7-94dce9b61f68" containerName="payload-pre-processing" containerID="cri-o://e96f191ce8c49a1da1d5ea47abf00f6878e111351e90ea9549510f46619bdebb" gracePeriod=30
Sep 18 22:17:41.140369 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:41.140344    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c2b1f0a4-fe83-4c26-9c1b-452b67bb0f86" path="/var/lib/kubelet/pods/c2b1f0a4-fe83-4c26-9c1b-452b67bb0f86/volumes"
Sep 18 22:17:41.281153 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:41.281060    2577 generic.go:356] "Generic (PLEG): container finished" podID="4ca8691f-514c-4ff7-a9d7-94dce9b61f68" containerID="e96f191ce8c49a1da1d5ea47abf00f6878e111351e90ea9549510f46619bdebb" exitCode=0
Sep 18 22:17:41.281153 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:41.281085    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-a13357-7b6898dccd-gzcx5" event={"ID":"4ca8691f-514c-4ff7-a9d7-94dce9b61f68","Type":"ContainerDied","Data":"e96f191ce8c49a1da1d5ea47abf00f6878e111351e90ea9549510f46619bdebb"}
Sep 18 22:17:41.496609 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:41.496581    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-a13357-7b6898dccd-gzcx5"
Sep 18 22:17:41.613146 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:41.613116    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7656s\" (UniqueName: \"kubernetes.io/projected/4ca8691f-514c-4ff7-a9d7-94dce9b61f68-kube-api-access-7656s\") pod \"4ca8691f-514c-4ff7-a9d7-94dce9b61f68\" (UID: \"4ca8691f-514c-4ff7-a9d7-94dce9b61f68\") "
Sep 18 22:17:41.613317 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:41.613268    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4ca8691f-514c-4ff7-a9d7-94dce9b61f68-plugins-config-volume\") pod \"4ca8691f-514c-4ff7-a9d7-94dce9b61f68\" (UID: \"4ca8691f-514c-4ff7-a9d7-94dce9b61f68\") "
Sep 18 22:17:41.613643 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:41.613621    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ca8691f-514c-4ff7-a9d7-94dce9b61f68-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4ca8691f-514c-4ff7-a9d7-94dce9b61f68" (UID: "4ca8691f-514c-4ff7-a9d7-94dce9b61f68"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:17:41.615384 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:41.615367    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ca8691f-514c-4ff7-a9d7-94dce9b61f68-kube-api-access-7656s" (OuterVolumeSpecName: "kube-api-access-7656s") pod "4ca8691f-514c-4ff7-a9d7-94dce9b61f68" (UID: "4ca8691f-514c-4ff7-a9d7-94dce9b61f68"). InnerVolumeSpecName "kube-api-access-7656s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:17:41.714595 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:41.714562    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4ca8691f-514c-4ff7-a9d7-94dce9b61f68-plugins-config-volume\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:17:41.714595 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:41.714589    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7656s\" (UniqueName: \"kubernetes.io/projected/4ca8691f-514c-4ff7-a9d7-94dce9b61f68-kube-api-access-7656s\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:17:42.290009 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:42.289979    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-a13357-7b6898dccd-gzcx5"
Sep 18 22:17:42.290541 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:42.290031    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-a13357-7b6898dccd-gzcx5" event={"ID":"4ca8691f-514c-4ff7-a9d7-94dce9b61f68","Type":"ContainerDied","Data":"fa2998362ca72e1778669671cc5531dcde8ae36845f811d42ae09006303d75ab"}
Sep 18 22:17:42.290541 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:42.290134    2577 scope.go:117] "RemoveContainer" containerID="e96f191ce8c49a1da1d5ea47abf00f6878e111351e90ea9549510f46619bdebb"
Sep 18 22:17:42.323152 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:42.323119    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-a13357-7b6898dccd-gzcx5"]
Sep 18 22:17:42.326918 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:42.326891    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-a13357-7b6898dccd-gzcx5"]
Sep 18 22:17:43.140286 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:43.140249    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ca8691f-514c-4ff7-a9d7-94dce9b61f68" path="/var/lib/kubelet/pods/4ca8691f-514c-4ff7-a9d7-94dce9b61f68/volumes"
Sep 18 22:17:48.336067 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:48.336036    2577 generic.go:356] "Generic (PLEG): container finished" podID="c93ed92f-bf02-4351-8e94-389c64a30005" containerID="af06e6bea06e912f53794cc6ee6d23c58507731da112ba0497a08ce4ef8f827e" exitCode=0
Sep 18 22:17:48.336512 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:48.336110    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-4209a4-openshift-default-57976f4696-7tn9n" event={"ID":"c93ed92f-bf02-4351-8e94-389c64a30005","Type":"ContainerDied","Data":"af06e6bea06e912f53794cc6ee6d23c58507731da112ba0497a08ce4ef8f827e"}
Sep 18 22:17:48.336597 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:48.336582    2577 scope.go:117] "RemoveContainer" containerID="af06e6bea06e912f53794cc6ee6d23c58507731da112ba0497a08ce4ef8f827e"
Sep 18 22:17:48.337761 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:48.337729    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:17:48.337856 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:48.337795    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:17:48.337856 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:48.337827    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:17:49.344641 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:49.344606    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-4209a4-openshift-default-57976f4696-7tn9n" event={"ID":"c93ed92f-bf02-4351-8e94-389c64a30005","Type":"ContainerStarted","Data":"6c0769207f19c58466be51cf4256c5d866d0ff195dd422d80c5d595b9a0dedac"}
Sep 18 22:17:49.796309 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:49.796225    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-4209a4-openshift-default-57976f4696-7tn9n"
Sep 18 22:17:49.796309 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:49.796270    2577 patch_prober.go:28] interesting pod/e2e-explicit-4209a4-openshift-default-57976f4696-7tn9n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Sep 18 22:17:49.796543 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:49.796331    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-4209a4-openshift-default-57976f4696-7tn9n" podUID="c93ed92f-bf02-4351-8e94-389c64a30005" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Sep 18 22:17:50.796125 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:50.796093    2577 patch_prober.go:28] interesting pod/e2e-explicit-4209a4-openshift-default-57976f4696-7tn9n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Sep 18 22:17:50.796531 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:50.796150    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-4209a4-openshift-default-57976f4696-7tn9n" podUID="c93ed92f-bf02-4351-8e94-389c64a30005" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Sep 18 22:17:51.479594 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:51.479543    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-a13357-openshift-default-6dbf49559b-zznj9"]
Sep 18 22:17:51.480220 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:51.480190    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-a13357-openshift-default-6dbf49559b-zznj9" podUID="ecc5b678-e35f-47f3-b50c-ee1a44680f88" containerName="istio-proxy" containerID="cri-o://03c3423bc03be169aa04b8b69c40aebdab193652d95d2b158b4cca7006856771" gracePeriod=30
Sep 18 22:17:51.796365 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:51.796276    2577 patch_prober.go:28] interesting pod/e2e-explicit-4209a4-openshift-default-57976f4696-7tn9n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Sep 18 22:17:51.796365 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:51.796328    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-4209a4-openshift-default-57976f4696-7tn9n" podUID="c93ed92f-bf02-4351-8e94-389c64a30005" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Sep 18 22:17:52.796788 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:52.796747    2577 patch_prober.go:28] interesting pod/e2e-explicit-4209a4-openshift-default-57976f4696-7tn9n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Sep 18 22:17:52.797275 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:52.796806    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-4209a4-openshift-default-57976f4696-7tn9n" podUID="c93ed92f-bf02-4351-8e94-389c64a30005" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Sep 18 22:17:53.795906 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:53.795871    2577 patch_prober.go:28] interesting pod/e2e-explicit-4209a4-openshift-default-57976f4696-7tn9n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Sep 18 22:17:53.796090 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:53.795926    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-4209a4-openshift-default-57976f4696-7tn9n" podUID="c93ed92f-bf02-4351-8e94-389c64a30005" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Sep 18 22:17:54.796369 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:54.796328    2577 patch_prober.go:28] interesting pod/e2e-explicit-4209a4-openshift-default-57976f4696-7tn9n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Sep 18 22:17:54.796799 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:54.796392    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-4209a4-openshift-default-57976f4696-7tn9n" podUID="c93ed92f-bf02-4351-8e94-389c64a30005" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Sep 18 22:17:55.160670 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:55.160624    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-4209a4-openshift-default-57976f4696-7tn9n"
Sep 18 22:17:55.801017 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:55.800986    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-4209a4-openshift-default-57976f4696-7tn9n"
Sep 18 22:17:55.802080 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:55.802060    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-4209a4-openshift-default-57976f4696-7tn9n"
Sep 18 22:17:56.741920 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:56.741864    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-a13357-openshift-default-6dbf49559b-zznj9"
Sep 18 22:17:56.869824 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:56.869790    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-svfsk\" (UniqueName: \"kubernetes.io/projected/ecc5b678-e35f-47f3-b50c-ee1a44680f88-kube-api-access-svfsk\") pod \"ecc5b678-e35f-47f3-b50c-ee1a44680f88\" (UID: \"ecc5b678-e35f-47f3-b50c-ee1a44680f88\") "
Sep 18 22:17:56.870256 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:56.869866    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ecc5b678-e35f-47f3-b50c-ee1a44680f88-credential-socket\") pod \"ecc5b678-e35f-47f3-b50c-ee1a44680f88\" (UID: \"ecc5b678-e35f-47f3-b50c-ee1a44680f88\") "
Sep 18 22:17:56.870256 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:56.869914    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ecc5b678-e35f-47f3-b50c-ee1a44680f88-workload-socket\") pod \"ecc5b678-e35f-47f3-b50c-ee1a44680f88\" (UID: \"ecc5b678-e35f-47f3-b50c-ee1a44680f88\") "
Sep 18 22:17:56.870256 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:56.869959    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ecc5b678-e35f-47f3-b50c-ee1a44680f88-istio-token\") pod \"ecc5b678-e35f-47f3-b50c-ee1a44680f88\" (UID: \"ecc5b678-e35f-47f3-b50c-ee1a44680f88\") "
Sep 18 22:17:56.870256 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:56.869998    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ecc5b678-e35f-47f3-b50c-ee1a44680f88-istio-podinfo\") pod \"ecc5b678-e35f-47f3-b50c-ee1a44680f88\" (UID: \"ecc5b678-e35f-47f3-b50c-ee1a44680f88\") "
Sep 18 22:17:56.870256 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:56.870029    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ecc5b678-e35f-47f3-b50c-ee1a44680f88-istiod-ca-cert\") pod \"ecc5b678-e35f-47f3-b50c-ee1a44680f88\" (UID: \"ecc5b678-e35f-47f3-b50c-ee1a44680f88\") "
Sep 18 22:17:56.870256 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:56.870084    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ecc5b678-e35f-47f3-b50c-ee1a44680f88-workload-certs\") pod \"ecc5b678-e35f-47f3-b50c-ee1a44680f88\" (UID: \"ecc5b678-e35f-47f3-b50c-ee1a44680f88\") "
Sep 18 22:17:56.870256 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:56.870122    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ecc5b678-e35f-47f3-b50c-ee1a44680f88-istio-envoy\") pod \"ecc5b678-e35f-47f3-b50c-ee1a44680f88\" (UID: \"ecc5b678-e35f-47f3-b50c-ee1a44680f88\") "
Sep 18 22:17:56.870256 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:56.870149    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ecc5b678-e35f-47f3-b50c-ee1a44680f88-istio-data\") pod \"ecc5b678-e35f-47f3-b50c-ee1a44680f88\" (UID: \"ecc5b678-e35f-47f3-b50c-ee1a44680f88\") "
Sep 18 22:17:56.870256 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:56.870168    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ecc5b678-e35f-47f3-b50c-ee1a44680f88-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ecc5b678-e35f-47f3-b50c-ee1a44680f88" (UID: "ecc5b678-e35f-47f3-b50c-ee1a44680f88"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:17:56.870813 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:56.870358    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ecc5b678-e35f-47f3-b50c-ee1a44680f88-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ecc5b678-e35f-47f3-b50c-ee1a44680f88" (UID: "ecc5b678-e35f-47f3-b50c-ee1a44680f88"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:17:56.870813 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:56.870497    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ecc5b678-e35f-47f3-b50c-ee1a44680f88-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ecc5b678-e35f-47f3-b50c-ee1a44680f88" (UID: "ecc5b678-e35f-47f3-b50c-ee1a44680f88"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:17:56.870813 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:56.870659    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ecc5b678-e35f-47f3-b50c-ee1a44680f88-istio-data" (OuterVolumeSpecName: "istio-data") pod "ecc5b678-e35f-47f3-b50c-ee1a44680f88" (UID: "ecc5b678-e35f-47f3-b50c-ee1a44680f88"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:17:56.870813 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:56.870671    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ecc5b678-e35f-47f3-b50c-ee1a44680f88-istiod-ca-cert\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:17:56.870813 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:56.870672    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ecc5b678-e35f-47f3-b50c-ee1a44680f88-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ecc5b678-e35f-47f3-b50c-ee1a44680f88" (UID: "ecc5b678-e35f-47f3-b50c-ee1a44680f88"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:17:56.870813 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:56.870693    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ecc5b678-e35f-47f3-b50c-ee1a44680f88-workload-certs\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:17:56.870813 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:56.870709    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ecc5b678-e35f-47f3-b50c-ee1a44680f88-credential-socket\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:17:56.872464 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:56.872389    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ecc5b678-e35f-47f3-b50c-ee1a44680f88-istio-token" (OuterVolumeSpecName: "istio-token") pod "ecc5b678-e35f-47f3-b50c-ee1a44680f88" (UID: "ecc5b678-e35f-47f3-b50c-ee1a44680f88"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:17:56.872464 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:56.872441    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ecc5b678-e35f-47f3-b50c-ee1a44680f88-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ecc5b678-e35f-47f3-b50c-ee1a44680f88" (UID: "ecc5b678-e35f-47f3-b50c-ee1a44680f88"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:17:56.872657 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:56.872639    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ecc5b678-e35f-47f3-b50c-ee1a44680f88-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ecc5b678-e35f-47f3-b50c-ee1a44680f88" (UID: "ecc5b678-e35f-47f3-b50c-ee1a44680f88"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 18 22:17:56.872709 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:56.872694    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ecc5b678-e35f-47f3-b50c-ee1a44680f88-kube-api-access-svfsk" (OuterVolumeSpecName: "kube-api-access-svfsk") pod "ecc5b678-e35f-47f3-b50c-ee1a44680f88" (UID: "ecc5b678-e35f-47f3-b50c-ee1a44680f88"). InnerVolumeSpecName "kube-api-access-svfsk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:17:56.971320 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:56.971296    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ecc5b678-e35f-47f3-b50c-ee1a44680f88-workload-socket\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:17:56.971320 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:56.971319    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ecc5b678-e35f-47f3-b50c-ee1a44680f88-istio-token\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:17:56.971551 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:56.971328    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ecc5b678-e35f-47f3-b50c-ee1a44680f88-istio-podinfo\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:17:56.971551 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:56.971335    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ecc5b678-e35f-47f3-b50c-ee1a44680f88-istio-envoy\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:17:56.971551 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:56.971342    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ecc5b678-e35f-47f3-b50c-ee1a44680f88-istio-data\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:17:56.971551 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:56.971350    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-svfsk\" (UniqueName: \"kubernetes.io/projected/ecc5b678-e35f-47f3-b50c-ee1a44680f88-kube-api-access-svfsk\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:17:57.418195 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:57.418097    2577 generic.go:356] "Generic (PLEG): container finished" podID="ecc5b678-e35f-47f3-b50c-ee1a44680f88" containerID="03c3423bc03be169aa04b8b69c40aebdab193652d95d2b158b4cca7006856771" exitCode=0
Sep 18 22:17:57.418195 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:57.418173    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-a13357-openshift-default-6dbf49559b-zznj9"
Sep 18 22:17:57.418448 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:57.418188    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-a13357-openshift-default-6dbf49559b-zznj9" event={"ID":"ecc5b678-e35f-47f3-b50c-ee1a44680f88","Type":"ContainerDied","Data":"03c3423bc03be169aa04b8b69c40aebdab193652d95d2b158b4cca7006856771"}
Sep 18 22:17:57.418448 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:57.418266    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-a13357-openshift-default-6dbf49559b-zznj9" event={"ID":"ecc5b678-e35f-47f3-b50c-ee1a44680f88","Type":"ContainerDied","Data":"29d9c72482042a6abb2323a1f3dfa4e9cca5d0bb5ec35f98c65806b450c57f8b"}
Sep 18 22:17:57.418448 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:57.418290    2577 scope.go:117] "RemoveContainer" containerID="03c3423bc03be169aa04b8b69c40aebdab193652d95d2b158b4cca7006856771"
Sep 18 22:17:57.428153 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:57.428135    2577 scope.go:117] "RemoveContainer" containerID="ae1c0d7532985bedf9ccabd8806679597f9f49950e250295a18c3b04cb1a56d3"
Sep 18 22:17:57.437030 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:57.437002    2577 scope.go:117] "RemoveContainer" containerID="03c3423bc03be169aa04b8b69c40aebdab193652d95d2b158b4cca7006856771"
Sep 18 22:17:57.437424 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:17:57.437390    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"03c3423bc03be169aa04b8b69c40aebdab193652d95d2b158b4cca7006856771\": container with ID starting with 03c3423bc03be169aa04b8b69c40aebdab193652d95d2b158b4cca7006856771 not found: ID does not exist" containerID="03c3423bc03be169aa04b8b69c40aebdab193652d95d2b158b4cca7006856771"
Sep 18 22:17:57.437524 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:57.437447    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03c3423bc03be169aa04b8b69c40aebdab193652d95d2b158b4cca7006856771"} err="failed to get container status \"03c3423bc03be169aa04b8b69c40aebdab193652d95d2b158b4cca7006856771\": rpc error: code = NotFound desc = could not find container \"03c3423bc03be169aa04b8b69c40aebdab193652d95d2b158b4cca7006856771\": container with ID starting with 03c3423bc03be169aa04b8b69c40aebdab193652d95d2b158b4cca7006856771 not found: ID does not exist"
Sep 18 22:17:57.437524 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:57.437471    2577 scope.go:117] "RemoveContainer" containerID="ae1c0d7532985bedf9ccabd8806679597f9f49950e250295a18c3b04cb1a56d3"
Sep 18 22:17:57.437848 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:17:57.437825    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae1c0d7532985bedf9ccabd8806679597f9f49950e250295a18c3b04cb1a56d3\": container with ID starting with ae1c0d7532985bedf9ccabd8806679597f9f49950e250295a18c3b04cb1a56d3 not found: ID does not exist" containerID="ae1c0d7532985bedf9ccabd8806679597f9f49950e250295a18c3b04cb1a56d3"
Sep 18 22:17:57.437936 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:57.437852    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae1c0d7532985bedf9ccabd8806679597f9f49950e250295a18c3b04cb1a56d3"} err="failed to get container status \"ae1c0d7532985bedf9ccabd8806679597f9f49950e250295a18c3b04cb1a56d3\": rpc error: code = NotFound desc = could not find container \"ae1c0d7532985bedf9ccabd8806679597f9f49950e250295a18c3b04cb1a56d3\": container with ID starting with ae1c0d7532985bedf9ccabd8806679597f9f49950e250295a18c3b04cb1a56d3 not found: ID does not exist"
Sep 18 22:17:57.440888 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:57.440867    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-a13357-openshift-default-6dbf49559b-zznj9"]
Sep 18 22:17:57.443435 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:57.443404    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-a13357-openshift-default-6dbf49559b-zznj9"]
Sep 18 22:17:59.140467 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:17:59.140437    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ecc5b678-e35f-47f3-b50c-ee1a44680f88" path="/var/lib/kubelet/pods/ecc5b678-e35f-47f3-b50c-ee1a44680f88/volumes"
Sep 18 22:18:28.927471 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:18:28.927379    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-explicit-4209a4/explicit-model-4209a4-kserve-7d67857d9-9vqcb"]
Sep 18 22:18:28.927913 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:18:28.927836    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ecc5b678-e35f-47f3-b50c-ee1a44680f88" containerName="istio-proxy"
Sep 18 22:18:28.927913 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:18:28.927848    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="ecc5b678-e35f-47f3-b50c-ee1a44680f88" containerName="istio-proxy"
Sep 18 22:18:28.927913 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:18:28.927858    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88740ac0-7237-4035-a68d-74d4d7dc7619" containerName="istio-proxy"
Sep 18 22:18:28.927913 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:18:28.927864    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="88740ac0-7237-4035-a68d-74d4d7dc7619" containerName="istio-proxy"
Sep 18 22:18:28.927913 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:18:28.927881    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ecc5b678-e35f-47f3-b50c-ee1a44680f88" containerName="istio-proxy"
Sep 18 22:18:28.927913 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:18:28.927887    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="ecc5b678-e35f-47f3-b50c-ee1a44680f88" containerName="istio-proxy"
Sep 18 22:18:28.927913 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:18:28.927899    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ca8691f-514c-4ff7-a9d7-94dce9b61f68" containerName="payload-pre-processing"
Sep 18 22:18:28.927913 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:18:28.927904    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ca8691f-514c-4ff7-a9d7-94dce9b61f68" containerName="payload-pre-processing"
Sep 18 22:18:28.928334 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:18:28.927964    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="88740ac0-7237-4035-a68d-74d4d7dc7619" containerName="istio-proxy"
Sep 18 22:18:28.928334 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:18:28.927971    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="26ff9791-76db-4aa7-af4a-a66a9fb968a1" containerName="istio-proxy"
Sep 18 22:18:28.928334 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:18:28.927977    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ca8691f-514c-4ff7-a9d7-94dce9b61f68" containerName="payload-pre-processing"
Sep 18 22:18:28.928334 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:18:28.927985    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="ecc5b678-e35f-47f3-b50c-ee1a44680f88" containerName="istio-proxy"
Sep 18 22:18:28.928334 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:18:28.927991    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="ecc5b678-e35f-47f3-b50c-ee1a44680f88" containerName="istio-proxy"
Sep 18 22:18:28.932541 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:18:28.932525    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-4209a4/explicit-model-4209a4-kserve-7d67857d9-9vqcb"
Sep 18 22:18:28.941435 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:18:28.941397    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-explicit-4209a4\"/\"kube-root-ca.crt\""
Sep 18 22:18:28.942643 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:18:28.942620    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-explicit-4209a4\"/\"explicit-model-4209a4-kserve-self-signed-certs\""
Sep 18 22:18:28.942761 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:18:28.942625    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-explicit-4209a4\"/\"default-dockercfg-ln5jx\""
Sep 18 22:18:28.942967 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:18:28.942949    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-explicit-4209a4\"/\"openshift-service-ca.crt\""
Sep 18 22:18:28.946405 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:18:28.946378    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-explicit-4209a4/explicit-model-4209a4-kserve-7d67857d9-9vqcb"]
Sep 18 22:18:28.984584 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:18:28.984560    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ef9204e2-a438-4d65-8592-a0d2509ddb09-home\") pod \"explicit-model-4209a4-kserve-7d67857d9-9vqcb\" (UID: \"ef9204e2-a438-4d65-8592-a0d2509ddb09\") " pod="ai-tenant-e2e-explicit-4209a4/explicit-model-4209a4-kserve-7d67857d9-9vqcb"
Sep 18 22:18:28.984700 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:18:28.984595    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lmj7\" (UniqueName: \"kubernetes.io/projected/ef9204e2-a438-4d65-8592-a0d2509ddb09-kube-api-access-9lmj7\") pod \"explicit-model-4209a4-kserve-7d67857d9-9vqcb\" (UID: \"ef9204e2-a438-4d65-8592-a0d2509ddb09\") " pod="ai-tenant-e2e-explicit-4209a4/explicit-model-4209a4-kserve-7d67857d9-9vqcb"
Sep 18 22:18:28.984700 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:18:28.984623    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef9204e2-a438-4d65-8592-a0d2509ddb09-tmp-dir\") pod \"explicit-model-4209a4-kserve-7d67857d9-9vqcb\" (UID: \"ef9204e2-a438-4d65-8592-a0d2509ddb09\") " pod="ai-tenant-e2e-explicit-4209a4/explicit-model-4209a4-kserve-7d67857d9-9vqcb"
Sep 18 22:18:28.984700 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:18:28.984664    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ef9204e2-a438-4d65-8592-a0d2509ddb09-model-cache\") pod \"explicit-model-4209a4-kserve-7d67857d9-9vqcb\" (UID: \"ef9204e2-a438-4d65-8592-a0d2509ddb09\") " pod="ai-tenant-e2e-explicit-4209a4/explicit-model-4209a4-kserve-7d67857d9-9vqcb"
Sep 18 22:18:28.984800 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:18:28.984723    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef9204e2-a438-4d65-8592-a0d2509ddb09-tls-certs\") pod \"explicit-model-4209a4-kserve-7d67857d9-9vqcb\" (UID: \"ef9204e2-a438-4d65-8592-a0d2509ddb09\") " pod="ai-tenant-e2e-explicit-4209a4/explicit-model-4209a4-kserve-7d67857d9-9vqcb"
Sep 18 22:18:28.984800 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:18:28.984748    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ef9204e2-a438-4d65-8592-a0d2509ddb09-dshm\") pod \"explicit-model-4209a4-kserve-7d67857d9-9vqcb\" (UID: \"ef9204e2-a438-4d65-8592-a0d2509ddb09\") " pod="ai-tenant-e2e-explicit-4209a4/explicit-model-4209a4-kserve-7d67857d9-9vqcb"
Sep 18 22:18:29.085581 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:18:29.085544    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ef9204e2-a438-4d65-8592-a0d2509ddb09-home\") pod \"explicit-model-4209a4-kserve-7d67857d9-9vqcb\" (UID: \"ef9204e2-a438-4d65-8592-a0d2509ddb09\") " pod="ai-tenant-e2e-explicit-4209a4/explicit-model-4209a4-kserve-7d67857d9-9vqcb"
Sep 18 22:18:29.085763 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:18:29.085602    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9lmj7\" (UniqueName: \"kubernetes.io/projected/ef9204e2-a438-4d65-8592-a0d2509ddb09-kube-api-access-9lmj7\") pod \"explicit-model-4209a4-kserve-7d67857d9-9vqcb\" (UID: \"ef9204e2-a438-4d65-8592-a0d2509ddb09\") " pod="ai-tenant-e2e-explicit-4209a4/explicit-model-4209a4-kserve-7d67857d9-9vqcb"
Sep 18 22:18:29.085763 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:18:29.085657    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef9204e2-a438-4d65-8592-a0d2509ddb09-tmp-dir\") pod \"explicit-model-4209a4-kserve-7d67857d9-9vqcb\" (UID: \"ef9204e2-a438-4d65-8592-a0d2509ddb09\") " pod="ai-tenant-e2e-explicit-4209a4/explicit-model-4209a4-kserve-7d67857d9-9vqcb"
Sep 18 22:18:29.085763 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:18:29.085676    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ef9204e2-a438-4d65-8592-a0d2509ddb09-model-cache\") pod \"explicit-model-4209a4-kserve-7d67857d9-9vqcb\" (UID: \"ef9204e2-a438-4d65-8592-a0d2509ddb09\") " pod="ai-tenant-e2e-explicit-4209a4/explicit-model-4209a4-kserve-7d67857d9-9vqcb"
Sep 18 22:18:29.085763 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:18:29.085719    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef9204e2-a438-4d65-8592-a0d2509ddb09-tls-certs\") pod \"explicit-model-4209a4-kserve-7d67857d9-9vqcb\" (UID: \"ef9204e2-a438-4d65-8592-a0d2509ddb09\") " pod="ai-tenant-e2e-explicit-4209a4/explicit-model-4209a4-kserve-7d67857d9-9vqcb"
Sep 18 22:18:29.085763 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:18:29.085756    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ef9204e2-a438-4d65-8592-a0d2509ddb09-dshm\") pod \"explicit-model-4209a4-kserve-7d67857d9-9vqcb\" (UID: \"ef9204e2-a438-4d65-8592-a0d2509ddb09\") " pod="ai-tenant-e2e-explicit-4209a4/explicit-model-4209a4-kserve-7d67857d9-9vqcb"
Sep 18 22:18:29.086064 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:18:29.086040    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ef9204e2-a438-4d65-8592-a0d2509ddb09-home\") pod \"explicit-model-4209a4-kserve-7d67857d9-9vqcb\" (UID: \"ef9204e2-a438-4d65-8592-a0d2509ddb09\") " pod="ai-tenant-e2e-explicit-4209a4/explicit-model-4209a4-kserve-7d67857d9-9vqcb"
Sep 18 22:18:29.086125 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:18:29.086083    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef9204e2-a438-4d65-8592-a0d2509ddb09-tmp-dir\") pod \"explicit-model-4209a4-kserve-7d67857d9-9vqcb\" (UID: \"ef9204e2-a438-4d65-8592-a0d2509ddb09\") " pod="ai-tenant-e2e-explicit-4209a4/explicit-model-4209a4-kserve-7d67857d9-9vqcb"
Sep 18 22:18:29.086125 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:18:29.086108    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ef9204e2-a438-4d65-8592-a0d2509ddb09-model-cache\") pod \"explicit-model-4209a4-kserve-7d67857d9-9vqcb\" (UID: \"ef9204e2-a438-4d65-8592-a0d2509ddb09\") " pod="ai-tenant-e2e-explicit-4209a4/explicit-model-4209a4-kserve-7d67857d9-9vqcb"
Sep 18 22:18:29.088239 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:18:29.088211    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ef9204e2-a438-4d65-8592-a0d2509ddb09-dshm\") pod \"explicit-model-4209a4-kserve-7d67857d9-9vqcb\" (UID: \"ef9204e2-a438-4d65-8592-a0d2509ddb09\") " pod="ai-tenant-e2e-explicit-4209a4/explicit-model-4209a4-kserve-7d67857d9-9vqcb"
Sep 18 22:18:29.088360 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:18:29.088346    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef9204e2-a438-4d65-8592-a0d2509ddb09-tls-certs\") pod \"explicit-model-4209a4-kserve-7d67857d9-9vqcb\" (UID: \"ef9204e2-a438-4d65-8592-a0d2509ddb09\") " pod="ai-tenant-e2e-explicit-4209a4/explicit-model-4209a4-kserve-7d67857d9-9vqcb"
Sep 18 22:18:29.095645 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:18:29.095625    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lmj7\" (UniqueName: \"kubernetes.io/projected/ef9204e2-a438-4d65-8592-a0d2509ddb09-kube-api-access-9lmj7\") pod \"explicit-model-4209a4-kserve-7d67857d9-9vqcb\" (UID: \"ef9204e2-a438-4d65-8592-a0d2509ddb09\") " pod="ai-tenant-e2e-explicit-4209a4/explicit-model-4209a4-kserve-7d67857d9-9vqcb"
Sep 18 22:18:29.242451 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:18:29.242360    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-4209a4/explicit-model-4209a4-kserve-7d67857d9-9vqcb"
Sep 18 22:18:29.523493 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:18:29.523472    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-explicit-4209a4/explicit-model-4209a4-kserve-7d67857d9-9vqcb"]
Sep 18 22:18:29.525521 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:18:29.525492    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podef9204e2_a438_4d65_8592_a0d2509ddb09.slice/crio-df7469fc9f201ba90f0a950c8b905ee7b1bc7d8c1d5d02223f454b9a407d4c18 WatchSource:0}: Error finding container df7469fc9f201ba90f0a950c8b905ee7b1bc7d8c1d5d02223f454b9a407d4c18: Status 404 returned error can't find the container with id df7469fc9f201ba90f0a950c8b905ee7b1bc7d8c1d5d02223f454b9a407d4c18
Sep 18 22:18:29.527449 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:18:29.527431    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 18 22:18:29.628139 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:18:29.628110    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-4209a4/explicit-model-4209a4-kserve-7d67857d9-9vqcb" event={"ID":"ef9204e2-a438-4d65-8592-a0d2509ddb09","Type":"ContainerStarted","Data":"df7469fc9f201ba90f0a950c8b905ee7b1bc7d8c1d5d02223f454b9a407d4c18"}
Sep 18 22:18:31.642275 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:18:31.642234    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-4209a4/explicit-model-4209a4-kserve-7d67857d9-9vqcb" event={"ID":"ef9204e2-a438-4d65-8592-a0d2509ddb09","Type":"ContainerStarted","Data":"249bd7d68408a4bb37c41ff86f3067f63eada0bb3136e99840e5e25dc7314a7d"}
Sep 18 22:18:31.670247 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:18:31.670198    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-explicit-4209a4/explicit-model-4209a4-kserve-7d67857d9-9vqcb" podStartSLOduration=2.580947209 podStartE2EDuration="3.670182231s" totalImagesPullingTime="1.089235022s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:18:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:18:31.667708629 +0000 UTC m=+1090.987380701" watchObservedRunningTime="2026-09-18 22:18:31.670182231 +0000 UTC m=+1090.989854317"
Sep 18 22:18:39.242757 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:18:39.242720    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-explicit-4209a4/explicit-model-4209a4-kserve-7d67857d9-9vqcb"
Sep 18 22:18:39.243295 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:18:39.242795    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-explicit-4209a4/explicit-model-4209a4-kserve-7d67857d9-9vqcb"
Sep 18 22:18:39.255555 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:18:39.255526    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-explicit-4209a4/explicit-model-4209a4-kserve-7d67857d9-9vqcb"
Sep 18 22:18:39.707523 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:18:39.707499    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-explicit-4209a4/explicit-model-4209a4-kserve-7d67857d9-9vqcb"
Sep 18 22:18:51.323820 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:18:51.323786    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-6ad61446-openshift-default-76976d5984-mhzwb"]
Sep 18 22:18:51.324398 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:18:51.324383    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88740ac0-7237-4035-a68d-74d4d7dc7619" containerName="istio-proxy"
Sep 18 22:18:51.324483 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:18:51.324401    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="88740ac0-7237-4035-a68d-74d4d7dc7619" containerName="istio-proxy"
Sep 18 22:18:51.324560 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:18:51.324549    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="88740ac0-7237-4035-a68d-74d4d7dc7619" containerName="istio-proxy"
Sep 18 22:18:51.328176 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:18:51.328154    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6ad61446-openshift-default-76976d5984-mhzwb"
Sep 18 22:18:51.333864 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:18:51.333839    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-6ad61446-openshift-default-dockercfg-mzzrv\""
Sep 18 22:18:51.344829 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:18:51.344801    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-6ad61446-openshift-default-76976d5984-mhzwb"]
Sep 18 22:18:51.446965 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:18:51.446247    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/36727232-bd03-4068-83e4-182dc910df1b-istio-envoy\") pod \"e2e-mt-6ad61446-openshift-default-76976d5984-mhzwb\" (UID: \"36727232-bd03-4068-83e4-182dc910df1b\") " pod="openshift-ingress/e2e-mt-6ad61446-openshift-default-76976d5984-mhzwb"
Sep 18 22:18:51.446965 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:18:51.446332    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/36727232-bd03-4068-83e4-182dc910df1b-workload-socket\") pod \"e2e-mt-6ad61446-openshift-default-76976d5984-mhzwb\" (UID: \"36727232-bd03-4068-83e4-182dc910df1b\") " pod="openshift-ingress/e2e-mt-6ad61446-openshift-default-76976d5984-mhzwb"
Sep 18 22:18:51.446965 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:18:51.446439    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/36727232-bd03-4068-83e4-182dc910df1b-istio-podinfo\") pod \"e2e-mt-6ad61446-openshift-default-76976d5984-mhzwb\" (UID: \"36727232-bd03-4068-83e4-182dc910df1b\") " pod="openshift-ingress/e2e-mt-6ad61446-openshift-default-76976d5984-mhzwb"
Sep 18 22:18:51.446965 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:18:51.446477    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/36727232-bd03-4068-83e4-182dc910df1b-istiod-ca-cert\") pod \"e2e-mt-6ad61446-openshift-default-76976d5984-mhzwb\" (UID: \"36727232-bd03-4068-83e4-182dc910df1b\") " pod="openshift-ingress/e2e-mt-6ad61446-openshift-default-76976d5984-mhzwb"
Sep 18 22:18:51.446965 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:18:51.446554    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/36727232-bd03-4068-83e4-182dc910df1b-istio-data\") pod \"e2e-mt-6ad61446-openshift-default-76976d5984-mhzwb\" (UID: \"36727232-bd03-4068-83e4-182dc910df1b\") " pod="openshift-ingress/e2e-mt-6ad61446-openshift-default-76976d5984-mhzwb"
Sep 18 22:18:51.446965 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:18:51.446594    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/36727232-bd03-4068-83e4-182dc910df1b-istio-token\") pod \"e2e-mt-6ad61446-openshift-default-76976d5984-mhzwb\" (UID: \"36727232-bd03-4068-83e4-182dc910df1b\") " pod="openshift-ingress/e2e-mt-6ad61446-openshift-default-76976d5984-mhzwb"
Sep 18 22:18:51.446965 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:18:51.446673    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/36727232-bd03-4068-83e4-182dc910df1b-credential-socket\") pod \"e2e-mt-6ad61446-openshift-default-76976d5984-mhzwb\" (UID: \"36727232-bd03-4068-83e4-182dc910df1b\") " pod="openshift-ingress/e2e-mt-6ad61446-openshift-default-76976d5984-mhzwb"
Sep 18 22:18:51.446965 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:18:51.446700    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cltn7\" (UniqueName: \"kubernetes.io/projected/36727232-bd03-4068-83e4-182dc910df1b-kube-api-access-cltn7\") pod \"e2e-mt-6ad61446-openshift-default-76976d5984-mhzwb\" (UID: \"36727232-bd03-4068-83e4-182dc910df1b\") " pod="openshift-ingress/e2e-mt-6ad61446-openshift-default-76976d5984-mhzwb"
Sep 18 22:18:51.446965 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:18:51.446733    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/36727232-bd03-4068-83e4-182dc910df1b-workload-certs\") pod \"e2e-mt-6ad61446-openshift-default-76976d5984-mhzwb\" (UID: \"36727232-bd03-4068-83e4-182dc910df1b\") " pod="openshift-ingress/e2e-mt-6ad61446-openshift-default-76976d5984-mhzwb"
Sep 18 22:18:51.548252 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:18:51.548206    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/36727232-bd03-4068-83e4-182dc910df1b-workload-socket\") pod \"e2e-mt-6ad61446-openshift-default-76976d5984-mhzwb\" (UID: \"36727232-bd03-4068-83e4-182dc910df1b\") " pod="openshift-ingress/e2e-mt-6ad61446-openshift-default-76976d5984-mhzwb"
Sep 18 22:18:51.548455 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:18:51.548285    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/36727232-bd03-4068-83e4-182dc910df1b-istio-podinfo\") pod \"e2e-mt-6ad61446-openshift-default-76976d5984-mhzwb\" (UID: \"36727232-bd03-4068-83e4-182dc910df1b\") " pod="openshift-ingress/e2e-mt-6ad61446-openshift-default-76976d5984-mhzwb"
Sep 18 22:18:51.548455 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:18:51.548319    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/36727232-bd03-4068-83e4-182dc910df1b-istiod-ca-cert\") pod \"e2e-mt-6ad61446-openshift-default-76976d5984-mhzwb\" (UID: \"36727232-bd03-4068-83e4-182dc910df1b\") " pod="openshift-ingress/e2e-mt-6ad61446-openshift-default-76976d5984-mhzwb"
Sep 18 22:18:51.548455 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:18:51.548364    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/36727232-bd03-4068-83e4-182dc910df1b-istio-data\") pod \"e2e-mt-6ad61446-openshift-default-76976d5984-mhzwb\" (UID: \"36727232-bd03-4068-83e4-182dc910df1b\") " pod="openshift-ingress/e2e-mt-6ad61446-openshift-default-76976d5984-mhzwb"
Sep 18 22:18:51.548643 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:18:51.548470    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/36727232-bd03-4068-83e4-182dc910df1b-istio-token\") pod \"e2e-mt-6ad61446-openshift-default-76976d5984-mhzwb\" (UID: \"36727232-bd03-4068-83e4-182dc910df1b\") " pod="openshift-ingress/e2e-mt-6ad61446-openshift-default-76976d5984-mhzwb"
Sep 18 22:18:51.548643 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:18:51.548554    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/36727232-bd03-4068-83e4-182dc910df1b-credential-socket\") pod \"e2e-mt-6ad61446-openshift-default-76976d5984-mhzwb\" (UID: \"36727232-bd03-4068-83e4-182dc910df1b\") " pod="openshift-ingress/e2e-mt-6ad61446-openshift-default-76976d5984-mhzwb"
Sep 18 22:18:51.548643 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:18:51.548586    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cltn7\" (UniqueName: \"kubernetes.io/projected/36727232-bd03-4068-83e4-182dc910df1b-kube-api-access-cltn7\") pod \"e2e-mt-6ad61446-openshift-default-76976d5984-mhzwb\" (UID: \"36727232-bd03-4068-83e4-182dc910df1b\") " pod="openshift-ingress/e2e-mt-6ad61446-openshift-default-76976d5984-mhzwb"
Sep 18 22:18:51.548643 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:18:51.548619    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/36727232-bd03-4068-83e4-182dc910df1b-workload-certs\") pod \"e2e-mt-6ad61446-openshift-default-76976d5984-mhzwb\" (UID: \"36727232-bd03-4068-83e4-182dc910df1b\") " pod="openshift-ingress/e2e-mt-6ad61446-openshift-default-76976d5984-mhzwb"
Sep 18 22:18:51.548910 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:18:51.548698    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/36727232-bd03-4068-83e4-182dc910df1b-istio-envoy\") pod \"e2e-mt-6ad61446-openshift-default-76976d5984-mhzwb\" (UID: \"36727232-bd03-4068-83e4-182dc910df1b\") " pod="openshift-ingress/e2e-mt-6ad61446-openshift-default-76976d5984-mhzwb"
Sep 18 22:18:51.548910 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:18:51.548744    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/36727232-bd03-4068-83e4-182dc910df1b-workload-socket\") pod \"e2e-mt-6ad61446-openshift-default-76976d5984-mhzwb\" (UID: \"36727232-bd03-4068-83e4-182dc910df1b\") " pod="openshift-ingress/e2e-mt-6ad61446-openshift-default-76976d5984-mhzwb"
Sep 18 22:18:51.549020 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:18:51.548914    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/36727232-bd03-4068-83e4-182dc910df1b-credential-socket\") pod \"e2e-mt-6ad61446-openshift-default-76976d5984-mhzwb\" (UID: \"36727232-bd03-4068-83e4-182dc910df1b\") " pod="openshift-ingress/e2e-mt-6ad61446-openshift-default-76976d5984-mhzwb"
Sep 18 22:18:51.549088 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:18:51.549039    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/36727232-bd03-4068-83e4-182dc910df1b-workload-certs\") pod \"e2e-mt-6ad61446-openshift-default-76976d5984-mhzwb\" (UID: \"36727232-bd03-4068-83e4-182dc910df1b\") " pod="openshift-ingress/e2e-mt-6ad61446-openshift-default-76976d5984-mhzwb"
Sep 18 22:18:51.549306 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:18:51.549284    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/36727232-bd03-4068-83e4-182dc910df1b-istio-data\") pod \"e2e-mt-6ad61446-openshift-default-76976d5984-mhzwb\" (UID: \"36727232-bd03-4068-83e4-182dc910df1b\") " pod="openshift-ingress/e2e-mt-6ad61446-openshift-default-76976d5984-mhzwb"
Sep 18 22:18:51.549779 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:18:51.549701    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/36727232-bd03-4068-83e4-182dc910df1b-istiod-ca-cert\") pod \"e2e-mt-6ad61446-openshift-default-76976d5984-mhzwb\" (UID: \"36727232-bd03-4068-83e4-182dc910df1b\") " pod="openshift-ingress/e2e-mt-6ad61446-openshift-default-76976d5984-mhzwb"
Sep 18 22:18:51.551299 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:18:51.551275    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/36727232-bd03-4068-83e4-182dc910df1b-istio-envoy\") pod \"e2e-mt-6ad61446-openshift-default-76976d5984-mhzwb\" (UID: \"36727232-bd03-4068-83e4-182dc910df1b\") " pod="openshift-ingress/e2e-mt-6ad61446-openshift-default-76976d5984-mhzwb"
Sep 18 22:18:51.551426 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:18:51.551391    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/36727232-bd03-4068-83e4-182dc910df1b-istio-podinfo\") pod \"e2e-mt-6ad61446-openshift-default-76976d5984-mhzwb\" (UID: \"36727232-bd03-4068-83e4-182dc910df1b\") " pod="openshift-ingress/e2e-mt-6ad61446-openshift-default-76976d5984-mhzwb"
Sep 18 22:18:51.570592 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:18:51.570570    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cltn7\" (UniqueName: \"kubernetes.io/projected/36727232-bd03-4068-83e4-182dc910df1b-kube-api-access-cltn7\") pod \"e2e-mt-6ad61446-openshift-default-76976d5984-mhzwb\" (UID: \"36727232-bd03-4068-83e4-182dc910df1b\") " pod="openshift-ingress/e2e-mt-6ad61446-openshift-default-76976d5984-mhzwb"
Sep 18 22:18:51.573523 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:18:51.573503    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/36727232-bd03-4068-83e4-182dc910df1b-istio-token\") pod \"e2e-mt-6ad61446-openshift-default-76976d5984-mhzwb\" (UID: \"36727232-bd03-4068-83e4-182dc910df1b\") " pod="openshift-ingress/e2e-mt-6ad61446-openshift-default-76976d5984-mhzwb"
Sep 18 22:18:51.639565 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:18:51.639453    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6ad61446-openshift-default-76976d5984-mhzwb"
Sep 18 22:18:52.239330 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:18:52.239300    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36727232_bd03_4068_83e4_182dc910df1b.slice/crio-b2fa6cb5dd945f9a6c174fc5eb4d8fd998e051c41305948d8ce5a4279d2c5079 WatchSource:0}: Error finding container b2fa6cb5dd945f9a6c174fc5eb4d8fd998e051c41305948d8ce5a4279d2c5079: Status 404 returned error can't find the container with id b2fa6cb5dd945f9a6c174fc5eb4d8fd998e051c41305948d8ce5a4279d2c5079
Sep 18 22:18:52.241948 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:18:52.241903    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:18:52.242068 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:18:52.241990    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:18:52.242068 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:18:52.242020    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:18:52.279250 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:18:52.279225    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-6ad61446-openshift-default-76976d5984-mhzwb"]
Sep 18 22:18:52.788447 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:18:52.788393    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6ad61446-openshift-default-76976d5984-mhzwb" event={"ID":"36727232-bd03-4068-83e4-182dc910df1b","Type":"ContainerStarted","Data":"529d480bd0f9a5f662657c6e9c5e20cdb0ae5b4dae4856696b2b104ced92753d"}
Sep 18 22:18:52.788892 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:18:52.788461    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6ad61446-openshift-default-76976d5984-mhzwb" event={"ID":"36727232-bd03-4068-83e4-182dc910df1b","Type":"ContainerStarted","Data":"b2fa6cb5dd945f9a6c174fc5eb4d8fd998e051c41305948d8ce5a4279d2c5079"}
Sep 18 22:18:52.837979 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:18:52.837935    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-6ad61446-openshift-default-76976d5984-mhzwb" podStartSLOduration=1.837918785 podStartE2EDuration="1.837918785s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:18:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:18:52.837353884 +0000 UTC m=+1112.157025938" watchObservedRunningTime="2026-09-18 22:18:52.837918785 +0000 UTC m=+1112.157590840"
Sep 18 22:18:53.641524 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:18:53.641462    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-6ad61446-openshift-default-76976d5984-mhzwb"
Sep 18 22:18:53.648280 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:18:53.648253    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-6ad61446-openshift-default-76976d5984-mhzwb"
Sep 18 22:18:53.795163 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:18:53.795129    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-6ad61446-openshift-default-76976d5984-mhzwb"
Sep 18 22:18:53.796084 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:18:53.796063    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-6ad61446-openshift-default-76976d5984-mhzwb"
Sep 18 22:18:59.502946 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:18:59.502916    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-explicit-4209a4/explicit-model-4209a4-kserve-7d67857d9-9vqcb"]
Sep 18 22:18:59.623354 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:18:59.623321    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-4209a4-2fcpf"]
Sep 18 22:18:59.627112 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:18:59.627095    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-4209a4-2fcpf"
Sep 18 22:18:59.629387 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:18:59.629369    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-9g7m4\""
Sep 18 22:18:59.635584 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:18:59.635558    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-4209a4-2fcpf"]
Sep 18 22:18:59.740380 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:18:59.740341    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9526a73-17a3-4b18-9e50-56ea227a2ef4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-4209a4-2fcpf\" (UID: \"f9526a73-17a3-4b18-9e50-56ea227a2ef4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-4209a4-2fcpf"
Sep 18 22:18:59.840966 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:18:59.840932    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9526a73-17a3-4b18-9e50-56ea227a2ef4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-4209a4-2fcpf\" (UID: \"f9526a73-17a3-4b18-9e50-56ea227a2ef4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-4209a4-2fcpf"
Sep 18 22:18:59.841558 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:18:59.841539    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9526a73-17a3-4b18-9e50-56ea227a2ef4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-4209a4-2fcpf\" (UID: \"f9526a73-17a3-4b18-9e50-56ea227a2ef4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-4209a4-2fcpf"
Sep 18 22:18:59.939506 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:18:59.939473    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-4209a4-2fcpf"
Sep 18 22:19:00.218057 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:00.218030    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-4209a4-2fcpf"]
Sep 18 22:19:00.219185 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:19:00.219162    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9526a73_17a3_4b18_9e50_56ea227a2ef4.slice/crio-9332a168455f44f08ff45094fd3f33756d80216d2a7840bcaa244cd1197f0e8f WatchSource:0}: Error finding container 9332a168455f44f08ff45094fd3f33756d80216d2a7840bcaa244cd1197f0e8f: Status 404 returned error can't find the container with id 9332a168455f44f08ff45094fd3f33756d80216d2a7840bcaa244cd1197f0e8f
Sep 18 22:19:00.839880 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:00.839846    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-4209a4-2fcpf" event={"ID":"f9526a73-17a3-4b18-9e50-56ea227a2ef4","Type":"ContainerStarted","Data":"02bb391c70ae2ec2df16ef3c2c98e5b21bab3943cfe48bd48c0aa5e58d802290"}
Sep 18 22:19:00.840265 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:00.839897    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-4209a4-2fcpf" event={"ID":"f9526a73-17a3-4b18-9e50-56ea227a2ef4","Type":"ContainerStarted","Data":"9332a168455f44f08ff45094fd3f33756d80216d2a7840bcaa244cd1197f0e8f"}
Sep 18 22:19:00.856009 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:00.855955    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-4209a4-2fcpf" podStartSLOduration=1.855938134 podStartE2EDuration="1.855938134s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:18:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:19:00.855404195 +0000 UTC m=+1120.175076250" watchObservedRunningTime="2026-09-18 22:19:00.855938134 +0000 UTC m=+1120.175610188"
Sep 18 22:19:01.849882 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:01.849844    2577 generic.go:356] "Generic (PLEG): container finished" podID="f9526a73-17a3-4b18-9e50-56ea227a2ef4" containerID="02bb391c70ae2ec2df16ef3c2c98e5b21bab3943cfe48bd48c0aa5e58d802290" exitCode=0
Sep 18 22:19:01.850292 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:01.849889    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-4209a4-2fcpf" event={"ID":"f9526a73-17a3-4b18-9e50-56ea227a2ef4","Type":"ContainerDied","Data":"02bb391c70ae2ec2df16ef3c2c98e5b21bab3943cfe48bd48c0aa5e58d802290"}
Sep 18 22:19:03.007371 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:03.007339    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-4209a4-2fcpf"
Sep 18 22:19:03.079912 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:03.079883    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9526a73-17a3-4b18-9e50-56ea227a2ef4-maas-api-service-ca\") pod \"f9526a73-17a3-4b18-9e50-56ea227a2ef4\" (UID: \"f9526a73-17a3-4b18-9e50-56ea227a2ef4\") "
Sep 18 22:19:03.080243 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:03.080218    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f9526a73-17a3-4b18-9e50-56ea227a2ef4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f9526a73-17a3-4b18-9e50-56ea227a2ef4" (UID: "f9526a73-17a3-4b18-9e50-56ea227a2ef4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:19:03.181586 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:03.181560    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9526a73-17a3-4b18-9e50-56ea227a2ef4-maas-api-service-ca\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:19:03.864928 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:03.864901    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-4209a4-2fcpf"
Sep 18 22:19:03.864928 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:03.864920    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-4209a4-2fcpf" event={"ID":"f9526a73-17a3-4b18-9e50-56ea227a2ef4","Type":"ContainerDied","Data":"9332a168455f44f08ff45094fd3f33756d80216d2a7840bcaa244cd1197f0e8f"}
Sep 18 22:19:03.865249 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:03.864963    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9332a168455f44f08ff45094fd3f33756d80216d2a7840bcaa244cd1197f0e8f"
Sep 18 22:19:05.637288 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:05.637252    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-6ad61446-5467586ccc-xcfxl"]
Sep 18 22:19:05.637733 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:05.637693    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9526a73-17a3-4b18-9e50-56ea227a2ef4" containerName="revoke-keys"
Sep 18 22:19:05.637733 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:05.637705    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9526a73-17a3-4b18-9e50-56ea227a2ef4" containerName="revoke-keys"
Sep 18 22:19:05.637810 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:05.637790    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9526a73-17a3-4b18-9e50-56ea227a2ef4" containerName="revoke-keys"
Sep 18 22:19:05.641708 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:05.641691    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-6ad61446-5467586ccc-xcfxl"
Sep 18 22:19:05.643687 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:05.643670    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-6ad61446-dockercfg-cwp9f\""
Sep 18 22:19:05.643937 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:05.643914    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-6ad61446\""
Sep 18 22:19:05.652019 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:05.651994    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-6ad61446-5467586ccc-xcfxl"]
Sep 18 22:19:05.715726 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:05.715695    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b0070329-94ee-4f0e-b991-89ebb6465bb3-plugins-config-volume\") pod \"payload-processing-e2e-mt-6ad61446-5467586ccc-xcfxl\" (UID: \"b0070329-94ee-4f0e-b991-89ebb6465bb3\") " pod="openshift-ingress/payload-processing-e2e-mt-6ad61446-5467586ccc-xcfxl"
Sep 18 22:19:05.715891 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:05.715736    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcgvb\" (UniqueName: \"kubernetes.io/projected/b0070329-94ee-4f0e-b991-89ebb6465bb3-kube-api-access-dcgvb\") pod \"payload-processing-e2e-mt-6ad61446-5467586ccc-xcfxl\" (UID: \"b0070329-94ee-4f0e-b991-89ebb6465bb3\") " pod="openshift-ingress/payload-processing-e2e-mt-6ad61446-5467586ccc-xcfxl"
Sep 18 22:19:05.816983 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:05.816955    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b0070329-94ee-4f0e-b991-89ebb6465bb3-plugins-config-volume\") pod \"payload-processing-e2e-mt-6ad61446-5467586ccc-xcfxl\" (UID: \"b0070329-94ee-4f0e-b991-89ebb6465bb3\") " pod="openshift-ingress/payload-processing-e2e-mt-6ad61446-5467586ccc-xcfxl"
Sep 18 22:19:05.817159 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:05.816994    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcgvb\" (UniqueName: \"kubernetes.io/projected/b0070329-94ee-4f0e-b991-89ebb6465bb3-kube-api-access-dcgvb\") pod \"payload-processing-e2e-mt-6ad61446-5467586ccc-xcfxl\" (UID: \"b0070329-94ee-4f0e-b991-89ebb6465bb3\") " pod="openshift-ingress/payload-processing-e2e-mt-6ad61446-5467586ccc-xcfxl"
Sep 18 22:19:05.817687 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:05.817668    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b0070329-94ee-4f0e-b991-89ebb6465bb3-plugins-config-volume\") pod \"payload-processing-e2e-mt-6ad61446-5467586ccc-xcfxl\" (UID: \"b0070329-94ee-4f0e-b991-89ebb6465bb3\") " pod="openshift-ingress/payload-processing-e2e-mt-6ad61446-5467586ccc-xcfxl"
Sep 18 22:19:05.826051 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:05.826028    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcgvb\" (UniqueName: \"kubernetes.io/projected/b0070329-94ee-4f0e-b991-89ebb6465bb3-kube-api-access-dcgvb\") pod \"payload-processing-e2e-mt-6ad61446-5467586ccc-xcfxl\" (UID: \"b0070329-94ee-4f0e-b991-89ebb6465bb3\") " pod="openshift-ingress/payload-processing-e2e-mt-6ad61446-5467586ccc-xcfxl"
Sep 18 22:19:05.955134 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:05.955037    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-6ad61446-5467586ccc-xcfxl"
Sep 18 22:19:06.252159 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:06.252135    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-6ad61446-5467586ccc-xcfxl"]
Sep 18 22:19:06.254700 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:19:06.254665    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0070329_94ee_4f0e_b991_89ebb6465bb3.slice/crio-ab7b4222bb49b6182da09ddf46b57107993f576c3b70304ff6554875d0fbbc3d WatchSource:0}: Error finding container ab7b4222bb49b6182da09ddf46b57107993f576c3b70304ff6554875d0fbbc3d: Status 404 returned error can't find the container with id ab7b4222bb49b6182da09ddf46b57107993f576c3b70304ff6554875d0fbbc3d
Sep 18 22:19:06.886869 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:06.886835    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-6ad61446-5467586ccc-xcfxl" event={"ID":"b0070329-94ee-4f0e-b991-89ebb6465bb3","Type":"ContainerStarted","Data":"e07af354db9eb6668d48537e63f79e3fd753ca9cda16376725f2663e53b45fa6"}
Sep 18 22:19:06.887255 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:06.886887    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-6ad61446-5467586ccc-xcfxl" event={"ID":"b0070329-94ee-4f0e-b991-89ebb6465bb3","Type":"ContainerStarted","Data":"ab7b4222bb49b6182da09ddf46b57107993f576c3b70304ff6554875d0fbbc3d"}
Sep 18 22:19:06.887255 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:06.886991    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-6ad61446-5467586ccc-xcfxl"
Sep 18 22:19:06.910242 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:06.910193    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-6ad61446-5467586ccc-xcfxl" podStartSLOduration=1.910177942 podStartE2EDuration="1.910177942s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:19:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:19:06.906950001 +0000 UTC m=+1126.226622057" watchObservedRunningTime="2026-09-18 22:19:06.910177942 +0000 UTC m=+1126.229850002"
Sep 18 22:19:11.317539 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:11.317505    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-4209a4-2fcpf"]
Sep 18 22:19:11.320678 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:11.320651    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-4209a4-2fcpf"]
Sep 18 22:19:13.140256 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:13.140220    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f9526a73-17a3-4b18-9e50-56ea227a2ef4" path="/var/lib/kubelet/pods/f9526a73-17a3-4b18-9e50-56ea227a2ef4/volumes"
Sep 18 22:19:14.523559 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:14.523515    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-explicit-4209a4/explicit-model-4209a4-kserve-7d67857d9-9vqcb" podUID="ef9204e2-a438-4d65-8592-a0d2509ddb09" containerName="main" containerID="cri-o://249bd7d68408a4bb37c41ff86f3067f63eada0bb3136e99840e5e25dc7314a7d" gracePeriod=45
Sep 18 22:19:14.778050 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:14.777981    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-4209a4/explicit-model-4209a4-kserve-7d67857d9-9vqcb"
Sep 18 22:19:14.908812 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:14.908770    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef9204e2-a438-4d65-8592-a0d2509ddb09-tmp-dir\") pod \"ef9204e2-a438-4d65-8592-a0d2509ddb09\" (UID: \"ef9204e2-a438-4d65-8592-a0d2509ddb09\") "
Sep 18 22:19:14.909014 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:14.908846    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef9204e2-a438-4d65-8592-a0d2509ddb09-tls-certs\") pod \"ef9204e2-a438-4d65-8592-a0d2509ddb09\" (UID: \"ef9204e2-a438-4d65-8592-a0d2509ddb09\") "
Sep 18 22:19:14.909014 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:14.908945    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ef9204e2-a438-4d65-8592-a0d2509ddb09-home\") pod \"ef9204e2-a438-4d65-8592-a0d2509ddb09\" (UID: \"ef9204e2-a438-4d65-8592-a0d2509ddb09\") "
Sep 18 22:19:14.909014 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:14.908978    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ef9204e2-a438-4d65-8592-a0d2509ddb09-dshm\") pod \"ef9204e2-a438-4d65-8592-a0d2509ddb09\" (UID: \"ef9204e2-a438-4d65-8592-a0d2509ddb09\") "
Sep 18 22:19:14.909014 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:14.909008    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ef9204e2-a438-4d65-8592-a0d2509ddb09-model-cache\") pod \"ef9204e2-a438-4d65-8592-a0d2509ddb09\" (UID: \"ef9204e2-a438-4d65-8592-a0d2509ddb09\") "
Sep 18 22:19:14.909242 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:14.909063    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9lmj7\" (UniqueName: \"kubernetes.io/projected/ef9204e2-a438-4d65-8592-a0d2509ddb09-kube-api-access-9lmj7\") pod \"ef9204e2-a438-4d65-8592-a0d2509ddb09\" (UID: \"ef9204e2-a438-4d65-8592-a0d2509ddb09\") "
Sep 18 22:19:14.909242 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:14.909080    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef9204e2-a438-4d65-8592-a0d2509ddb09-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ef9204e2-a438-4d65-8592-a0d2509ddb09" (UID: "ef9204e2-a438-4d65-8592-a0d2509ddb09"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:19:14.909575 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:14.909550    2577 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef9204e2-a438-4d65-8592-a0d2509ddb09-tmp-dir\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:19:14.909776 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:14.909727    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef9204e2-a438-4d65-8592-a0d2509ddb09-home" (OuterVolumeSpecName: "home") pod "ef9204e2-a438-4d65-8592-a0d2509ddb09" (UID: "ef9204e2-a438-4d65-8592-a0d2509ddb09"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:19:14.909776 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:14.909740    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef9204e2-a438-4d65-8592-a0d2509ddb09-model-cache" (OuterVolumeSpecName: "model-cache") pod "ef9204e2-a438-4d65-8592-a0d2509ddb09" (UID: "ef9204e2-a438-4d65-8592-a0d2509ddb09"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:19:14.912192 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:14.912159    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef9204e2-a438-4d65-8592-a0d2509ddb09-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ef9204e2-a438-4d65-8592-a0d2509ddb09" (UID: "ef9204e2-a438-4d65-8592-a0d2509ddb09"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 22:19:14.912353 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:14.912333    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef9204e2-a438-4d65-8592-a0d2509ddb09-kube-api-access-9lmj7" (OuterVolumeSpecName: "kube-api-access-9lmj7") pod "ef9204e2-a438-4d65-8592-a0d2509ddb09" (UID: "ef9204e2-a438-4d65-8592-a0d2509ddb09"). InnerVolumeSpecName "kube-api-access-9lmj7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:19:14.912648 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:14.912628    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef9204e2-a438-4d65-8592-a0d2509ddb09-dshm" (OuterVolumeSpecName: "dshm") pod "ef9204e2-a438-4d65-8592-a0d2509ddb09" (UID: "ef9204e2-a438-4d65-8592-a0d2509ddb09"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:19:14.942122 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:14.942092    2577 generic.go:356] "Generic (PLEG): container finished" podID="ef9204e2-a438-4d65-8592-a0d2509ddb09" containerID="249bd7d68408a4bb37c41ff86f3067f63eada0bb3136e99840e5e25dc7314a7d" exitCode=0
Sep 18 22:19:14.942305 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:14.942136    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-4209a4/explicit-model-4209a4-kserve-7d67857d9-9vqcb"
Sep 18 22:19:14.942305 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:14.942173    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-4209a4/explicit-model-4209a4-kserve-7d67857d9-9vqcb" event={"ID":"ef9204e2-a438-4d65-8592-a0d2509ddb09","Type":"ContainerDied","Data":"249bd7d68408a4bb37c41ff86f3067f63eada0bb3136e99840e5e25dc7314a7d"}
Sep 18 22:19:14.942305 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:14.942210    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-4209a4/explicit-model-4209a4-kserve-7d67857d9-9vqcb" event={"ID":"ef9204e2-a438-4d65-8592-a0d2509ddb09","Type":"ContainerDied","Data":"df7469fc9f201ba90f0a950c8b905ee7b1bc7d8c1d5d02223f454b9a407d4c18"}
Sep 18 22:19:14.942305 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:14.942230    2577 scope.go:117] "RemoveContainer" containerID="249bd7d68408a4bb37c41ff86f3067f63eada0bb3136e99840e5e25dc7314a7d"
Sep 18 22:19:14.967823 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:14.967764    2577 scope.go:117] "RemoveContainer" containerID="249bd7d68408a4bb37c41ff86f3067f63eada0bb3136e99840e5e25dc7314a7d"
Sep 18 22:19:14.969183 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:19:14.968375    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"249bd7d68408a4bb37c41ff86f3067f63eada0bb3136e99840e5e25dc7314a7d\": container with ID starting with 249bd7d68408a4bb37c41ff86f3067f63eada0bb3136e99840e5e25dc7314a7d not found: ID does not exist" containerID="249bd7d68408a4bb37c41ff86f3067f63eada0bb3136e99840e5e25dc7314a7d"
Sep 18 22:19:14.969183 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:14.968437    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"249bd7d68408a4bb37c41ff86f3067f63eada0bb3136e99840e5e25dc7314a7d"} err="failed to get container status \"249bd7d68408a4bb37c41ff86f3067f63eada0bb3136e99840e5e25dc7314a7d\": rpc error: code = NotFound desc = could not find container \"249bd7d68408a4bb37c41ff86f3067f63eada0bb3136e99840e5e25dc7314a7d\": container with ID starting with 249bd7d68408a4bb37c41ff86f3067f63eada0bb3136e99840e5e25dc7314a7d not found: ID does not exist"
Sep 18 22:19:14.999356 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:14.999318    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-explicit-4209a4/explicit-model-4209a4-kserve-7d67857d9-9vqcb"]
Sep 18 22:19:15.010332 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:15.010292    2577 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef9204e2-a438-4d65-8592-a0d2509ddb09-tls-certs\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:19:15.010332 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:15.010325    2577 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ef9204e2-a438-4d65-8592-a0d2509ddb09-home\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:19:15.010332 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:15.010333    2577 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ef9204e2-a438-4d65-8592-a0d2509ddb09-dshm\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:19:15.010332 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:15.010341    2577 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ef9204e2-a438-4d65-8592-a0d2509ddb09-model-cache\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:19:15.010626 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:15.010349    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9lmj7\" (UniqueName: \"kubernetes.io/projected/ef9204e2-a438-4d65-8592-a0d2509ddb09-kube-api-access-9lmj7\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:19:15.010920 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:15.010902    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-explicit-4209a4/explicit-model-4209a4-kserve-7d67857d9-9vqcb"]
Sep 18 22:19:15.149437 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:15.148840    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef9204e2-a438-4d65-8592-a0d2509ddb09" path="/var/lib/kubelet/pods/ef9204e2-a438-4d65-8592-a0d2509ddb09/volumes"
Sep 18 22:19:17.895587 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:17.895559    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-6ad61446-5467586ccc-xcfxl"
Sep 18 22:19:19.804128 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:19.804084    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-4209a4-openshift-default-57976f4696-7tn9n"]
Sep 18 22:19:19.804626 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:19.804289    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-explicit-4209a4-openshift-default-57976f4696-7tn9n" podUID="c93ed92f-bf02-4351-8e94-389c64a30005" containerName="istio-proxy" containerID="cri-o://6c0769207f19c58466be51cf4256c5d866d0ff195dd422d80c5d595b9a0dedac" gracePeriod=30
Sep 18 22:19:20.570400 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:20.570369    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-noten-268aff-openshift-default-57b8fb58f4-f6dk4"]
Sep 18 22:19:20.570897 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:20.570877    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef9204e2-a438-4d65-8592-a0d2509ddb09" containerName="main"
Sep 18 22:19:20.570986 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:20.570901    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef9204e2-a438-4d65-8592-a0d2509ddb09" containerName="main"
Sep 18 22:19:20.571060 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:20.571048    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef9204e2-a438-4d65-8592-a0d2509ddb09" containerName="main"
Sep 18 22:19:20.575375 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:20.575028    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-268aff-openshift-default-57b8fb58f4-f6dk4"
Sep 18 22:19:20.578990 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:20.578962    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-noten-268aff-openshift-default-dockercfg-44s7t\""
Sep 18 22:19:20.592107 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:20.591903    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ded8dbe1-e436-42fa-87b9-a5b64dfec3c4-istio-data\") pod \"e2e-noten-268aff-openshift-default-57b8fb58f4-f6dk4\" (UID: \"ded8dbe1-e436-42fa-87b9-a5b64dfec3c4\") " pod="openshift-ingress/e2e-noten-268aff-openshift-default-57b8fb58f4-f6dk4"
Sep 18 22:19:20.592107 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:20.591941    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ded8dbe1-e436-42fa-87b9-a5b64dfec3c4-workload-certs\") pod \"e2e-noten-268aff-openshift-default-57b8fb58f4-f6dk4\" (UID: \"ded8dbe1-e436-42fa-87b9-a5b64dfec3c4\") " pod="openshift-ingress/e2e-noten-268aff-openshift-default-57b8fb58f4-f6dk4"
Sep 18 22:19:20.592107 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:20.592019    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ded8dbe1-e436-42fa-87b9-a5b64dfec3c4-istio-podinfo\") pod \"e2e-noten-268aff-openshift-default-57b8fb58f4-f6dk4\" (UID: \"ded8dbe1-e436-42fa-87b9-a5b64dfec3c4\") " pod="openshift-ingress/e2e-noten-268aff-openshift-default-57b8fb58f4-f6dk4"
Sep 18 22:19:20.592107 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:20.592069    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ded8dbe1-e436-42fa-87b9-a5b64dfec3c4-workload-socket\") pod \"e2e-noten-268aff-openshift-default-57b8fb58f4-f6dk4\" (UID: \"ded8dbe1-e436-42fa-87b9-a5b64dfec3c4\") " pod="openshift-ingress/e2e-noten-268aff-openshift-default-57b8fb58f4-f6dk4"
Sep 18 22:19:20.592107 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:20.592092    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ded8dbe1-e436-42fa-87b9-a5b64dfec3c4-istio-token\") pod \"e2e-noten-268aff-openshift-default-57b8fb58f4-f6dk4\" (UID: \"ded8dbe1-e436-42fa-87b9-a5b64dfec3c4\") " pod="openshift-ingress/e2e-noten-268aff-openshift-default-57b8fb58f4-f6dk4"
Sep 18 22:19:20.592579 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:20.592250    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ded8dbe1-e436-42fa-87b9-a5b64dfec3c4-istio-envoy\") pod \"e2e-noten-268aff-openshift-default-57b8fb58f4-f6dk4\" (UID: \"ded8dbe1-e436-42fa-87b9-a5b64dfec3c4\") " pod="openshift-ingress/e2e-noten-268aff-openshift-default-57b8fb58f4-f6dk4"
Sep 18 22:19:20.592579 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:20.592300    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ded8dbe1-e436-42fa-87b9-a5b64dfec3c4-credential-socket\") pod \"e2e-noten-268aff-openshift-default-57b8fb58f4-f6dk4\" (UID: \"ded8dbe1-e436-42fa-87b9-a5b64dfec3c4\") " pod="openshift-ingress/e2e-noten-268aff-openshift-default-57b8fb58f4-f6dk4"
Sep 18 22:19:20.592859 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:20.592835    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ded8dbe1-e436-42fa-87b9-a5b64dfec3c4-istiod-ca-cert\") pod \"e2e-noten-268aff-openshift-default-57b8fb58f4-f6dk4\" (UID: \"ded8dbe1-e436-42fa-87b9-a5b64dfec3c4\") " pod="openshift-ingress/e2e-noten-268aff-openshift-default-57b8fb58f4-f6dk4"
Sep 18 22:19:20.592952 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:20.592913    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmjzf\" (UniqueName: \"kubernetes.io/projected/ded8dbe1-e436-42fa-87b9-a5b64dfec3c4-kube-api-access-qmjzf\") pod \"e2e-noten-268aff-openshift-default-57b8fb58f4-f6dk4\" (UID: \"ded8dbe1-e436-42fa-87b9-a5b64dfec3c4\") " pod="openshift-ingress/e2e-noten-268aff-openshift-default-57b8fb58f4-f6dk4"
Sep 18 22:19:20.596137 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:20.596115    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-268aff-openshift-default-57b8fb58f4-f6dk4"]
Sep 18 22:19:20.694480 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:20.694439    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmjzf\" (UniqueName: \"kubernetes.io/projected/ded8dbe1-e436-42fa-87b9-a5b64dfec3c4-kube-api-access-qmjzf\") pod \"e2e-noten-268aff-openshift-default-57b8fb58f4-f6dk4\" (UID: \"ded8dbe1-e436-42fa-87b9-a5b64dfec3c4\") " pod="openshift-ingress/e2e-noten-268aff-openshift-default-57b8fb58f4-f6dk4"
Sep 18 22:19:20.694672 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:20.694494    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ded8dbe1-e436-42fa-87b9-a5b64dfec3c4-istio-data\") pod \"e2e-noten-268aff-openshift-default-57b8fb58f4-f6dk4\" (UID: \"ded8dbe1-e436-42fa-87b9-a5b64dfec3c4\") " pod="openshift-ingress/e2e-noten-268aff-openshift-default-57b8fb58f4-f6dk4"
Sep 18 22:19:20.694672 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:20.694523    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ded8dbe1-e436-42fa-87b9-a5b64dfec3c4-workload-certs\") pod \"e2e-noten-268aff-openshift-default-57b8fb58f4-f6dk4\" (UID: \"ded8dbe1-e436-42fa-87b9-a5b64dfec3c4\") " pod="openshift-ingress/e2e-noten-268aff-openshift-default-57b8fb58f4-f6dk4"
Sep 18 22:19:20.694672 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:20.694592    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ded8dbe1-e436-42fa-87b9-a5b64dfec3c4-istio-podinfo\") pod \"e2e-noten-268aff-openshift-default-57b8fb58f4-f6dk4\" (UID: \"ded8dbe1-e436-42fa-87b9-a5b64dfec3c4\") " pod="openshift-ingress/e2e-noten-268aff-openshift-default-57b8fb58f4-f6dk4"
Sep 18 22:19:20.694672 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:20.694638    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ded8dbe1-e436-42fa-87b9-a5b64dfec3c4-workload-socket\") pod \"e2e-noten-268aff-openshift-default-57b8fb58f4-f6dk4\" (UID: \"ded8dbe1-e436-42fa-87b9-a5b64dfec3c4\") " pod="openshift-ingress/e2e-noten-268aff-openshift-default-57b8fb58f4-f6dk4"
Sep 18 22:19:20.694672 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:20.694663    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ded8dbe1-e436-42fa-87b9-a5b64dfec3c4-istio-token\") pod \"e2e-noten-268aff-openshift-default-57b8fb58f4-f6dk4\" (UID: \"ded8dbe1-e436-42fa-87b9-a5b64dfec3c4\") " pod="openshift-ingress/e2e-noten-268aff-openshift-default-57b8fb58f4-f6dk4"
Sep 18 22:19:20.694949 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:20.694691    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ded8dbe1-e436-42fa-87b9-a5b64dfec3c4-istio-envoy\") pod \"e2e-noten-268aff-openshift-default-57b8fb58f4-f6dk4\" (UID: \"ded8dbe1-e436-42fa-87b9-a5b64dfec3c4\") " pod="openshift-ingress/e2e-noten-268aff-openshift-default-57b8fb58f4-f6dk4"
Sep 18 22:19:20.694949 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:20.694731    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ded8dbe1-e436-42fa-87b9-a5b64dfec3c4-credential-socket\") pod \"e2e-noten-268aff-openshift-default-57b8fb58f4-f6dk4\" (UID: \"ded8dbe1-e436-42fa-87b9-a5b64dfec3c4\") " pod="openshift-ingress/e2e-noten-268aff-openshift-default-57b8fb58f4-f6dk4"
Sep 18 22:19:20.694949 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:20.694789    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ded8dbe1-e436-42fa-87b9-a5b64dfec3c4-istiod-ca-cert\") pod \"e2e-noten-268aff-openshift-default-57b8fb58f4-f6dk4\" (UID: \"ded8dbe1-e436-42fa-87b9-a5b64dfec3c4\") " pod="openshift-ingress/e2e-noten-268aff-openshift-default-57b8fb58f4-f6dk4"
Sep 18 22:19:20.695620 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:20.695594    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ded8dbe1-e436-42fa-87b9-a5b64dfec3c4-istiod-ca-cert\") pod \"e2e-noten-268aff-openshift-default-57b8fb58f4-f6dk4\" (UID: \"ded8dbe1-e436-42fa-87b9-a5b64dfec3c4\") " pod="openshift-ingress/e2e-noten-268aff-openshift-default-57b8fb58f4-f6dk4"
Sep 18 22:19:20.696188 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:20.696163    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ded8dbe1-e436-42fa-87b9-a5b64dfec3c4-istio-data\") pod \"e2e-noten-268aff-openshift-default-57b8fb58f4-f6dk4\" (UID: \"ded8dbe1-e436-42fa-87b9-a5b64dfec3c4\") " pod="openshift-ingress/e2e-noten-268aff-openshift-default-57b8fb58f4-f6dk4"
Sep 18 22:19:20.696402 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:20.696381    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ded8dbe1-e436-42fa-87b9-a5b64dfec3c4-workload-certs\") pod \"e2e-noten-268aff-openshift-default-57b8fb58f4-f6dk4\" (UID: \"ded8dbe1-e436-42fa-87b9-a5b64dfec3c4\") " pod="openshift-ingress/e2e-noten-268aff-openshift-default-57b8fb58f4-f6dk4"
Sep 18 22:19:20.697265 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:20.697236    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ded8dbe1-e436-42fa-87b9-a5b64dfec3c4-workload-socket\") pod \"e2e-noten-268aff-openshift-default-57b8fb58f4-f6dk4\" (UID: \"ded8dbe1-e436-42fa-87b9-a5b64dfec3c4\") " pod="openshift-ingress/e2e-noten-268aff-openshift-default-57b8fb58f4-f6dk4"
Sep 18 22:19:20.700787 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:20.700638    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ded8dbe1-e436-42fa-87b9-a5b64dfec3c4-istio-envoy\") pod \"e2e-noten-268aff-openshift-default-57b8fb58f4-f6dk4\" (UID: \"ded8dbe1-e436-42fa-87b9-a5b64dfec3c4\") " pod="openshift-ingress/e2e-noten-268aff-openshift-default-57b8fb58f4-f6dk4"
Sep 18 22:19:20.700897 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:20.700874    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ded8dbe1-e436-42fa-87b9-a5b64dfec3c4-credential-socket\") pod \"e2e-noten-268aff-openshift-default-57b8fb58f4-f6dk4\" (UID: \"ded8dbe1-e436-42fa-87b9-a5b64dfec3c4\") " pod="openshift-ingress/e2e-noten-268aff-openshift-default-57b8fb58f4-f6dk4"
Sep 18 22:19:20.706201 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:20.706165    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ded8dbe1-e436-42fa-87b9-a5b64dfec3c4-istio-podinfo\") pod \"e2e-noten-268aff-openshift-default-57b8fb58f4-f6dk4\" (UID: \"ded8dbe1-e436-42fa-87b9-a5b64dfec3c4\") " pod="openshift-ingress/e2e-noten-268aff-openshift-default-57b8fb58f4-f6dk4"
Sep 18 22:19:20.716723 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:20.713873    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ded8dbe1-e436-42fa-87b9-a5b64dfec3c4-istio-token\") pod \"e2e-noten-268aff-openshift-default-57b8fb58f4-f6dk4\" (UID: \"ded8dbe1-e436-42fa-87b9-a5b64dfec3c4\") " pod="openshift-ingress/e2e-noten-268aff-openshift-default-57b8fb58f4-f6dk4"
Sep 18 22:19:20.719962 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:20.719019    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmjzf\" (UniqueName: \"kubernetes.io/projected/ded8dbe1-e436-42fa-87b9-a5b64dfec3c4-kube-api-access-qmjzf\") pod \"e2e-noten-268aff-openshift-default-57b8fb58f4-f6dk4\" (UID: \"ded8dbe1-e436-42fa-87b9-a5b64dfec3c4\") " pod="openshift-ingress/e2e-noten-268aff-openshift-default-57b8fb58f4-f6dk4"
Sep 18 22:19:20.889521 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:20.889478    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-268aff-openshift-default-57b8fb58f4-f6dk4"
Sep 18 22:19:21.197835 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:21.197811    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-268aff-openshift-default-57b8fb58f4-f6dk4"]
Sep 18 22:19:21.199639 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:19:21.199613    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podded8dbe1_e436_42fa_87b9_a5b64dfec3c4.slice/crio-77ae0a6a20f8a62b255a0066bcefb467751e078c510949b6ede9a0a25b32f72b WatchSource:0}: Error finding container 77ae0a6a20f8a62b255a0066bcefb467751e078c510949b6ede9a0a25b32f72b: Status 404 returned error can't find the container with id 77ae0a6a20f8a62b255a0066bcefb467751e078c510949b6ede9a0a25b32f72b
Sep 18 22:19:21.202709 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:21.202674    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:19:21.202816 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:21.202769    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:19:21.202883 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:21.202825    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:19:22.010207 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:22.010164    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-268aff-openshift-default-57b8fb58f4-f6dk4" event={"ID":"ded8dbe1-e436-42fa-87b9-a5b64dfec3c4","Type":"ContainerStarted","Data":"fd9108fac216d75fbe3415f6efb5fe5271d13b88c890e8d32bd3606013112f68"}
Sep 18 22:19:22.010674 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:22.010268    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-268aff-openshift-default-57b8fb58f4-f6dk4" event={"ID":"ded8dbe1-e436-42fa-87b9-a5b64dfec3c4","Type":"ContainerStarted","Data":"77ae0a6a20f8a62b255a0066bcefb467751e078c510949b6ede9a0a25b32f72b"}
Sep 18 22:19:22.890097 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:22.890056    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-noten-268aff-openshift-default-57b8fb58f4-f6dk4"
Sep 18 22:19:22.895434 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:22.895391    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-noten-268aff-openshift-default-57b8fb58f4-f6dk4"
Sep 18 22:19:22.930097 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:22.930044    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-noten-268aff-openshift-default-57b8fb58f4-f6dk4" podStartSLOduration=2.930029652 podStartE2EDuration="2.930029652s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:19:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:19:22.043348453 +0000 UTC m=+1141.363020508" watchObservedRunningTime="2026-09-18 22:19:22.930029652 +0000 UTC m=+1142.249701782"
Sep 18 22:19:23.017880 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:23.017844    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-noten-268aff-openshift-default-57b8fb58f4-f6dk4"
Sep 18 22:19:23.018827 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:23.018806    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-noten-268aff-openshift-default-57b8fb58f4-f6dk4"
Sep 18 22:19:23.883563 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:23.882161    2577 patch_prober.go:28] interesting pod/e2e-mt-6ad61446-openshift-default-76976d5984-mhzwb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": read tcp 10.133.0.2:59868->10.133.0.76:15021: read: connection reset by peer" start-of-body=
Sep 18 22:19:23.883563 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:23.882227    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-6ad61446-openshift-default-76976d5984-mhzwb" podUID="36727232-bd03-4068-83e4-182dc910df1b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": read tcp 10.133.0.2:59868->10.133.0.76:15021: read: connection reset by peer"
Sep 18 22:19:24.025773 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:24.025745    2577 generic.go:356] "Generic (PLEG): container finished" podID="36727232-bd03-4068-83e4-182dc910df1b" containerID="529d480bd0f9a5f662657c6e9c5e20cdb0ae5b4dae4856696b2b104ced92753d" exitCode=0
Sep 18 22:19:24.026208 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:24.025821    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6ad61446-openshift-default-76976d5984-mhzwb" event={"ID":"36727232-bd03-4068-83e4-182dc910df1b","Type":"ContainerDied","Data":"529d480bd0f9a5f662657c6e9c5e20cdb0ae5b4dae4856696b2b104ced92753d"}
Sep 18 22:19:24.026333 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:24.026318    2577 scope.go:117] "RemoveContainer" containerID="529d480bd0f9a5f662657c6e9c5e20cdb0ae5b4dae4856696b2b104ced92753d"
Sep 18 22:19:24.027425 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:24.027375    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:19:24.027536 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:24.027478    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:19:24.027536 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:24.027529    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:19:25.035782 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:25.035753    2577 generic.go:356] "Generic (PLEG): container finished" podID="c93ed92f-bf02-4351-8e94-389c64a30005" containerID="6c0769207f19c58466be51cf4256c5d866d0ff195dd422d80c5d595b9a0dedac" exitCode=0
Sep 18 22:19:25.036218 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:25.035835    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-4209a4-openshift-default-57976f4696-7tn9n" event={"ID":"c93ed92f-bf02-4351-8e94-389c64a30005","Type":"ContainerDied","Data":"6c0769207f19c58466be51cf4256c5d866d0ff195dd422d80c5d595b9a0dedac"}
Sep 18 22:19:25.036218 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:25.035910    2577 scope.go:117] "RemoveContainer" containerID="af06e6bea06e912f53794cc6ee6d23c58507731da112ba0497a08ce4ef8f827e"
Sep 18 22:19:25.038095 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:25.038072    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6ad61446-openshift-default-76976d5984-mhzwb" event={"ID":"36727232-bd03-4068-83e4-182dc910df1b","Type":"ContainerStarted","Data":"f7af65b65b6c7ba4779f819f8681e82e56d8bf06fdf9057574e73f26df8c573d"}
Sep 18 22:19:25.108459 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:25.108435    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-4209a4-openshift-default-57976f4696-7tn9n"
Sep 18 22:19:25.141604 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:25.141570    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c93ed92f-bf02-4351-8e94-389c64a30005-istio-data\") pod \"c93ed92f-bf02-4351-8e94-389c64a30005\" (UID: \"c93ed92f-bf02-4351-8e94-389c64a30005\") "
Sep 18 22:19:25.141803 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:25.141627    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c93ed92f-bf02-4351-8e94-389c64a30005-istio-envoy\") pod \"c93ed92f-bf02-4351-8e94-389c64a30005\" (UID: \"c93ed92f-bf02-4351-8e94-389c64a30005\") "
Sep 18 22:19:25.141803 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:25.141703    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c93ed92f-bf02-4351-8e94-389c64a30005-workload-certs\") pod \"c93ed92f-bf02-4351-8e94-389c64a30005\" (UID: \"c93ed92f-bf02-4351-8e94-389c64a30005\") "
Sep 18 22:19:25.141803 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:25.141742    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c93ed92f-bf02-4351-8e94-389c64a30005-istiod-ca-cert\") pod \"c93ed92f-bf02-4351-8e94-389c64a30005\" (UID: \"c93ed92f-bf02-4351-8e94-389c64a30005\") "
Sep 18 22:19:25.141803 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:25.141779    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c93ed92f-bf02-4351-8e94-389c64a30005-istio-podinfo\") pod \"c93ed92f-bf02-4351-8e94-389c64a30005\" (UID: \"c93ed92f-bf02-4351-8e94-389c64a30005\") "
Sep 18 22:19:25.142046 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:25.141817    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xndpz\" (UniqueName: \"kubernetes.io/projected/c93ed92f-bf02-4351-8e94-389c64a30005-kube-api-access-xndpz\") pod \"c93ed92f-bf02-4351-8e94-389c64a30005\" (UID: \"c93ed92f-bf02-4351-8e94-389c64a30005\") "
Sep 18 22:19:25.142046 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:25.141845    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c93ed92f-bf02-4351-8e94-389c64a30005-istio-token\") pod \"c93ed92f-bf02-4351-8e94-389c64a30005\" (UID: \"c93ed92f-bf02-4351-8e94-389c64a30005\") "
Sep 18 22:19:25.142046 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:25.141887    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c93ed92f-bf02-4351-8e94-389c64a30005-workload-socket\") pod \"c93ed92f-bf02-4351-8e94-389c64a30005\" (UID: \"c93ed92f-bf02-4351-8e94-389c64a30005\") "
Sep 18 22:19:25.142046 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:25.141909    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c93ed92f-bf02-4351-8e94-389c64a30005-credential-socket\") pod \"c93ed92f-bf02-4351-8e94-389c64a30005\" (UID: \"c93ed92f-bf02-4351-8e94-389c64a30005\") "
Sep 18 22:19:25.142046 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:25.141809    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c93ed92f-bf02-4351-8e94-389c64a30005-istio-data" (OuterVolumeSpecName: "istio-data") pod "c93ed92f-bf02-4351-8e94-389c64a30005" (UID: "c93ed92f-bf02-4351-8e94-389c64a30005"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:19:25.142046 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:25.141947    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c93ed92f-bf02-4351-8e94-389c64a30005-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c93ed92f-bf02-4351-8e94-389c64a30005" (UID: "c93ed92f-bf02-4351-8e94-389c64a30005"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:19:25.142449 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:25.142141    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c93ed92f-bf02-4351-8e94-389c64a30005-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c93ed92f-bf02-4351-8e94-389c64a30005" (UID: "c93ed92f-bf02-4351-8e94-389c64a30005"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:19:25.142449 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:25.142293    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c93ed92f-bf02-4351-8e94-389c64a30005-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c93ed92f-bf02-4351-8e94-389c64a30005" (UID: "c93ed92f-bf02-4351-8e94-389c64a30005"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:19:25.142449 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:25.142306    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c93ed92f-bf02-4351-8e94-389c64a30005-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c93ed92f-bf02-4351-8e94-389c64a30005" (UID: "c93ed92f-bf02-4351-8e94-389c64a30005"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:19:25.142910 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:25.142693    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c93ed92f-bf02-4351-8e94-389c64a30005-istiod-ca-cert\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:19:25.142910 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:25.142814    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c93ed92f-bf02-4351-8e94-389c64a30005-workload-socket\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:19:25.142910 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:25.142839    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c93ed92f-bf02-4351-8e94-389c64a30005-credential-socket\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:19:25.142910 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:25.142854    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c93ed92f-bf02-4351-8e94-389c64a30005-istio-data\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:19:25.142910 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:25.142869    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c93ed92f-bf02-4351-8e94-389c64a30005-workload-certs\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:19:25.169680 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:25.169551    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c93ed92f-bf02-4351-8e94-389c64a30005-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c93ed92f-bf02-4351-8e94-389c64a30005" (UID: "c93ed92f-bf02-4351-8e94-389c64a30005"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 18 22:19:25.169680 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:25.169646    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c93ed92f-bf02-4351-8e94-389c64a30005-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c93ed92f-bf02-4351-8e94-389c64a30005" (UID: "c93ed92f-bf02-4351-8e94-389c64a30005"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:19:25.177010 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:25.176555    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c93ed92f-bf02-4351-8e94-389c64a30005-kube-api-access-xndpz" (OuterVolumeSpecName: "kube-api-access-xndpz") pod "c93ed92f-bf02-4351-8e94-389c64a30005" (UID: "c93ed92f-bf02-4351-8e94-389c64a30005"). InnerVolumeSpecName "kube-api-access-xndpz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:19:25.177010 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:25.176703    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c93ed92f-bf02-4351-8e94-389c64a30005-istio-token" (OuterVolumeSpecName: "istio-token") pod "c93ed92f-bf02-4351-8e94-389c64a30005" (UID: "c93ed92f-bf02-4351-8e94-389c64a30005"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:19:25.244308 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:25.244274    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c93ed92f-bf02-4351-8e94-389c64a30005-istio-envoy\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:19:25.244308 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:25.244305    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c93ed92f-bf02-4351-8e94-389c64a30005-istio-podinfo\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:19:25.244308 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:25.244314    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xndpz\" (UniqueName: \"kubernetes.io/projected/c93ed92f-bf02-4351-8e94-389c64a30005-kube-api-access-xndpz\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:19:25.244649 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:25.244324    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c93ed92f-bf02-4351-8e94-389c64a30005-istio-token\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:19:25.640484 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:25.640454    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-6ad61446-openshift-default-76976d5984-mhzwb"
Sep 18 22:19:25.640717 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:25.640691    2577 patch_prober.go:28] interesting pod/e2e-mt-6ad61446-openshift-default-76976d5984-mhzwb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Sep 18 22:19:25.640832 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:25.640754    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6ad61446-openshift-default-76976d5984-mhzwb" podUID="36727232-bd03-4068-83e4-182dc910df1b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Sep 18 22:19:26.047726 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:26.047643    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-4209a4-openshift-default-57976f4696-7tn9n"
Sep 18 22:19:26.055320 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:26.055118    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-4209a4-openshift-default-57976f4696-7tn9n" event={"ID":"c93ed92f-bf02-4351-8e94-389c64a30005","Type":"ContainerDied","Data":"75eabb2a6e89724cd0c4cb4d17db45db0a4f8a551a04ad14cd7b9b219d380b1d"}
Sep 18 22:19:26.055320 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:26.055193    2577 scope.go:117] "RemoveContainer" containerID="6c0769207f19c58466be51cf4256c5d866d0ff195dd422d80c5d595b9a0dedac"
Sep 18 22:19:26.081384 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:26.081355    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-4209a4-openshift-default-57976f4696-7tn9n"]
Sep 18 22:19:26.086219 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:26.086185    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-explicit-4209a4-openshift-default-57976f4696-7tn9n"]
Sep 18 22:19:26.640289 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:26.640254    2577 patch_prober.go:28] interesting pod/e2e-mt-6ad61446-openshift-default-76976d5984-mhzwb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Sep 18 22:19:26.640492 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:26.640322    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6ad61446-openshift-default-76976d5984-mhzwb" podUID="36727232-bd03-4068-83e4-182dc910df1b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Sep 18 22:19:27.140219 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:27.140187    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c93ed92f-bf02-4351-8e94-389c64a30005" path="/var/lib/kubelet/pods/c93ed92f-bf02-4351-8e94-389c64a30005/volumes"
Sep 18 22:19:27.640285 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:27.640250    2577 patch_prober.go:28] interesting pod/e2e-mt-6ad61446-openshift-default-76976d5984-mhzwb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Sep 18 22:19:27.640503 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:27.640318    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6ad61446-openshift-default-76976d5984-mhzwb" podUID="36727232-bd03-4068-83e4-182dc910df1b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Sep 18 22:19:28.640514 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:28.640481    2577 patch_prober.go:28] interesting pod/e2e-mt-6ad61446-openshift-default-76976d5984-mhzwb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Sep 18 22:19:28.640946 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:28.640549    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6ad61446-openshift-default-76976d5984-mhzwb" podUID="36727232-bd03-4068-83e4-182dc910df1b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Sep 18 22:19:29.640352 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:29.640319    2577 patch_prober.go:28] interesting pod/e2e-mt-6ad61446-openshift-default-76976d5984-mhzwb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Sep 18 22:19:29.640577 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:29.640373    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6ad61446-openshift-default-76976d5984-mhzwb" podUID="36727232-bd03-4068-83e4-182dc910df1b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Sep 18 22:19:30.643227 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:30.643198    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-6ad61446-openshift-default-76976d5984-mhzwb"
Sep 18 22:19:30.643682 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:30.643665    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-6ad61446-openshift-default-76976d5984-mhzwb"
Sep 18 22:19:30.644252 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:30.644236    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-6ad61446-openshift-default-76976d5984-mhzwb"
Sep 18 22:19:42.633237 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:42.633150    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-6ad61446-5467586ccc-xcfxl"]
Sep 18 22:19:42.633854 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:42.633433    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-6ad61446-5467586ccc-xcfxl" podUID="b0070329-94ee-4f0e-b991-89ebb6465bb3" containerName="payload-processing" containerID="cri-o://e07af354db9eb6668d48537e63f79e3fd753ca9cda16376725f2663e53b45fa6" gracePeriod=30
Sep 18 22:19:42.934918 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:42.934889    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-6ad61446-5467586ccc-xcfxl"
Sep 18 22:19:43.027253 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:43.027211    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b0070329-94ee-4f0e-b991-89ebb6465bb3-plugins-config-volume\") pod \"b0070329-94ee-4f0e-b991-89ebb6465bb3\" (UID: \"b0070329-94ee-4f0e-b991-89ebb6465bb3\") "
Sep 18 22:19:43.027472 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:43.027268    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dcgvb\" (UniqueName: \"kubernetes.io/projected/b0070329-94ee-4f0e-b991-89ebb6465bb3-kube-api-access-dcgvb\") pod \"b0070329-94ee-4f0e-b991-89ebb6465bb3\" (UID: \"b0070329-94ee-4f0e-b991-89ebb6465bb3\") "
Sep 18 22:19:43.027697 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:43.027670    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0070329-94ee-4f0e-b991-89ebb6465bb3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b0070329-94ee-4f0e-b991-89ebb6465bb3" (UID: "b0070329-94ee-4f0e-b991-89ebb6465bb3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:19:43.029566 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:43.029543    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0070329-94ee-4f0e-b991-89ebb6465bb3-kube-api-access-dcgvb" (OuterVolumeSpecName: "kube-api-access-dcgvb") pod "b0070329-94ee-4f0e-b991-89ebb6465bb3" (UID: "b0070329-94ee-4f0e-b991-89ebb6465bb3"). InnerVolumeSpecName "kube-api-access-dcgvb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:19:43.129115 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:43.129080    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b0070329-94ee-4f0e-b991-89ebb6465bb3-plugins-config-volume\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:19:43.129115 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:43.129109    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dcgvb\" (UniqueName: \"kubernetes.io/projected/b0070329-94ee-4f0e-b991-89ebb6465bb3-kube-api-access-dcgvb\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:19:43.180254 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:43.180175    2577 generic.go:356] "Generic (PLEG): container finished" podID="b0070329-94ee-4f0e-b991-89ebb6465bb3" containerID="e07af354db9eb6668d48537e63f79e3fd753ca9cda16376725f2663e53b45fa6" exitCode=0
Sep 18 22:19:43.180254 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:43.180234    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-6ad61446-5467586ccc-xcfxl"
Sep 18 22:19:43.180489 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:43.180261    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-6ad61446-5467586ccc-xcfxl" event={"ID":"b0070329-94ee-4f0e-b991-89ebb6465bb3","Type":"ContainerDied","Data":"e07af354db9eb6668d48537e63f79e3fd753ca9cda16376725f2663e53b45fa6"}
Sep 18 22:19:43.180489 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:43.180331    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-6ad61446-5467586ccc-xcfxl" event={"ID":"b0070329-94ee-4f0e-b991-89ebb6465bb3","Type":"ContainerDied","Data":"ab7b4222bb49b6182da09ddf46b57107993f576c3b70304ff6554875d0fbbc3d"}
Sep 18 22:19:43.180489 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:43.180362    2577 scope.go:117] "RemoveContainer" containerID="e07af354db9eb6668d48537e63f79e3fd753ca9cda16376725f2663e53b45fa6"
Sep 18 22:19:43.190124 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:43.190101    2577 scope.go:117] "RemoveContainer" containerID="e07af354db9eb6668d48537e63f79e3fd753ca9cda16376725f2663e53b45fa6"
Sep 18 22:19:43.190441 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:19:43.190399    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e07af354db9eb6668d48537e63f79e3fd753ca9cda16376725f2663e53b45fa6\": container with ID starting with e07af354db9eb6668d48537e63f79e3fd753ca9cda16376725f2663e53b45fa6 not found: ID does not exist" containerID="e07af354db9eb6668d48537e63f79e3fd753ca9cda16376725f2663e53b45fa6"
Sep 18 22:19:43.190532 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:43.190452    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e07af354db9eb6668d48537e63f79e3fd753ca9cda16376725f2663e53b45fa6"} err="failed to get container status \"e07af354db9eb6668d48537e63f79e3fd753ca9cda16376725f2663e53b45fa6\": rpc error: code = NotFound desc = could not find container \"e07af354db9eb6668d48537e63f79e3fd753ca9cda16376725f2663e53b45fa6\": container with ID starting with e07af354db9eb6668d48537e63f79e3fd753ca9cda16376725f2663e53b45fa6 not found: ID does not exist"
Sep 18 22:19:43.208626 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:43.208600    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-6ad61446-5467586ccc-xcfxl"]
Sep 18 22:19:43.211200 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:43.211181    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-6ad61446-5467586ccc-xcfxl"]
Sep 18 22:19:45.140192 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:45.140147    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b0070329-94ee-4f0e-b991-89ebb6465bb3" path="/var/lib/kubelet/pods/b0070329-94ee-4f0e-b991-89ebb6465bb3/volumes"
Sep 18 22:19:51.400044 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:51.400014    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-6ad61446-openshift-default-76976d5984-mhzwb"]
Sep 18 22:19:51.400479 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:51.400219    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-6ad61446-openshift-default-76976d5984-mhzwb" podUID="36727232-bd03-4068-83e4-182dc910df1b" containerName="istio-proxy" containerID="cri-o://f7af65b65b6c7ba4779f819f8681e82e56d8bf06fdf9057574e73f26df8c573d" gracePeriod=30
Sep 18 22:19:51.451848 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:51.451818    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-268aff-openshift-default-57b8fb58f4-f6dk4"]
Sep 18 22:19:51.452055 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:51.452013    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-noten-268aff-openshift-default-57b8fb58f4-f6dk4" podUID="ded8dbe1-e436-42fa-87b9-a5b64dfec3c4" containerName="istio-proxy" containerID="cri-o://fd9108fac216d75fbe3415f6efb5fe5271d13b88c890e8d32bd3606013112f68" gracePeriod=30
Sep 18 22:19:53.020903 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:53.020863    2577 patch_prober.go:28] interesting pod/e2e-noten-268aff-openshift-default-57b8fb58f4-f6dk4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 18 22:19:53.021323 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:53.020928    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-noten-268aff-openshift-default-57b8fb58f4-f6dk4" podUID="ded8dbe1-e436-42fa-87b9-a5b64dfec3c4" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 22:19:56.728107 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:56.728078    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6ad61446-openshift-default-76976d5984-mhzwb"
Sep 18 22:19:56.730621 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:56.730600    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-268aff-openshift-default-57b8fb58f4-f6dk4"
Sep 18 22:19:56.870465 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:56.870439    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/36727232-bd03-4068-83e4-182dc910df1b-istio-token\") pod \"36727232-bd03-4068-83e4-182dc910df1b\" (UID: \"36727232-bd03-4068-83e4-182dc910df1b\") "
Sep 18 22:19:56.870648 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:56.870484    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/36727232-bd03-4068-83e4-182dc910df1b-istio-podinfo\") pod \"36727232-bd03-4068-83e4-182dc910df1b\" (UID: \"36727232-bd03-4068-83e4-182dc910df1b\") "
Sep 18 22:19:56.870648 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:56.870508    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ded8dbe1-e436-42fa-87b9-a5b64dfec3c4-istio-envoy\") pod \"ded8dbe1-e436-42fa-87b9-a5b64dfec3c4\" (UID: \"ded8dbe1-e436-42fa-87b9-a5b64dfec3c4\") "
Sep 18 22:19:56.870648 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:56.870552    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ded8dbe1-e436-42fa-87b9-a5b64dfec3c4-credential-socket\") pod \"ded8dbe1-e436-42fa-87b9-a5b64dfec3c4\" (UID: \"ded8dbe1-e436-42fa-87b9-a5b64dfec3c4\") "
Sep 18 22:19:56.870648 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:56.870583    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ded8dbe1-e436-42fa-87b9-a5b64dfec3c4-istiod-ca-cert\") pod \"ded8dbe1-e436-42fa-87b9-a5b64dfec3c4\" (UID: \"ded8dbe1-e436-42fa-87b9-a5b64dfec3c4\") "
Sep 18 22:19:56.870648 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:56.870608    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cltn7\" (UniqueName: \"kubernetes.io/projected/36727232-bd03-4068-83e4-182dc910df1b-kube-api-access-cltn7\") pod \"36727232-bd03-4068-83e4-182dc910df1b\" (UID: \"36727232-bd03-4068-83e4-182dc910df1b\") "
Sep 18 22:19:56.870648 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:56.870641    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/36727232-bd03-4068-83e4-182dc910df1b-credential-socket\") pod \"36727232-bd03-4068-83e4-182dc910df1b\" (UID: \"36727232-bd03-4068-83e4-182dc910df1b\") "
Sep 18 22:19:56.870993 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:56.870707    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/36727232-bd03-4068-83e4-182dc910df1b-workload-certs\") pod \"36727232-bd03-4068-83e4-182dc910df1b\" (UID: \"36727232-bd03-4068-83e4-182dc910df1b\") "
Sep 18 22:19:56.870993 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:56.870738    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ded8dbe1-e436-42fa-87b9-a5b64dfec3c4-istio-data\") pod \"ded8dbe1-e436-42fa-87b9-a5b64dfec3c4\" (UID: \"ded8dbe1-e436-42fa-87b9-a5b64dfec3c4\") "
Sep 18 22:19:56.870993 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:56.870766    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ded8dbe1-e436-42fa-87b9-a5b64dfec3c4-istio-token\") pod \"ded8dbe1-e436-42fa-87b9-a5b64dfec3c4\" (UID: \"ded8dbe1-e436-42fa-87b9-a5b64dfec3c4\") "
Sep 18 22:19:56.870993 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:56.870793    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qmjzf\" (UniqueName: \"kubernetes.io/projected/ded8dbe1-e436-42fa-87b9-a5b64dfec3c4-kube-api-access-qmjzf\") pod \"ded8dbe1-e436-42fa-87b9-a5b64dfec3c4\" (UID: \"ded8dbe1-e436-42fa-87b9-a5b64dfec3c4\") "
Sep 18 22:19:56.870993 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:56.870820    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/36727232-bd03-4068-83e4-182dc910df1b-istiod-ca-cert\") pod \"36727232-bd03-4068-83e4-182dc910df1b\" (UID: \"36727232-bd03-4068-83e4-182dc910df1b\") "
Sep 18 22:19:56.870993 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:56.870888    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/36727232-bd03-4068-83e4-182dc910df1b-istio-data\") pod \"36727232-bd03-4068-83e4-182dc910df1b\" (UID: \"36727232-bd03-4068-83e4-182dc910df1b\") "
Sep 18 22:19:56.870993 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:56.870906    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ded8dbe1-e436-42fa-87b9-a5b64dfec3c4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ded8dbe1-e436-42fa-87b9-a5b64dfec3c4" (UID: "ded8dbe1-e436-42fa-87b9-a5b64dfec3c4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:19:56.870993 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:56.870930    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/36727232-bd03-4068-83e4-182dc910df1b-workload-socket\") pod \"36727232-bd03-4068-83e4-182dc910df1b\" (UID: \"36727232-bd03-4068-83e4-182dc910df1b\") "
Sep 18 22:19:56.870993 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:56.870976    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ded8dbe1-e436-42fa-87b9-a5b64dfec3c4-workload-certs\") pod \"ded8dbe1-e436-42fa-87b9-a5b64dfec3c4\" (UID: \"ded8dbe1-e436-42fa-87b9-a5b64dfec3c4\") "
Sep 18 22:19:56.871644 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:56.871004    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ded8dbe1-e436-42fa-87b9-a5b64dfec3c4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ded8dbe1-e436-42fa-87b9-a5b64dfec3c4" (UID: "ded8dbe1-e436-42fa-87b9-a5b64dfec3c4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:19:56.871644 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:56.871013    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ded8dbe1-e436-42fa-87b9-a5b64dfec3c4-istio-podinfo\") pod \"ded8dbe1-e436-42fa-87b9-a5b64dfec3c4\" (UID: \"ded8dbe1-e436-42fa-87b9-a5b64dfec3c4\") "
Sep 18 22:19:56.871644 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:56.871067    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ded8dbe1-e436-42fa-87b9-a5b64dfec3c4-workload-socket\") pod \"ded8dbe1-e436-42fa-87b9-a5b64dfec3c4\" (UID: \"ded8dbe1-e436-42fa-87b9-a5b64dfec3c4\") "
Sep 18 22:19:56.871644 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:56.871107    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/36727232-bd03-4068-83e4-182dc910df1b-istio-envoy\") pod \"36727232-bd03-4068-83e4-182dc910df1b\" (UID: \"36727232-bd03-4068-83e4-182dc910df1b\") "
Sep 18 22:19:56.871867 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:56.871662    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ded8dbe1-e436-42fa-87b9-a5b64dfec3c4-credential-socket\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:19:56.871867 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:56.871683    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ded8dbe1-e436-42fa-87b9-a5b64dfec3c4-istiod-ca-cert\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:19:56.871867 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:56.871686    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ded8dbe1-e436-42fa-87b9-a5b64dfec3c4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ded8dbe1-e436-42fa-87b9-a5b64dfec3c4" (UID: "ded8dbe1-e436-42fa-87b9-a5b64dfec3c4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:19:56.872020 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:56.871965    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36727232-bd03-4068-83e4-182dc910df1b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "36727232-bd03-4068-83e4-182dc910df1b" (UID: "36727232-bd03-4068-83e4-182dc910df1b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:19:56.872020 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:56.872014    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36727232-bd03-4068-83e4-182dc910df1b-istio-data" (OuterVolumeSpecName: "istio-data") pod "36727232-bd03-4068-83e4-182dc910df1b" (UID: "36727232-bd03-4068-83e4-182dc910df1b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:19:56.872889 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:56.872266    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ded8dbe1-e436-42fa-87b9-a5b64dfec3c4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ded8dbe1-e436-42fa-87b9-a5b64dfec3c4" (UID: "ded8dbe1-e436-42fa-87b9-a5b64dfec3c4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:19:56.872889 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:56.872476    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36727232-bd03-4068-83e4-182dc910df1b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "36727232-bd03-4068-83e4-182dc910df1b" (UID: "36727232-bd03-4068-83e4-182dc910df1b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:19:56.872889 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:56.872748    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ded8dbe1-e436-42fa-87b9-a5b64dfec3c4-istio-data" (OuterVolumeSpecName: "istio-data") pod "ded8dbe1-e436-42fa-87b9-a5b64dfec3c4" (UID: "ded8dbe1-e436-42fa-87b9-a5b64dfec3c4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:19:56.872889 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:56.872793    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36727232-bd03-4068-83e4-182dc910df1b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "36727232-bd03-4068-83e4-182dc910df1b" (UID: "36727232-bd03-4068-83e4-182dc910df1b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:19:56.872889 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:56.872858    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36727232-bd03-4068-83e4-182dc910df1b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "36727232-bd03-4068-83e4-182dc910df1b" (UID: "36727232-bd03-4068-83e4-182dc910df1b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:19:56.873964 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:56.873743    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/36727232-bd03-4068-83e4-182dc910df1b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "36727232-bd03-4068-83e4-182dc910df1b" (UID: "36727232-bd03-4068-83e4-182dc910df1b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 18 22:19:56.874223 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:56.874194    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ded8dbe1-e436-42fa-87b9-a5b64dfec3c4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ded8dbe1-e436-42fa-87b9-a5b64dfec3c4" (UID: "ded8dbe1-e436-42fa-87b9-a5b64dfec3c4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:19:56.874335 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:56.874279    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36727232-bd03-4068-83e4-182dc910df1b-kube-api-access-cltn7" (OuterVolumeSpecName: "kube-api-access-cltn7") pod "36727232-bd03-4068-83e4-182dc910df1b" (UID: "36727232-bd03-4068-83e4-182dc910df1b"). InnerVolumeSpecName "kube-api-access-cltn7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:19:56.874396 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:56.874364    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ded8dbe1-e436-42fa-87b9-a5b64dfec3c4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ded8dbe1-e436-42fa-87b9-a5b64dfec3c4" (UID: "ded8dbe1-e436-42fa-87b9-a5b64dfec3c4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 18 22:19:56.874543 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:56.874514    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36727232-bd03-4068-83e4-182dc910df1b-istio-token" (OuterVolumeSpecName: "istio-token") pod "36727232-bd03-4068-83e4-182dc910df1b" (UID: "36727232-bd03-4068-83e4-182dc910df1b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:19:56.874614 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:56.874578    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36727232-bd03-4068-83e4-182dc910df1b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "36727232-bd03-4068-83e4-182dc910df1b" (UID: "36727232-bd03-4068-83e4-182dc910df1b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:19:56.874790 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:56.874767    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ded8dbe1-e436-42fa-87b9-a5b64dfec3c4-istio-token" (OuterVolumeSpecName: "istio-token") pod "ded8dbe1-e436-42fa-87b9-a5b64dfec3c4" (UID: "ded8dbe1-e436-42fa-87b9-a5b64dfec3c4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:19:56.875274 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:56.875255    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ded8dbe1-e436-42fa-87b9-a5b64dfec3c4-kube-api-access-qmjzf" (OuterVolumeSpecName: "kube-api-access-qmjzf") pod "ded8dbe1-e436-42fa-87b9-a5b64dfec3c4" (UID: "ded8dbe1-e436-42fa-87b9-a5b64dfec3c4"). InnerVolumeSpecName "kube-api-access-qmjzf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:19:56.972810 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:56.972733    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cltn7\" (UniqueName: \"kubernetes.io/projected/36727232-bd03-4068-83e4-182dc910df1b-kube-api-access-cltn7\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:19:56.972810 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:56.972759    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/36727232-bd03-4068-83e4-182dc910df1b-credential-socket\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:19:56.972810 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:56.972769    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/36727232-bd03-4068-83e4-182dc910df1b-workload-certs\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:19:56.972810 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:56.972777    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ded8dbe1-e436-42fa-87b9-a5b64dfec3c4-istio-data\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:19:56.972810 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:56.972785    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ded8dbe1-e436-42fa-87b9-a5b64dfec3c4-istio-token\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:19:56.972810 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:56.972792    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qmjzf\" (UniqueName: \"kubernetes.io/projected/ded8dbe1-e436-42fa-87b9-a5b64dfec3c4-kube-api-access-qmjzf\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:19:56.972810 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:56.972800    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/36727232-bd03-4068-83e4-182dc910df1b-istiod-ca-cert\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:19:56.972810 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:56.972807    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/36727232-bd03-4068-83e4-182dc910df1b-istio-data\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:19:56.972810 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:56.972815    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/36727232-bd03-4068-83e4-182dc910df1b-workload-socket\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:19:56.973198 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:56.972822    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ded8dbe1-e436-42fa-87b9-a5b64dfec3c4-workload-certs\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:19:56.973198 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:56.972829    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ded8dbe1-e436-42fa-87b9-a5b64dfec3c4-istio-podinfo\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:19:56.973198 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:56.972836    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ded8dbe1-e436-42fa-87b9-a5b64dfec3c4-workload-socket\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:19:56.973198 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:56.972843    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/36727232-bd03-4068-83e4-182dc910df1b-istio-envoy\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:19:56.973198 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:56.972851    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/36727232-bd03-4068-83e4-182dc910df1b-istio-token\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:19:56.973198 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:56.972858    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/36727232-bd03-4068-83e4-182dc910df1b-istio-podinfo\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:19:56.973198 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:56.972865    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ded8dbe1-e436-42fa-87b9-a5b64dfec3c4-istio-envoy\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:19:57.281602 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:57.281521    2577 generic.go:356] "Generic (PLEG): container finished" podID="ded8dbe1-e436-42fa-87b9-a5b64dfec3c4" containerID="fd9108fac216d75fbe3415f6efb5fe5271d13b88c890e8d32bd3606013112f68" exitCode=0
Sep 18 22:19:57.281602 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:57.281569    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-268aff-openshift-default-57b8fb58f4-f6dk4"
Sep 18 22:19:57.281785 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:57.281597    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-268aff-openshift-default-57b8fb58f4-f6dk4" event={"ID":"ded8dbe1-e436-42fa-87b9-a5b64dfec3c4","Type":"ContainerDied","Data":"fd9108fac216d75fbe3415f6efb5fe5271d13b88c890e8d32bd3606013112f68"}
Sep 18 22:19:57.281785 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:57.281659    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-268aff-openshift-default-57b8fb58f4-f6dk4" event={"ID":"ded8dbe1-e436-42fa-87b9-a5b64dfec3c4","Type":"ContainerDied","Data":"77ae0a6a20f8a62b255a0066bcefb467751e078c510949b6ede9a0a25b32f72b"}
Sep 18 22:19:57.281785 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:57.281683    2577 scope.go:117] "RemoveContainer" containerID="fd9108fac216d75fbe3415f6efb5fe5271d13b88c890e8d32bd3606013112f68"
Sep 18 22:19:57.284052 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:57.284027    2577 generic.go:356] "Generic (PLEG): container finished" podID="36727232-bd03-4068-83e4-182dc910df1b" containerID="f7af65b65b6c7ba4779f819f8681e82e56d8bf06fdf9057574e73f26df8c573d" exitCode=0
Sep 18 22:19:57.284151 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:57.284079    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6ad61446-openshift-default-76976d5984-mhzwb"
Sep 18 22:19:57.284151 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:57.284101    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6ad61446-openshift-default-76976d5984-mhzwb" event={"ID":"36727232-bd03-4068-83e4-182dc910df1b","Type":"ContainerDied","Data":"f7af65b65b6c7ba4779f819f8681e82e56d8bf06fdf9057574e73f26df8c573d"}
Sep 18 22:19:57.284151 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:57.284143    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6ad61446-openshift-default-76976d5984-mhzwb" event={"ID":"36727232-bd03-4068-83e4-182dc910df1b","Type":"ContainerDied","Data":"b2fa6cb5dd945f9a6c174fc5eb4d8fd998e051c41305948d8ce5a4279d2c5079"}
Sep 18 22:19:57.291990 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:57.291974    2577 scope.go:117] "RemoveContainer" containerID="fd9108fac216d75fbe3415f6efb5fe5271d13b88c890e8d32bd3606013112f68"
Sep 18 22:19:57.292269 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:19:57.292251    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd9108fac216d75fbe3415f6efb5fe5271d13b88c890e8d32bd3606013112f68\": container with ID starting with fd9108fac216d75fbe3415f6efb5fe5271d13b88c890e8d32bd3606013112f68 not found: ID does not exist" containerID="fd9108fac216d75fbe3415f6efb5fe5271d13b88c890e8d32bd3606013112f68"
Sep 18 22:19:57.292313 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:57.292277    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd9108fac216d75fbe3415f6efb5fe5271d13b88c890e8d32bd3606013112f68"} err="failed to get container status \"fd9108fac216d75fbe3415f6efb5fe5271d13b88c890e8d32bd3606013112f68\": rpc error: code = NotFound desc = could not find container \"fd9108fac216d75fbe3415f6efb5fe5271d13b88c890e8d32bd3606013112f68\": container with ID starting with fd9108fac216d75fbe3415f6efb5fe5271d13b88c890e8d32bd3606013112f68 not found: ID does not exist"
Sep 18 22:19:57.292313 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:57.292293    2577 scope.go:117] "RemoveContainer" containerID="f7af65b65b6c7ba4779f819f8681e82e56d8bf06fdf9057574e73f26df8c573d"
Sep 18 22:19:57.301371 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:57.301348    2577 scope.go:117] "RemoveContainer" containerID="529d480bd0f9a5f662657c6e9c5e20cdb0ae5b4dae4856696b2b104ced92753d"
Sep 18 22:19:57.310122 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:57.310076    2577 scope.go:117] "RemoveContainer" containerID="f7af65b65b6c7ba4779f819f8681e82e56d8bf06fdf9057574e73f26df8c573d"
Sep 18 22:19:57.310624 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:19:57.310595    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7af65b65b6c7ba4779f819f8681e82e56d8bf06fdf9057574e73f26df8c573d\": container with ID starting with f7af65b65b6c7ba4779f819f8681e82e56d8bf06fdf9057574e73f26df8c573d not found: ID does not exist" containerID="f7af65b65b6c7ba4779f819f8681e82e56d8bf06fdf9057574e73f26df8c573d"
Sep 18 22:19:57.310730 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:57.310634    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7af65b65b6c7ba4779f819f8681e82e56d8bf06fdf9057574e73f26df8c573d"} err="failed to get container status \"f7af65b65b6c7ba4779f819f8681e82e56d8bf06fdf9057574e73f26df8c573d\": rpc error: code = NotFound desc = could not find container \"f7af65b65b6c7ba4779f819f8681e82e56d8bf06fdf9057574e73f26df8c573d\": container with ID starting with f7af65b65b6c7ba4779f819f8681e82e56d8bf06fdf9057574e73f26df8c573d not found: ID does not exist"
Sep 18 22:19:57.310730 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:57.310659    2577 scope.go:117] "RemoveContainer" containerID="529d480bd0f9a5f662657c6e9c5e20cdb0ae5b4dae4856696b2b104ced92753d"
Sep 18 22:19:57.310934 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:19:57.310916    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"529d480bd0f9a5f662657c6e9c5e20cdb0ae5b4dae4856696b2b104ced92753d\": container with ID starting with 529d480bd0f9a5f662657c6e9c5e20cdb0ae5b4dae4856696b2b104ced92753d not found: ID does not exist" containerID="529d480bd0f9a5f662657c6e9c5e20cdb0ae5b4dae4856696b2b104ced92753d"
Sep 18 22:19:57.311002 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:57.310935    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"529d480bd0f9a5f662657c6e9c5e20cdb0ae5b4dae4856696b2b104ced92753d"} err="failed to get container status \"529d480bd0f9a5f662657c6e9c5e20cdb0ae5b4dae4856696b2b104ced92753d\": rpc error: code = NotFound desc = could not find container \"529d480bd0f9a5f662657c6e9c5e20cdb0ae5b4dae4856696b2b104ced92753d\": container with ID starting with 529d480bd0f9a5f662657c6e9c5e20cdb0ae5b4dae4856696b2b104ced92753d not found: ID does not exist"
Sep 18 22:19:57.313354 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:57.313331    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-6ad61446-openshift-default-76976d5984-mhzwb"]
Sep 18 22:19:57.328754 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:57.328726    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-6ad61446-openshift-default-76976d5984-mhzwb"]
Sep 18 22:19:57.357661 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:57.357634    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-268aff-openshift-default-57b8fb58f4-f6dk4"]
Sep 18 22:19:57.369956 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:57.369930    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-noten-268aff-openshift-default-57b8fb58f4-f6dk4"]
Sep 18 22:19:59.139962 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:59.139932    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="36727232-bd03-4068-83e4-182dc910df1b" path="/var/lib/kubelet/pods/36727232-bd03-4068-83e4-182dc910df1b/volumes"
Sep 18 22:19:59.140394 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:19:59.140379    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ded8dbe1-e436-42fa-87b9-a5b64dfec3c4" path="/var/lib/kubelet/pods/ded8dbe1-e436-42fa-87b9-a5b64dfec3c4/volumes"
Sep 18 22:20:08.424541 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:08.424499    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-59b357/e2e-conflict-b-97f2ccbd-kserve-89788595-67x46"]
Sep 18 22:20:08.425097 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:08.425077    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0070329-94ee-4f0e-b991-89ebb6465bb3" containerName="payload-processing"
Sep 18 22:20:08.425251 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:08.425098    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0070329-94ee-4f0e-b991-89ebb6465bb3" containerName="payload-processing"
Sep 18 22:20:08.425251 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:08.425117    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36727232-bd03-4068-83e4-182dc910df1b" containerName="istio-proxy"
Sep 18 22:20:08.425251 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:08.425125    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="36727232-bd03-4068-83e4-182dc910df1b" containerName="istio-proxy"
Sep 18 22:20:08.425251 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:08.425149    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c93ed92f-bf02-4351-8e94-389c64a30005" containerName="istio-proxy"
Sep 18 22:20:08.425251 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:08.425158    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c93ed92f-bf02-4351-8e94-389c64a30005" containerName="istio-proxy"
Sep 18 22:20:08.425251 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:08.425175    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ded8dbe1-e436-42fa-87b9-a5b64dfec3c4" containerName="istio-proxy"
Sep 18 22:20:08.425251 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:08.425183    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="ded8dbe1-e436-42fa-87b9-a5b64dfec3c4" containerName="istio-proxy"
Sep 18 22:20:08.425251 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:08.425194    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c93ed92f-bf02-4351-8e94-389c64a30005" containerName="istio-proxy"
Sep 18 22:20:08.425251 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:08.425204    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c93ed92f-bf02-4351-8e94-389c64a30005" containerName="istio-proxy"
Sep 18 22:20:08.425721 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:08.425311    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c93ed92f-bf02-4351-8e94-389c64a30005" containerName="istio-proxy"
Sep 18 22:20:08.425721 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:08.425325    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0070329-94ee-4f0e-b991-89ebb6465bb3" containerName="payload-processing"
Sep 18 22:20:08.425721 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:08.425334    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="36727232-bd03-4068-83e4-182dc910df1b" containerName="istio-proxy"
Sep 18 22:20:08.425721 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:08.425344    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="36727232-bd03-4068-83e4-182dc910df1b" containerName="istio-proxy"
Sep 18 22:20:08.425721 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:08.425355    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="ded8dbe1-e436-42fa-87b9-a5b64dfec3c4" containerName="istio-proxy"
Sep 18 22:20:08.430170 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:08.430148    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-59b357/e2e-conflict-b-97f2ccbd-kserve-89788595-67x46"
Sep 18 22:20:08.433551 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:08.433533    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-59b357\"/\"kube-root-ca.crt\""
Sep 18 22:20:08.433651 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:08.433583    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-59b357\"/\"openshift-service-ca.crt\""
Sep 18 22:20:08.434354 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:08.434335    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-59b357\"/\"default-dockercfg-mtlw6\""
Sep 18 22:20:08.434511 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:08.434488    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-59b357\"/\"e2e-conflict-b-97f2ccbd-kserve-self-signed-certs\""
Sep 18 22:20:08.491943 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:08.491911    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7833bd48-f435-4f4a-b1df-5e7e3fed4f46-home\") pod \"e2e-conflict-b-97f2ccbd-kserve-89788595-67x46\" (UID: \"7833bd48-f435-4f4a-b1df-5e7e3fed4f46\") " pod="e2e-models-e2e-worker-w4-59b357/e2e-conflict-b-97f2ccbd-kserve-89788595-67x46"
Sep 18 22:20:08.492122 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:08.491957    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7833bd48-f435-4f4a-b1df-5e7e3fed4f46-tls-certs\") pod \"e2e-conflict-b-97f2ccbd-kserve-89788595-67x46\" (UID: \"7833bd48-f435-4f4a-b1df-5e7e3fed4f46\") " pod="e2e-models-e2e-worker-w4-59b357/e2e-conflict-b-97f2ccbd-kserve-89788595-67x46"
Sep 18 22:20:08.492122 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:08.492005    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7833bd48-f435-4f4a-b1df-5e7e3fed4f46-dshm\") pod \"e2e-conflict-b-97f2ccbd-kserve-89788595-67x46\" (UID: \"7833bd48-f435-4f4a-b1df-5e7e3fed4f46\") " pod="e2e-models-e2e-worker-w4-59b357/e2e-conflict-b-97f2ccbd-kserve-89788595-67x46"
Sep 18 22:20:08.492122 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:08.492095    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7833bd48-f435-4f4a-b1df-5e7e3fed4f46-tmp-dir\") pod \"e2e-conflict-b-97f2ccbd-kserve-89788595-67x46\" (UID: \"7833bd48-f435-4f4a-b1df-5e7e3fed4f46\") " pod="e2e-models-e2e-worker-w4-59b357/e2e-conflict-b-97f2ccbd-kserve-89788595-67x46"
Sep 18 22:20:08.492122 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:08.492118    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7833bd48-f435-4f4a-b1df-5e7e3fed4f46-model-cache\") pod \"e2e-conflict-b-97f2ccbd-kserve-89788595-67x46\" (UID: \"7833bd48-f435-4f4a-b1df-5e7e3fed4f46\") " pod="e2e-models-e2e-worker-w4-59b357/e2e-conflict-b-97f2ccbd-kserve-89788595-67x46"
Sep 18 22:20:08.492301 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:08.492144    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sllw9\" (UniqueName: \"kubernetes.io/projected/7833bd48-f435-4f4a-b1df-5e7e3fed4f46-kube-api-access-sllw9\") pod \"e2e-conflict-b-97f2ccbd-kserve-89788595-67x46\" (UID: \"7833bd48-f435-4f4a-b1df-5e7e3fed4f46\") " pod="e2e-models-e2e-worker-w4-59b357/e2e-conflict-b-97f2ccbd-kserve-89788595-67x46"
Sep 18 22:20:08.593012 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:08.592974    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-59b357/e2e-conflict-b-97f2ccbd-kserve-89788595-67x46"]
Sep 18 22:20:08.593437 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:08.593387    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7833bd48-f435-4f4a-b1df-5e7e3fed4f46-home\") pod \"e2e-conflict-b-97f2ccbd-kserve-89788595-67x46\" (UID: \"7833bd48-f435-4f4a-b1df-5e7e3fed4f46\") " pod="e2e-models-e2e-worker-w4-59b357/e2e-conflict-b-97f2ccbd-kserve-89788595-67x46"
Sep 18 22:20:08.593510 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:08.593478    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7833bd48-f435-4f4a-b1df-5e7e3fed4f46-tls-certs\") pod \"e2e-conflict-b-97f2ccbd-kserve-89788595-67x46\" (UID: \"7833bd48-f435-4f4a-b1df-5e7e3fed4f46\") " pod="e2e-models-e2e-worker-w4-59b357/e2e-conflict-b-97f2ccbd-kserve-89788595-67x46"
Sep 18 22:20:08.593510 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:08.593504    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7833bd48-f435-4f4a-b1df-5e7e3fed4f46-dshm\") pod \"e2e-conflict-b-97f2ccbd-kserve-89788595-67x46\" (UID: \"7833bd48-f435-4f4a-b1df-5e7e3fed4f46\") " pod="e2e-models-e2e-worker-w4-59b357/e2e-conflict-b-97f2ccbd-kserve-89788595-67x46"
Sep 18 22:20:08.593586 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:08.593572    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7833bd48-f435-4f4a-b1df-5e7e3fed4f46-tmp-dir\") pod \"e2e-conflict-b-97f2ccbd-kserve-89788595-67x46\" (UID: \"7833bd48-f435-4f4a-b1df-5e7e3fed4f46\") " pod="e2e-models-e2e-worker-w4-59b357/e2e-conflict-b-97f2ccbd-kserve-89788595-67x46"
Sep 18 22:20:08.593627 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:08.593605    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7833bd48-f435-4f4a-b1df-5e7e3fed4f46-model-cache\") pod \"e2e-conflict-b-97f2ccbd-kserve-89788595-67x46\" (UID: \"7833bd48-f435-4f4a-b1df-5e7e3fed4f46\") " pod="e2e-models-e2e-worker-w4-59b357/e2e-conflict-b-97f2ccbd-kserve-89788595-67x46"
Sep 18 22:20:08.593679 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:08.593636    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sllw9\" (UniqueName: \"kubernetes.io/projected/7833bd48-f435-4f4a-b1df-5e7e3fed4f46-kube-api-access-sllw9\") pod \"e2e-conflict-b-97f2ccbd-kserve-89788595-67x46\" (UID: \"7833bd48-f435-4f4a-b1df-5e7e3fed4f46\") " pod="e2e-models-e2e-worker-w4-59b357/e2e-conflict-b-97f2ccbd-kserve-89788595-67x46"
Sep 18 22:20:08.593846 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:08.593827    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7833bd48-f435-4f4a-b1df-5e7e3fed4f46-home\") pod \"e2e-conflict-b-97f2ccbd-kserve-89788595-67x46\" (UID: \"7833bd48-f435-4f4a-b1df-5e7e3fed4f46\") " pod="e2e-models-e2e-worker-w4-59b357/e2e-conflict-b-97f2ccbd-kserve-89788595-67x46"
Sep 18 22:20:08.594001 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:08.593980    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7833bd48-f435-4f4a-b1df-5e7e3fed4f46-model-cache\") pod \"e2e-conflict-b-97f2ccbd-kserve-89788595-67x46\" (UID: \"7833bd48-f435-4f4a-b1df-5e7e3fed4f46\") " pod="e2e-models-e2e-worker-w4-59b357/e2e-conflict-b-97f2ccbd-kserve-89788595-67x46"
Sep 18 22:20:08.594066 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:08.594027    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7833bd48-f435-4f4a-b1df-5e7e3fed4f46-tmp-dir\") pod \"e2e-conflict-b-97f2ccbd-kserve-89788595-67x46\" (UID: \"7833bd48-f435-4f4a-b1df-5e7e3fed4f46\") " pod="e2e-models-e2e-worker-w4-59b357/e2e-conflict-b-97f2ccbd-kserve-89788595-67x46"
Sep 18 22:20:08.596798 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:08.596774    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7833bd48-f435-4f4a-b1df-5e7e3fed4f46-tls-certs\") pod \"e2e-conflict-b-97f2ccbd-kserve-89788595-67x46\" (UID: \"7833bd48-f435-4f4a-b1df-5e7e3fed4f46\") " pod="e2e-models-e2e-worker-w4-59b357/e2e-conflict-b-97f2ccbd-kserve-89788595-67x46"
Sep 18 22:20:08.596935 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:08.596848    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7833bd48-f435-4f4a-b1df-5e7e3fed4f46-dshm\") pod \"e2e-conflict-b-97f2ccbd-kserve-89788595-67x46\" (UID: \"7833bd48-f435-4f4a-b1df-5e7e3fed4f46\") " pod="e2e-models-e2e-worker-w4-59b357/e2e-conflict-b-97f2ccbd-kserve-89788595-67x46"
Sep 18 22:20:08.616991 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:08.616961    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sllw9\" (UniqueName: \"kubernetes.io/projected/7833bd48-f435-4f4a-b1df-5e7e3fed4f46-kube-api-access-sllw9\") pod \"e2e-conflict-b-97f2ccbd-kserve-89788595-67x46\" (UID: \"7833bd48-f435-4f4a-b1df-5e7e3fed4f46\") " pod="e2e-models-e2e-worker-w4-59b357/e2e-conflict-b-97f2ccbd-kserve-89788595-67x46"
Sep 18 22:20:08.739957 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:08.739871    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-59b357/e2e-conflict-b-97f2ccbd-kserve-89788595-67x46"
Sep 18 22:20:09.070564 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:09.070540    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-59b357/e2e-conflict-b-97f2ccbd-kserve-89788595-67x46"]
Sep 18 22:20:09.072370 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:20:09.072344    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7833bd48_f435_4f4a_b1df_5e7e3fed4f46.slice/crio-0253e8842a71de2113696ff574c98c4ddc626d4f8fa0ee0b51f236e514811659 WatchSource:0}: Error finding container 0253e8842a71de2113696ff574c98c4ddc626d4f8fa0ee0b51f236e514811659: Status 404 returned error can't find the container with id 0253e8842a71de2113696ff574c98c4ddc626d4f8fa0ee0b51f236e514811659
Sep 18 22:20:09.365397 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:09.365318    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-59b357/e2e-conflict-b-97f2ccbd-kserve-89788595-67x46" event={"ID":"7833bd48-f435-4f4a-b1df-5e7e3fed4f46","Type":"ContainerStarted","Data":"28e7bc9210d8b3e201c344c9e82297835d560af6d143fc64585f1e104b898dc6"}
Sep 18 22:20:09.365397 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:09.365363    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-59b357/e2e-conflict-b-97f2ccbd-kserve-89788595-67x46" event={"ID":"7833bd48-f435-4f4a-b1df-5e7e3fed4f46","Type":"ContainerStarted","Data":"0253e8842a71de2113696ff574c98c4ddc626d4f8fa0ee0b51f236e514811659"}
Sep 18 22:20:09.414607 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:09.414557    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-59b357/e2e-conflict-b-97f2ccbd-kserve-89788595-67x46" podStartSLOduration=1.414541035 podStartE2EDuration="1.414541035s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:20:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:20:09.410513112 +0000 UTC m=+1188.730185167" watchObservedRunningTime="2026-09-18 22:20:09.414541035 +0000 UTC m=+1188.734213090"
Sep 18 22:20:10.365342 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:10.365305    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-62f806-openshift-default-678f9b6b98-7xbhc"]
Sep 18 22:20:10.365951 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:10.365930    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36727232-bd03-4068-83e4-182dc910df1b" containerName="istio-proxy"
Sep 18 22:20:10.366032 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:10.365954    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="36727232-bd03-4068-83e4-182dc910df1b" containerName="istio-proxy"
Sep 18 22:20:10.366091 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:10.366072    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c93ed92f-bf02-4351-8e94-389c64a30005" containerName="istio-proxy"
Sep 18 22:20:10.369476 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:10.369453    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-62f806-openshift-default-678f9b6b98-7xbhc"
Sep 18 22:20:10.373889 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:10.373862    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-62f806-openshift-default-dockercfg-9nw9n\""
Sep 18 22:20:10.397729 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:10.397702    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-62f806-openshift-default-678f9b6b98-7xbhc"]
Sep 18 22:20:10.410857 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:10.410832    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c4215060-d143-4fd8-80f4-10f9cb813087-istio-token\") pod \"e2e-shared-a-w2-62f806-openshift-default-678f9b6b98-7xbhc\" (UID: \"c4215060-d143-4fd8-80f4-10f9cb813087\") " pod="openshift-ingress/e2e-shared-a-w2-62f806-openshift-default-678f9b6b98-7xbhc"
Sep 18 22:20:10.410991 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:10.410899    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4215060-d143-4fd8-80f4-10f9cb813087-workload-socket\") pod \"e2e-shared-a-w2-62f806-openshift-default-678f9b6b98-7xbhc\" (UID: \"c4215060-d143-4fd8-80f4-10f9cb813087\") " pod="openshift-ingress/e2e-shared-a-w2-62f806-openshift-default-678f9b6b98-7xbhc"
Sep 18 22:20:10.410991 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:10.410938    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4215060-d143-4fd8-80f4-10f9cb813087-credential-socket\") pod \"e2e-shared-a-w2-62f806-openshift-default-678f9b6b98-7xbhc\" (UID: \"c4215060-d143-4fd8-80f4-10f9cb813087\") " pod="openshift-ingress/e2e-shared-a-w2-62f806-openshift-default-678f9b6b98-7xbhc"
Sep 18 22:20:10.410991 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:10.410966    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c4215060-d143-4fd8-80f4-10f9cb813087-istio-data\") pod \"e2e-shared-a-w2-62f806-openshift-default-678f9b6b98-7xbhc\" (UID: \"c4215060-d143-4fd8-80f4-10f9cb813087\") " pod="openshift-ingress/e2e-shared-a-w2-62f806-openshift-default-678f9b6b98-7xbhc"
Sep 18 22:20:10.411188 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:10.410990    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c4215060-d143-4fd8-80f4-10f9cb813087-istiod-ca-cert\") pod \"e2e-shared-a-w2-62f806-openshift-default-678f9b6b98-7xbhc\" (UID: \"c4215060-d143-4fd8-80f4-10f9cb813087\") " pod="openshift-ingress/e2e-shared-a-w2-62f806-openshift-default-678f9b6b98-7xbhc"
Sep 18 22:20:10.411188 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:10.411024    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c4215060-d143-4fd8-80f4-10f9cb813087-workload-certs\") pod \"e2e-shared-a-w2-62f806-openshift-default-678f9b6b98-7xbhc\" (UID: \"c4215060-d143-4fd8-80f4-10f9cb813087\") " pod="openshift-ingress/e2e-shared-a-w2-62f806-openshift-default-678f9b6b98-7xbhc"
Sep 18 22:20:10.411188 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:10.411038    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c4215060-d143-4fd8-80f4-10f9cb813087-istio-envoy\") pod \"e2e-shared-a-w2-62f806-openshift-default-678f9b6b98-7xbhc\" (UID: \"c4215060-d143-4fd8-80f4-10f9cb813087\") " pod="openshift-ingress/e2e-shared-a-w2-62f806-openshift-default-678f9b6b98-7xbhc"
Sep 18 22:20:10.411188 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:10.411099    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c4215060-d143-4fd8-80f4-10f9cb813087-istio-podinfo\") pod \"e2e-shared-a-w2-62f806-openshift-default-678f9b6b98-7xbhc\" (UID: \"c4215060-d143-4fd8-80f4-10f9cb813087\") " pod="openshift-ingress/e2e-shared-a-w2-62f806-openshift-default-678f9b6b98-7xbhc"
Sep 18 22:20:10.411188 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:10.411148    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdhhf\" (UniqueName: \"kubernetes.io/projected/c4215060-d143-4fd8-80f4-10f9cb813087-kube-api-access-rdhhf\") pod \"e2e-shared-a-w2-62f806-openshift-default-678f9b6b98-7xbhc\" (UID: \"c4215060-d143-4fd8-80f4-10f9cb813087\") " pod="openshift-ingress/e2e-shared-a-w2-62f806-openshift-default-678f9b6b98-7xbhc"
Sep 18 22:20:10.512796 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:10.512760    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c4215060-d143-4fd8-80f4-10f9cb813087-istio-token\") pod \"e2e-shared-a-w2-62f806-openshift-default-678f9b6b98-7xbhc\" (UID: \"c4215060-d143-4fd8-80f4-10f9cb813087\") " pod="openshift-ingress/e2e-shared-a-w2-62f806-openshift-default-678f9b6b98-7xbhc"
Sep 18 22:20:10.513010 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:10.512856    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4215060-d143-4fd8-80f4-10f9cb813087-workload-socket\") pod \"e2e-shared-a-w2-62f806-openshift-default-678f9b6b98-7xbhc\" (UID: \"c4215060-d143-4fd8-80f4-10f9cb813087\") " pod="openshift-ingress/e2e-shared-a-w2-62f806-openshift-default-678f9b6b98-7xbhc"
Sep 18 22:20:10.513010 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:10.512940    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4215060-d143-4fd8-80f4-10f9cb813087-credential-socket\") pod \"e2e-shared-a-w2-62f806-openshift-default-678f9b6b98-7xbhc\" (UID: \"c4215060-d143-4fd8-80f4-10f9cb813087\") " pod="openshift-ingress/e2e-shared-a-w2-62f806-openshift-default-678f9b6b98-7xbhc"
Sep 18 22:20:10.513010 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:10.512985    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c4215060-d143-4fd8-80f4-10f9cb813087-istio-data\") pod \"e2e-shared-a-w2-62f806-openshift-default-678f9b6b98-7xbhc\" (UID: \"c4215060-d143-4fd8-80f4-10f9cb813087\") " pod="openshift-ingress/e2e-shared-a-w2-62f806-openshift-default-678f9b6b98-7xbhc"
Sep 18 22:20:10.513213 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:10.513011    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c4215060-d143-4fd8-80f4-10f9cb813087-istiod-ca-cert\") pod \"e2e-shared-a-w2-62f806-openshift-default-678f9b6b98-7xbhc\" (UID: \"c4215060-d143-4fd8-80f4-10f9cb813087\") " pod="openshift-ingress/e2e-shared-a-w2-62f806-openshift-default-678f9b6b98-7xbhc"
Sep 18 22:20:10.513213 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:10.513069    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c4215060-d143-4fd8-80f4-10f9cb813087-workload-certs\") pod \"e2e-shared-a-w2-62f806-openshift-default-678f9b6b98-7xbhc\" (UID: \"c4215060-d143-4fd8-80f4-10f9cb813087\") " pod="openshift-ingress/e2e-shared-a-w2-62f806-openshift-default-678f9b6b98-7xbhc"
Sep 18 22:20:10.513213 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:10.513094    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c4215060-d143-4fd8-80f4-10f9cb813087-istio-envoy\") pod \"e2e-shared-a-w2-62f806-openshift-default-678f9b6b98-7xbhc\" (UID: \"c4215060-d143-4fd8-80f4-10f9cb813087\") " pod="openshift-ingress/e2e-shared-a-w2-62f806-openshift-default-678f9b6b98-7xbhc"
Sep 18 22:20:10.513213 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:10.513149    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c4215060-d143-4fd8-80f4-10f9cb813087-istio-podinfo\") pod \"e2e-shared-a-w2-62f806-openshift-default-678f9b6b98-7xbhc\" (UID: \"c4215060-d143-4fd8-80f4-10f9cb813087\") " pod="openshift-ingress/e2e-shared-a-w2-62f806-openshift-default-678f9b6b98-7xbhc"
Sep 18 22:20:10.513213 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:10.513193    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdhhf\" (UniqueName: \"kubernetes.io/projected/c4215060-d143-4fd8-80f4-10f9cb813087-kube-api-access-rdhhf\") pod \"e2e-shared-a-w2-62f806-openshift-default-678f9b6b98-7xbhc\" (UID: \"c4215060-d143-4fd8-80f4-10f9cb813087\") " pod="openshift-ingress/e2e-shared-a-w2-62f806-openshift-default-678f9b6b98-7xbhc"
Sep 18 22:20:10.513937 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:10.513911    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c4215060-d143-4fd8-80f4-10f9cb813087-istio-data\") pod \"e2e-shared-a-w2-62f806-openshift-default-678f9b6b98-7xbhc\" (UID: \"c4215060-d143-4fd8-80f4-10f9cb813087\") " pod="openshift-ingress/e2e-shared-a-w2-62f806-openshift-default-678f9b6b98-7xbhc"
Sep 18 22:20:10.514257 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:10.514229    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4215060-d143-4fd8-80f4-10f9cb813087-workload-socket\") pod \"e2e-shared-a-w2-62f806-openshift-default-678f9b6b98-7xbhc\" (UID: \"c4215060-d143-4fd8-80f4-10f9cb813087\") " pod="openshift-ingress/e2e-shared-a-w2-62f806-openshift-default-678f9b6b98-7xbhc"
Sep 18 22:20:10.514461 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:10.514406    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4215060-d143-4fd8-80f4-10f9cb813087-credential-socket\") pod \"e2e-shared-a-w2-62f806-openshift-default-678f9b6b98-7xbhc\" (UID: \"c4215060-d143-4fd8-80f4-10f9cb813087\") " pod="openshift-ingress/e2e-shared-a-w2-62f806-openshift-default-678f9b6b98-7xbhc"
Sep 18 22:20:10.515014 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:10.514989    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c4215060-d143-4fd8-80f4-10f9cb813087-istiod-ca-cert\") pod \"e2e-shared-a-w2-62f806-openshift-default-678f9b6b98-7xbhc\" (UID: \"c4215060-d143-4fd8-80f4-10f9cb813087\") " pod="openshift-ingress/e2e-shared-a-w2-62f806-openshift-default-678f9b6b98-7xbhc"
Sep 18 22:20:10.515281 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:10.515259    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c4215060-d143-4fd8-80f4-10f9cb813087-workload-certs\") pod \"e2e-shared-a-w2-62f806-openshift-default-678f9b6b98-7xbhc\" (UID: \"c4215060-d143-4fd8-80f4-10f9cb813087\") " pod="openshift-ingress/e2e-shared-a-w2-62f806-openshift-default-678f9b6b98-7xbhc"
Sep 18 22:20:10.517731 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:10.517686    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c4215060-d143-4fd8-80f4-10f9cb813087-istio-envoy\") pod \"e2e-shared-a-w2-62f806-openshift-default-678f9b6b98-7xbhc\" (UID: \"c4215060-d143-4fd8-80f4-10f9cb813087\") " pod="openshift-ingress/e2e-shared-a-w2-62f806-openshift-default-678f9b6b98-7xbhc"
Sep 18 22:20:10.520770 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:10.517995    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c4215060-d143-4fd8-80f4-10f9cb813087-istio-podinfo\") pod \"e2e-shared-a-w2-62f806-openshift-default-678f9b6b98-7xbhc\" (UID: \"c4215060-d143-4fd8-80f4-10f9cb813087\") " pod="openshift-ingress/e2e-shared-a-w2-62f806-openshift-default-678f9b6b98-7xbhc"
Sep 18 22:20:10.530605 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:10.530572    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c4215060-d143-4fd8-80f4-10f9cb813087-istio-token\") pod \"e2e-shared-a-w2-62f806-openshift-default-678f9b6b98-7xbhc\" (UID: \"c4215060-d143-4fd8-80f4-10f9cb813087\") " pod="openshift-ingress/e2e-shared-a-w2-62f806-openshift-default-678f9b6b98-7xbhc"
Sep 18 22:20:10.546158 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:10.546127    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdhhf\" (UniqueName: \"kubernetes.io/projected/c4215060-d143-4fd8-80f4-10f9cb813087-kube-api-access-rdhhf\") pod \"e2e-shared-a-w2-62f806-openshift-default-678f9b6b98-7xbhc\" (UID: \"c4215060-d143-4fd8-80f4-10f9cb813087\") " pod="openshift-ingress/e2e-shared-a-w2-62f806-openshift-default-678f9b6b98-7xbhc"
Sep 18 22:20:10.680814 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:10.680729    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-62f806-openshift-default-678f9b6b98-7xbhc"
Sep 18 22:20:10.973334 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:10.973300    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-62f806-openshift-default-678f9b6b98-7xbhc"]
Sep 18 22:20:10.975064 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:20:10.975037    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4215060_d143_4fd8_80f4_10f9cb813087.slice/crio-bef46372081fd8b9a1d8b147e3a08c06b533381bd6744667d651aa4ea2c5f56e WatchSource:0}: Error finding container bef46372081fd8b9a1d8b147e3a08c06b533381bd6744667d651aa4ea2c5f56e: Status 404 returned error can't find the container with id bef46372081fd8b9a1d8b147e3a08c06b533381bd6744667d651aa4ea2c5f56e
Sep 18 22:20:10.977807 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:10.977764    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:20:10.977891 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:10.977859    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:20:10.977928 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:10.977900    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:20:11.382064 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:11.382026    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-62f806-openshift-default-678f9b6b98-7xbhc" event={"ID":"c4215060-d143-4fd8-80f4-10f9cb813087","Type":"ContainerStarted","Data":"f5ba7370c92a89914cfb95335e202380bf4034f9ce02d1a2e804174bd16f56ef"}
Sep 18 22:20:11.382457 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:11.382090    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-62f806-openshift-default-678f9b6b98-7xbhc" event={"ID":"c4215060-d143-4fd8-80f4-10f9cb813087","Type":"ContainerStarted","Data":"bef46372081fd8b9a1d8b147e3a08c06b533381bd6744667d651aa4ea2c5f56e"}
Sep 18 22:20:11.426043 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:11.425994    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-62f806-openshift-default-678f9b6b98-7xbhc" podStartSLOduration=1.4259788 podStartE2EDuration="1.4259788s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:20:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:20:11.42418709 +0000 UTC m=+1190.743859145" watchObservedRunningTime="2026-09-18 22:20:11.4259788 +0000 UTC m=+1190.745650854"
Sep 18 22:20:11.680907 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:11.680823    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-62f806-openshift-default-678f9b6b98-7xbhc"
Sep 18 22:20:12.686391 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:12.686361    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-62f806-openshift-default-678f9b6b98-7xbhc"
Sep 18 22:20:13.395960 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:13.395933    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-62f806-openshift-default-678f9b6b98-7xbhc"
Sep 18 22:20:13.397045 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:13.397024    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-62f806-openshift-default-678f9b6b98-7xbhc"
Sep 18 22:20:18.740991 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:18.740955    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-59b357/e2e-conflict-b-97f2ccbd-kserve-89788595-67x46"
Sep 18 22:20:18.741549 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:18.741006    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-59b357/e2e-conflict-b-97f2ccbd-kserve-89788595-67x46"
Sep 18 22:20:18.753918 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:18.753894    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-59b357/e2e-conflict-b-97f2ccbd-kserve-89788595-67x46"
Sep 18 22:20:19.453444 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:19.453398    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-59b357/e2e-conflict-b-97f2ccbd-kserve-89788595-67x46"
Sep 18 22:20:19.508979 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:19.508943    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-62f806-db68bc95c-5d5dg"]
Sep 18 22:20:19.513438 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:19.513396    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-62f806-db68bc95c-5d5dg"
Sep 18 22:20:19.518743 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:19.518724    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w2-62f806\""
Sep 18 22:20:19.519185 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:19.519165    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w2-62f806-dockercfg-b4lt5\""
Sep 18 22:20:19.526982 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:19.526961    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-62f806-db68bc95c-5d5dg"]
Sep 18 22:20:19.611387 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:19.611349    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d8937bbd-8ac8-4021-8cf1-dcb95cd64ef6-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-62f806-db68bc95c-5d5dg\" (UID: \"d8937bbd-8ac8-4021-8cf1-dcb95cd64ef6\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-62f806-db68bc95c-5d5dg"
Sep 18 22:20:19.611590 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:19.611444    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdckg\" (UniqueName: \"kubernetes.io/projected/d8937bbd-8ac8-4021-8cf1-dcb95cd64ef6-kube-api-access-sdckg\") pod \"payload-processing-e2e-shared-a-w2-62f806-db68bc95c-5d5dg\" (UID: \"d8937bbd-8ac8-4021-8cf1-dcb95cd64ef6\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-62f806-db68bc95c-5d5dg"
Sep 18 22:20:19.712362 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:19.712291    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d8937bbd-8ac8-4021-8cf1-dcb95cd64ef6-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-62f806-db68bc95c-5d5dg\" (UID: \"d8937bbd-8ac8-4021-8cf1-dcb95cd64ef6\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-62f806-db68bc95c-5d5dg"
Sep 18 22:20:19.712362 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:19.712358    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdckg\" (UniqueName: \"kubernetes.io/projected/d8937bbd-8ac8-4021-8cf1-dcb95cd64ef6-kube-api-access-sdckg\") pod \"payload-processing-e2e-shared-a-w2-62f806-db68bc95c-5d5dg\" (UID: \"d8937bbd-8ac8-4021-8cf1-dcb95cd64ef6\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-62f806-db68bc95c-5d5dg"
Sep 18 22:20:19.713013 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:19.712994    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d8937bbd-8ac8-4021-8cf1-dcb95cd64ef6-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-62f806-db68bc95c-5d5dg\" (UID: \"d8937bbd-8ac8-4021-8cf1-dcb95cd64ef6\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-62f806-db68bc95c-5d5dg"
Sep 18 22:20:19.721667 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:19.721634    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdckg\" (UniqueName: \"kubernetes.io/projected/d8937bbd-8ac8-4021-8cf1-dcb95cd64ef6-kube-api-access-sdckg\") pod \"payload-processing-e2e-shared-a-w2-62f806-db68bc95c-5d5dg\" (UID: \"d8937bbd-8ac8-4021-8cf1-dcb95cd64ef6\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-62f806-db68bc95c-5d5dg"
Sep 18 22:20:19.824873 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:19.824825    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-62f806-db68bc95c-5d5dg"
Sep 18 22:20:20.108593 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:20.108563    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-62f806-db68bc95c-5d5dg"]
Sep 18 22:20:20.109706 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:20:20.109682    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8937bbd_8ac8_4021_8cf1_dcb95cd64ef6.slice/crio-59b19f39c3e32e52ab5e872354e800534b89d5d2050e8f5bc3eb60a13d37c615 WatchSource:0}: Error finding container 59b19f39c3e32e52ab5e872354e800534b89d5d2050e8f5bc3eb60a13d37c615: Status 404 returned error can't find the container with id 59b19f39c3e32e52ab5e872354e800534b89d5d2050e8f5bc3eb60a13d37c615
Sep 18 22:20:20.449674 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:20.449591    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-62f806-db68bc95c-5d5dg" event={"ID":"d8937bbd-8ac8-4021-8cf1-dcb95cd64ef6","Type":"ContainerStarted","Data":"1bd9d51a0fbbf4b4e33b2c7cf709fb95a645a618fa7b495dadd2a00ba9d37926"}
Sep 18 22:20:20.449907 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:20.449888    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-62f806-db68bc95c-5d5dg" event={"ID":"d8937bbd-8ac8-4021-8cf1-dcb95cd64ef6","Type":"ContainerStarted","Data":"59b19f39c3e32e52ab5e872354e800534b89d5d2050e8f5bc3eb60a13d37c615"}
Sep 18 22:20:20.450036 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:20.450024    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-62f806-db68bc95c-5d5dg"
Sep 18 22:20:20.470480 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:20.470424    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-62f806-db68bc95c-5d5dg" podStartSLOduration=1.470390348 podStartE2EDuration="1.470390348s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:20:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:20:20.467953014 +0000 UTC m=+1199.787625068" watchObservedRunningTime="2026-09-18 22:20:20.470390348 +0000 UTC m=+1199.790062484"
Sep 18 22:20:21.176641 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:21.176611    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-h2847_125d5bb0-54b7-4dff-aa80-e737f2791533/console-operator/1.log"
Sep 18 22:20:21.179160 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:21.179136    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-h2847_125d5bb0-54b7-4dff-aa80-e737f2791533/console-operator/1.log"
Sep 18 22:20:32.466073 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:32.466040    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-62f806-db68bc95c-5d5dg"
Sep 18 22:20:33.514355 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:33.514320    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-3d28c1-zngsj"]
Sep 18 22:20:33.519828 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:33.519808    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-3d28c1-zngsj"
Sep 18 22:20:33.524247 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:33.524226    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-9g7m4\""
Sep 18 22:20:33.537140 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:33.537116    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-3d28c1-zngsj"]
Sep 18 22:20:33.563437 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:33.562260    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2330526f-39dd-421c-b01b-b581d6fe8ad4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-3d28c1-zngsj\" (UID: \"2330526f-39dd-421c-b01b-b581d6fe8ad4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-3d28c1-zngsj"
Sep 18 22:20:33.663676 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:33.663623    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2330526f-39dd-421c-b01b-b581d6fe8ad4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-3d28c1-zngsj\" (UID: \"2330526f-39dd-421c-b01b-b581d6fe8ad4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-3d28c1-zngsj"
Sep 18 22:20:33.664674 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:33.664637    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2330526f-39dd-421c-b01b-b581d6fe8ad4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-3d28c1-zngsj\" (UID: \"2330526f-39dd-421c-b01b-b581d6fe8ad4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-3d28c1-zngsj"
Sep 18 22:20:33.829421 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:33.829370    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-3d28c1-zngsj"
Sep 18 22:20:34.144118 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:34.144075    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-3d28c1-zngsj"]
Sep 18 22:20:34.144315 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:20:34.144295    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2330526f_39dd_421c_b01b_b581d6fe8ad4.slice/crio-f3605242b76b3fbfde35b10db147deed24e702923aad3208e12b2e929218e66b WatchSource:0}: Error finding container f3605242b76b3fbfde35b10db147deed24e702923aad3208e12b2e929218e66b: Status 404 returned error can't find the container with id f3605242b76b3fbfde35b10db147deed24e702923aad3208e12b2e929218e66b
Sep 18 22:20:34.551225 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:34.551187    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-3d28c1-zngsj" event={"ID":"2330526f-39dd-421c-b01b-b581d6fe8ad4","Type":"ContainerStarted","Data":"e4e6637183d15e8a7c0fed7f3b54a344af195899548f9e586bd0402184eb54ac"}
Sep 18 22:20:34.551814 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:34.551786    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-3d28c1-zngsj" event={"ID":"2330526f-39dd-421c-b01b-b581d6fe8ad4","Type":"ContainerStarted","Data":"f3605242b76b3fbfde35b10db147deed24e702923aad3208e12b2e929218e66b"}
Sep 18 22:20:34.585464 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:34.585385    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-3d28c1-zngsj" podStartSLOduration=1.585371106 podStartE2EDuration="1.585371106s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:20:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:20:34.584614981 +0000 UTC m=+1213.904287037" watchObservedRunningTime="2026-09-18 22:20:34.585371106 +0000 UTC m=+1213.905043160"
Sep 18 22:20:35.564797 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:35.564758    2577 generic.go:356] "Generic (PLEG): container finished" podID="2330526f-39dd-421c-b01b-b581d6fe8ad4" containerID="e4e6637183d15e8a7c0fed7f3b54a344af195899548f9e586bd0402184eb54ac" exitCode=0
Sep 18 22:20:35.565280 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:35.564843    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-3d28c1-zngsj" event={"ID":"2330526f-39dd-421c-b01b-b581d6fe8ad4","Type":"ContainerDied","Data":"e4e6637183d15e8a7c0fed7f3b54a344af195899548f9e586bd0402184eb54ac"}
Sep 18 22:20:35.683444 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:35.681276    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-59b357/e2e-conflict-b-97f2ccbd-kserve-89788595-67x46"]
Sep 18 22:20:36.732522 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:36.732493    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-3d28c1-zngsj"
Sep 18 22:20:36.811915 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:36.811882    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2330526f-39dd-421c-b01b-b581d6fe8ad4-maas-api-service-ca\") pod \"2330526f-39dd-421c-b01b-b581d6fe8ad4\" (UID: \"2330526f-39dd-421c-b01b-b581d6fe8ad4\") "
Sep 18 22:20:36.812299 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:36.812271    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2330526f-39dd-421c-b01b-b581d6fe8ad4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2330526f-39dd-421c-b01b-b581d6fe8ad4" (UID: "2330526f-39dd-421c-b01b-b581d6fe8ad4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:20:36.913543 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:36.913458    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2330526f-39dd-421c-b01b-b581d6fe8ad4-maas-api-service-ca\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:20:37.579150 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:37.579119    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-3d28c1-zngsj"
Sep 18 22:20:37.579325 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:37.579121    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-3d28c1-zngsj" event={"ID":"2330526f-39dd-421c-b01b-b581d6fe8ad4","Type":"ContainerDied","Data":"f3605242b76b3fbfde35b10db147deed24e702923aad3208e12b2e929218e66b"}
Sep 18 22:20:37.579325 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:37.579288    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f3605242b76b3fbfde35b10db147deed24e702923aad3208e12b2e929218e66b"
Sep 18 22:20:39.593458 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:39.593398    2577 generic.go:356] "Generic (PLEG): container finished" podID="c4215060-d143-4fd8-80f4-10f9cb813087" containerID="f5ba7370c92a89914cfb95335e202380bf4034f9ce02d1a2e804174bd16f56ef" exitCode=0
Sep 18 22:20:39.593886 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:39.593458    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-62f806-openshift-default-678f9b6b98-7xbhc" event={"ID":"c4215060-d143-4fd8-80f4-10f9cb813087","Type":"ContainerDied","Data":"f5ba7370c92a89914cfb95335e202380bf4034f9ce02d1a2e804174bd16f56ef"}
Sep 18 22:20:39.593937 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:39.593898    2577 scope.go:117] "RemoveContainer" containerID="f5ba7370c92a89914cfb95335e202380bf4034f9ce02d1a2e804174bd16f56ef"
Sep 18 22:20:39.595146 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:39.595112    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:20:39.595209 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:39.595193    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:20:39.595254 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:39.595243    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:20:40.601964 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:40.601931    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-62f806-openshift-default-678f9b6b98-7xbhc" event={"ID":"c4215060-d143-4fd8-80f4-10f9cb813087","Type":"ContainerStarted","Data":"4febde2bce2e2a11a551a86fb0a8a4a42eab472a06e46b7332bd576efb007334"}
Sep 18 22:20:40.681255 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:40.681220    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-62f806-openshift-default-678f9b6b98-7xbhc"
Sep 18 22:20:40.682563 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:40.682440    2577 patch_prober.go:28] interesting pod/e2e-shared-a-w2-62f806-openshift-default-678f9b6b98-7xbhc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused" start-of-body=
Sep 18 22:20:40.682563 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:40.682501    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-62f806-openshift-default-678f9b6b98-7xbhc" podUID="c4215060-d143-4fd8-80f4-10f9cb813087" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused"
Sep 18 22:20:41.682067 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:41.682033    2577 patch_prober.go:28] interesting pod/e2e-shared-a-w2-62f806-openshift-default-678f9b6b98-7xbhc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused" start-of-body=
Sep 18 22:20:41.682481 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:41.682089    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-62f806-openshift-default-678f9b6b98-7xbhc" podUID="c4215060-d143-4fd8-80f4-10f9cb813087" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused"
Sep 18 22:20:42.681735 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:42.681698    2577 patch_prober.go:28] interesting pod/e2e-shared-a-w2-62f806-openshift-default-678f9b6b98-7xbhc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused" start-of-body=
Sep 18 22:20:42.681921 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:42.681754    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-62f806-openshift-default-678f9b6b98-7xbhc" podUID="c4215060-d143-4fd8-80f4-10f9cb813087" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused"
Sep 18 22:20:43.395989 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:43.395956    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-62f806-openshift-default-678f9b6b98-7xbhc"
Sep 18 22:20:43.681196 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:43.681106    2577 patch_prober.go:28] interesting pod/e2e-shared-a-w2-62f806-openshift-default-678f9b6b98-7xbhc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused" start-of-body=
Sep 18 22:20:43.681196 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:43.681179    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-62f806-openshift-default-678f9b6b98-7xbhc" podUID="c4215060-d143-4fd8-80f4-10f9cb813087" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused"
Sep 18 22:20:44.166437 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:44.165387    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w2-aa9dcd-openshift-default-6dcc9d97fb-4z9l2"]
Sep 18 22:20:44.166437 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:44.166031    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2330526f-39dd-421c-b01b-b581d6fe8ad4" containerName="revoke-keys"
Sep 18 22:20:44.166437 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:44.166047    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="2330526f-39dd-421c-b01b-b581d6fe8ad4" containerName="revoke-keys"
Sep 18 22:20:44.166437 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:44.166180    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="2330526f-39dd-421c-b01b-b581d6fe8ad4" containerName="revoke-keys"
Sep 18 22:20:44.172588 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:44.171703    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-aa9dcd-openshift-default-6dcc9d97fb-4z9l2"
Sep 18 22:20:44.179630 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:44.179609    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w2-aa9dcd-openshift-default-dockercfg-xnk4g\""
Sep 18 22:20:44.184161 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:44.184140    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-aa9dcd-openshift-default-6dcc9d97fb-4z9l2"]
Sep 18 22:20:44.299437 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:44.298952    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0ca4a048-4332-4aa2-867a-7b7fc269ee04-workload-certs\") pod \"e2e-shared-b-w2-aa9dcd-openshift-default-6dcc9d97fb-4z9l2\" (UID: \"0ca4a048-4332-4aa2-867a-7b7fc269ee04\") " pod="openshift-ingress/e2e-shared-b-w2-aa9dcd-openshift-default-6dcc9d97fb-4z9l2"
Sep 18 22:20:44.299437 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:44.299030    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ca4a048-4332-4aa2-867a-7b7fc269ee04-credential-socket\") pod \"e2e-shared-b-w2-aa9dcd-openshift-default-6dcc9d97fb-4z9l2\" (UID: \"0ca4a048-4332-4aa2-867a-7b7fc269ee04\") " pod="openshift-ingress/e2e-shared-b-w2-aa9dcd-openshift-default-6dcc9d97fb-4z9l2"
Sep 18 22:20:44.299437 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:44.299072    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-722qs\" (UniqueName: \"kubernetes.io/projected/0ca4a048-4332-4aa2-867a-7b7fc269ee04-kube-api-access-722qs\") pod \"e2e-shared-b-w2-aa9dcd-openshift-default-6dcc9d97fb-4z9l2\" (UID: \"0ca4a048-4332-4aa2-867a-7b7fc269ee04\") " pod="openshift-ingress/e2e-shared-b-w2-aa9dcd-openshift-default-6dcc9d97fb-4z9l2"
Sep 18 22:20:44.299437 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:44.299147    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0ca4a048-4332-4aa2-867a-7b7fc269ee04-istio-envoy\") pod \"e2e-shared-b-w2-aa9dcd-openshift-default-6dcc9d97fb-4z9l2\" (UID: \"0ca4a048-4332-4aa2-867a-7b7fc269ee04\") " pod="openshift-ingress/e2e-shared-b-w2-aa9dcd-openshift-default-6dcc9d97fb-4z9l2"
Sep 18 22:20:44.299437 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:44.299215    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ca4a048-4332-4aa2-867a-7b7fc269ee04-workload-socket\") pod \"e2e-shared-b-w2-aa9dcd-openshift-default-6dcc9d97fb-4z9l2\" (UID: \"0ca4a048-4332-4aa2-867a-7b7fc269ee04\") " pod="openshift-ingress/e2e-shared-b-w2-aa9dcd-openshift-default-6dcc9d97fb-4z9l2"
Sep 18 22:20:44.299437 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:44.299247    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0ca4a048-4332-4aa2-867a-7b7fc269ee04-istio-token\") pod \"e2e-shared-b-w2-aa9dcd-openshift-default-6dcc9d97fb-4z9l2\" (UID: \"0ca4a048-4332-4aa2-867a-7b7fc269ee04\") " pod="openshift-ingress/e2e-shared-b-w2-aa9dcd-openshift-default-6dcc9d97fb-4z9l2"
Sep 18 22:20:44.299437 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:44.299279    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0ca4a048-4332-4aa2-867a-7b7fc269ee04-istio-data\") pod \"e2e-shared-b-w2-aa9dcd-openshift-default-6dcc9d97fb-4z9l2\" (UID: \"0ca4a048-4332-4aa2-867a-7b7fc269ee04\") " pod="openshift-ingress/e2e-shared-b-w2-aa9dcd-openshift-default-6dcc9d97fb-4z9l2"
Sep 18 22:20:44.299437 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:44.299306    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0ca4a048-4332-4aa2-867a-7b7fc269ee04-istiod-ca-cert\") pod \"e2e-shared-b-w2-aa9dcd-openshift-default-6dcc9d97fb-4z9l2\" (UID: \"0ca4a048-4332-4aa2-867a-7b7fc269ee04\") " pod="openshift-ingress/e2e-shared-b-w2-aa9dcd-openshift-default-6dcc9d97fb-4z9l2"
Sep 18 22:20:44.299437 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:44.299343    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0ca4a048-4332-4aa2-867a-7b7fc269ee04-istio-podinfo\") pod \"e2e-shared-b-w2-aa9dcd-openshift-default-6dcc9d97fb-4z9l2\" (UID: \"0ca4a048-4332-4aa2-867a-7b7fc269ee04\") " pod="openshift-ingress/e2e-shared-b-w2-aa9dcd-openshift-default-6dcc9d97fb-4z9l2"
Sep 18 22:20:44.400252 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:44.400209    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ca4a048-4332-4aa2-867a-7b7fc269ee04-credential-socket\") pod \"e2e-shared-b-w2-aa9dcd-openshift-default-6dcc9d97fb-4z9l2\" (UID: \"0ca4a048-4332-4aa2-867a-7b7fc269ee04\") " pod="openshift-ingress/e2e-shared-b-w2-aa9dcd-openshift-default-6dcc9d97fb-4z9l2"
Sep 18 22:20:44.400743 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:44.400296    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-722qs\" (UniqueName: \"kubernetes.io/projected/0ca4a048-4332-4aa2-867a-7b7fc269ee04-kube-api-access-722qs\") pod \"e2e-shared-b-w2-aa9dcd-openshift-default-6dcc9d97fb-4z9l2\" (UID: \"0ca4a048-4332-4aa2-867a-7b7fc269ee04\") " pod="openshift-ingress/e2e-shared-b-w2-aa9dcd-openshift-default-6dcc9d97fb-4z9l2"
Sep 18 22:20:44.400743 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:44.400367    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0ca4a048-4332-4aa2-867a-7b7fc269ee04-istio-envoy\") pod \"e2e-shared-b-w2-aa9dcd-openshift-default-6dcc9d97fb-4z9l2\" (UID: \"0ca4a048-4332-4aa2-867a-7b7fc269ee04\") " pod="openshift-ingress/e2e-shared-b-w2-aa9dcd-openshift-default-6dcc9d97fb-4z9l2"
Sep 18 22:20:44.400743 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:44.400448    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ca4a048-4332-4aa2-867a-7b7fc269ee04-workload-socket\") pod \"e2e-shared-b-w2-aa9dcd-openshift-default-6dcc9d97fb-4z9l2\" (UID: \"0ca4a048-4332-4aa2-867a-7b7fc269ee04\") " pod="openshift-ingress/e2e-shared-b-w2-aa9dcd-openshift-default-6dcc9d97fb-4z9l2"
Sep 18 22:20:44.400743 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:44.400482    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0ca4a048-4332-4aa2-867a-7b7fc269ee04-istio-token\") pod \"e2e-shared-b-w2-aa9dcd-openshift-default-6dcc9d97fb-4z9l2\" (UID: \"0ca4a048-4332-4aa2-867a-7b7fc269ee04\") " pod="openshift-ingress/e2e-shared-b-w2-aa9dcd-openshift-default-6dcc9d97fb-4z9l2"
Sep 18 22:20:44.400743 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:44.400516    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0ca4a048-4332-4aa2-867a-7b7fc269ee04-istio-data\") pod \"e2e-shared-b-w2-aa9dcd-openshift-default-6dcc9d97fb-4z9l2\" (UID: \"0ca4a048-4332-4aa2-867a-7b7fc269ee04\") " pod="openshift-ingress/e2e-shared-b-w2-aa9dcd-openshift-default-6dcc9d97fb-4z9l2"
Sep 18 22:20:44.400743 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:44.400697    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ca4a048-4332-4aa2-867a-7b7fc269ee04-credential-socket\") pod \"e2e-shared-b-w2-aa9dcd-openshift-default-6dcc9d97fb-4z9l2\" (UID: \"0ca4a048-4332-4aa2-867a-7b7fc269ee04\") " pod="openshift-ingress/e2e-shared-b-w2-aa9dcd-openshift-default-6dcc9d97fb-4z9l2"
Sep 18 22:20:44.400743 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:44.400699    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0ca4a048-4332-4aa2-867a-7b7fc269ee04-istiod-ca-cert\") pod \"e2e-shared-b-w2-aa9dcd-openshift-default-6dcc9d97fb-4z9l2\" (UID: \"0ca4a048-4332-4aa2-867a-7b7fc269ee04\") " pod="openshift-ingress/e2e-shared-b-w2-aa9dcd-openshift-default-6dcc9d97fb-4z9l2"
Sep 18 22:20:44.401148 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:44.400763    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0ca4a048-4332-4aa2-867a-7b7fc269ee04-istio-podinfo\") pod \"e2e-shared-b-w2-aa9dcd-openshift-default-6dcc9d97fb-4z9l2\" (UID: \"0ca4a048-4332-4aa2-867a-7b7fc269ee04\") " pod="openshift-ingress/e2e-shared-b-w2-aa9dcd-openshift-default-6dcc9d97fb-4z9l2"
Sep 18 22:20:44.401148 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:44.400819    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0ca4a048-4332-4aa2-867a-7b7fc269ee04-workload-certs\") pod \"e2e-shared-b-w2-aa9dcd-openshift-default-6dcc9d97fb-4z9l2\" (UID: \"0ca4a048-4332-4aa2-867a-7b7fc269ee04\") " pod="openshift-ingress/e2e-shared-b-w2-aa9dcd-openshift-default-6dcc9d97fb-4z9l2"
Sep 18 22:20:44.401148 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:44.400817    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ca4a048-4332-4aa2-867a-7b7fc269ee04-workload-socket\") pod \"e2e-shared-b-w2-aa9dcd-openshift-default-6dcc9d97fb-4z9l2\" (UID: \"0ca4a048-4332-4aa2-867a-7b7fc269ee04\") " pod="openshift-ingress/e2e-shared-b-w2-aa9dcd-openshift-default-6dcc9d97fb-4z9l2"
Sep 18 22:20:44.401148 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:44.401032    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0ca4a048-4332-4aa2-867a-7b7fc269ee04-istio-data\") pod \"e2e-shared-b-w2-aa9dcd-openshift-default-6dcc9d97fb-4z9l2\" (UID: \"0ca4a048-4332-4aa2-867a-7b7fc269ee04\") " pod="openshift-ingress/e2e-shared-b-w2-aa9dcd-openshift-default-6dcc9d97fb-4z9l2"
Sep 18 22:20:44.401339 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:44.401321    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0ca4a048-4332-4aa2-867a-7b7fc269ee04-istiod-ca-cert\") pod \"e2e-shared-b-w2-aa9dcd-openshift-default-6dcc9d97fb-4z9l2\" (UID: \"0ca4a048-4332-4aa2-867a-7b7fc269ee04\") " pod="openshift-ingress/e2e-shared-b-w2-aa9dcd-openshift-default-6dcc9d97fb-4z9l2"
Sep 18 22:20:44.401404 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:44.401380    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0ca4a048-4332-4aa2-867a-7b7fc269ee04-workload-certs\") pod \"e2e-shared-b-w2-aa9dcd-openshift-default-6dcc9d97fb-4z9l2\" (UID: \"0ca4a048-4332-4aa2-867a-7b7fc269ee04\") " pod="openshift-ingress/e2e-shared-b-w2-aa9dcd-openshift-default-6dcc9d97fb-4z9l2"
Sep 18 22:20:44.402908 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:44.402889    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0ca4a048-4332-4aa2-867a-7b7fc269ee04-istio-envoy\") pod \"e2e-shared-b-w2-aa9dcd-openshift-default-6dcc9d97fb-4z9l2\" (UID: \"0ca4a048-4332-4aa2-867a-7b7fc269ee04\") " pod="openshift-ingress/e2e-shared-b-w2-aa9dcd-openshift-default-6dcc9d97fb-4z9l2"
Sep 18 22:20:44.403637 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:44.403616    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0ca4a048-4332-4aa2-867a-7b7fc269ee04-istio-podinfo\") pod \"e2e-shared-b-w2-aa9dcd-openshift-default-6dcc9d97fb-4z9l2\" (UID: \"0ca4a048-4332-4aa2-867a-7b7fc269ee04\") " pod="openshift-ingress/e2e-shared-b-w2-aa9dcd-openshift-default-6dcc9d97fb-4z9l2"
Sep 18 22:20:44.413119 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:44.413096    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0ca4a048-4332-4aa2-867a-7b7fc269ee04-istio-token\") pod \"e2e-shared-b-w2-aa9dcd-openshift-default-6dcc9d97fb-4z9l2\" (UID: \"0ca4a048-4332-4aa2-867a-7b7fc269ee04\") " pod="openshift-ingress/e2e-shared-b-w2-aa9dcd-openshift-default-6dcc9d97fb-4z9l2"
Sep 18 22:20:44.413222 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:44.413169    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-722qs\" (UniqueName: \"kubernetes.io/projected/0ca4a048-4332-4aa2-867a-7b7fc269ee04-kube-api-access-722qs\") pod \"e2e-shared-b-w2-aa9dcd-openshift-default-6dcc9d97fb-4z9l2\" (UID: \"0ca4a048-4332-4aa2-867a-7b7fc269ee04\") " pod="openshift-ingress/e2e-shared-b-w2-aa9dcd-openshift-default-6dcc9d97fb-4z9l2"
Sep 18 22:20:44.488530 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:44.488429    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-aa9dcd-openshift-default-6dcc9d97fb-4z9l2"
Sep 18 22:20:44.681965 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:44.681931    2577 patch_prober.go:28] interesting pod/e2e-shared-a-w2-62f806-openshift-default-678f9b6b98-7xbhc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused" start-of-body=
Sep 18 22:20:44.682139 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:44.681987    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-62f806-openshift-default-678f9b6b98-7xbhc" podUID="c4215060-d143-4fd8-80f4-10f9cb813087" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused"
Sep 18 22:20:44.812767 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:44.812735    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-aa9dcd-openshift-default-6dcc9d97fb-4z9l2"]
Sep 18 22:20:44.813097 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:20:44.813075    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ca4a048_4332_4aa2_867a_7b7fc269ee04.slice/crio-2e81eafbb14848078123c0cff792bb0f4dec152070f9ba13fe4d03824f4dda12 WatchSource:0}: Error finding container 2e81eafbb14848078123c0cff792bb0f4dec152070f9ba13fe4d03824f4dda12: Status 404 returned error can't find the container with id 2e81eafbb14848078123c0cff792bb0f4dec152070f9ba13fe4d03824f4dda12
Sep 18 22:20:44.815537 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:44.815506    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:20:44.815621 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:44.815576    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:20:44.815621 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:44.815608    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:20:45.637594 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:45.637556    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-aa9dcd-openshift-default-6dcc9d97fb-4z9l2" event={"ID":"0ca4a048-4332-4aa2-867a-7b7fc269ee04","Type":"ContainerStarted","Data":"2fe3212e8fb873017c765170b035ac76490400412aa8fa02833dde2481541273"}
Sep 18 22:20:45.637997 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:45.637605    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-aa9dcd-openshift-default-6dcc9d97fb-4z9l2" event={"ID":"0ca4a048-4332-4aa2-867a-7b7fc269ee04","Type":"ContainerStarted","Data":"2e81eafbb14848078123c0cff792bb0f4dec152070f9ba13fe4d03824f4dda12"}
Sep 18 22:20:45.679399 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:45.679347    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w2-aa9dcd-openshift-default-6dcc9d97fb-4z9l2" podStartSLOduration=1.679332246 podStartE2EDuration="1.679332246s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:20:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:20:45.676997498 +0000 UTC m=+1224.996669566" watchObservedRunningTime="2026-09-18 22:20:45.679332246 +0000 UTC m=+1224.999004300"
Sep 18 22:20:45.681444 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:45.681395    2577 patch_prober.go:28] interesting pod/e2e-shared-a-w2-62f806-openshift-default-678f9b6b98-7xbhc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused" start-of-body=
Sep 18 22:20:45.681562 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:45.681464    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-62f806-openshift-default-678f9b6b98-7xbhc" podUID="c4215060-d143-4fd8-80f4-10f9cb813087" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused"
Sep 18 22:20:46.489268 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:46.489234    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-aa9dcd-openshift-default-6dcc9d97fb-4z9l2"
Sep 18 22:20:46.494991 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:46.494962    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-aa9dcd-openshift-default-6dcc9d97fb-4z9l2"
Sep 18 22:20:46.644819 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:46.644787    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-aa9dcd-openshift-default-6dcc9d97fb-4z9l2"
Sep 18 22:20:46.645940 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:46.645910    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-aa9dcd-openshift-default-6dcc9d97fb-4z9l2"
Sep 18 22:20:46.685319 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:46.685290    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-62f806-openshift-default-678f9b6b98-7xbhc"
Sep 18 22:20:46.686208 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:46.686190    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-62f806-openshift-default-678f9b6b98-7xbhc"
Sep 18 22:20:47.983065 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:47.983035    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-3d28c1-zngsj"]
Sep 18 22:20:47.988872 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:47.988851    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-3d28c1-zngsj"]
Sep 18 22:20:49.140234 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:49.140203    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2330526f-39dd-421c-b01b-b581d6fe8ad4" path="/var/lib/kubelet/pods/2330526f-39dd-421c-b01b-b581d6fe8ad4/volumes"
Sep 18 22:20:50.705996 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:50.705954    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-59b357/e2e-conflict-b-97f2ccbd-kserve-89788595-67x46" podUID="7833bd48-f435-4f4a-b1df-5e7e3fed4f46" containerName="main" containerID="cri-o://28e7bc9210d8b3e201c344c9e82297835d560af6d143fc64585f1e104b898dc6" gracePeriod=45
Sep 18 22:20:50.963843 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:50.963780    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-59b357/e2e-conflict-b-97f2ccbd-kserve-89788595-67x46"
Sep 18 22:20:51.070617 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:51.070585    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7833bd48-f435-4f4a-b1df-5e7e3fed4f46-tls-certs\") pod \"7833bd48-f435-4f4a-b1df-5e7e3fed4f46\" (UID: \"7833bd48-f435-4f4a-b1df-5e7e3fed4f46\") "
Sep 18 22:20:51.070826 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:51.070637    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7833bd48-f435-4f4a-b1df-5e7e3fed4f46-tmp-dir\") pod \"7833bd48-f435-4f4a-b1df-5e7e3fed4f46\" (UID: \"7833bd48-f435-4f4a-b1df-5e7e3fed4f46\") "
Sep 18 22:20:51.070826 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:51.070712    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7833bd48-f435-4f4a-b1df-5e7e3fed4f46-dshm\") pod \"7833bd48-f435-4f4a-b1df-5e7e3fed4f46\" (UID: \"7833bd48-f435-4f4a-b1df-5e7e3fed4f46\") "
Sep 18 22:20:51.070826 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:51.070756    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7833bd48-f435-4f4a-b1df-5e7e3fed4f46-home\") pod \"7833bd48-f435-4f4a-b1df-5e7e3fed4f46\" (UID: \"7833bd48-f435-4f4a-b1df-5e7e3fed4f46\") "
Sep 18 22:20:51.070826 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:51.070775    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7833bd48-f435-4f4a-b1df-5e7e3fed4f46-model-cache\") pod \"7833bd48-f435-4f4a-b1df-5e7e3fed4f46\" (UID: \"7833bd48-f435-4f4a-b1df-5e7e3fed4f46\") "
Sep 18 22:20:51.070826 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:51.070809    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sllw9\" (UniqueName: \"kubernetes.io/projected/7833bd48-f435-4f4a-b1df-5e7e3fed4f46-kube-api-access-sllw9\") pod \"7833bd48-f435-4f4a-b1df-5e7e3fed4f46\" (UID: \"7833bd48-f435-4f4a-b1df-5e7e3fed4f46\") "
Sep 18 22:20:51.071100 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:51.070955    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7833bd48-f435-4f4a-b1df-5e7e3fed4f46-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7833bd48-f435-4f4a-b1df-5e7e3fed4f46" (UID: "7833bd48-f435-4f4a-b1df-5e7e3fed4f46"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:20:51.071100 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:51.071005    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7833bd48-f435-4f4a-b1df-5e7e3fed4f46-home" (OuterVolumeSpecName: "home") pod "7833bd48-f435-4f4a-b1df-5e7e3fed4f46" (UID: "7833bd48-f435-4f4a-b1df-5e7e3fed4f46"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:20:51.071100 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:51.071034    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7833bd48-f435-4f4a-b1df-5e7e3fed4f46-model-cache" (OuterVolumeSpecName: "model-cache") pod "7833bd48-f435-4f4a-b1df-5e7e3fed4f46" (UID: "7833bd48-f435-4f4a-b1df-5e7e3fed4f46"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:20:51.071235 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:51.071179    2577 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7833bd48-f435-4f4a-b1df-5e7e3fed4f46-tmp-dir\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:20:51.071235 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:51.071192    2577 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7833bd48-f435-4f4a-b1df-5e7e3fed4f46-home\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:20:51.071235 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:51.071200    2577 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7833bd48-f435-4f4a-b1df-5e7e3fed4f46-model-cache\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:20:51.073200 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:51.073176    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7833bd48-f435-4f4a-b1df-5e7e3fed4f46-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7833bd48-f435-4f4a-b1df-5e7e3fed4f46" (UID: "7833bd48-f435-4f4a-b1df-5e7e3fed4f46"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 22:20:51.073606 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:51.073588    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7833bd48-f435-4f4a-b1df-5e7e3fed4f46-kube-api-access-sllw9" (OuterVolumeSpecName: "kube-api-access-sllw9") pod "7833bd48-f435-4f4a-b1df-5e7e3fed4f46" (UID: "7833bd48-f435-4f4a-b1df-5e7e3fed4f46"). InnerVolumeSpecName "kube-api-access-sllw9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:20:51.073606 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:51.073588    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7833bd48-f435-4f4a-b1df-5e7e3fed4f46-dshm" (OuterVolumeSpecName: "dshm") pod "7833bd48-f435-4f4a-b1df-5e7e3fed4f46" (UID: "7833bd48-f435-4f4a-b1df-5e7e3fed4f46"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:20:51.172176 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:51.172145    2577 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7833bd48-f435-4f4a-b1df-5e7e3fed4f46-dshm\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:20:51.172176 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:51.172172    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sllw9\" (UniqueName: \"kubernetes.io/projected/7833bd48-f435-4f4a-b1df-5e7e3fed4f46-kube-api-access-sllw9\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:20:51.172345 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:51.172186    2577 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7833bd48-f435-4f4a-b1df-5e7e3fed4f46-tls-certs\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:20:51.681532 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:51.681500    2577 generic.go:356] "Generic (PLEG): container finished" podID="7833bd48-f435-4f4a-b1df-5e7e3fed4f46" containerID="28e7bc9210d8b3e201c344c9e82297835d560af6d143fc64585f1e104b898dc6" exitCode=0
Sep 18 22:20:51.681727 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:51.681545    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-59b357/e2e-conflict-b-97f2ccbd-kserve-89788595-67x46"
Sep 18 22:20:51.681727 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:51.681582    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-59b357/e2e-conflict-b-97f2ccbd-kserve-89788595-67x46" event={"ID":"7833bd48-f435-4f4a-b1df-5e7e3fed4f46","Type":"ContainerDied","Data":"28e7bc9210d8b3e201c344c9e82297835d560af6d143fc64585f1e104b898dc6"}
Sep 18 22:20:51.681727 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:51.681633    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-59b357/e2e-conflict-b-97f2ccbd-kserve-89788595-67x46" event={"ID":"7833bd48-f435-4f4a-b1df-5e7e3fed4f46","Type":"ContainerDied","Data":"0253e8842a71de2113696ff574c98c4ddc626d4f8fa0ee0b51f236e514811659"}
Sep 18 22:20:51.681727 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:51.681653    2577 scope.go:117] "RemoveContainer" containerID="28e7bc9210d8b3e201c344c9e82297835d560af6d143fc64585f1e104b898dc6"
Sep 18 22:20:51.691177 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:51.691161    2577 scope.go:117] "RemoveContainer" containerID="28e7bc9210d8b3e201c344c9e82297835d560af6d143fc64585f1e104b898dc6"
Sep 18 22:20:51.691476 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:20:51.691453    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"28e7bc9210d8b3e201c344c9e82297835d560af6d143fc64585f1e104b898dc6\": container with ID starting with 28e7bc9210d8b3e201c344c9e82297835d560af6d143fc64585f1e104b898dc6 not found: ID does not exist" containerID="28e7bc9210d8b3e201c344c9e82297835d560af6d143fc64585f1e104b898dc6"
Sep 18 22:20:51.691556 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:51.691482    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28e7bc9210d8b3e201c344c9e82297835d560af6d143fc64585f1e104b898dc6"} err="failed to get container status \"28e7bc9210d8b3e201c344c9e82297835d560af6d143fc64585f1e104b898dc6\": rpc error: code = NotFound desc = could not find container \"28e7bc9210d8b3e201c344c9e82297835d560af6d143fc64585f1e104b898dc6\": container with ID starting with 28e7bc9210d8b3e201c344c9e82297835d560af6d143fc64585f1e104b898dc6 not found: ID does not exist"
Sep 18 22:20:51.710937 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:51.710910    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-59b357/e2e-conflict-b-97f2ccbd-kserve-89788595-67x46"]
Sep 18 22:20:51.715856 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:51.715835    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-59b357/e2e-conflict-b-97f2ccbd-kserve-89788595-67x46"]
Sep 18 22:20:53.141513 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:20:53.141481    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7833bd48-f435-4f4a-b1df-5e7e3fed4f46" path="/var/lib/kubelet/pods/7833bd48-f435-4f4a-b1df-5e7e3fed4f46/volumes"
Sep 18 22:21:00.116257 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:00.116224    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-3d28c1-openshift-default-6745f5d8d8-mdxtn"]
Sep 18 22:21:00.116647 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:00.116463    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-3d28c1-openshift-default-6745f5d8d8-mdxtn" podUID="01bdcd1e-7689-43dc-87e9-b1f98ce153ed" containerName="istio-proxy" containerID="cri-o://c48a80f8ad6e2a20eb23686265742cc1460ba1cc563b1886455fd0fbb96d0ebc" gracePeriod=30
Sep 18 22:21:00.514055 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:00.513978    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ab559b-bsdfx"]
Sep 18 22:21:00.514426 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:00.514398    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7833bd48-f435-4f4a-b1df-5e7e3fed4f46" containerName="main"
Sep 18 22:21:00.514426 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:00.514424    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="7833bd48-f435-4f4a-b1df-5e7e3fed4f46" containerName="main"
Sep 18 22:21:00.514513 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:00.514504    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="7833bd48-f435-4f4a-b1df-5e7e3fed4f46" containerName="main"
Sep 18 22:21:00.518747 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:00.518728    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ab559b-bsdfx"
Sep 18 22:21:00.524162 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:00.524140    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-9g7m4\""
Sep 18 22:21:00.537267 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:00.537245    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ab559b-bsdfx"]
Sep 18 22:21:00.669559 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:00.669526    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/236abffc-ceeb-4e66-9d59-0941863082d0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-ab559b-bsdfx\" (UID: \"236abffc-ceeb-4e66-9d59-0941863082d0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ab559b-bsdfx"
Sep 18 22:21:00.770151 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:00.770069    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/236abffc-ceeb-4e66-9d59-0941863082d0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-ab559b-bsdfx\" (UID: \"236abffc-ceeb-4e66-9d59-0941863082d0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ab559b-bsdfx"
Sep 18 22:21:00.770746 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:00.770727    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/236abffc-ceeb-4e66-9d59-0941863082d0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-ab559b-bsdfx\" (UID: \"236abffc-ceeb-4e66-9d59-0941863082d0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ab559b-bsdfx"
Sep 18 22:21:00.829633 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:00.829605    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ab559b-bsdfx"
Sep 18 22:21:01.143381 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:01.143356    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ab559b-bsdfx"]
Sep 18 22:21:01.144874 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:21:01.144831    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod236abffc_ceeb_4e66_9d59_0941863082d0.slice/crio-237cb81efc0a4ff6f3df47e472aff134de7bc359123dc5b93c5d8a71c282dc13 WatchSource:0}: Error finding container 237cb81efc0a4ff6f3df47e472aff134de7bc359123dc5b93c5d8a71c282dc13: Status 404 returned error can't find the container with id 237cb81efc0a4ff6f3df47e472aff134de7bc359123dc5b93c5d8a71c282dc13
Sep 18 22:21:01.754576 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:01.754534    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ab559b-bsdfx" event={"ID":"236abffc-ceeb-4e66-9d59-0941863082d0","Type":"ContainerStarted","Data":"3bcd8b7df56008dc0fe173032c462a46edb23a641c6eeb1e0ff6e0bc3baab54f"}
Sep 18 22:21:01.754747 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:01.754604    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ab559b-bsdfx" event={"ID":"236abffc-ceeb-4e66-9d59-0941863082d0","Type":"ContainerStarted","Data":"237cb81efc0a4ff6f3df47e472aff134de7bc359123dc5b93c5d8a71c282dc13"}
Sep 18 22:21:01.836987 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:01.836943    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ab559b-bsdfx" podStartSLOduration=1.83692868 podStartE2EDuration="1.83692868s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:21:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:21:01.827094934 +0000 UTC m=+1241.146766999" watchObservedRunningTime="2026-09-18 22:21:01.83692868 +0000 UTC m=+1241.156600734"
Sep 18 22:21:02.763600 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:02.763564    2577 generic.go:356] "Generic (PLEG): container finished" podID="236abffc-ceeb-4e66-9d59-0941863082d0" containerID="3bcd8b7df56008dc0fe173032c462a46edb23a641c6eeb1e0ff6e0bc3baab54f" exitCode=0
Sep 18 22:21:02.764044 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:02.763653    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ab559b-bsdfx" event={"ID":"236abffc-ceeb-4e66-9d59-0941863082d0","Type":"ContainerDied","Data":"3bcd8b7df56008dc0fe173032c462a46edb23a641c6eeb1e0ff6e0bc3baab54f"}
Sep 18 22:21:03.957450 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:03.944804    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ab559b-bsdfx"
Sep 18 22:21:04.103250 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:04.103218    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/236abffc-ceeb-4e66-9d59-0941863082d0-maas-api-service-ca\") pod \"236abffc-ceeb-4e66-9d59-0941863082d0\" (UID: \"236abffc-ceeb-4e66-9d59-0941863082d0\") "
Sep 18 22:21:04.103621 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:04.103596    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/236abffc-ceeb-4e66-9d59-0941863082d0-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "236abffc-ceeb-4e66-9d59-0941863082d0" (UID: "236abffc-ceeb-4e66-9d59-0941863082d0"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:21:04.204099 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:04.204065    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/236abffc-ceeb-4e66-9d59-0941863082d0-maas-api-service-ca\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:21:04.784526 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:04.784493    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ab559b-bsdfx"
Sep 18 22:21:04.784526 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:04.784506    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ab559b-bsdfx" event={"ID":"236abffc-ceeb-4e66-9d59-0941863082d0","Type":"ContainerDied","Data":"237cb81efc0a4ff6f3df47e472aff134de7bc359123dc5b93c5d8a71c282dc13"}
Sep 18 22:21:04.784747 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:04.784565    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="237cb81efc0a4ff6f3df47e472aff134de7bc359123dc5b93c5d8a71c282dc13"
Sep 18 22:21:05.438989 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:05.438957    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-3d28c1-openshift-default-6745f5d8d8-mdxtn"
Sep 18 22:21:05.618403 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:05.618370    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/01bdcd1e-7689-43dc-87e9-b1f98ce153ed-workload-certs\") pod \"01bdcd1e-7689-43dc-87e9-b1f98ce153ed\" (UID: \"01bdcd1e-7689-43dc-87e9-b1f98ce153ed\") "
Sep 18 22:21:05.618639 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:05.618484    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/01bdcd1e-7689-43dc-87e9-b1f98ce153ed-istiod-ca-cert\") pod \"01bdcd1e-7689-43dc-87e9-b1f98ce153ed\" (UID: \"01bdcd1e-7689-43dc-87e9-b1f98ce153ed\") "
Sep 18 22:21:05.618639 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:05.618511    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/01bdcd1e-7689-43dc-87e9-b1f98ce153ed-istio-data\") pod \"01bdcd1e-7689-43dc-87e9-b1f98ce153ed\" (UID: \"01bdcd1e-7689-43dc-87e9-b1f98ce153ed\") "
Sep 18 22:21:05.618639 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:05.618554    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/01bdcd1e-7689-43dc-87e9-b1f98ce153ed-istio-podinfo\") pod \"01bdcd1e-7689-43dc-87e9-b1f98ce153ed\" (UID: \"01bdcd1e-7689-43dc-87e9-b1f98ce153ed\") "
Sep 18 22:21:05.618639 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:05.618579    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/01bdcd1e-7689-43dc-87e9-b1f98ce153ed-istio-envoy\") pod \"01bdcd1e-7689-43dc-87e9-b1f98ce153ed\" (UID: \"01bdcd1e-7689-43dc-87e9-b1f98ce153ed\") "
Sep 18 22:21:05.618639 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:05.618620    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h5lpj\" (UniqueName: \"kubernetes.io/projected/01bdcd1e-7689-43dc-87e9-b1f98ce153ed-kube-api-access-h5lpj\") pod \"01bdcd1e-7689-43dc-87e9-b1f98ce153ed\" (UID: \"01bdcd1e-7689-43dc-87e9-b1f98ce153ed\") "
Sep 18 22:21:05.618892 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:05.618637    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01bdcd1e-7689-43dc-87e9-b1f98ce153ed-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "01bdcd1e-7689-43dc-87e9-b1f98ce153ed" (UID: "01bdcd1e-7689-43dc-87e9-b1f98ce153ed"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:21:05.618892 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:05.618676    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/01bdcd1e-7689-43dc-87e9-b1f98ce153ed-istio-token\") pod \"01bdcd1e-7689-43dc-87e9-b1f98ce153ed\" (UID: \"01bdcd1e-7689-43dc-87e9-b1f98ce153ed\") "
Sep 18 22:21:05.618892 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:05.618718    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/01bdcd1e-7689-43dc-87e9-b1f98ce153ed-workload-socket\") pod \"01bdcd1e-7689-43dc-87e9-b1f98ce153ed\" (UID: \"01bdcd1e-7689-43dc-87e9-b1f98ce153ed\") "
Sep 18 22:21:05.618892 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:05.618745    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01bdcd1e-7689-43dc-87e9-b1f98ce153ed-istio-data" (OuterVolumeSpecName: "istio-data") pod "01bdcd1e-7689-43dc-87e9-b1f98ce153ed" (UID: "01bdcd1e-7689-43dc-87e9-b1f98ce153ed"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:21:05.618892 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:05.618853    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/01bdcd1e-7689-43dc-87e9-b1f98ce153ed-credential-socket\") pod \"01bdcd1e-7689-43dc-87e9-b1f98ce153ed\" (UID: \"01bdcd1e-7689-43dc-87e9-b1f98ce153ed\") "
Sep 18 22:21:05.618892 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:05.618875    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/01bdcd1e-7689-43dc-87e9-b1f98ce153ed-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "01bdcd1e-7689-43dc-87e9-b1f98ce153ed" (UID: "01bdcd1e-7689-43dc-87e9-b1f98ce153ed"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:21:05.619189 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:05.618898    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01bdcd1e-7689-43dc-87e9-b1f98ce153ed-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "01bdcd1e-7689-43dc-87e9-b1f98ce153ed" (UID: "01bdcd1e-7689-43dc-87e9-b1f98ce153ed"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:21:05.619189 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:05.619088    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01bdcd1e-7689-43dc-87e9-b1f98ce153ed-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "01bdcd1e-7689-43dc-87e9-b1f98ce153ed" (UID: "01bdcd1e-7689-43dc-87e9-b1f98ce153ed"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:21:05.619255 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:05.619243    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/01bdcd1e-7689-43dc-87e9-b1f98ce153ed-istiod-ca-cert\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:21:05.619289 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:05.619257    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/01bdcd1e-7689-43dc-87e9-b1f98ce153ed-istio-data\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:21:05.619289 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:05.619266    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/01bdcd1e-7689-43dc-87e9-b1f98ce153ed-workload-socket\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:21:05.619289 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:05.619280    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/01bdcd1e-7689-43dc-87e9-b1f98ce153ed-credential-socket\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:21:05.619378 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:05.619291    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/01bdcd1e-7689-43dc-87e9-b1f98ce153ed-workload-certs\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:21:05.620914 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:05.620889    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01bdcd1e-7689-43dc-87e9-b1f98ce153ed-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "01bdcd1e-7689-43dc-87e9-b1f98ce153ed" (UID: "01bdcd1e-7689-43dc-87e9-b1f98ce153ed"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:21:05.621081 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:05.621064    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01bdcd1e-7689-43dc-87e9-b1f98ce153ed-istio-token" (OuterVolumeSpecName: "istio-token") pod "01bdcd1e-7689-43dc-87e9-b1f98ce153ed" (UID: "01bdcd1e-7689-43dc-87e9-b1f98ce153ed"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:21:05.621262 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:05.621248    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/01bdcd1e-7689-43dc-87e9-b1f98ce153ed-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "01bdcd1e-7689-43dc-87e9-b1f98ce153ed" (UID: "01bdcd1e-7689-43dc-87e9-b1f98ce153ed"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 18 22:21:05.621348 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:05.621327    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01bdcd1e-7689-43dc-87e9-b1f98ce153ed-kube-api-access-h5lpj" (OuterVolumeSpecName: "kube-api-access-h5lpj") pod "01bdcd1e-7689-43dc-87e9-b1f98ce153ed" (UID: "01bdcd1e-7689-43dc-87e9-b1f98ce153ed"). InnerVolumeSpecName "kube-api-access-h5lpj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:21:05.720599 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:05.720519    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/01bdcd1e-7689-43dc-87e9-b1f98ce153ed-istio-token\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:21:05.720599 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:05.720541    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/01bdcd1e-7689-43dc-87e9-b1f98ce153ed-istio-podinfo\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:21:05.720599 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:05.720549    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/01bdcd1e-7689-43dc-87e9-b1f98ce153ed-istio-envoy\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:21:05.720599 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:05.720557    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h5lpj\" (UniqueName: \"kubernetes.io/projected/01bdcd1e-7689-43dc-87e9-b1f98ce153ed-kube-api-access-h5lpj\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:21:05.792871 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:05.792841    2577 generic.go:356] "Generic (PLEG): container finished" podID="01bdcd1e-7689-43dc-87e9-b1f98ce153ed" containerID="c48a80f8ad6e2a20eb23686265742cc1460ba1cc563b1886455fd0fbb96d0ebc" exitCode=0
Sep 18 22:21:05.793029 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:05.792888    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-3d28c1-openshift-default-6745f5d8d8-mdxtn"
Sep 18 22:21:05.793029 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:05.792922    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-3d28c1-openshift-default-6745f5d8d8-mdxtn" event={"ID":"01bdcd1e-7689-43dc-87e9-b1f98ce153ed","Type":"ContainerDied","Data":"c48a80f8ad6e2a20eb23686265742cc1460ba1cc563b1886455fd0fbb96d0ebc"}
Sep 18 22:21:05.793029 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:05.792978    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-3d28c1-openshift-default-6745f5d8d8-mdxtn" event={"ID":"01bdcd1e-7689-43dc-87e9-b1f98ce153ed","Type":"ContainerDied","Data":"b7c822d006b36a068c2e9307508664c2cc2f20b610ffd7c3da4b9fa0abe9a192"}
Sep 18 22:21:05.793029 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:05.793001    2577 scope.go:117] "RemoveContainer" containerID="c48a80f8ad6e2a20eb23686265742cc1460ba1cc563b1886455fd0fbb96d0ebc"
Sep 18 22:21:05.803368 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:05.803357    2577 scope.go:117] "RemoveContainer" containerID="4a877e70e9e928b025ae81356b464803ec50f4279153bebd89e884f5ba160ea7"
Sep 18 22:21:05.812805 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:05.812787    2577 scope.go:117] "RemoveContainer" containerID="c48a80f8ad6e2a20eb23686265742cc1460ba1cc563b1886455fd0fbb96d0ebc"
Sep 18 22:21:05.813113 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:21:05.813078    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c48a80f8ad6e2a20eb23686265742cc1460ba1cc563b1886455fd0fbb96d0ebc\": container with ID starting with c48a80f8ad6e2a20eb23686265742cc1460ba1cc563b1886455fd0fbb96d0ebc not found: ID does not exist" containerID="c48a80f8ad6e2a20eb23686265742cc1460ba1cc563b1886455fd0fbb96d0ebc"
Sep 18 22:21:05.813176 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:05.813124    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c48a80f8ad6e2a20eb23686265742cc1460ba1cc563b1886455fd0fbb96d0ebc"} err="failed to get container status \"c48a80f8ad6e2a20eb23686265742cc1460ba1cc563b1886455fd0fbb96d0ebc\": rpc error: code = NotFound desc = could not find container \"c48a80f8ad6e2a20eb23686265742cc1460ba1cc563b1886455fd0fbb96d0ebc\": container with ID starting with c48a80f8ad6e2a20eb23686265742cc1460ba1cc563b1886455fd0fbb96d0ebc not found: ID does not exist"
Sep 18 22:21:05.813176 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:05.813147    2577 scope.go:117] "RemoveContainer" containerID="4a877e70e9e928b025ae81356b464803ec50f4279153bebd89e884f5ba160ea7"
Sep 18 22:21:05.813438 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:21:05.813402    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a877e70e9e928b025ae81356b464803ec50f4279153bebd89e884f5ba160ea7\": container with ID starting with 4a877e70e9e928b025ae81356b464803ec50f4279153bebd89e884f5ba160ea7 not found: ID does not exist" containerID="4a877e70e9e928b025ae81356b464803ec50f4279153bebd89e884f5ba160ea7"
Sep 18 22:21:05.813511 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:05.813448    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a877e70e9e928b025ae81356b464803ec50f4279153bebd89e884f5ba160ea7"} err="failed to get container status \"4a877e70e9e928b025ae81356b464803ec50f4279153bebd89e884f5ba160ea7\": rpc error: code = NotFound desc = could not find container \"4a877e70e9e928b025ae81356b464803ec50f4279153bebd89e884f5ba160ea7\": container with ID starting with 4a877e70e9e928b025ae81356b464803ec50f4279153bebd89e884f5ba160ea7 not found: ID does not exist"
Sep 18 22:21:05.831762 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:05.831731    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-3d28c1-openshift-default-6745f5d8d8-mdxtn"]
Sep 18 22:21:05.875531 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:05.875492    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-3d28c1-openshift-default-6745f5d8d8-mdxtn"]
Sep 18 22:21:07.140158 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:07.140123    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01bdcd1e-7689-43dc-87e9-b1f98ce153ed" path="/var/lib/kubelet/pods/01bdcd1e-7689-43dc-87e9-b1f98ce153ed/volumes"
Sep 18 22:21:11.497131 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:11.497103    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7639-d409c6"]
Sep 18 22:21:11.497552 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:11.497538    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="236abffc-ceeb-4e66-9d59-0941863082d0" containerName="revoke-keys"
Sep 18 22:21:11.497552 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:11.497554    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="236abffc-ceeb-4e66-9d59-0941863082d0" containerName="revoke-keys"
Sep 18 22:21:11.497638 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:11.497573    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01bdcd1e-7689-43dc-87e9-b1f98ce153ed" containerName="istio-proxy"
Sep 18 22:21:11.497638 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:11.497578    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="01bdcd1e-7689-43dc-87e9-b1f98ce153ed" containerName="istio-proxy"
Sep 18 22:21:11.497699 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:11.497644    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="01bdcd1e-7689-43dc-87e9-b1f98ce153ed" containerName="istio-proxy"
Sep 18 22:21:11.497699 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:11.497654    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="01bdcd1e-7689-43dc-87e9-b1f98ce153ed" containerName="istio-proxy"
Sep 18 22:21:11.497699 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:11.497660    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="236abffc-ceeb-4e66-9d59-0941863082d0" containerName="revoke-keys"
Sep 18 22:21:11.504407 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:11.504388    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7639-d409c6"
Sep 18 22:21:11.509305 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:11.509290    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-t97qt\""
Sep 18 22:21:11.531659 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:11.531638    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7639-d409c6"]
Sep 18 22:21:11.587582 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:11.587555    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pfff\" (UniqueName: \"kubernetes.io/projected/1c962b3c-fb32-4524-89ac-f0e11896afe9-kube-api-access-2pfff\") pod \"test-curl-7639-d409c6\" (UID: \"1c962b3c-fb32-4524-89ac-f0e11896afe9\") " pod="opendatahub/test-curl-7639-d409c6"
Sep 18 22:21:11.688954 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:11.688926    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pfff\" (UniqueName: \"kubernetes.io/projected/1c962b3c-fb32-4524-89ac-f0e11896afe9-kube-api-access-2pfff\") pod \"test-curl-7639-d409c6\" (UID: \"1c962b3c-fb32-4524-89ac-f0e11896afe9\") " pod="opendatahub/test-curl-7639-d409c6"
Sep 18 22:21:11.703789 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:11.703764    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pfff\" (UniqueName: \"kubernetes.io/projected/1c962b3c-fb32-4524-89ac-f0e11896afe9-kube-api-access-2pfff\") pod \"test-curl-7639-d409c6\" (UID: \"1c962b3c-fb32-4524-89ac-f0e11896afe9\") " pod="opendatahub/test-curl-7639-d409c6"
Sep 18 22:21:11.813846 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:11.813822    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7639-d409c6"
Sep 18 22:21:11.836243 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:11.836213    2577 generic.go:356] "Generic (PLEG): container finished" podID="0ca4a048-4332-4aa2-867a-7b7fc269ee04" containerID="2fe3212e8fb873017c765170b035ac76490400412aa8fa02833dde2481541273" exitCode=0
Sep 18 22:21:11.836354 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:11.836284    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-aa9dcd-openshift-default-6dcc9d97fb-4z9l2" event={"ID":"0ca4a048-4332-4aa2-867a-7b7fc269ee04","Type":"ContainerDied","Data":"2fe3212e8fb873017c765170b035ac76490400412aa8fa02833dde2481541273"}
Sep 18 22:21:11.836684 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:11.836671    2577 scope.go:117] "RemoveContainer" containerID="2fe3212e8fb873017c765170b035ac76490400412aa8fa02833dde2481541273"
Sep 18 22:21:11.837833 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:11.837805    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:21:11.837910 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:11.837878    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:21:11.837948 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:11.837911    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:21:12.108767 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:12.108741    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7639-d409c6"]
Sep 18 22:21:12.111312 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:21:12.111287    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1c962b3c_fb32_4524_89ac_f0e11896afe9.slice/crio-f2ba8877249d2cb0d5c91ac1824a5a02c8d879a4f7dc987d07ed2cb481f8261e WatchSource:0}: Error finding container f2ba8877249d2cb0d5c91ac1824a5a02c8d879a4f7dc987d07ed2cb481f8261e: Status 404 returned error can't find the container with id f2ba8877249d2cb0d5c91ac1824a5a02c8d879a4f7dc987d07ed2cb481f8261e
Sep 18 22:21:12.844197 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:12.844153    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7639-d409c6" event={"ID":"1c962b3c-fb32-4524-89ac-f0e11896afe9","Type":"ContainerStarted","Data":"4b2633bb9edfc23fc293c0f4253753dbee75e9a61cee9654957ba4a17f3dcbfc"}
Sep 18 22:21:12.844737 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:12.844214    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7639-d409c6" event={"ID":"1c962b3c-fb32-4524-89ac-f0e11896afe9","Type":"ContainerStarted","Data":"f2ba8877249d2cb0d5c91ac1824a5a02c8d879a4f7dc987d07ed2cb481f8261e"}
Sep 18 22:21:12.847867 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:12.847086    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-aa9dcd-openshift-default-6dcc9d97fb-4z9l2" event={"ID":"0ca4a048-4332-4aa2-867a-7b7fc269ee04","Type":"ContainerStarted","Data":"02f705ba02ee32346d473609881ec9ad6565057e6a8c3fa346d1175da4b3315e"}
Sep 18 22:21:12.922570 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:12.922519    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7639-d409c6" podStartSLOduration=1.9225031590000001 podStartE2EDuration="1.922503159s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:21:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:21:12.88519957 +0000 UTC m=+1252.204871625" watchObservedRunningTime="2026-09-18 22:21:12.922503159 +0000 UTC m=+1252.242175212"
Sep 18 22:21:13.489299 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:13.489264    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-aa9dcd-openshift-default-6dcc9d97fb-4z9l2"
Sep 18 22:21:13.490287 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:13.490260    2577 patch_prober.go:28] interesting pod/e2e-shared-b-w2-aa9dcd-openshift-default-6dcc9d97fb-4z9l2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused" start-of-body=
Sep 18 22:21:13.490437 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:13.490308    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-aa9dcd-openshift-default-6dcc9d97fb-4z9l2" podUID="0ca4a048-4332-4aa2-867a-7b7fc269ee04" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused"
Sep 18 22:21:13.642838 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:13.642750    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7639-d409c6"]
Sep 18 22:21:13.649714 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:13.649673    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7639-d409c6"]
Sep 18 22:21:13.871437 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:21:13.870741    2577 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7639-d409c6" container="test-curl-7639-d409c6"
Sep 18 22:21:14.488915 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:14.488881    2577 patch_prober.go:28] interesting pod/e2e-shared-b-w2-aa9dcd-openshift-default-6dcc9d97fb-4z9l2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused" start-of-body=
Sep 18 22:21:14.489111 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:14.488939    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-aa9dcd-openshift-default-6dcc9d97fb-4z9l2" podUID="0ca4a048-4332-4aa2-867a-7b7fc269ee04" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused"
Sep 18 22:21:14.879262 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:14.879225    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7639-d409c6" podUID="1c962b3c-fb32-4524-89ac-f0e11896afe9" containerName="test-curl-7639-d409c6" containerID="cri-o://4b2633bb9edfc23fc293c0f4253753dbee75e9a61cee9654957ba4a17f3dcbfc" gracePeriod=2
Sep 18 22:21:14.882988 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:21:14.882955    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7639-d409c6\" is forbidden: User \"system:node:ip-10-0-141-99.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-141-99.ec2.internal' and this object" podUID="1c962b3c-fb32-4524-89ac-f0e11896afe9" pod="opendatahub/test-curl-7639-d409c6"
Sep 18 22:21:15.275993 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:15.275846    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-ab559b-29829495-42rhv"]
Sep 18 22:21:15.278326 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:15.278295    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-ab559b-29829495-42rhv"]
Sep 18 22:21:15.329602 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:15.329572    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-ab559b-69c6fb8479-4m56j"]
Sep 18 22:21:15.329892 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:15.329830    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-ab559b-69c6fb8479-4m56j" podUID="fcd7c065-e05c-4c76-88de-5706c9bd45ec" containerName="payload-processing" containerID="cri-o://22b06674abafe18f47c06f3bf2674bc389e4076a75787bcec900472d15543270" gracePeriod=30
Sep 18 22:21:15.339943 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:15.339913    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-ab559b-79b445f574-f5dhw"]
Sep 18 22:21:15.340101 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:15.340083    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ab559b-79b445f574-f5dhw" podUID="ca6dbb78-23e8-45e9-b524-e66713ec8514" containerName="payload-pre-processing" containerID="cri-o://f48ee18fd2bd56124989350d1ab8ae6b8146b7541a9c7cbcfc17392391c5fcc5" gracePeriod=30
Sep 18 22:21:15.373086 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:21:15.367956    2577 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcd7c065_e05c_4c76_88de_5706c9bd45ec.slice/crio-22b06674abafe18f47c06f3bf2674bc389e4076a75787bcec900472d15543270.scope\": RecentStats: unable to find data in memory cache]"
Sep 18 22:21:15.490078 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:15.489914    2577 patch_prober.go:28] interesting pod/e2e-shared-b-w2-aa9dcd-openshift-default-6dcc9d97fb-4z9l2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused" start-of-body=
Sep 18 22:21:15.490078 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:15.489985    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-aa9dcd-openshift-default-6dcc9d97fb-4z9l2" podUID="0ca4a048-4332-4aa2-867a-7b7fc269ee04" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused"
Sep 18 22:21:15.638310 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:15.638256    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ab559b-bsdfx"]
Sep 18 22:21:15.643893 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:15.643641    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ab559b-bsdfx"]
Sep 18 22:21:15.715739 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:15.715614    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ab559b-79b445f574-f5dhw"
Sep 18 22:21:15.718681 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:15.718620    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-ab559b-69c6fb8479-4m56j"
Sep 18 22:21:15.831682 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:15.831648    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ca6dbb78-23e8-45e9-b524-e66713ec8514-plugins-config-volume\") pod \"ca6dbb78-23e8-45e9-b524-e66713ec8514\" (UID: \"ca6dbb78-23e8-45e9-b524-e66713ec8514\") "
Sep 18 22:21:15.831839 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:15.831700    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fcd7c065-e05c-4c76-88de-5706c9bd45ec-plugins-config-volume\") pod \"fcd7c065-e05c-4c76-88de-5706c9bd45ec\" (UID: \"fcd7c065-e05c-4c76-88de-5706c9bd45ec\") "
Sep 18 22:21:15.831839 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:15.831833    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6wll9\" (UniqueName: \"kubernetes.io/projected/ca6dbb78-23e8-45e9-b524-e66713ec8514-kube-api-access-6wll9\") pod \"ca6dbb78-23e8-45e9-b524-e66713ec8514\" (UID: \"ca6dbb78-23e8-45e9-b524-e66713ec8514\") "
Sep 18 22:21:15.831904 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:15.831857    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bqgbq\" (UniqueName: \"kubernetes.io/projected/fcd7c065-e05c-4c76-88de-5706c9bd45ec-kube-api-access-bqgbq\") pod \"fcd7c065-e05c-4c76-88de-5706c9bd45ec\" (UID: \"fcd7c065-e05c-4c76-88de-5706c9bd45ec\") "
Sep 18 22:21:15.832152 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:15.832117    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fcd7c065-e05c-4c76-88de-5706c9bd45ec-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "fcd7c065-e05c-4c76-88de-5706c9bd45ec" (UID: "fcd7c065-e05c-4c76-88de-5706c9bd45ec"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:21:15.832152 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:15.832116    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca6dbb78-23e8-45e9-b524-e66713ec8514-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ca6dbb78-23e8-45e9-b524-e66713ec8514" (UID: "ca6dbb78-23e8-45e9-b524-e66713ec8514"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:21:15.832259 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:15.832211    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ca6dbb78-23e8-45e9-b524-e66713ec8514-plugins-config-volume\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:21:15.832259 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:15.832232    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fcd7c065-e05c-4c76-88de-5706c9bd45ec-plugins-config-volume\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:21:15.834206 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:15.834171    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fcd7c065-e05c-4c76-88de-5706c9bd45ec-kube-api-access-bqgbq" (OuterVolumeSpecName: "kube-api-access-bqgbq") pod "fcd7c065-e05c-4c76-88de-5706c9bd45ec" (UID: "fcd7c065-e05c-4c76-88de-5706c9bd45ec"). InnerVolumeSpecName "kube-api-access-bqgbq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:21:15.834294 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:15.834230    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca6dbb78-23e8-45e9-b524-e66713ec8514-kube-api-access-6wll9" (OuterVolumeSpecName: "kube-api-access-6wll9") pod "ca6dbb78-23e8-45e9-b524-e66713ec8514" (UID: "ca6dbb78-23e8-45e9-b524-e66713ec8514"). InnerVolumeSpecName "kube-api-access-6wll9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:21:15.886947 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:15.886911    2577 generic.go:356] "Generic (PLEG): container finished" podID="fcd7c065-e05c-4c76-88de-5706c9bd45ec" containerID="22b06674abafe18f47c06f3bf2674bc389e4076a75787bcec900472d15543270" exitCode=0
Sep 18 22:21:15.887364 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:15.886975    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-ab559b-69c6fb8479-4m56j"
Sep 18 22:21:15.887364 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:15.887006    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-ab559b-69c6fb8479-4m56j" event={"ID":"fcd7c065-e05c-4c76-88de-5706c9bd45ec","Type":"ContainerDied","Data":"22b06674abafe18f47c06f3bf2674bc389e4076a75787bcec900472d15543270"}
Sep 18 22:21:15.887364 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:15.887087    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-ab559b-69c6fb8479-4m56j" event={"ID":"fcd7c065-e05c-4c76-88de-5706c9bd45ec","Type":"ContainerDied","Data":"69548fd6f053f846b407b887bd580aca55bb229f945e6bb5c26441bdd7b72c9b"}
Sep 18 22:21:15.887364 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:15.887110    2577 scope.go:117] "RemoveContainer" containerID="22b06674abafe18f47c06f3bf2674bc389e4076a75787bcec900472d15543270"
Sep 18 22:21:15.888517 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:15.888496    2577 generic.go:356] "Generic (PLEG): container finished" podID="ca6dbb78-23e8-45e9-b524-e66713ec8514" containerID="f48ee18fd2bd56124989350d1ab8ae6b8146b7541a9c7cbcfc17392391c5fcc5" exitCode=0
Sep 18 22:21:15.888618 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:15.888563    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ab559b-79b445f574-f5dhw"
Sep 18 22:21:15.888618 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:15.888589    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ab559b-79b445f574-f5dhw" event={"ID":"ca6dbb78-23e8-45e9-b524-e66713ec8514","Type":"ContainerDied","Data":"f48ee18fd2bd56124989350d1ab8ae6b8146b7541a9c7cbcfc17392391c5fcc5"}
Sep 18 22:21:15.888725 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:15.888636    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ab559b-79b445f574-f5dhw" event={"ID":"ca6dbb78-23e8-45e9-b524-e66713ec8514","Type":"ContainerDied","Data":"16cba5b9b55d9b6479867186394071be52d03373863ae7d26267e8550acc860d"}
Sep 18 22:21:15.899307 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:15.899292    2577 scope.go:117] "RemoveContainer" containerID="22b06674abafe18f47c06f3bf2674bc389e4076a75787bcec900472d15543270"
Sep 18 22:21:15.899701 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:21:15.899678    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22b06674abafe18f47c06f3bf2674bc389e4076a75787bcec900472d15543270\": container with ID starting with 22b06674abafe18f47c06f3bf2674bc389e4076a75787bcec900472d15543270 not found: ID does not exist" containerID="22b06674abafe18f47c06f3bf2674bc389e4076a75787bcec900472d15543270"
Sep 18 22:21:15.899796 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:15.899708    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22b06674abafe18f47c06f3bf2674bc389e4076a75787bcec900472d15543270"} err="failed to get container status \"22b06674abafe18f47c06f3bf2674bc389e4076a75787bcec900472d15543270\": rpc error: code = NotFound desc = could not find container \"22b06674abafe18f47c06f3bf2674bc389e4076a75787bcec900472d15543270\": container with ID starting with 22b06674abafe18f47c06f3bf2674bc389e4076a75787bcec900472d15543270 not found: ID does not exist"
Sep 18 22:21:15.899796 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:15.899762    2577 scope.go:117] "RemoveContainer" containerID="f48ee18fd2bd56124989350d1ab8ae6b8146b7541a9c7cbcfc17392391c5fcc5"
Sep 18 22:21:15.908590 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:15.908571    2577 scope.go:117] "RemoveContainer" containerID="f48ee18fd2bd56124989350d1ab8ae6b8146b7541a9c7cbcfc17392391c5fcc5"
Sep 18 22:21:15.908846 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:21:15.908824    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f48ee18fd2bd56124989350d1ab8ae6b8146b7541a9c7cbcfc17392391c5fcc5\": container with ID starting with f48ee18fd2bd56124989350d1ab8ae6b8146b7541a9c7cbcfc17392391c5fcc5 not found: ID does not exist" containerID="f48ee18fd2bd56124989350d1ab8ae6b8146b7541a9c7cbcfc17392391c5fcc5"
Sep 18 22:21:15.908921 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:15.908849    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f48ee18fd2bd56124989350d1ab8ae6b8146b7541a9c7cbcfc17392391c5fcc5"} err="failed to get container status \"f48ee18fd2bd56124989350d1ab8ae6b8146b7541a9c7cbcfc17392391c5fcc5\": rpc error: code = NotFound desc = could not find container \"f48ee18fd2bd56124989350d1ab8ae6b8146b7541a9c7cbcfc17392391c5fcc5\": container with ID starting with f48ee18fd2bd56124989350d1ab8ae6b8146b7541a9c7cbcfc17392391c5fcc5 not found: ID does not exist"
Sep 18 22:21:15.922325 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:15.922292    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-ab559b-79b445f574-f5dhw"]
Sep 18 22:21:15.932868 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:15.932845    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-ab559b-79b445f574-f5dhw"]
Sep 18 22:21:15.933270 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:15.933253    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6wll9\" (UniqueName: \"kubernetes.io/projected/ca6dbb78-23e8-45e9-b524-e66713ec8514-kube-api-access-6wll9\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:21:15.933323 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:15.933273    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bqgbq\" (UniqueName: \"kubernetes.io/projected/fcd7c065-e05c-4c76-88de-5706c9bd45ec-kube-api-access-bqgbq\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:21:15.973907 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:15.973864    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-ab559b-69c6fb8479-4m56j"]
Sep 18 22:21:15.974091 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:15.973925    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-ab559b-69c6fb8479-4m56j"]
Sep 18 22:21:16.488936 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:16.488909    2577 patch_prober.go:28] interesting pod/e2e-shared-b-w2-aa9dcd-openshift-default-6dcc9d97fb-4z9l2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused" start-of-body=
Sep 18 22:21:16.489120 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:16.488961    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-aa9dcd-openshift-default-6dcc9d97fb-4z9l2" podUID="0ca4a048-4332-4aa2-867a-7b7fc269ee04" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused"
Sep 18 22:21:16.645363 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:16.645254    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-aa9dcd-openshift-default-6dcc9d97fb-4z9l2"
Sep 18 22:21:17.115617 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:17.115595    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7639-d409c6"
Sep 18 22:21:17.140265 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:17.140239    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="236abffc-ceeb-4e66-9d59-0941863082d0" path="/var/lib/kubelet/pods/236abffc-ceeb-4e66-9d59-0941863082d0/volumes"
Sep 18 22:21:17.140555 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:17.140542    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f9cb321-ccf0-4cb8-b3d7-c8ea27f032df" path="/var/lib/kubelet/pods/5f9cb321-ccf0-4cb8-b3d7-c8ea27f032df/volumes"
Sep 18 22:21:17.140834 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:17.140823    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca6dbb78-23e8-45e9-b524-e66713ec8514" path="/var/lib/kubelet/pods/ca6dbb78-23e8-45e9-b524-e66713ec8514/volumes"
Sep 18 22:21:17.141149 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:17.141137    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fcd7c065-e05c-4c76-88de-5706c9bd45ec" path="/var/lib/kubelet/pods/fcd7c065-e05c-4c76-88de-5706c9bd45ec/volumes"
Sep 18 22:21:17.245340 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:17.245256    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2pfff\" (UniqueName: \"kubernetes.io/projected/1c962b3c-fb32-4524-89ac-f0e11896afe9-kube-api-access-2pfff\") pod \"1c962b3c-fb32-4524-89ac-f0e11896afe9\" (UID: \"1c962b3c-fb32-4524-89ac-f0e11896afe9\") "
Sep 18 22:21:17.248739 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:17.248705    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c962b3c-fb32-4524-89ac-f0e11896afe9-kube-api-access-2pfff" (OuterVolumeSpecName: "kube-api-access-2pfff") pod "1c962b3c-fb32-4524-89ac-f0e11896afe9" (UID: "1c962b3c-fb32-4524-89ac-f0e11896afe9"). InnerVolumeSpecName "kube-api-access-2pfff". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:21:17.347087 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:17.347046    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2pfff\" (UniqueName: \"kubernetes.io/projected/1c962b3c-fb32-4524-89ac-f0e11896afe9-kube-api-access-2pfff\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:21:17.489164 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:17.489125    2577 patch_prober.go:28] interesting pod/e2e-shared-b-w2-aa9dcd-openshift-default-6dcc9d97fb-4z9l2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused" start-of-body=
Sep 18 22:21:17.489380 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:17.489179    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-aa9dcd-openshift-default-6dcc9d97fb-4z9l2" podUID="0ca4a048-4332-4aa2-867a-7b7fc269ee04" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused"
Sep 18 22:21:17.905082 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:17.905044    2577 generic.go:356] "Generic (PLEG): container finished" podID="1c962b3c-fb32-4524-89ac-f0e11896afe9" containerID="4b2633bb9edfc23fc293c0f4253753dbee75e9a61cee9654957ba4a17f3dcbfc" exitCode=137
Sep 18 22:21:17.905270 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:17.905091    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7639-d409c6"
Sep 18 22:21:17.905270 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:17.905124    2577 scope.go:117] "RemoveContainer" containerID="4b2633bb9edfc23fc293c0f4253753dbee75e9a61cee9654957ba4a17f3dcbfc"
Sep 18 22:21:17.914935 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:17.914917    2577 scope.go:117] "RemoveContainer" containerID="4b2633bb9edfc23fc293c0f4253753dbee75e9a61cee9654957ba4a17f3dcbfc"
Sep 18 22:21:17.915231 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:21:17.915214    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b2633bb9edfc23fc293c0f4253753dbee75e9a61cee9654957ba4a17f3dcbfc\": container with ID starting with 4b2633bb9edfc23fc293c0f4253753dbee75e9a61cee9654957ba4a17f3dcbfc not found: ID does not exist" containerID="4b2633bb9edfc23fc293c0f4253753dbee75e9a61cee9654957ba4a17f3dcbfc"
Sep 18 22:21:17.915278 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:17.915240    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b2633bb9edfc23fc293c0f4253753dbee75e9a61cee9654957ba4a17f3dcbfc"} err="failed to get container status \"4b2633bb9edfc23fc293c0f4253753dbee75e9a61cee9654957ba4a17f3dcbfc\": rpc error: code = NotFound desc = could not find container \"4b2633bb9edfc23fc293c0f4253753dbee75e9a61cee9654957ba4a17f3dcbfc\": container with ID starting with 4b2633bb9edfc23fc293c0f4253753dbee75e9a61cee9654957ba4a17f3dcbfc not found: ID does not exist"
Sep 18 22:21:18.492739 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:18.492709    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-aa9dcd-openshift-default-6dcc9d97fb-4z9l2"
Sep 18 22:21:18.493889 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:18.493867    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-aa9dcd-openshift-default-6dcc9d97fb-4z9l2"
Sep 18 22:21:19.093879 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:19.093833    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-027c8100-openshift-default-85cdb9b7cb-fl25x"]
Sep 18 22:21:19.094300 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:19.094286    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca6dbb78-23e8-45e9-b524-e66713ec8514" containerName="payload-pre-processing"
Sep 18 22:21:19.094343 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:19.094303    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca6dbb78-23e8-45e9-b524-e66713ec8514" containerName="payload-pre-processing"
Sep 18 22:21:19.094343 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:19.094321    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01bdcd1e-7689-43dc-87e9-b1f98ce153ed" containerName="istio-proxy"
Sep 18 22:21:19.094343 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:19.094327    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="01bdcd1e-7689-43dc-87e9-b1f98ce153ed" containerName="istio-proxy"
Sep 18 22:21:19.094464 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:19.094345    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fcd7c065-e05c-4c76-88de-5706c9bd45ec" containerName="payload-processing"
Sep 18 22:21:19.094464 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:19.094355    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="fcd7c065-e05c-4c76-88de-5706c9bd45ec" containerName="payload-processing"
Sep 18 22:21:19.094464 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:19.094363    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c962b3c-fb32-4524-89ac-f0e11896afe9" containerName="test-curl-7639-d409c6"
Sep 18 22:21:19.094464 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:19.094369    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c962b3c-fb32-4524-89ac-f0e11896afe9" containerName="test-curl-7639-d409c6"
Sep 18 22:21:19.094464 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:19.094453    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="fcd7c065-e05c-4c76-88de-5706c9bd45ec" containerName="payload-processing"
Sep 18 22:21:19.094464 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:19.094460    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c962b3c-fb32-4524-89ac-f0e11896afe9" containerName="test-curl-7639-d409c6"
Sep 18 22:21:19.094636 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:19.094467    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca6dbb78-23e8-45e9-b524-e66713ec8514" containerName="payload-pre-processing"
Sep 18 22:21:19.097629 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:19.097609    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-027c8100-openshift-default-85cdb9b7cb-fl25x"
Sep 18 22:21:19.100784 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:19.100767    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-027c8100-openshift-default-dockercfg-zh5td\""
Sep 18 22:21:19.128689 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:19.128664    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-027c8100-openshift-default-85cdb9b7cb-fl25x"]
Sep 18 22:21:19.141493 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:19.141467    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c962b3c-fb32-4524-89ac-f0e11896afe9" path="/var/lib/kubelet/pods/1c962b3c-fb32-4524-89ac-f0e11896afe9/volumes"
Sep 18 22:21:19.168100 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:19.168058    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fd344548-dc1f-4a5a-9813-a05fee6ade30-istio-envoy\") pod \"e2e-mt-027c8100-openshift-default-85cdb9b7cb-fl25x\" (UID: \"fd344548-dc1f-4a5a-9813-a05fee6ade30\") " pod="openshift-ingress/e2e-mt-027c8100-openshift-default-85cdb9b7cb-fl25x"
Sep 18 22:21:19.168327 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:19.168310    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd344548-dc1f-4a5a-9813-a05fee6ade30-workload-certs\") pod \"e2e-mt-027c8100-openshift-default-85cdb9b7cb-fl25x\" (UID: \"fd344548-dc1f-4a5a-9813-a05fee6ade30\") " pod="openshift-ingress/e2e-mt-027c8100-openshift-default-85cdb9b7cb-fl25x"
Sep 18 22:21:19.168476 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:19.168460    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd344548-dc1f-4a5a-9813-a05fee6ade30-credential-socket\") pod \"e2e-mt-027c8100-openshift-default-85cdb9b7cb-fl25x\" (UID: \"fd344548-dc1f-4a5a-9813-a05fee6ade30\") " pod="openshift-ingress/e2e-mt-027c8100-openshift-default-85cdb9b7cb-fl25x"
Sep 18 22:21:19.168610 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:19.168597    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fd344548-dc1f-4a5a-9813-a05fee6ade30-istio-podinfo\") pod \"e2e-mt-027c8100-openshift-default-85cdb9b7cb-fl25x\" (UID: \"fd344548-dc1f-4a5a-9813-a05fee6ade30\") " pod="openshift-ingress/e2e-mt-027c8100-openshift-default-85cdb9b7cb-fl25x"
Sep 18 22:21:19.168719 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:19.168704    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9cdbw\" (UniqueName: \"kubernetes.io/projected/fd344548-dc1f-4a5a-9813-a05fee6ade30-kube-api-access-9cdbw\") pod \"e2e-mt-027c8100-openshift-default-85cdb9b7cb-fl25x\" (UID: \"fd344548-dc1f-4a5a-9813-a05fee6ade30\") " pod="openshift-ingress/e2e-mt-027c8100-openshift-default-85cdb9b7cb-fl25x"
Sep 18 22:21:19.168804 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:19.168793    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd344548-dc1f-4a5a-9813-a05fee6ade30-workload-socket\") pod \"e2e-mt-027c8100-openshift-default-85cdb9b7cb-fl25x\" (UID: \"fd344548-dc1f-4a5a-9813-a05fee6ade30\") " pod="openshift-ingress/e2e-mt-027c8100-openshift-default-85cdb9b7cb-fl25x"
Sep 18 22:21:19.168914 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:19.168903    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fd344548-dc1f-4a5a-9813-a05fee6ade30-istiod-ca-cert\") pod \"e2e-mt-027c8100-openshift-default-85cdb9b7cb-fl25x\" (UID: \"fd344548-dc1f-4a5a-9813-a05fee6ade30\") " pod="openshift-ingress/e2e-mt-027c8100-openshift-default-85cdb9b7cb-fl25x"
Sep 18 22:21:19.169030 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:19.169020    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fd344548-dc1f-4a5a-9813-a05fee6ade30-istio-token\") pod \"e2e-mt-027c8100-openshift-default-85cdb9b7cb-fl25x\" (UID: \"fd344548-dc1f-4a5a-9813-a05fee6ade30\") " pod="openshift-ingress/e2e-mt-027c8100-openshift-default-85cdb9b7cb-fl25x"
Sep 18 22:21:19.169147 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:19.169134    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fd344548-dc1f-4a5a-9813-a05fee6ade30-istio-data\") pod \"e2e-mt-027c8100-openshift-default-85cdb9b7cb-fl25x\" (UID: \"fd344548-dc1f-4a5a-9813-a05fee6ade30\") " pod="openshift-ingress/e2e-mt-027c8100-openshift-default-85cdb9b7cb-fl25x"
Sep 18 22:21:19.270786 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:19.270751    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fd344548-dc1f-4a5a-9813-a05fee6ade30-istio-token\") pod \"e2e-mt-027c8100-openshift-default-85cdb9b7cb-fl25x\" (UID: \"fd344548-dc1f-4a5a-9813-a05fee6ade30\") " pod="openshift-ingress/e2e-mt-027c8100-openshift-default-85cdb9b7cb-fl25x"
Sep 18 22:21:19.270988 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:19.270800    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fd344548-dc1f-4a5a-9813-a05fee6ade30-istio-data\") pod \"e2e-mt-027c8100-openshift-default-85cdb9b7cb-fl25x\" (UID: \"fd344548-dc1f-4a5a-9813-a05fee6ade30\") " pod="openshift-ingress/e2e-mt-027c8100-openshift-default-85cdb9b7cb-fl25x"
Sep 18 22:21:19.270988 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:19.270843    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fd344548-dc1f-4a5a-9813-a05fee6ade30-istio-envoy\") pod \"e2e-mt-027c8100-openshift-default-85cdb9b7cb-fl25x\" (UID: \"fd344548-dc1f-4a5a-9813-a05fee6ade30\") " pod="openshift-ingress/e2e-mt-027c8100-openshift-default-85cdb9b7cb-fl25x"
Sep 18 22:21:19.270988 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:19.270869    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd344548-dc1f-4a5a-9813-a05fee6ade30-workload-certs\") pod \"e2e-mt-027c8100-openshift-default-85cdb9b7cb-fl25x\" (UID: \"fd344548-dc1f-4a5a-9813-a05fee6ade30\") " pod="openshift-ingress/e2e-mt-027c8100-openshift-default-85cdb9b7cb-fl25x"
Sep 18 22:21:19.270988 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:19.270899    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd344548-dc1f-4a5a-9813-a05fee6ade30-credential-socket\") pod \"e2e-mt-027c8100-openshift-default-85cdb9b7cb-fl25x\" (UID: \"fd344548-dc1f-4a5a-9813-a05fee6ade30\") " pod="openshift-ingress/e2e-mt-027c8100-openshift-default-85cdb9b7cb-fl25x"
Sep 18 22:21:19.270988 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:19.270963    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fd344548-dc1f-4a5a-9813-a05fee6ade30-istio-podinfo\") pod \"e2e-mt-027c8100-openshift-default-85cdb9b7cb-fl25x\" (UID: \"fd344548-dc1f-4a5a-9813-a05fee6ade30\") " pod="openshift-ingress/e2e-mt-027c8100-openshift-default-85cdb9b7cb-fl25x"
Sep 18 22:21:19.271276 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:19.271019    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9cdbw\" (UniqueName: \"kubernetes.io/projected/fd344548-dc1f-4a5a-9813-a05fee6ade30-kube-api-access-9cdbw\") pod \"e2e-mt-027c8100-openshift-default-85cdb9b7cb-fl25x\" (UID: \"fd344548-dc1f-4a5a-9813-a05fee6ade30\") " pod="openshift-ingress/e2e-mt-027c8100-openshift-default-85cdb9b7cb-fl25x"
Sep 18 22:21:19.271276 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:19.271064    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd344548-dc1f-4a5a-9813-a05fee6ade30-workload-socket\") pod \"e2e-mt-027c8100-openshift-default-85cdb9b7cb-fl25x\" (UID: \"fd344548-dc1f-4a5a-9813-a05fee6ade30\") " pod="openshift-ingress/e2e-mt-027c8100-openshift-default-85cdb9b7cb-fl25x"
Sep 18 22:21:19.271276 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:19.271117    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fd344548-dc1f-4a5a-9813-a05fee6ade30-istiod-ca-cert\") pod \"e2e-mt-027c8100-openshift-default-85cdb9b7cb-fl25x\" (UID: \"fd344548-dc1f-4a5a-9813-a05fee6ade30\") " pod="openshift-ingress/e2e-mt-027c8100-openshift-default-85cdb9b7cb-fl25x"
Sep 18 22:21:19.271276 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:19.271231    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fd344548-dc1f-4a5a-9813-a05fee6ade30-istio-data\") pod \"e2e-mt-027c8100-openshift-default-85cdb9b7cb-fl25x\" (UID: \"fd344548-dc1f-4a5a-9813-a05fee6ade30\") " pod="openshift-ingress/e2e-mt-027c8100-openshift-default-85cdb9b7cb-fl25x"
Sep 18 22:21:19.271558 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:19.271453    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd344548-dc1f-4a5a-9813-a05fee6ade30-workload-socket\") pod \"e2e-mt-027c8100-openshift-default-85cdb9b7cb-fl25x\" (UID: \"fd344548-dc1f-4a5a-9813-a05fee6ade30\") " pod="openshift-ingress/e2e-mt-027c8100-openshift-default-85cdb9b7cb-fl25x"
Sep 18 22:21:19.271851 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:19.271799    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd344548-dc1f-4a5a-9813-a05fee6ade30-workload-certs\") pod \"e2e-mt-027c8100-openshift-default-85cdb9b7cb-fl25x\" (UID: \"fd344548-dc1f-4a5a-9813-a05fee6ade30\") " pod="openshift-ingress/e2e-mt-027c8100-openshift-default-85cdb9b7cb-fl25x"
Sep 18 22:21:19.271986 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:19.271912    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd344548-dc1f-4a5a-9813-a05fee6ade30-credential-socket\") pod \"e2e-mt-027c8100-openshift-default-85cdb9b7cb-fl25x\" (UID: \"fd344548-dc1f-4a5a-9813-a05fee6ade30\") " pod="openshift-ingress/e2e-mt-027c8100-openshift-default-85cdb9b7cb-fl25x"
Sep 18 22:21:19.272174 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:19.272152    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fd344548-dc1f-4a5a-9813-a05fee6ade30-istiod-ca-cert\") pod \"e2e-mt-027c8100-openshift-default-85cdb9b7cb-fl25x\" (UID: \"fd344548-dc1f-4a5a-9813-a05fee6ade30\") " pod="openshift-ingress/e2e-mt-027c8100-openshift-default-85cdb9b7cb-fl25x"
Sep 18 22:21:19.273712 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:19.273691    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fd344548-dc1f-4a5a-9813-a05fee6ade30-istio-envoy\") pod \"e2e-mt-027c8100-openshift-default-85cdb9b7cb-fl25x\" (UID: \"fd344548-dc1f-4a5a-9813-a05fee6ade30\") " pod="openshift-ingress/e2e-mt-027c8100-openshift-default-85cdb9b7cb-fl25x"
Sep 18 22:21:19.273973 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:19.273958    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fd344548-dc1f-4a5a-9813-a05fee6ade30-istio-podinfo\") pod \"e2e-mt-027c8100-openshift-default-85cdb9b7cb-fl25x\" (UID: \"fd344548-dc1f-4a5a-9813-a05fee6ade30\") " pod="openshift-ingress/e2e-mt-027c8100-openshift-default-85cdb9b7cb-fl25x"
Sep 18 22:21:19.288701 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:19.288681    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fd344548-dc1f-4a5a-9813-a05fee6ade30-istio-token\") pod \"e2e-mt-027c8100-openshift-default-85cdb9b7cb-fl25x\" (UID: \"fd344548-dc1f-4a5a-9813-a05fee6ade30\") " pod="openshift-ingress/e2e-mt-027c8100-openshift-default-85cdb9b7cb-fl25x"
Sep 18 22:21:19.290026 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:19.290004    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9cdbw\" (UniqueName: \"kubernetes.io/projected/fd344548-dc1f-4a5a-9813-a05fee6ade30-kube-api-access-9cdbw\") pod \"e2e-mt-027c8100-openshift-default-85cdb9b7cb-fl25x\" (UID: \"fd344548-dc1f-4a5a-9813-a05fee6ade30\") " pod="openshift-ingress/e2e-mt-027c8100-openshift-default-85cdb9b7cb-fl25x"
Sep 18 22:21:19.408371 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:19.408280    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-027c8100-openshift-default-85cdb9b7cb-fl25x"
Sep 18 22:21:19.695360 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:19.695330    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-027c8100-openshift-default-85cdb9b7cb-fl25x"]
Sep 18 22:21:19.695717 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:21:19.695570    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd344548_dc1f_4a5a_9813_a05fee6ade30.slice/crio-d9a6226dc60fcf5463b77d70a8d5cfb900fab30a1ae3f7b0d21653b3cd0ac6c3 WatchSource:0}: Error finding container d9a6226dc60fcf5463b77d70a8d5cfb900fab30a1ae3f7b0d21653b3cd0ac6c3: Status 404 returned error can't find the container with id d9a6226dc60fcf5463b77d70a8d5cfb900fab30a1ae3f7b0d21653b3cd0ac6c3
Sep 18 22:21:19.697764 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:19.697729    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:21:19.697852 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:19.697799    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:21:19.697852 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:19.697830    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:21:19.924175 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:19.924134    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-027c8100-openshift-default-85cdb9b7cb-fl25x" event={"ID":"fd344548-dc1f-4a5a-9813-a05fee6ade30","Type":"ContainerStarted","Data":"07c0a486413fd2e48fe2af36a7c369c12c6d13a89e15f4e89bd3ac61a559b2d7"}
Sep 18 22:21:19.924342 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:19.924188    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-027c8100-openshift-default-85cdb9b7cb-fl25x" event={"ID":"fd344548-dc1f-4a5a-9813-a05fee6ade30","Type":"ContainerStarted","Data":"d9a6226dc60fcf5463b77d70a8d5cfb900fab30a1ae3f7b0d21653b3cd0ac6c3"}
Sep 18 22:21:19.959720 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:19.959604    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-027c8100-openshift-default-85cdb9b7cb-fl25x" podStartSLOduration=0.959579595 podStartE2EDuration="959.579595ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:21:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:21:19.956674666 +0000 UTC m=+1259.276346723" watchObservedRunningTime="2026-09-18 22:21:19.959579595 +0000 UTC m=+1259.279251652"
Sep 18 22:21:20.408492 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:20.408465    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-027c8100-openshift-default-85cdb9b7cb-fl25x"
Sep 18 22:21:20.413594 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:20.413573    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-027c8100-openshift-default-85cdb9b7cb-fl25x"
Sep 18 22:21:20.930542 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:20.930513    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-027c8100-openshift-default-85cdb9b7cb-fl25x"
Sep 18 22:21:20.931564 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:20.931543    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-027c8100-openshift-default-85cdb9b7cb-fl25x"
Sep 18 22:21:21.324613 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:21.324582    2577 scope.go:117] "RemoveContainer" containerID="d12c943a9aa764811851702d58827c53ade3d6dfa41ca402a1ef4aff91ad518e"
Sep 18 22:21:21.334097 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:21.334080    2577 scope.go:117] "RemoveContainer" containerID="faafaecd600e77dfd2888985dcfed8ae76a7e8f7c1d1ae070ee99e48c5f7c5db"
Sep 18 22:21:21.342322 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:21.342304    2577 scope.go:117] "RemoveContainer" containerID="fce87f650812386f1b3be7b727eed17d33faf0f32e38c7088d849699babe16b0"
Sep 18 22:21:25.729985 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:25.729953    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-ab559b-openshift-default-6b94d48488-hx84d"]
Sep 18 22:21:25.730402 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:25.730166    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-ab559b-openshift-default-6b94d48488-hx84d" podUID="ebab4845-1c9a-483e-aff6-dc86da22da83" containerName="istio-proxy" containerID="cri-o://9cc60e2f7301a3081b664e7d3d955ad4373f027147827a69d3d5e9427256065b" gracePeriod=30
Sep 18 22:21:26.639235 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:26.639201    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w3-123a30-openshift-default-79444bfb7b-8l2hl"]
Sep 18 22:21:26.645185 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:26.645154    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-123a30-openshift-default-79444bfb7b-8l2hl"
Sep 18 22:21:26.649084 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:26.649058    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w3-123a30-openshift-default-dockercfg-t6fs4\""
Sep 18 22:21:26.661002 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:26.660977    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-123a30-openshift-default-79444bfb7b-8l2hl"]
Sep 18 22:21:26.749043 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:26.749007    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6-istio-token\") pod \"e2e-shared-a-w3-123a30-openshift-default-79444bfb7b-8l2hl\" (UID: \"d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6\") " pod="openshift-ingress/e2e-shared-a-w3-123a30-openshift-default-79444bfb7b-8l2hl"
Sep 18 22:21:26.749717 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:26.749689    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwpjg\" (UniqueName: \"kubernetes.io/projected/d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6-kube-api-access-nwpjg\") pod \"e2e-shared-a-w3-123a30-openshift-default-79444bfb7b-8l2hl\" (UID: \"d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6\") " pod="openshift-ingress/e2e-shared-a-w3-123a30-openshift-default-79444bfb7b-8l2hl"
Sep 18 22:21:26.749871 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:26.749856    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6-credential-socket\") pod \"e2e-shared-a-w3-123a30-openshift-default-79444bfb7b-8l2hl\" (UID: \"d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6\") " pod="openshift-ingress/e2e-shared-a-w3-123a30-openshift-default-79444bfb7b-8l2hl"
Sep 18 22:21:26.750041 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:26.750025    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6-istio-podinfo\") pod \"e2e-shared-a-w3-123a30-openshift-default-79444bfb7b-8l2hl\" (UID: \"d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6\") " pod="openshift-ingress/e2e-shared-a-w3-123a30-openshift-default-79444bfb7b-8l2hl"
Sep 18 22:21:26.750195 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:26.750181    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6-istio-envoy\") pod \"e2e-shared-a-w3-123a30-openshift-default-79444bfb7b-8l2hl\" (UID: \"d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6\") " pod="openshift-ingress/e2e-shared-a-w3-123a30-openshift-default-79444bfb7b-8l2hl"
Sep 18 22:21:26.750337 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:26.750324    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6-istio-data\") pod \"e2e-shared-a-w3-123a30-openshift-default-79444bfb7b-8l2hl\" (UID: \"d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6\") " pod="openshift-ingress/e2e-shared-a-w3-123a30-openshift-default-79444bfb7b-8l2hl"
Sep 18 22:21:26.750487 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:26.750472    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6-istiod-ca-cert\") pod \"e2e-shared-a-w3-123a30-openshift-default-79444bfb7b-8l2hl\" (UID: \"d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6\") " pod="openshift-ingress/e2e-shared-a-w3-123a30-openshift-default-79444bfb7b-8l2hl"
Sep 18 22:21:26.750660 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:26.750647    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6-workload-socket\") pod \"e2e-shared-a-w3-123a30-openshift-default-79444bfb7b-8l2hl\" (UID: \"d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6\") " pod="openshift-ingress/e2e-shared-a-w3-123a30-openshift-default-79444bfb7b-8l2hl"
Sep 18 22:21:26.750808 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:26.750796    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6-workload-certs\") pod \"e2e-shared-a-w3-123a30-openshift-default-79444bfb7b-8l2hl\" (UID: \"d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6\") " pod="openshift-ingress/e2e-shared-a-w3-123a30-openshift-default-79444bfb7b-8l2hl"
Sep 18 22:21:26.852440 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:26.852375    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6-workload-socket\") pod \"e2e-shared-a-w3-123a30-openshift-default-79444bfb7b-8l2hl\" (UID: \"d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6\") " pod="openshift-ingress/e2e-shared-a-w3-123a30-openshift-default-79444bfb7b-8l2hl"
Sep 18 22:21:26.852611 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:26.852443    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6-workload-certs\") pod \"e2e-shared-a-w3-123a30-openshift-default-79444bfb7b-8l2hl\" (UID: \"d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6\") " pod="openshift-ingress/e2e-shared-a-w3-123a30-openshift-default-79444bfb7b-8l2hl"
Sep 18 22:21:26.852611 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:26.852509    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6-istio-token\") pod \"e2e-shared-a-w3-123a30-openshift-default-79444bfb7b-8l2hl\" (UID: \"d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6\") " pod="openshift-ingress/e2e-shared-a-w3-123a30-openshift-default-79444bfb7b-8l2hl"
Sep 18 22:21:26.852611 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:26.852551    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwpjg\" (UniqueName: \"kubernetes.io/projected/d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6-kube-api-access-nwpjg\") pod \"e2e-shared-a-w3-123a30-openshift-default-79444bfb7b-8l2hl\" (UID: \"d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6\") " pod="openshift-ingress/e2e-shared-a-w3-123a30-openshift-default-79444bfb7b-8l2hl"
Sep 18 22:21:26.852611 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:26.852586    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6-credential-socket\") pod \"e2e-shared-a-w3-123a30-openshift-default-79444bfb7b-8l2hl\" (UID: \"d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6\") " pod="openshift-ingress/e2e-shared-a-w3-123a30-openshift-default-79444bfb7b-8l2hl"
Sep 18 22:21:26.852845 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:26.852634    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6-istio-podinfo\") pod \"e2e-shared-a-w3-123a30-openshift-default-79444bfb7b-8l2hl\" (UID: \"d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6\") " pod="openshift-ingress/e2e-shared-a-w3-123a30-openshift-default-79444bfb7b-8l2hl"
Sep 18 22:21:26.852845 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:26.852681    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6-istio-envoy\") pod \"e2e-shared-a-w3-123a30-openshift-default-79444bfb7b-8l2hl\" (UID: \"d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6\") " pod="openshift-ingress/e2e-shared-a-w3-123a30-openshift-default-79444bfb7b-8l2hl"
Sep 18 22:21:26.852845 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:26.852727    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6-istio-data\") pod \"e2e-shared-a-w3-123a30-openshift-default-79444bfb7b-8l2hl\" (UID: \"d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6\") " pod="openshift-ingress/e2e-shared-a-w3-123a30-openshift-default-79444bfb7b-8l2hl"
Sep 18 22:21:26.852845 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:26.852756    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6-istiod-ca-cert\") pod \"e2e-shared-a-w3-123a30-openshift-default-79444bfb7b-8l2hl\" (UID: \"d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6\") " pod="openshift-ingress/e2e-shared-a-w3-123a30-openshift-default-79444bfb7b-8l2hl"
Sep 18 22:21:26.852845 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:26.852829    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6-workload-socket\") pod \"e2e-shared-a-w3-123a30-openshift-default-79444bfb7b-8l2hl\" (UID: \"d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6\") " pod="openshift-ingress/e2e-shared-a-w3-123a30-openshift-default-79444bfb7b-8l2hl"
Sep 18 22:21:26.853124 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:26.853025    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6-credential-socket\") pod \"e2e-shared-a-w3-123a30-openshift-default-79444bfb7b-8l2hl\" (UID: \"d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6\") " pod="openshift-ingress/e2e-shared-a-w3-123a30-openshift-default-79444bfb7b-8l2hl"
Sep 18 22:21:26.853236 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:26.853199    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6-istio-data\") pod \"e2e-shared-a-w3-123a30-openshift-default-79444bfb7b-8l2hl\" (UID: \"d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6\") " pod="openshift-ingress/e2e-shared-a-w3-123a30-openshift-default-79444bfb7b-8l2hl"
Sep 18 22:21:26.853442 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:26.853247    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6-workload-certs\") pod \"e2e-shared-a-w3-123a30-openshift-default-79444bfb7b-8l2hl\" (UID: \"d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6\") " pod="openshift-ingress/e2e-shared-a-w3-123a30-openshift-default-79444bfb7b-8l2hl"
Sep 18 22:21:26.853576 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:26.853516    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6-istiod-ca-cert\") pod \"e2e-shared-a-w3-123a30-openshift-default-79444bfb7b-8l2hl\" (UID: \"d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6\") " pod="openshift-ingress/e2e-shared-a-w3-123a30-openshift-default-79444bfb7b-8l2hl"
Sep 18 22:21:26.855144 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:26.855125    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6-istio-envoy\") pod \"e2e-shared-a-w3-123a30-openshift-default-79444bfb7b-8l2hl\" (UID: \"d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6\") " pod="openshift-ingress/e2e-shared-a-w3-123a30-openshift-default-79444bfb7b-8l2hl"
Sep 18 22:21:26.855480 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:26.855460    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6-istio-podinfo\") pod \"e2e-shared-a-w3-123a30-openshift-default-79444bfb7b-8l2hl\" (UID: \"d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6\") " pod="openshift-ingress/e2e-shared-a-w3-123a30-openshift-default-79444bfb7b-8l2hl"
Sep 18 22:21:26.865803 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:26.865780    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwpjg\" (UniqueName: \"kubernetes.io/projected/d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6-kube-api-access-nwpjg\") pod \"e2e-shared-a-w3-123a30-openshift-default-79444bfb7b-8l2hl\" (UID: \"d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6\") " pod="openshift-ingress/e2e-shared-a-w3-123a30-openshift-default-79444bfb7b-8l2hl"
Sep 18 22:21:26.866686 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:26.866656    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6-istio-token\") pod \"e2e-shared-a-w3-123a30-openshift-default-79444bfb7b-8l2hl\" (UID: \"d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6\") " pod="openshift-ingress/e2e-shared-a-w3-123a30-openshift-default-79444bfb7b-8l2hl"
Sep 18 22:21:26.957573 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:26.957477    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-123a30-openshift-default-79444bfb7b-8l2hl"
Sep 18 22:21:27.256962 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:27.256926    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-123a30-openshift-default-79444bfb7b-8l2hl"]
Sep 18 22:21:27.258635 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:21:27.258611    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd57cb1cb_ce02_4f2c_9814_e9bc0ea775c6.slice/crio-8ae6ece908a563e1327c719f1bb0b9a2181c2ba4090f62b14961f78e586e3101 WatchSource:0}: Error finding container 8ae6ece908a563e1327c719f1bb0b9a2181c2ba4090f62b14961f78e586e3101: Status 404 returned error can't find the container with id 8ae6ece908a563e1327c719f1bb0b9a2181c2ba4090f62b14961f78e586e3101
Sep 18 22:21:27.260779 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:27.260747    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:21:27.260883 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:27.260821    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:21:27.260883 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:27.260870    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:21:27.985248 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:27.985215    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-123a30-openshift-default-79444bfb7b-8l2hl" event={"ID":"d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6","Type":"ContainerStarted","Data":"9e7bf3980af39f51186cd857833ef12f9960033ae0d09e16083bda8703bafd20"}
Sep 18 22:21:27.985657 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:27.985264    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-123a30-openshift-default-79444bfb7b-8l2hl" event={"ID":"d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6","Type":"ContainerStarted","Data":"8ae6ece908a563e1327c719f1bb0b9a2181c2ba4090f62b14961f78e586e3101"}
Sep 18 22:21:28.033352 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:28.033302    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w3-123a30-openshift-default-79444bfb7b-8l2hl" podStartSLOduration=2.033282938 podStartE2EDuration="2.033282938s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:21:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:21:28.031325805 +0000 UTC m=+1267.350997948" watchObservedRunningTime="2026-09-18 22:21:28.033282938 +0000 UTC m=+1267.352954992"
Sep 18 22:21:28.958400 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:28.958370    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-123a30-openshift-default-79444bfb7b-8l2hl"
Sep 18 22:21:28.964095 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:28.964069    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-123a30-openshift-default-79444bfb7b-8l2hl"
Sep 18 22:21:28.991474 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:28.991442    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-123a30-openshift-default-79444bfb7b-8l2hl"
Sep 18 22:21:28.992339 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:28.992323    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-123a30-openshift-default-79444bfb7b-8l2hl"
Sep 18 22:21:29.454368 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:29.454330    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-027c8100-5cf9c98645-cxtv7"]
Sep 18 22:21:29.458305 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:29.458282    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-027c8100-5cf9c98645-cxtv7"
Sep 18 22:21:29.460852 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:29.460830    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-027c8100-dockercfg-brm6x\""
Sep 18 22:21:29.461595 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:29.461569    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-027c8100\""
Sep 18 22:21:29.476693 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:29.476668    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-027c8100-5cf9c98645-cxtv7"]
Sep 18 22:21:29.582264 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:29.582224    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d4054c3a-b573-46fd-984d-45d1b885f44c-plugins-config-volume\") pod \"payload-processing-e2e-mt-027c8100-5cf9c98645-cxtv7\" (UID: \"d4054c3a-b573-46fd-984d-45d1b885f44c\") " pod="openshift-ingress/payload-processing-e2e-mt-027c8100-5cf9c98645-cxtv7"
Sep 18 22:21:29.582443 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:29.582277    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j765f\" (UniqueName: \"kubernetes.io/projected/d4054c3a-b573-46fd-984d-45d1b885f44c-kube-api-access-j765f\") pod \"payload-processing-e2e-mt-027c8100-5cf9c98645-cxtv7\" (UID: \"d4054c3a-b573-46fd-984d-45d1b885f44c\") " pod="openshift-ingress/payload-processing-e2e-mt-027c8100-5cf9c98645-cxtv7"
Sep 18 22:21:29.683372 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:29.683336    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d4054c3a-b573-46fd-984d-45d1b885f44c-plugins-config-volume\") pod \"payload-processing-e2e-mt-027c8100-5cf9c98645-cxtv7\" (UID: \"d4054c3a-b573-46fd-984d-45d1b885f44c\") " pod="openshift-ingress/payload-processing-e2e-mt-027c8100-5cf9c98645-cxtv7"
Sep 18 22:21:29.683552 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:29.683389    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j765f\" (UniqueName: \"kubernetes.io/projected/d4054c3a-b573-46fd-984d-45d1b885f44c-kube-api-access-j765f\") pod \"payload-processing-e2e-mt-027c8100-5cf9c98645-cxtv7\" (UID: \"d4054c3a-b573-46fd-984d-45d1b885f44c\") " pod="openshift-ingress/payload-processing-e2e-mt-027c8100-5cf9c98645-cxtv7"
Sep 18 22:21:29.684023 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:29.684003    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d4054c3a-b573-46fd-984d-45d1b885f44c-plugins-config-volume\") pod \"payload-processing-e2e-mt-027c8100-5cf9c98645-cxtv7\" (UID: \"d4054c3a-b573-46fd-984d-45d1b885f44c\") " pod="openshift-ingress/payload-processing-e2e-mt-027c8100-5cf9c98645-cxtv7"
Sep 18 22:21:29.705076 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:29.705002    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j765f\" (UniqueName: \"kubernetes.io/projected/d4054c3a-b573-46fd-984d-45d1b885f44c-kube-api-access-j765f\") pod \"payload-processing-e2e-mt-027c8100-5cf9c98645-cxtv7\" (UID: \"d4054c3a-b573-46fd-984d-45d1b885f44c\") " pod="openshift-ingress/payload-processing-e2e-mt-027c8100-5cf9c98645-cxtv7"
Sep 18 22:21:29.769954 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:29.769919    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-027c8100-5cf9c98645-cxtv7"
Sep 18 22:21:30.058306 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:30.058280    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-027c8100-5cf9c98645-cxtv7"]
Sep 18 22:21:30.059281 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:21:30.059253    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4054c3a_b573_46fd_984d_45d1b885f44c.slice/crio-58301d5f4ff0b5764cb265c5a6ed7f37e7f8afeec536b6da306fe0b0073de08a WatchSource:0}: Error finding container 58301d5f4ff0b5764cb265c5a6ed7f37e7f8afeec536b6da306fe0b0073de08a: Status 404 returned error can't find the container with id 58301d5f4ff0b5764cb265c5a6ed7f37e7f8afeec536b6da306fe0b0073de08a
Sep 18 22:21:30.988047 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:30.988020    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-ab559b-openshift-default-6b94d48488-hx84d"
Sep 18 22:21:31.006233 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:31.006164    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-027c8100-5cf9c98645-cxtv7" event={"ID":"d4054c3a-b573-46fd-984d-45d1b885f44c","Type":"ContainerStarted","Data":"7d6cf47fc2b8abdcad7ae7c0e85284b937e6860d419d38fb5092143b072d9aca"}
Sep 18 22:21:31.006233 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:31.006221    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-027c8100-5cf9c98645-cxtv7"
Sep 18 22:21:31.006423 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:31.006248    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-027c8100-5cf9c98645-cxtv7" event={"ID":"d4054c3a-b573-46fd-984d-45d1b885f44c","Type":"ContainerStarted","Data":"58301d5f4ff0b5764cb265c5a6ed7f37e7f8afeec536b6da306fe0b0073de08a"}
Sep 18 22:21:31.008030 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:31.008006    2577 generic.go:356] "Generic (PLEG): container finished" podID="ebab4845-1c9a-483e-aff6-dc86da22da83" containerID="9cc60e2f7301a3081b664e7d3d955ad4373f027147827a69d3d5e9427256065b" exitCode=0
Sep 18 22:21:31.008126 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:31.008059    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-ab559b-openshift-default-6b94d48488-hx84d"
Sep 18 22:21:31.008126 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:31.008088    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-ab559b-openshift-default-6b94d48488-hx84d" event={"ID":"ebab4845-1c9a-483e-aff6-dc86da22da83","Type":"ContainerDied","Data":"9cc60e2f7301a3081b664e7d3d955ad4373f027147827a69d3d5e9427256065b"}
Sep 18 22:21:31.008203 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:31.008144    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-ab559b-openshift-default-6b94d48488-hx84d" event={"ID":"ebab4845-1c9a-483e-aff6-dc86da22da83","Type":"ContainerDied","Data":"8e29cec131048cb37cef2d016aa1bc95ef6c18d4e3e52fda102b23123276ec98"}
Sep 18 22:21:31.008834 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:31.008174    2577 scope.go:117] "RemoveContainer" containerID="9cc60e2f7301a3081b664e7d3d955ad4373f027147827a69d3d5e9427256065b"
Sep 18 22:21:31.018825 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:31.018805    2577 scope.go:117] "RemoveContainer" containerID="9799fb3f9703e6a782f1ef0077809c6e0a96f4d52c18b1ac3406b4b217f7bb5c"
Sep 18 22:21:31.030189 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:31.030168    2577 scope.go:117] "RemoveContainer" containerID="9cc60e2f7301a3081b664e7d3d955ad4373f027147827a69d3d5e9427256065b"
Sep 18 22:21:31.030535 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:21:31.030508    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9cc60e2f7301a3081b664e7d3d955ad4373f027147827a69d3d5e9427256065b\": container with ID starting with 9cc60e2f7301a3081b664e7d3d955ad4373f027147827a69d3d5e9427256065b not found: ID does not exist" containerID="9cc60e2f7301a3081b664e7d3d955ad4373f027147827a69d3d5e9427256065b"
Sep 18 22:21:31.030644 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:31.030535    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9cc60e2f7301a3081b664e7d3d955ad4373f027147827a69d3d5e9427256065b"} err="failed to get container status \"9cc60e2f7301a3081b664e7d3d955ad4373f027147827a69d3d5e9427256065b\": rpc error: code = NotFound desc = could not find container \"9cc60e2f7301a3081b664e7d3d955ad4373f027147827a69d3d5e9427256065b\": container with ID starting with 9cc60e2f7301a3081b664e7d3d955ad4373f027147827a69d3d5e9427256065b not found: ID does not exist"
Sep 18 22:21:31.030644 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:31.030553    2577 scope.go:117] "RemoveContainer" containerID="9799fb3f9703e6a782f1ef0077809c6e0a96f4d52c18b1ac3406b4b217f7bb5c"
Sep 18 22:21:31.030821 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:21:31.030801    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9799fb3f9703e6a782f1ef0077809c6e0a96f4d52c18b1ac3406b4b217f7bb5c\": container with ID starting with 9799fb3f9703e6a782f1ef0077809c6e0a96f4d52c18b1ac3406b4b217f7bb5c not found: ID does not exist" containerID="9799fb3f9703e6a782f1ef0077809c6e0a96f4d52c18b1ac3406b4b217f7bb5c"
Sep 18 22:21:31.030887 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:31.030826    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9799fb3f9703e6a782f1ef0077809c6e0a96f4d52c18b1ac3406b4b217f7bb5c"} err="failed to get container status \"9799fb3f9703e6a782f1ef0077809c6e0a96f4d52c18b1ac3406b4b217f7bb5c\": rpc error: code = NotFound desc = could not find container \"9799fb3f9703e6a782f1ef0077809c6e0a96f4d52c18b1ac3406b4b217f7bb5c\": container with ID starting with 9799fb3f9703e6a782f1ef0077809c6e0a96f4d52c18b1ac3406b4b217f7bb5c not found: ID does not exist"
Sep 18 22:21:31.050692 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:31.050638    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-027c8100-5cf9c98645-cxtv7" podStartSLOduration=2.050618445 podStartE2EDuration="2.050618445s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:21:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:21:31.046275288 +0000 UTC m=+1270.365947345" watchObservedRunningTime="2026-09-18 22:21:31.050618445 +0000 UTC m=+1270.370290506"
Sep 18 22:21:31.097607 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:31.097581    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ebab4845-1c9a-483e-aff6-dc86da22da83-istio-podinfo\") pod \"ebab4845-1c9a-483e-aff6-dc86da22da83\" (UID: \"ebab4845-1c9a-483e-aff6-dc86da22da83\") "
Sep 18 22:21:31.098013 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:31.097622    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ebab4845-1c9a-483e-aff6-dc86da22da83-istio-data\") pod \"ebab4845-1c9a-483e-aff6-dc86da22da83\" (UID: \"ebab4845-1c9a-483e-aff6-dc86da22da83\") "
Sep 18 22:21:31.098013 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:31.097655    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ebab4845-1c9a-483e-aff6-dc86da22da83-istiod-ca-cert\") pod \"ebab4845-1c9a-483e-aff6-dc86da22da83\" (UID: \"ebab4845-1c9a-483e-aff6-dc86da22da83\") "
Sep 18 22:21:31.098013 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:31.097709    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebab4845-1c9a-483e-aff6-dc86da22da83-workload-socket\") pod \"ebab4845-1c9a-483e-aff6-dc86da22da83\" (UID: \"ebab4845-1c9a-483e-aff6-dc86da22da83\") "
Sep 18 22:21:31.098013 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:31.097732    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ebab4845-1c9a-483e-aff6-dc86da22da83-istio-token\") pod \"ebab4845-1c9a-483e-aff6-dc86da22da83\" (UID: \"ebab4845-1c9a-483e-aff6-dc86da22da83\") "
Sep 18 22:21:31.098013 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:31.097764    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebab4845-1c9a-483e-aff6-dc86da22da83-credential-socket\") pod \"ebab4845-1c9a-483e-aff6-dc86da22da83\" (UID: \"ebab4845-1c9a-483e-aff6-dc86da22da83\") "
Sep 18 22:21:31.098013 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:31.097936    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jwxlv\" (UniqueName: \"kubernetes.io/projected/ebab4845-1c9a-483e-aff6-dc86da22da83-kube-api-access-jwxlv\") pod \"ebab4845-1c9a-483e-aff6-dc86da22da83\" (UID: \"ebab4845-1c9a-483e-aff6-dc86da22da83\") "
Sep 18 22:21:31.098013 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:31.097994    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ebab4845-1c9a-483e-aff6-dc86da22da83-workload-certs\") pod \"ebab4845-1c9a-483e-aff6-dc86da22da83\" (UID: \"ebab4845-1c9a-483e-aff6-dc86da22da83\") "
Sep 18 22:21:31.098013 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:31.097937    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ebab4845-1c9a-483e-aff6-dc86da22da83-istio-data" (OuterVolumeSpecName: "istio-data") pod "ebab4845-1c9a-483e-aff6-dc86da22da83" (UID: "ebab4845-1c9a-483e-aff6-dc86da22da83"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:21:31.098400 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:31.098025    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ebab4845-1c9a-483e-aff6-dc86da22da83-istio-envoy\") pod \"ebab4845-1c9a-483e-aff6-dc86da22da83\" (UID: \"ebab4845-1c9a-483e-aff6-dc86da22da83\") "
Sep 18 22:21:31.099215 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:31.098551    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ebab4845-1c9a-483e-aff6-dc86da22da83-istio-data\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:21:31.099215 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:31.098646    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ebab4845-1c9a-483e-aff6-dc86da22da83-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ebab4845-1c9a-483e-aff6-dc86da22da83" (UID: "ebab4845-1c9a-483e-aff6-dc86da22da83"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:21:31.099215 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:31.098663    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ebab4845-1c9a-483e-aff6-dc86da22da83-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ebab4845-1c9a-483e-aff6-dc86da22da83" (UID: "ebab4845-1c9a-483e-aff6-dc86da22da83"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:21:31.099215 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:31.098761    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ebab4845-1c9a-483e-aff6-dc86da22da83-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ebab4845-1c9a-483e-aff6-dc86da22da83" (UID: "ebab4845-1c9a-483e-aff6-dc86da22da83"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:21:31.099215 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:31.099017    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ebab4845-1c9a-483e-aff6-dc86da22da83-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ebab4845-1c9a-483e-aff6-dc86da22da83" (UID: "ebab4845-1c9a-483e-aff6-dc86da22da83"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:21:31.100125 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:31.100096    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ebab4845-1c9a-483e-aff6-dc86da22da83-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ebab4845-1c9a-483e-aff6-dc86da22da83" (UID: "ebab4845-1c9a-483e-aff6-dc86da22da83"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 18 22:21:31.101096 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:31.101074    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ebab4845-1c9a-483e-aff6-dc86da22da83-istio-token" (OuterVolumeSpecName: "istio-token") pod "ebab4845-1c9a-483e-aff6-dc86da22da83" (UID: "ebab4845-1c9a-483e-aff6-dc86da22da83"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:21:31.101193 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:31.101153    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ebab4845-1c9a-483e-aff6-dc86da22da83-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ebab4845-1c9a-483e-aff6-dc86da22da83" (UID: "ebab4845-1c9a-483e-aff6-dc86da22da83"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:21:31.101279 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:31.101254    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ebab4845-1c9a-483e-aff6-dc86da22da83-kube-api-access-jwxlv" (OuterVolumeSpecName: "kube-api-access-jwxlv") pod "ebab4845-1c9a-483e-aff6-dc86da22da83" (UID: "ebab4845-1c9a-483e-aff6-dc86da22da83"). InnerVolumeSpecName "kube-api-access-jwxlv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:21:31.199622 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:31.199586    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jwxlv\" (UniqueName: \"kubernetes.io/projected/ebab4845-1c9a-483e-aff6-dc86da22da83-kube-api-access-jwxlv\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:21:31.199622 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:31.199619    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ebab4845-1c9a-483e-aff6-dc86da22da83-workload-certs\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:21:31.199622 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:31.199631    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ebab4845-1c9a-483e-aff6-dc86da22da83-istio-envoy\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:21:31.199863 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:31.199642    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ebab4845-1c9a-483e-aff6-dc86da22da83-istio-podinfo\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:21:31.199863 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:31.199652    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ebab4845-1c9a-483e-aff6-dc86da22da83-istiod-ca-cert\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:21:31.199863 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:31.199662    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebab4845-1c9a-483e-aff6-dc86da22da83-workload-socket\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:21:31.199863 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:31.199672    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ebab4845-1c9a-483e-aff6-dc86da22da83-istio-token\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:21:31.199863 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:31.199682    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebab4845-1c9a-483e-aff6-dc86da22da83-credential-socket\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:21:31.336660 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:31.336628    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-ab559b-openshift-default-6b94d48488-hx84d"]
Sep 18 22:21:31.348060 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:31.348033    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-ab559b-openshift-default-6b94d48488-hx84d"]
Sep 18 22:21:33.140200 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:33.140170    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ebab4845-1c9a-483e-aff6-dc86da22da83" path="/var/lib/kubelet/pods/ebab4845-1c9a-483e-aff6-dc86da22da83/volumes"
Sep 18 22:21:37.009186 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:37.009154    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-123a30-5f56bf8b75-h2dwv"]
Sep 18 22:21:37.009630 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:37.009616    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebab4845-1c9a-483e-aff6-dc86da22da83" containerName="istio-proxy"
Sep 18 22:21:37.009674 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:37.009631    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebab4845-1c9a-483e-aff6-dc86da22da83" containerName="istio-proxy"
Sep 18 22:21:37.009720 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:37.009711    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="ebab4845-1c9a-483e-aff6-dc86da22da83" containerName="istio-proxy"
Sep 18 22:21:37.014620 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:37.014597    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-123a30-5f56bf8b75-h2dwv"
Sep 18 22:21:37.022519 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:37.022496    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w3-123a30\""
Sep 18 22:21:37.039320 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:37.039284    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-123a30-5f56bf8b75-h2dwv"]
Sep 18 22:21:37.082693 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:37.082638    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a4479845-a02e-4784-93e0-a25d20d12f5c-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-123a30-5f56bf8b75-h2dwv\" (UID: \"a4479845-a02e-4784-93e0-a25d20d12f5c\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-123a30-5f56bf8b75-h2dwv"
Sep 18 22:21:37.083173 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:37.083130    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jkdh\" (UniqueName: \"kubernetes.io/projected/a4479845-a02e-4784-93e0-a25d20d12f5c-kube-api-access-2jkdh\") pod \"payload-processing-e2e-shared-a-w3-123a30-5f56bf8b75-h2dwv\" (UID: \"a4479845-a02e-4784-93e0-a25d20d12f5c\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-123a30-5f56bf8b75-h2dwv"
Sep 18 22:21:37.184244 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:37.184213    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a4479845-a02e-4784-93e0-a25d20d12f5c-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-123a30-5f56bf8b75-h2dwv\" (UID: \"a4479845-a02e-4784-93e0-a25d20d12f5c\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-123a30-5f56bf8b75-h2dwv"
Sep 18 22:21:37.184579 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:37.184529    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jkdh\" (UniqueName: \"kubernetes.io/projected/a4479845-a02e-4784-93e0-a25d20d12f5c-kube-api-access-2jkdh\") pod \"payload-processing-e2e-shared-a-w3-123a30-5f56bf8b75-h2dwv\" (UID: \"a4479845-a02e-4784-93e0-a25d20d12f5c\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-123a30-5f56bf8b75-h2dwv"
Sep 18 22:21:37.185127 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:37.185039    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a4479845-a02e-4784-93e0-a25d20d12f5c-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-123a30-5f56bf8b75-h2dwv\" (UID: \"a4479845-a02e-4784-93e0-a25d20d12f5c\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-123a30-5f56bf8b75-h2dwv"
Sep 18 22:21:37.218810 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:37.218778    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jkdh\" (UniqueName: \"kubernetes.io/projected/a4479845-a02e-4784-93e0-a25d20d12f5c-kube-api-access-2jkdh\") pod \"payload-processing-e2e-shared-a-w3-123a30-5f56bf8b75-h2dwv\" (UID: \"a4479845-a02e-4784-93e0-a25d20d12f5c\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-123a30-5f56bf8b75-h2dwv"
Sep 18 22:21:37.324801 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:37.324764    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-123a30-5f56bf8b75-h2dwv"
Sep 18 22:21:37.642371 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:37.642335    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-123a30-5f56bf8b75-h2dwv"]
Sep 18 22:21:37.643985 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:21:37.643953    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4479845_a02e_4784_93e0_a25d20d12f5c.slice/crio-1ab96065fe2087d5b04c1a12984975c5770a724a1b915f826141a62abf81903b WatchSource:0}: Error finding container 1ab96065fe2087d5b04c1a12984975c5770a724a1b915f826141a62abf81903b: Status 404 returned error can't find the container with id 1ab96065fe2087d5b04c1a12984975c5770a724a1b915f826141a62abf81903b
Sep 18 22:21:38.100900 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:38.100860    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-123a30-5f56bf8b75-h2dwv" event={"ID":"a4479845-a02e-4784-93e0-a25d20d12f5c","Type":"ContainerStarted","Data":"8e04137f8168216f413ac896fb9336676ee16d81b7f8b51f821276fe335dc15b"}
Sep 18 22:21:38.101386 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:38.100937    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-123a30-5f56bf8b75-h2dwv" event={"ID":"a4479845-a02e-4784-93e0-a25d20d12f5c","Type":"ContainerStarted","Data":"1ab96065fe2087d5b04c1a12984975c5770a724a1b915f826141a62abf81903b"}
Sep 18 22:21:38.101386 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:38.100974    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-123a30-5f56bf8b75-h2dwv"
Sep 18 22:21:38.180530 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:38.180468    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-123a30-5f56bf8b75-h2dwv" podStartSLOduration=2.180445618 podStartE2EDuration="2.180445618s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:21:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:21:38.174660077 +0000 UTC m=+1277.494332136" watchObservedRunningTime="2026-09-18 22:21:38.180445618 +0000 UTC m=+1277.500117674"
Sep 18 22:21:42.017646 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:42.017613    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-027c8100-5cf9c98645-cxtv7"
Sep 18 22:21:44.145615 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:44.145508    2577 generic.go:356] "Generic (PLEG): container finished" podID="fd344548-dc1f-4a5a-9813-a05fee6ade30" containerID="07c0a486413fd2e48fe2af36a7c369c12c6d13a89e15f4e89bd3ac61a559b2d7" exitCode=0
Sep 18 22:21:44.145615 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:44.145581    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-027c8100-openshift-default-85cdb9b7cb-fl25x" event={"ID":"fd344548-dc1f-4a5a-9813-a05fee6ade30","Type":"ContainerDied","Data":"07c0a486413fd2e48fe2af36a7c369c12c6d13a89e15f4e89bd3ac61a559b2d7"}
Sep 18 22:21:44.146208 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:44.146070    2577 scope.go:117] "RemoveContainer" containerID="07c0a486413fd2e48fe2af36a7c369c12c6d13a89e15f4e89bd3ac61a559b2d7"
Sep 18 22:21:44.147368 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:44.147337    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:21:44.147509 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:44.147405    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:21:44.147509 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:44.147470    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:21:45.154870 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:45.154830    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-027c8100-openshift-default-85cdb9b7cb-fl25x" event={"ID":"fd344548-dc1f-4a5a-9813-a05fee6ade30","Type":"ContainerStarted","Data":"5aa838f67b47d88aa56a21e0af50c6fece548687c4c4d22507cf127b7c5c9d84"}
Sep 18 22:21:45.408875 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:45.408776    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-027c8100-openshift-default-85cdb9b7cb-fl25x"
Sep 18 22:21:45.409067 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:45.409016    2577 patch_prober.go:28] interesting pod/e2e-mt-027c8100-openshift-default-85cdb9b7cb-fl25x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.87:15021/healthz/ready\": dial tcp 10.133.0.87:15021: connect: connection refused" start-of-body=
Sep 18 22:21:45.409154 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:45.409097    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-027c8100-openshift-default-85cdb9b7cb-fl25x" podUID="fd344548-dc1f-4a5a-9813-a05fee6ade30" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.87:15021/healthz/ready\": dial tcp 10.133.0.87:15021: connect: connection refused"
Sep 18 22:21:46.408889 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:46.408858    2577 patch_prober.go:28] interesting pod/e2e-mt-027c8100-openshift-default-85cdb9b7cb-fl25x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.87:15021/healthz/ready\": dial tcp 10.133.0.87:15021: connect: connection refused" start-of-body=
Sep 18 22:21:46.409358 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:46.408911    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-027c8100-openshift-default-85cdb9b7cb-fl25x" podUID="fd344548-dc1f-4a5a-9813-a05fee6ade30" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.87:15021/healthz/ready\": dial tcp 10.133.0.87:15021: connect: connection refused"
Sep 18 22:21:47.408965 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:47.408925    2577 patch_prober.go:28] interesting pod/e2e-mt-027c8100-openshift-default-85cdb9b7cb-fl25x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.87:15021/healthz/ready\": dial tcp 10.133.0.87:15021: connect: connection refused" start-of-body=
Sep 18 22:21:47.409372 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:47.408991    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-027c8100-openshift-default-85cdb9b7cb-fl25x" podUID="fd344548-dc1f-4a5a-9813-a05fee6ade30" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.87:15021/healthz/ready\": dial tcp 10.133.0.87:15021: connect: connection refused"
Sep 18 22:21:48.408821 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:48.408783    2577 patch_prober.go:28] interesting pod/e2e-mt-027c8100-openshift-default-85cdb9b7cb-fl25x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.87:15021/healthz/ready\": dial tcp 10.133.0.87:15021: connect: connection refused" start-of-body=
Sep 18 22:21:48.409011 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:48.408842    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-027c8100-openshift-default-85cdb9b7cb-fl25x" podUID="fd344548-dc1f-4a5a-9813-a05fee6ade30" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.87:15021/healthz/ready\": dial tcp 10.133.0.87:15021: connect: connection refused"
Sep 18 22:21:49.111235 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:49.111205    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-123a30-5f56bf8b75-h2dwv"
Sep 18 22:21:49.409432 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:49.409336    2577 patch_prober.go:28] interesting pod/e2e-mt-027c8100-openshift-default-85cdb9b7cb-fl25x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.87:15021/healthz/ready\": dial tcp 10.133.0.87:15021: connect: connection refused" start-of-body=
Sep 18 22:21:49.409432 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:49.409392    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-027c8100-openshift-default-85cdb9b7cb-fl25x" podUID="fd344548-dc1f-4a5a-9813-a05fee6ade30" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.87:15021/healthz/ready\": dial tcp 10.133.0.87:15021: connect: connection refused"
Sep 18 22:21:50.409261 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:50.409225    2577 patch_prober.go:28] interesting pod/e2e-mt-027c8100-openshift-default-85cdb9b7cb-fl25x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.87:15021/healthz/ready\": dial tcp 10.133.0.87:15021: connect: connection refused" start-of-body=
Sep 18 22:21:50.409448 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:50.409280    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-027c8100-openshift-default-85cdb9b7cb-fl25x" podUID="fd344548-dc1f-4a5a-9813-a05fee6ade30" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.87:15021/healthz/ready\": dial tcp 10.133.0.87:15021: connect: connection refused"
Sep 18 22:21:50.857034 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:50.856998    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58-7xtq5"]
Sep 18 22:21:50.858335 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:50.858313    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebab4845-1c9a-483e-aff6-dc86da22da83" containerName="istio-proxy"
Sep 18 22:21:50.858524 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:50.858507    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebab4845-1c9a-483e-aff6-dc86da22da83" containerName="istio-proxy"
Sep 18 22:21:50.858811 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:50.858796    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="ebab4845-1c9a-483e-aff6-dc86da22da83" containerName="istio-proxy"
Sep 18 22:21:50.873791 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:50.873769    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58-7xtq5"
Sep 18 22:21:50.889129 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:50.889100    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w3-7f10d8-openshift-default-dockercfg-k27s4\""
Sep 18 22:21:50.893283 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:50.893257    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58-7xtq5"]
Sep 18 22:21:50.929799 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:50.929761    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ca5b41e-920d-4dc0-9636-22d83ade195d-istio-token\") pod \"e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58-7xtq5\" (UID: \"9ca5b41e-920d-4dc0-9636-22d83ade195d\") " pod="openshift-ingress/e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58-7xtq5"
Sep 18 22:21:50.929990 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:50.929872    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ca5b41e-920d-4dc0-9636-22d83ade195d-istio-data\") pod \"e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58-7xtq5\" (UID: \"9ca5b41e-920d-4dc0-9636-22d83ade195d\") " pod="openshift-ingress/e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58-7xtq5"
Sep 18 22:21:50.929990 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:50.929947    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ca5b41e-920d-4dc0-9636-22d83ade195d-credential-socket\") pod \"e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58-7xtq5\" (UID: \"9ca5b41e-920d-4dc0-9636-22d83ade195d\") " pod="openshift-ingress/e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58-7xtq5"
Sep 18 22:21:50.929990 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:50.929972    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ca5b41e-920d-4dc0-9636-22d83ade195d-istiod-ca-cert\") pod \"e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58-7xtq5\" (UID: \"9ca5b41e-920d-4dc0-9636-22d83ade195d\") " pod="openshift-ingress/e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58-7xtq5"
Sep 18 22:21:50.929990 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:50.929987    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7cjkz\" (UniqueName: \"kubernetes.io/projected/9ca5b41e-920d-4dc0-9636-22d83ade195d-kube-api-access-7cjkz\") pod \"e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58-7xtq5\" (UID: \"9ca5b41e-920d-4dc0-9636-22d83ade195d\") " pod="openshift-ingress/e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58-7xtq5"
Sep 18 22:21:50.930169 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:50.930007    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ca5b41e-920d-4dc0-9636-22d83ade195d-istio-envoy\") pod \"e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58-7xtq5\" (UID: \"9ca5b41e-920d-4dc0-9636-22d83ade195d\") " pod="openshift-ingress/e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58-7xtq5"
Sep 18 22:21:50.930169 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:50.930069    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ca5b41e-920d-4dc0-9636-22d83ade195d-workload-certs\") pod \"e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58-7xtq5\" (UID: \"9ca5b41e-920d-4dc0-9636-22d83ade195d\") " pod="openshift-ingress/e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58-7xtq5"
Sep 18 22:21:50.930169 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:50.930142    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ca5b41e-920d-4dc0-9636-22d83ade195d-workload-socket\") pod \"e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58-7xtq5\" (UID: \"9ca5b41e-920d-4dc0-9636-22d83ade195d\") " pod="openshift-ingress/e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58-7xtq5"
Sep 18 22:21:50.930289 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:50.930169    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ca5b41e-920d-4dc0-9636-22d83ade195d-istio-podinfo\") pod \"e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58-7xtq5\" (UID: \"9ca5b41e-920d-4dc0-9636-22d83ade195d\") " pod="openshift-ingress/e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58-7xtq5"
Sep 18 22:21:50.930472 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:50.930458    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-027c8100-openshift-default-85cdb9b7cb-fl25x"
Sep 18 22:21:51.030957 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:51.030925    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ca5b41e-920d-4dc0-9636-22d83ade195d-istiod-ca-cert\") pod \"e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58-7xtq5\" (UID: \"9ca5b41e-920d-4dc0-9636-22d83ade195d\") " pod="openshift-ingress/e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58-7xtq5"
Sep 18 22:21:51.030957 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:51.030960    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cjkz\" (UniqueName: \"kubernetes.io/projected/9ca5b41e-920d-4dc0-9636-22d83ade195d-kube-api-access-7cjkz\") pod \"e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58-7xtq5\" (UID: \"9ca5b41e-920d-4dc0-9636-22d83ade195d\") " pod="openshift-ingress/e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58-7xtq5"
Sep 18 22:21:51.031231 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:51.030982    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ca5b41e-920d-4dc0-9636-22d83ade195d-istio-envoy\") pod \"e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58-7xtq5\" (UID: \"9ca5b41e-920d-4dc0-9636-22d83ade195d\") " pod="openshift-ingress/e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58-7xtq5"
Sep 18 22:21:51.031231 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:51.031021    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ca5b41e-920d-4dc0-9636-22d83ade195d-workload-certs\") pod \"e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58-7xtq5\" (UID: \"9ca5b41e-920d-4dc0-9636-22d83ade195d\") " pod="openshift-ingress/e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58-7xtq5"
Sep 18 22:21:51.031231 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:51.031083    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ca5b41e-920d-4dc0-9636-22d83ade195d-workload-socket\") pod \"e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58-7xtq5\" (UID: \"9ca5b41e-920d-4dc0-9636-22d83ade195d\") " pod="openshift-ingress/e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58-7xtq5"
Sep 18 22:21:51.031231 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:51.031115    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ca5b41e-920d-4dc0-9636-22d83ade195d-istio-podinfo\") pod \"e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58-7xtq5\" (UID: \"9ca5b41e-920d-4dc0-9636-22d83ade195d\") " pod="openshift-ingress/e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58-7xtq5"
Sep 18 22:21:51.031231 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:51.031180    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ca5b41e-920d-4dc0-9636-22d83ade195d-istio-token\") pod \"e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58-7xtq5\" (UID: \"9ca5b41e-920d-4dc0-9636-22d83ade195d\") " pod="openshift-ingress/e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58-7xtq5"
Sep 18 22:21:51.031231 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:51.031209    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ca5b41e-920d-4dc0-9636-22d83ade195d-istio-data\") pod \"e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58-7xtq5\" (UID: \"9ca5b41e-920d-4dc0-9636-22d83ade195d\") " pod="openshift-ingress/e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58-7xtq5"
Sep 18 22:21:51.031598 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:51.031257    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ca5b41e-920d-4dc0-9636-22d83ade195d-credential-socket\") pod \"e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58-7xtq5\" (UID: \"9ca5b41e-920d-4dc0-9636-22d83ade195d\") " pod="openshift-ingress/e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58-7xtq5"
Sep 18 22:21:51.031664 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:51.031605    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ca5b41e-920d-4dc0-9636-22d83ade195d-credential-socket\") pod \"e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58-7xtq5\" (UID: \"9ca5b41e-920d-4dc0-9636-22d83ade195d\") " pod="openshift-ingress/e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58-7xtq5"
Sep 18 22:21:51.031758 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:51.031734    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ca5b41e-920d-4dc0-9636-22d83ade195d-workload-socket\") pod \"e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58-7xtq5\" (UID: \"9ca5b41e-920d-4dc0-9636-22d83ade195d\") " pod="openshift-ingress/e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58-7xtq5"
Sep 18 22:21:51.032580 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:51.032532    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ca5b41e-920d-4dc0-9636-22d83ade195d-workload-certs\") pod \"e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58-7xtq5\" (UID: \"9ca5b41e-920d-4dc0-9636-22d83ade195d\") " pod="openshift-ingress/e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58-7xtq5"
Sep 18 22:21:51.032725 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:51.032677    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ca5b41e-920d-4dc0-9636-22d83ade195d-istiod-ca-cert\") pod \"e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58-7xtq5\" (UID: \"9ca5b41e-920d-4dc0-9636-22d83ade195d\") " pod="openshift-ingress/e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58-7xtq5"
Sep 18 22:21:51.033029 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:51.033005    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ca5b41e-920d-4dc0-9636-22d83ade195d-istio-data\") pod \"e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58-7xtq5\" (UID: \"9ca5b41e-920d-4dc0-9636-22d83ade195d\") " pod="openshift-ingress/e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58-7xtq5"
Sep 18 22:21:51.036849 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:51.036814    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ca5b41e-920d-4dc0-9636-22d83ade195d-istio-podinfo\") pod \"e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58-7xtq5\" (UID: \"9ca5b41e-920d-4dc0-9636-22d83ade195d\") " pod="openshift-ingress/e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58-7xtq5"
Sep 18 22:21:51.049434 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:51.047670    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ca5b41e-920d-4dc0-9636-22d83ade195d-istio-envoy\") pod \"e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58-7xtq5\" (UID: \"9ca5b41e-920d-4dc0-9636-22d83ade195d\") " pod="openshift-ingress/e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58-7xtq5"
Sep 18 22:21:51.074898 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:51.074802    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7cjkz\" (UniqueName: \"kubernetes.io/projected/9ca5b41e-920d-4dc0-9636-22d83ade195d-kube-api-access-7cjkz\") pod \"e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58-7xtq5\" (UID: \"9ca5b41e-920d-4dc0-9636-22d83ade195d\") " pod="openshift-ingress/e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58-7xtq5"
Sep 18 22:21:51.078432 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:51.076545    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ca5b41e-920d-4dc0-9636-22d83ade195d-istio-token\") pod \"e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58-7xtq5\" (UID: \"9ca5b41e-920d-4dc0-9636-22d83ade195d\") " pod="openshift-ingress/e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58-7xtq5"
Sep 18 22:21:51.204848 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:51.204754    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58-7xtq5"
Sep 18 22:21:51.413493 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:51.413464    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-027c8100-openshift-default-85cdb9b7cb-fl25x"
Sep 18 22:21:51.414520 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:51.414500    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-027c8100-openshift-default-85cdb9b7cb-fl25x"
Sep 18 22:21:51.526110 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:51.526072    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58-7xtq5"]
Sep 18 22:21:51.536870 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:51.536820    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:21:51.537005 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:51.536914    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:21:51.537005 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:51.536971    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:21:52.216478 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:52.216405    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58-7xtq5" event={"ID":"9ca5b41e-920d-4dc0-9636-22d83ade195d","Type":"ContainerStarted","Data":"3c87d3775fc0ea04fa2a50fcc3416a219eedce1d12f2cdc9fc3713e872d03094"}
Sep 18 22:21:52.216675 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:52.216497    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58-7xtq5" event={"ID":"9ca5b41e-920d-4dc0-9636-22d83ade195d","Type":"ContainerStarted","Data":"d4564edc0c6cb6fe8a5bf80be94f649824493536a8f1bbe2a67207d85f4ed5eb"}
Sep 18 22:21:52.262169 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:52.262087    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58-7xtq5" podStartSLOduration=2.262064717 podStartE2EDuration="2.262064717s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:21:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:21:52.261440932 +0000 UTC m=+1291.581112985" watchObservedRunningTime="2026-09-18 22:21:52.262064717 +0000 UTC m=+1291.581736774"
Sep 18 22:21:53.205970 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:53.205936    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58-7xtq5"
Sep 18 22:21:53.211614 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:53.211583    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58-7xtq5"
Sep 18 22:21:53.222959 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:53.222932    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58-7xtq5"
Sep 18 22:21:53.223790 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:53.223769    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58-7xtq5"
Sep 18 22:21:58.262429 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:58.262333    2577 generic.go:356] "Generic (PLEG): container finished" podID="d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6" containerID="9e7bf3980af39f51186cd857833ef12f9960033ae0d09e16083bda8703bafd20" exitCode=0
Sep 18 22:21:58.262429 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:58.262374    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-123a30-openshift-default-79444bfb7b-8l2hl" event={"ID":"d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6","Type":"ContainerDied","Data":"9e7bf3980af39f51186cd857833ef12f9960033ae0d09e16083bda8703bafd20"}
Sep 18 22:21:58.262954 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:58.262779    2577 scope.go:117] "RemoveContainer" containerID="9e7bf3980af39f51186cd857833ef12f9960033ae0d09e16083bda8703bafd20"
Sep 18 22:21:58.263958 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:58.263931    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:21:58.264017 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:58.263998    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:21:58.264057 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:58.264031    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:21:58.992135 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:58.992095    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-123a30-openshift-default-79444bfb7b-8l2hl"
Sep 18 22:21:59.275619 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:59.275540    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-123a30-openshift-default-79444bfb7b-8l2hl" event={"ID":"d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6","Type":"ContainerStarted","Data":"37f76bc335906830d73e87ea74aeb12552b3e5fbd15bda321a36d220aa119f51"}
Sep 18 22:21:59.959729 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:59.959232    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-123a30-openshift-default-79444bfb7b-8l2hl"
Sep 18 22:21:59.959729 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:59.959362    2577 patch_prober.go:28] interesting pod/e2e-shared-a-w3-123a30-openshift-default-79444bfb7b-8l2hl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.88:15021/healthz/ready\": dial tcp 10.133.0.88:15021: connect: connection refused" start-of-body=
Sep 18 22:21:59.959729 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:21:59.959447    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-123a30-openshift-default-79444bfb7b-8l2hl" podUID="d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.88:15021/healthz/ready\": dial tcp 10.133.0.88:15021: connect: connection refused"
Sep 18 22:22:00.958682 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:22:00.958641    2577 patch_prober.go:28] interesting pod/e2e-shared-a-w3-123a30-openshift-default-79444bfb7b-8l2hl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.88:15021/healthz/ready\": dial tcp 10.133.0.88:15021: connect: connection refused" start-of-body=
Sep 18 22:22:00.959258 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:22:00.959228    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-123a30-openshift-default-79444bfb7b-8l2hl" podUID="d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.88:15021/healthz/ready\": dial tcp 10.133.0.88:15021: connect: connection refused"
Sep 18 22:22:01.958429 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:22:01.958370    2577 patch_prober.go:28] interesting pod/e2e-shared-a-w3-123a30-openshift-default-79444bfb7b-8l2hl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.88:15021/healthz/ready\": dial tcp 10.133.0.88:15021: connect: connection refused" start-of-body=
Sep 18 22:22:01.958738 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:22:01.958708    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-123a30-openshift-default-79444bfb7b-8l2hl" podUID="d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.88:15021/healthz/ready\": dial tcp 10.133.0.88:15021: connect: connection refused"
Sep 18 22:22:02.958747 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:22:02.958710    2577 patch_prober.go:28] interesting pod/e2e-shared-a-w3-123a30-openshift-default-79444bfb7b-8l2hl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.88:15021/healthz/ready\": dial tcp 10.133.0.88:15021: connect: connection refused" start-of-body=
Sep 18 22:22:02.959396 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:22:02.959361    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-123a30-openshift-default-79444bfb7b-8l2hl" podUID="d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.88:15021/healthz/ready\": dial tcp 10.133.0.88:15021: connect: connection refused"
Sep 18 22:22:03.958177 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:22:03.958138    2577 patch_prober.go:28] interesting pod/e2e-shared-a-w3-123a30-openshift-default-79444bfb7b-8l2hl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.88:15021/healthz/ready\": dial tcp 10.133.0.88:15021: connect: connection refused" start-of-body=
Sep 18 22:22:03.958549 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:22:03.958519    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-123a30-openshift-default-79444bfb7b-8l2hl" podUID="d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.88:15021/healthz/ready\": dial tcp 10.133.0.88:15021: connect: connection refused"
Sep 18 22:22:04.963062 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:22:04.963029    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-123a30-openshift-default-79444bfb7b-8l2hl"
Sep 18 22:22:04.963465 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:22:04.963438    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-123a30-openshift-default-79444bfb7b-8l2hl"
Sep 18 22:22:04.964221 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:22:04.964201    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-123a30-openshift-default-79444bfb7b-8l2hl"
Sep 18 22:22:21.399793 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:22:21.399770    2577 scope.go:117] "RemoveContainer" containerID="3ff20f1d8ff9b5a221aa0d3a5b540119afd2bd04dae4d52e288decd9f0856d99"
Sep 18 22:22:21.412820 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:22:21.412800    2577 scope.go:117] "RemoveContainer" containerID="cd431a5f85f9113620cf5e847eea47c80d582c2130105ae063a2b52d7d9125fb"
Sep 18 22:22:22.438525 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:22:22.438492    2577 generic.go:356] "Generic (PLEG): container finished" podID="9ca5b41e-920d-4dc0-9636-22d83ade195d" containerID="3c87d3775fc0ea04fa2a50fcc3416a219eedce1d12f2cdc9fc3713e872d03094" exitCode=0
Sep 18 22:22:22.438937 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:22:22.438571    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58-7xtq5" event={"ID":"9ca5b41e-920d-4dc0-9636-22d83ade195d","Type":"ContainerDied","Data":"3c87d3775fc0ea04fa2a50fcc3416a219eedce1d12f2cdc9fc3713e872d03094"}
Sep 18 22:22:22.439098 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:22:22.439084    2577 scope.go:117] "RemoveContainer" containerID="3c87d3775fc0ea04fa2a50fcc3416a219eedce1d12f2cdc9fc3713e872d03094"
Sep 18 22:22:22.440289 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:22:22.440260    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:22:22.440352 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:22:22.440330    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:22:22.440389 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:22:22.440360    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:22:23.222952 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:22:23.222908    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58-7xtq5"
Sep 18 22:22:23.448068 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:22:23.448027    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58-7xtq5" event={"ID":"9ca5b41e-920d-4dc0-9636-22d83ade195d","Type":"ContainerStarted","Data":"ac693703ac4b5180ec41e90a4b1760734f9378e240c6cd178c3684fc4e686ff4"}
Sep 18 22:22:24.204989 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:22:24.204957    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58-7xtq5"
Sep 18 22:22:24.206273 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:22:24.206245    2577 patch_prober.go:28] interesting pod/e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58-7xtq5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.91:15021/healthz/ready\": dial tcp 10.133.0.91:15021: connect: connection refused" start-of-body=
Sep 18 22:22:24.206402 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:22:24.206295    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58-7xtq5" podUID="9ca5b41e-920d-4dc0-9636-22d83ade195d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.91:15021/healthz/ready\": dial tcp 10.133.0.91:15021: connect: connection refused"
Sep 18 22:22:25.205761 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:22:25.205722    2577 patch_prober.go:28] interesting pod/e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58-7xtq5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.91:15021/healthz/ready\": dial tcp 10.133.0.91:15021: connect: connection refused" start-of-body=
Sep 18 22:22:25.206170 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:22:25.205779    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58-7xtq5" podUID="9ca5b41e-920d-4dc0-9636-22d83ade195d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.91:15021/healthz/ready\": dial tcp 10.133.0.91:15021: connect: connection refused"
Sep 18 22:22:26.205420 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:22:26.205366    2577 patch_prober.go:28] interesting pod/e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58-7xtq5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.91:15021/healthz/ready\": dial tcp 10.133.0.91:15021: connect: connection refused" start-of-body=
Sep 18 22:22:26.205604 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:22:26.205465    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58-7xtq5" podUID="9ca5b41e-920d-4dc0-9636-22d83ade195d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.91:15021/healthz/ready\": dial tcp 10.133.0.91:15021: connect: connection refused"
Sep 18 22:22:27.205737 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:22:27.205699    2577 patch_prober.go:28] interesting pod/e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58-7xtq5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.91:15021/healthz/ready\": dial tcp 10.133.0.91:15021: connect: connection refused" start-of-body=
Sep 18 22:22:27.206128 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:22:27.205754    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58-7xtq5" podUID="9ca5b41e-920d-4dc0-9636-22d83ade195d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.91:15021/healthz/ready\": dial tcp 10.133.0.91:15021: connect: connection refused"
Sep 18 22:22:28.205369 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:22:28.205332    2577 patch_prober.go:28] interesting pod/e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58-7xtq5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.91:15021/healthz/ready\": dial tcp 10.133.0.91:15021: connect: connection refused" start-of-body=
Sep 18 22:22:28.205635 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:22:28.205403    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58-7xtq5" podUID="9ca5b41e-920d-4dc0-9636-22d83ade195d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.91:15021/healthz/ready\": dial tcp 10.133.0.91:15021: connect: connection refused"
Sep 18 22:22:29.209663 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:22:29.209634    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58-7xtq5"
Sep 18 22:22:29.210097 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:22:29.210009    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58-7xtq5"
Sep 18 22:22:29.218176 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:22:29.218152    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58-7xtq5"
Sep 18 22:23:21.446927 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:23:21.446889    2577 scope.go:117] "RemoveContainer" containerID="b2d96f0d43d200be21fc362e14521d2fb6e8b924efff2be49ef846da588bce3b"
Sep 18 22:23:44.232953 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:23:44.232911    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-027c8100-5mqbj"]
Sep 18 22:23:44.236523 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:23:44.236498    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-027c8100-5mqbj"
Sep 18 22:23:44.238950 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:23:44.238928    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-9g7m4\""
Sep 18 22:23:44.261779 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:23:44.261753    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-027c8100-5mqbj"]
Sep 18 22:23:44.294588 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:23:44.294560    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0bab0e65-a9b5-4a53-90c8-ef3665f7f82c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-027c8100-5mqbj\" (UID: \"0bab0e65-a9b5-4a53-90c8-ef3665f7f82c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-027c8100-5mqbj"
Sep 18 22:23:44.396063 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:23:44.396030    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0bab0e65-a9b5-4a53-90c8-ef3665f7f82c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-027c8100-5mqbj\" (UID: \"0bab0e65-a9b5-4a53-90c8-ef3665f7f82c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-027c8100-5mqbj"
Sep 18 22:23:44.396738 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:23:44.396713    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0bab0e65-a9b5-4a53-90c8-ef3665f7f82c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-027c8100-5mqbj\" (UID: \"0bab0e65-a9b5-4a53-90c8-ef3665f7f82c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-027c8100-5mqbj"
Sep 18 22:23:44.546782 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:23:44.546696    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-027c8100-5mqbj"
Sep 18 22:23:44.838972 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:23:44.838946    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-027c8100-5mqbj"]
Sep 18 22:23:44.840538 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:23:44.840482    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bab0e65_a9b5_4a53_90c8_ef3665f7f82c.slice/crio-aa337fcca23b8d366fdd4ef0acd6886ef5b2b58ad4ed3350996c5faa5573f916 WatchSource:0}: Error finding container aa337fcca23b8d366fdd4ef0acd6886ef5b2b58ad4ed3350996c5faa5573f916: Status 404 returned error can't find the container with id aa337fcca23b8d366fdd4ef0acd6886ef5b2b58ad4ed3350996c5faa5573f916
Sep 18 22:23:45.009496 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:23:45.009463    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-027c8100-5mqbj" event={"ID":"0bab0e65-a9b5-4a53-90c8-ef3665f7f82c","Type":"ContainerStarted","Data":"aa337fcca23b8d366fdd4ef0acd6886ef5b2b58ad4ed3350996c5faa5573f916"}
Sep 18 22:23:46.017697 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:23:46.017666    2577 generic.go:356] "Generic (PLEG): container finished" podID="0bab0e65-a9b5-4a53-90c8-ef3665f7f82c" containerID="54f124668a344ef38ee6e99525df0fd38c823b811819d397b1f0dd5b4454e5ed" exitCode=0
Sep 18 22:23:46.018071 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:23:46.017750    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-027c8100-5mqbj" event={"ID":"0bab0e65-a9b5-4a53-90c8-ef3665f7f82c","Type":"ContainerDied","Data":"54f124668a344ef38ee6e99525df0fd38c823b811819d397b1f0dd5b4454e5ed"}
Sep 18 22:23:47.175744 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:23:47.175717    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-027c8100-5mqbj"
Sep 18 22:23:47.223589 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:23:47.223564    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0bab0e65-a9b5-4a53-90c8-ef3665f7f82c-maas-api-service-ca\") pod \"0bab0e65-a9b5-4a53-90c8-ef3665f7f82c\" (UID: \"0bab0e65-a9b5-4a53-90c8-ef3665f7f82c\") "
Sep 18 22:23:47.223961 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:23:47.223940    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0bab0e65-a9b5-4a53-90c8-ef3665f7f82c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0bab0e65-a9b5-4a53-90c8-ef3665f7f82c" (UID: "0bab0e65-a9b5-4a53-90c8-ef3665f7f82c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:23:47.325162 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:23:47.325127    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0bab0e65-a9b5-4a53-90c8-ef3665f7f82c-maas-api-service-ca\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:23:48.031964 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:23:48.031939    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-027c8100-5mqbj"
Sep 18 22:23:48.032133 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:23:48.031976    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-027c8100-5mqbj" event={"ID":"0bab0e65-a9b5-4a53-90c8-ef3665f7f82c","Type":"ContainerDied","Data":"aa337fcca23b8d366fdd4ef0acd6886ef5b2b58ad4ed3350996c5faa5573f916"}
Sep 18 22:23:48.032133 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:23:48.032019    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="aa337fcca23b8d366fdd4ef0acd6886ef5b2b58ad4ed3350996c5faa5573f916"
Sep 18 22:24:00.358991 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:24:00.358955    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-027c8100-5cf9c98645-cxtv7"]
Sep 18 22:24:00.359453 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:24:00.359227    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-027c8100-5cf9c98645-cxtv7" podUID="d4054c3a-b573-46fd-984d-45d1b885f44c" containerName="payload-processing" containerID="cri-o://7d6cf47fc2b8abdcad7ae7c0e85284b937e6860d419d38fb5092143b072d9aca" gracePeriod=30
Sep 18 22:24:00.637581 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:24:00.635491    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-027c8100-5cf9c98645-cxtv7"
Sep 18 22:24:00.766738 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:24:00.766703    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j765f\" (UniqueName: \"kubernetes.io/projected/d4054c3a-b573-46fd-984d-45d1b885f44c-kube-api-access-j765f\") pod \"d4054c3a-b573-46fd-984d-45d1b885f44c\" (UID: \"d4054c3a-b573-46fd-984d-45d1b885f44c\") "
Sep 18 22:24:00.766903 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:24:00.766817    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d4054c3a-b573-46fd-984d-45d1b885f44c-plugins-config-volume\") pod \"d4054c3a-b573-46fd-984d-45d1b885f44c\" (UID: \"d4054c3a-b573-46fd-984d-45d1b885f44c\") "
Sep 18 22:24:00.767182 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:24:00.767158    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4054c3a-b573-46fd-984d-45d1b885f44c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d4054c3a-b573-46fd-984d-45d1b885f44c" (UID: "d4054c3a-b573-46fd-984d-45d1b885f44c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:24:00.769053 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:24:00.769030    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4054c3a-b573-46fd-984d-45d1b885f44c-kube-api-access-j765f" (OuterVolumeSpecName: "kube-api-access-j765f") pod "d4054c3a-b573-46fd-984d-45d1b885f44c" (UID: "d4054c3a-b573-46fd-984d-45d1b885f44c"). InnerVolumeSpecName "kube-api-access-j765f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:24:00.792198 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:24:00.792176    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-027c8100-5mqbj"]
Sep 18 22:24:00.798048 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:24:00.798030    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-027c8100-5mqbj"]
Sep 18 22:24:00.868546 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:24:00.868516    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j765f\" (UniqueName: \"kubernetes.io/projected/d4054c3a-b573-46fd-984d-45d1b885f44c-kube-api-access-j765f\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:24:00.868546 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:24:00.868543    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d4054c3a-b573-46fd-984d-45d1b885f44c-plugins-config-volume\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:24:01.119055 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:24:01.119018    2577 generic.go:356] "Generic (PLEG): container finished" podID="d4054c3a-b573-46fd-984d-45d1b885f44c" containerID="7d6cf47fc2b8abdcad7ae7c0e85284b937e6860d419d38fb5092143b072d9aca" exitCode=0
Sep 18 22:24:01.119236 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:24:01.119058    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-027c8100-5cf9c98645-cxtv7" event={"ID":"d4054c3a-b573-46fd-984d-45d1b885f44c","Type":"ContainerDied","Data":"7d6cf47fc2b8abdcad7ae7c0e85284b937e6860d419d38fb5092143b072d9aca"}
Sep 18 22:24:01.119236 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:24:01.119079    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-027c8100-5cf9c98645-cxtv7"
Sep 18 22:24:01.119236 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:24:01.119124    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-027c8100-5cf9c98645-cxtv7" event={"ID":"d4054c3a-b573-46fd-984d-45d1b885f44c","Type":"ContainerDied","Data":"58301d5f4ff0b5764cb265c5a6ed7f37e7f8afeec536b6da306fe0b0073de08a"}
Sep 18 22:24:01.119236 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:24:01.119154    2577 scope.go:117] "RemoveContainer" containerID="7d6cf47fc2b8abdcad7ae7c0e85284b937e6860d419d38fb5092143b072d9aca"
Sep 18 22:24:01.129375 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:24:01.129357    2577 scope.go:117] "RemoveContainer" containerID="7d6cf47fc2b8abdcad7ae7c0e85284b937e6860d419d38fb5092143b072d9aca"
Sep 18 22:24:01.129695 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:24:01.129676    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d6cf47fc2b8abdcad7ae7c0e85284b937e6860d419d38fb5092143b072d9aca\": container with ID starting with 7d6cf47fc2b8abdcad7ae7c0e85284b937e6860d419d38fb5092143b072d9aca not found: ID does not exist" containerID="7d6cf47fc2b8abdcad7ae7c0e85284b937e6860d419d38fb5092143b072d9aca"
Sep 18 22:24:01.129752 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:24:01.129703    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d6cf47fc2b8abdcad7ae7c0e85284b937e6860d419d38fb5092143b072d9aca"} err="failed to get container status \"7d6cf47fc2b8abdcad7ae7c0e85284b937e6860d419d38fb5092143b072d9aca\": rpc error: code = NotFound desc = could not find container \"7d6cf47fc2b8abdcad7ae7c0e85284b937e6860d419d38fb5092143b072d9aca\": container with ID starting with 7d6cf47fc2b8abdcad7ae7c0e85284b937e6860d419d38fb5092143b072d9aca not found: ID does not exist"
Sep 18 22:24:01.140238 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:24:01.140216    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0bab0e65-a9b5-4a53-90c8-ef3665f7f82c" path="/var/lib/kubelet/pods/0bab0e65-a9b5-4a53-90c8-ef3665f7f82c/volumes"
Sep 18 22:24:01.149124 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:24:01.149092    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-027c8100-5cf9c98645-cxtv7"]
Sep 18 22:24:01.153552 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:24:01.153524    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-027c8100-5cf9c98645-cxtv7"]
Sep 18 22:24:03.140232 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:24:03.140201    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4054c3a-b573-46fd-984d-45d1b885f44c" path="/var/lib/kubelet/pods/d4054c3a-b573-46fd-984d-45d1b885f44c/volumes"
Sep 18 22:24:20.435147 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:24:20.435109    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-7f10d8/auth-test-model-7f10d8-kserve-64897c69c9-fzjxf"]
Sep 18 22:24:20.435681 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:24:20.435644    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4054c3a-b573-46fd-984d-45d1b885f44c" containerName="payload-processing"
Sep 18 22:24:20.435681 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:24:20.435660    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4054c3a-b573-46fd-984d-45d1b885f44c" containerName="payload-processing"
Sep 18 22:24:20.435681 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:24:20.435668    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0bab0e65-a9b5-4a53-90c8-ef3665f7f82c" containerName="revoke-keys"
Sep 18 22:24:20.435681 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:24:20.435674    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="0bab0e65-a9b5-4a53-90c8-ef3665f7f82c" containerName="revoke-keys"
Sep 18 22:24:20.435821 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:24:20.435760    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4054c3a-b573-46fd-984d-45d1b885f44c" containerName="payload-processing"
Sep 18 22:24:20.435821 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:24:20.435773    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="0bab0e65-a9b5-4a53-90c8-ef3665f7f82c" containerName="revoke-keys"
Sep 18 22:24:20.438861 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:24:20.438844    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-7f10d8/auth-test-model-7f10d8-kserve-64897c69c9-fzjxf"
Sep 18 22:24:20.442563 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:24:20.442536    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-7f10d8\"/\"openshift-service-ca.crt\""
Sep 18 22:24:20.442678 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:24:20.442610    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-7f10d8\"/\"auth-test-model-7f10d8-kserve-self-signed-certs\""
Sep 18 22:24:20.442678 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:24:20.442538    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-7f10d8\"/\"kube-root-ca.crt\""
Sep 18 22:24:20.442678 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:24:20.442633    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-7f10d8\"/\"default-dockercfg-hptzx\""
Sep 18 22:24:20.466270 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:24:20.466243    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-7f10d8/auth-test-model-7f10d8-kserve-64897c69c9-fzjxf"]
Sep 18 22:24:20.555308 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:24:20.555267    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ead4a87f-b7bd-4e3e-84be-19ba130f48ac-dshm\") pod \"auth-test-model-7f10d8-kserve-64897c69c9-fzjxf\" (UID: \"ead4a87f-b7bd-4e3e-84be-19ba130f48ac\") " pod="ai-tenant-e2e-shared-b-w3-7f10d8/auth-test-model-7f10d8-kserve-64897c69c9-fzjxf"
Sep 18 22:24:20.555527 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:24:20.555315    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77rjq\" (UniqueName: \"kubernetes.io/projected/ead4a87f-b7bd-4e3e-84be-19ba130f48ac-kube-api-access-77rjq\") pod \"auth-test-model-7f10d8-kserve-64897c69c9-fzjxf\" (UID: \"ead4a87f-b7bd-4e3e-84be-19ba130f48ac\") " pod="ai-tenant-e2e-shared-b-w3-7f10d8/auth-test-model-7f10d8-kserve-64897c69c9-fzjxf"
Sep 18 22:24:20.555527 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:24:20.555471    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ead4a87f-b7bd-4e3e-84be-19ba130f48ac-tmp-dir\") pod \"auth-test-model-7f10d8-kserve-64897c69c9-fzjxf\" (UID: \"ead4a87f-b7bd-4e3e-84be-19ba130f48ac\") " pod="ai-tenant-e2e-shared-b-w3-7f10d8/auth-test-model-7f10d8-kserve-64897c69c9-fzjxf"
Sep 18 22:24:20.555527 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:24:20.555522    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ead4a87f-b7bd-4e3e-84be-19ba130f48ac-home\") pod \"auth-test-model-7f10d8-kserve-64897c69c9-fzjxf\" (UID: \"ead4a87f-b7bd-4e3e-84be-19ba130f48ac\") " pod="ai-tenant-e2e-shared-b-w3-7f10d8/auth-test-model-7f10d8-kserve-64897c69c9-fzjxf"
Sep 18 22:24:20.555678 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:24:20.555598    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ead4a87f-b7bd-4e3e-84be-19ba130f48ac-tls-certs\") pod \"auth-test-model-7f10d8-kserve-64897c69c9-fzjxf\" (UID: \"ead4a87f-b7bd-4e3e-84be-19ba130f48ac\") " pod="ai-tenant-e2e-shared-b-w3-7f10d8/auth-test-model-7f10d8-kserve-64897c69c9-fzjxf"
Sep 18 22:24:20.555720 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:24:20.555676    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ead4a87f-b7bd-4e3e-84be-19ba130f48ac-model-cache\") pod \"auth-test-model-7f10d8-kserve-64897c69c9-fzjxf\" (UID: \"ead4a87f-b7bd-4e3e-84be-19ba130f48ac\") " pod="ai-tenant-e2e-shared-b-w3-7f10d8/auth-test-model-7f10d8-kserve-64897c69c9-fzjxf"
Sep 18 22:24:20.657387 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:24:20.657344    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ead4a87f-b7bd-4e3e-84be-19ba130f48ac-model-cache\") pod \"auth-test-model-7f10d8-kserve-64897c69c9-fzjxf\" (UID: \"ead4a87f-b7bd-4e3e-84be-19ba130f48ac\") " pod="ai-tenant-e2e-shared-b-w3-7f10d8/auth-test-model-7f10d8-kserve-64897c69c9-fzjxf"
Sep 18 22:24:20.657883 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:24:20.657859    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ead4a87f-b7bd-4e3e-84be-19ba130f48ac-dshm\") pod \"auth-test-model-7f10d8-kserve-64897c69c9-fzjxf\" (UID: \"ead4a87f-b7bd-4e3e-84be-19ba130f48ac\") " pod="ai-tenant-e2e-shared-b-w3-7f10d8/auth-test-model-7f10d8-kserve-64897c69c9-fzjxf"
Sep 18 22:24:20.658129 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:24:20.658111    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77rjq\" (UniqueName: \"kubernetes.io/projected/ead4a87f-b7bd-4e3e-84be-19ba130f48ac-kube-api-access-77rjq\") pod \"auth-test-model-7f10d8-kserve-64897c69c9-fzjxf\" (UID: \"ead4a87f-b7bd-4e3e-84be-19ba130f48ac\") " pod="ai-tenant-e2e-shared-b-w3-7f10d8/auth-test-model-7f10d8-kserve-64897c69c9-fzjxf"
Sep 18 22:24:20.658297 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:24:20.658281    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ead4a87f-b7bd-4e3e-84be-19ba130f48ac-tmp-dir\") pod \"auth-test-model-7f10d8-kserve-64897c69c9-fzjxf\" (UID: \"ead4a87f-b7bd-4e3e-84be-19ba130f48ac\") " pod="ai-tenant-e2e-shared-b-w3-7f10d8/auth-test-model-7f10d8-kserve-64897c69c9-fzjxf"
Sep 18 22:24:20.658438 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:24:20.658404    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ead4a87f-b7bd-4e3e-84be-19ba130f48ac-home\") pod \"auth-test-model-7f10d8-kserve-64897c69c9-fzjxf\" (UID: \"ead4a87f-b7bd-4e3e-84be-19ba130f48ac\") " pod="ai-tenant-e2e-shared-b-w3-7f10d8/auth-test-model-7f10d8-kserve-64897c69c9-fzjxf"
Sep 18 22:24:20.658600 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:24:20.658584    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ead4a87f-b7bd-4e3e-84be-19ba130f48ac-tls-certs\") pod \"auth-test-model-7f10d8-kserve-64897c69c9-fzjxf\" (UID: \"ead4a87f-b7bd-4e3e-84be-19ba130f48ac\") " pod="ai-tenant-e2e-shared-b-w3-7f10d8/auth-test-model-7f10d8-kserve-64897c69c9-fzjxf"
Sep 18 22:24:20.659889 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:24:20.659865    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ead4a87f-b7bd-4e3e-84be-19ba130f48ac-model-cache\") pod \"auth-test-model-7f10d8-kserve-64897c69c9-fzjxf\" (UID: \"ead4a87f-b7bd-4e3e-84be-19ba130f48ac\") " pod="ai-tenant-e2e-shared-b-w3-7f10d8/auth-test-model-7f10d8-kserve-64897c69c9-fzjxf"
Sep 18 22:24:20.661732 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:24:20.661711    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ead4a87f-b7bd-4e3e-84be-19ba130f48ac-tmp-dir\") pod \"auth-test-model-7f10d8-kserve-64897c69c9-fzjxf\" (UID: \"ead4a87f-b7bd-4e3e-84be-19ba130f48ac\") " pod="ai-tenant-e2e-shared-b-w3-7f10d8/auth-test-model-7f10d8-kserve-64897c69c9-fzjxf"
Sep 18 22:24:20.662133 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:24:20.662073    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ead4a87f-b7bd-4e3e-84be-19ba130f48ac-home\") pod \"auth-test-model-7f10d8-kserve-64897c69c9-fzjxf\" (UID: \"ead4a87f-b7bd-4e3e-84be-19ba130f48ac\") " pod="ai-tenant-e2e-shared-b-w3-7f10d8/auth-test-model-7f10d8-kserve-64897c69c9-fzjxf"
Sep 18 22:24:20.663379 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:24:20.663358    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ead4a87f-b7bd-4e3e-84be-19ba130f48ac-tls-certs\") pod \"auth-test-model-7f10d8-kserve-64897c69c9-fzjxf\" (UID: \"ead4a87f-b7bd-4e3e-84be-19ba130f48ac\") " pod="ai-tenant-e2e-shared-b-w3-7f10d8/auth-test-model-7f10d8-kserve-64897c69c9-fzjxf"
Sep 18 22:24:20.665246 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:24:20.664888    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ead4a87f-b7bd-4e3e-84be-19ba130f48ac-dshm\") pod \"auth-test-model-7f10d8-kserve-64897c69c9-fzjxf\" (UID: \"ead4a87f-b7bd-4e3e-84be-19ba130f48ac\") " pod="ai-tenant-e2e-shared-b-w3-7f10d8/auth-test-model-7f10d8-kserve-64897c69c9-fzjxf"
Sep 18 22:24:20.668658 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:24:20.668613    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-77rjq\" (UniqueName: \"kubernetes.io/projected/ead4a87f-b7bd-4e3e-84be-19ba130f48ac-kube-api-access-77rjq\") pod \"auth-test-model-7f10d8-kserve-64897c69c9-fzjxf\" (UID: \"ead4a87f-b7bd-4e3e-84be-19ba130f48ac\") " pod="ai-tenant-e2e-shared-b-w3-7f10d8/auth-test-model-7f10d8-kserve-64897c69c9-fzjxf"
Sep 18 22:24:20.749684 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:24:20.749604    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-7f10d8/auth-test-model-7f10d8-kserve-64897c69c9-fzjxf"
Sep 18 22:24:21.036386 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:24:21.036361    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-7f10d8/auth-test-model-7f10d8-kserve-64897c69c9-fzjxf"]
Sep 18 22:24:21.038228 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:24:21.038200    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podead4a87f_b7bd_4e3e_84be_19ba130f48ac.slice/crio-5c118acb7e59f3827fe865aac0a0e5f9785ee9d58b29fca6209cb6d4869ac7b0 WatchSource:0}: Error finding container 5c118acb7e59f3827fe865aac0a0e5f9785ee9d58b29fca6209cb6d4869ac7b0: Status 404 returned error can't find the container with id 5c118acb7e59f3827fe865aac0a0e5f9785ee9d58b29fca6209cb6d4869ac7b0
Sep 18 22:24:21.038378 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:24:21.038354    2577 manager.go:1116] Failed to create existing container: /kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podead4a87f_b7bd_4e3e_84be_19ba130f48ac.slice/crio-5c118acb7e59f3827fe865aac0a0e5f9785ee9d58b29fca6209cb6d4869ac7b0: Error finding container 5c118acb7e59f3827fe865aac0a0e5f9785ee9d58b29fca6209cb6d4869ac7b0: Status 404 returned error can't find the container with id 5c118acb7e59f3827fe865aac0a0e5f9785ee9d58b29fca6209cb6d4869ac7b0
Sep 18 22:24:21.254999 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:24:21.254966    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-7f10d8/auth-test-model-7f10d8-kserve-64897c69c9-fzjxf" event={"ID":"ead4a87f-b7bd-4e3e-84be-19ba130f48ac","Type":"ContainerStarted","Data":"811c96f5414a091eb5b60bc380641c2b3e42bd8626a10b0125b73c5c05498494"}
Sep 18 22:24:21.254999 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:24:21.255004    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-7f10d8/auth-test-model-7f10d8-kserve-64897c69c9-fzjxf" event={"ID":"ead4a87f-b7bd-4e3e-84be-19ba130f48ac","Type":"ContainerStarted","Data":"5c118acb7e59f3827fe865aac0a0e5f9785ee9d58b29fca6209cb6d4869ac7b0"}
Sep 18 22:24:21.315632 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:24:21.315570    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-7f10d8/auth-test-model-7f10d8-kserve-64897c69c9-fzjxf" podStartSLOduration=1.315555244 podStartE2EDuration="1.315555244s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:24:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:24:21.315271846 +0000 UTC m=+1440.634943901" watchObservedRunningTime="2026-09-18 22:24:21.315555244 +0000 UTC m=+1440.635227325"
Sep 18 22:24:30.749854 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:24:30.749812    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-7f10d8/auth-test-model-7f10d8-kserve-64897c69c9-fzjxf"
Sep 18 22:24:30.750366 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:24:30.749875    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-7f10d8/auth-test-model-7f10d8-kserve-64897c69c9-fzjxf"
Sep 18 22:24:30.762880 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:24:30.762855    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-7f10d8/auth-test-model-7f10d8-kserve-64897c69c9-fzjxf"
Sep 18 22:24:31.330751 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:24:31.330712    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-7f10d8/auth-test-model-7f10d8-kserve-64897c69c9-fzjxf"
Sep 18 22:24:54.820486 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:24:54.820440    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-027c8100-openshift-default-85cdb9b7cb-fl25x"]
Sep 18 22:24:54.821039 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:24:54.820729    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-027c8100-openshift-default-85cdb9b7cb-fl25x" podUID="fd344548-dc1f-4a5a-9813-a05fee6ade30" containerName="istio-proxy" containerID="cri-o://5aa838f67b47d88aa56a21e0af50c6fece548687c4c4d22507cf127b7c5c9d84" gracePeriod=30
Sep 18 22:25:00.092645 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:00.092577    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-027c8100-openshift-default-85cdb9b7cb-fl25x"
Sep 18 22:25:00.186225 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:00.186193    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9cdbw\" (UniqueName: \"kubernetes.io/projected/fd344548-dc1f-4a5a-9813-a05fee6ade30-kube-api-access-9cdbw\") pod \"fd344548-dc1f-4a5a-9813-a05fee6ade30\" (UID: \"fd344548-dc1f-4a5a-9813-a05fee6ade30\") "
Sep 18 22:25:00.186399 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:00.186251    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fd344548-dc1f-4a5a-9813-a05fee6ade30-istio-podinfo\") pod \"fd344548-dc1f-4a5a-9813-a05fee6ade30\" (UID: \"fd344548-dc1f-4a5a-9813-a05fee6ade30\") "
Sep 18 22:25:00.186399 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:00.186270    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fd344548-dc1f-4a5a-9813-a05fee6ade30-istiod-ca-cert\") pod \"fd344548-dc1f-4a5a-9813-a05fee6ade30\" (UID: \"fd344548-dc1f-4a5a-9813-a05fee6ade30\") "
Sep 18 22:25:00.186399 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:00.186339    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd344548-dc1f-4a5a-9813-a05fee6ade30-workload-certs\") pod \"fd344548-dc1f-4a5a-9813-a05fee6ade30\" (UID: \"fd344548-dc1f-4a5a-9813-a05fee6ade30\") "
Sep 18 22:25:00.186399 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:00.186388    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd344548-dc1f-4a5a-9813-a05fee6ade30-workload-socket\") pod \"fd344548-dc1f-4a5a-9813-a05fee6ade30\" (UID: \"fd344548-dc1f-4a5a-9813-a05fee6ade30\") "
Sep 18 22:25:00.186636 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:00.186448    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd344548-dc1f-4a5a-9813-a05fee6ade30-credential-socket\") pod \"fd344548-dc1f-4a5a-9813-a05fee6ade30\" (UID: \"fd344548-dc1f-4a5a-9813-a05fee6ade30\") "
Sep 18 22:25:00.186636 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:00.186496    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fd344548-dc1f-4a5a-9813-a05fee6ade30-istio-token\") pod \"fd344548-dc1f-4a5a-9813-a05fee6ade30\" (UID: \"fd344548-dc1f-4a5a-9813-a05fee6ade30\") "
Sep 18 22:25:00.186636 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:00.186519    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fd344548-dc1f-4a5a-9813-a05fee6ade30-istio-envoy\") pod \"fd344548-dc1f-4a5a-9813-a05fee6ade30\" (UID: \"fd344548-dc1f-4a5a-9813-a05fee6ade30\") "
Sep 18 22:25:00.186636 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:00.186578    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fd344548-dc1f-4a5a-9813-a05fee6ade30-istio-data\") pod \"fd344548-dc1f-4a5a-9813-a05fee6ade30\" (UID: \"fd344548-dc1f-4a5a-9813-a05fee6ade30\") "
Sep 18 22:25:00.186850 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:00.186716    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd344548-dc1f-4a5a-9813-a05fee6ade30-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fd344548-dc1f-4a5a-9813-a05fee6ade30" (UID: "fd344548-dc1f-4a5a-9813-a05fee6ade30"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:25:00.186850 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:00.186741    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd344548-dc1f-4a5a-9813-a05fee6ade30-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fd344548-dc1f-4a5a-9813-a05fee6ade30" (UID: "fd344548-dc1f-4a5a-9813-a05fee6ade30"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:25:00.186850 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:00.186743    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd344548-dc1f-4a5a-9813-a05fee6ade30-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fd344548-dc1f-4a5a-9813-a05fee6ade30" (UID: "fd344548-dc1f-4a5a-9813-a05fee6ade30"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:25:00.187020 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:00.186900    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd344548-dc1f-4a5a-9813-a05fee6ade30-istio-data" (OuterVolumeSpecName: "istio-data") pod "fd344548-dc1f-4a5a-9813-a05fee6ade30" (UID: "fd344548-dc1f-4a5a-9813-a05fee6ade30"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:25:00.187095 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:00.187019    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd344548-dc1f-4a5a-9813-a05fee6ade30-workload-certs\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:25:00.187095 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:00.187036    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd344548-dc1f-4a5a-9813-a05fee6ade30-workload-socket\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:25:00.187095 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:00.187050    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fd344548-dc1f-4a5a-9813-a05fee6ade30-istio-data\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:25:00.187095 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:00.187063    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fd344548-dc1f-4a5a-9813-a05fee6ade30-istiod-ca-cert\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:25:00.187095 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:00.187080    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd344548-dc1f-4a5a-9813-a05fee6ade30-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fd344548-dc1f-4a5a-9813-a05fee6ade30" (UID: "fd344548-dc1f-4a5a-9813-a05fee6ade30"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:25:00.188723 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:00.188697    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd344548-dc1f-4a5a-9813-a05fee6ade30-istio-token" (OuterVolumeSpecName: "istio-token") pod "fd344548-dc1f-4a5a-9813-a05fee6ade30" (UID: "fd344548-dc1f-4a5a-9813-a05fee6ade30"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:25:00.188889 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:00.188868    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd344548-dc1f-4a5a-9813-a05fee6ade30-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fd344548-dc1f-4a5a-9813-a05fee6ade30" (UID: "fd344548-dc1f-4a5a-9813-a05fee6ade30"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:25:00.189133 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:00.189112    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fd344548-dc1f-4a5a-9813-a05fee6ade30-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fd344548-dc1f-4a5a-9813-a05fee6ade30" (UID: "fd344548-dc1f-4a5a-9813-a05fee6ade30"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 18 22:25:00.189238 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:00.189142    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd344548-dc1f-4a5a-9813-a05fee6ade30-kube-api-access-9cdbw" (OuterVolumeSpecName: "kube-api-access-9cdbw") pod "fd344548-dc1f-4a5a-9813-a05fee6ade30" (UID: "fd344548-dc1f-4a5a-9813-a05fee6ade30"). InnerVolumeSpecName "kube-api-access-9cdbw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:25:00.287712 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:00.287683    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9cdbw\" (UniqueName: \"kubernetes.io/projected/fd344548-dc1f-4a5a-9813-a05fee6ade30-kube-api-access-9cdbw\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:25:00.287712 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:00.287708    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fd344548-dc1f-4a5a-9813-a05fee6ade30-istio-podinfo\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:25:00.287712 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:00.287719    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd344548-dc1f-4a5a-9813-a05fee6ade30-credential-socket\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:25:00.287712 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:00.287728    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fd344548-dc1f-4a5a-9813-a05fee6ade30-istio-token\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:25:00.288029 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:00.287736    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fd344548-dc1f-4a5a-9813-a05fee6ade30-istio-envoy\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:25:00.516869 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:00.516777    2577 generic.go:356] "Generic (PLEG): container finished" podID="fd344548-dc1f-4a5a-9813-a05fee6ade30" containerID="5aa838f67b47d88aa56a21e0af50c6fece548687c4c4d22507cf127b7c5c9d84" exitCode=0
Sep 18 22:25:00.516869 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:00.516831    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-027c8100-openshift-default-85cdb9b7cb-fl25x"
Sep 18 22:25:00.517065 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:00.516860    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-027c8100-openshift-default-85cdb9b7cb-fl25x" event={"ID":"fd344548-dc1f-4a5a-9813-a05fee6ade30","Type":"ContainerDied","Data":"5aa838f67b47d88aa56a21e0af50c6fece548687c4c4d22507cf127b7c5c9d84"}
Sep 18 22:25:00.517065 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:00.516926    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-027c8100-openshift-default-85cdb9b7cb-fl25x" event={"ID":"fd344548-dc1f-4a5a-9813-a05fee6ade30","Type":"ContainerDied","Data":"d9a6226dc60fcf5463b77d70a8d5cfb900fab30a1ae3f7b0d21653b3cd0ac6c3"}
Sep 18 22:25:00.517065 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:00.516949    2577 scope.go:117] "RemoveContainer" containerID="5aa838f67b47d88aa56a21e0af50c6fece548687c4c4d22507cf127b7c5c9d84"
Sep 18 22:25:00.527423 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:00.527394    2577 scope.go:117] "RemoveContainer" containerID="07c0a486413fd2e48fe2af36a7c369c12c6d13a89e15f4e89bd3ac61a559b2d7"
Sep 18 22:25:00.536220 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:00.536200    2577 scope.go:117] "RemoveContainer" containerID="5aa838f67b47d88aa56a21e0af50c6fece548687c4c4d22507cf127b7c5c9d84"
Sep 18 22:25:00.536518 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:25:00.536499    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5aa838f67b47d88aa56a21e0af50c6fece548687c4c4d22507cf127b7c5c9d84\": container with ID starting with 5aa838f67b47d88aa56a21e0af50c6fece548687c4c4d22507cf127b7c5c9d84 not found: ID does not exist" containerID="5aa838f67b47d88aa56a21e0af50c6fece548687c4c4d22507cf127b7c5c9d84"
Sep 18 22:25:00.536579 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:00.536527    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5aa838f67b47d88aa56a21e0af50c6fece548687c4c4d22507cf127b7c5c9d84"} err="failed to get container status \"5aa838f67b47d88aa56a21e0af50c6fece548687c4c4d22507cf127b7c5c9d84\": rpc error: code = NotFound desc = could not find container \"5aa838f67b47d88aa56a21e0af50c6fece548687c4c4d22507cf127b7c5c9d84\": container with ID starting with 5aa838f67b47d88aa56a21e0af50c6fece548687c4c4d22507cf127b7c5c9d84 not found: ID does not exist"
Sep 18 22:25:00.536579 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:00.536542    2577 scope.go:117] "RemoveContainer" containerID="07c0a486413fd2e48fe2af36a7c369c12c6d13a89e15f4e89bd3ac61a559b2d7"
Sep 18 22:25:00.536787 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:25:00.536771    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07c0a486413fd2e48fe2af36a7c369c12c6d13a89e15f4e89bd3ac61a559b2d7\": container with ID starting with 07c0a486413fd2e48fe2af36a7c369c12c6d13a89e15f4e89bd3ac61a559b2d7 not found: ID does not exist" containerID="07c0a486413fd2e48fe2af36a7c369c12c6d13a89e15f4e89bd3ac61a559b2d7"
Sep 18 22:25:00.536829 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:00.536793    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07c0a486413fd2e48fe2af36a7c369c12c6d13a89e15f4e89bd3ac61a559b2d7"} err="failed to get container status \"07c0a486413fd2e48fe2af36a7c369c12c6d13a89e15f4e89bd3ac61a559b2d7\": rpc error: code = NotFound desc = could not find container \"07c0a486413fd2e48fe2af36a7c369c12c6d13a89e15f4e89bd3ac61a559b2d7\": container with ID starting with 07c0a486413fd2e48fe2af36a7c369c12c6d13a89e15f4e89bd3ac61a559b2d7 not found: ID does not exist"
Sep 18 22:25:00.551477 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:00.551450    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-027c8100-openshift-default-85cdb9b7cb-fl25x"]
Sep 18 22:25:00.559526 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:00.559504    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-027c8100-openshift-default-85cdb9b7cb-fl25x"]
Sep 18 22:25:01.141987 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:01.141958    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd344548-dc1f-4a5a-9813-a05fee6ade30" path="/var/lib/kubelet/pods/fd344548-dc1f-4a5a-9813-a05fee6ade30/volumes"
Sep 18 22:25:21.220261 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:21.220233    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-h2847_125d5bb0-54b7-4dff-aa80-e737f2791533/console-operator/1.log"
Sep 18 22:25:21.223810 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:21.223788    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-h2847_125d5bb0-54b7-4dff-aa80-e737f2791533/console-operator/1.log"
Sep 18 22:25:21.486217 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:21.486133    2577 scope.go:117] "RemoveContainer" containerID="02bb391c70ae2ec2df16ef3c2c98e5b21bab3943cfe48bd48c0aa5e58d802290"
Sep 18 22:25:36.957241 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:36.957201    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-59b357-s6t6s"]
Sep 18 22:25:36.957749 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:36.957660    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd344548-dc1f-4a5a-9813-a05fee6ade30" containerName="istio-proxy"
Sep 18 22:25:36.957749 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:36.957672    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd344548-dc1f-4a5a-9813-a05fee6ade30" containerName="istio-proxy"
Sep 18 22:25:36.957916 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:36.957752    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd344548-dc1f-4a5a-9813-a05fee6ade30" containerName="istio-proxy"
Sep 18 22:25:36.957916 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:36.957765    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd344548-dc1f-4a5a-9813-a05fee6ade30" containerName="istio-proxy"
Sep 18 22:25:36.962100 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:36.962078    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-59b357-s6t6s"
Sep 18 22:25:36.964699 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:36.964677    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-9g7m4\""
Sep 18 22:25:36.969247 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:36.969226    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-59b357-s6t6s"]
Sep 18 22:25:37.067942 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:37.067908    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c87c0676-cfcd-4e94-9535-3a5713220aba-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w4-59b357-s6t6s\" (UID: \"c87c0676-cfcd-4e94-9535-3a5713220aba\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-59b357-s6t6s"
Sep 18 22:25:37.169662 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:37.169629    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c87c0676-cfcd-4e94-9535-3a5713220aba-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w4-59b357-s6t6s\" (UID: \"c87c0676-cfcd-4e94-9535-3a5713220aba\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-59b357-s6t6s"
Sep 18 22:25:37.170280 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:37.170253    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c87c0676-cfcd-4e94-9535-3a5713220aba-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w4-59b357-s6t6s\" (UID: \"c87c0676-cfcd-4e94-9535-3a5713220aba\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-59b357-s6t6s"
Sep 18 22:25:37.274081 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:37.273993    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-59b357-s6t6s"
Sep 18 22:25:37.560650 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:37.560624    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-59b357-s6t6s"]
Sep 18 22:25:37.562925 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:25:37.562898    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc87c0676_cfcd_4e94_9535_3a5713220aba.slice/crio-c774736d83fa1fe1e33d15082d25e14aa32e1022210b90d4d4f6d17e555b871e WatchSource:0}: Error finding container c774736d83fa1fe1e33d15082d25e14aa32e1022210b90d4d4f6d17e555b871e: Status 404 returned error can't find the container with id c774736d83fa1fe1e33d15082d25e14aa32e1022210b90d4d4f6d17e555b871e
Sep 18 22:25:37.760021 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:37.759916    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-59b357-s6t6s" event={"ID":"c87c0676-cfcd-4e94-9535-3a5713220aba","Type":"ContainerStarted","Data":"c774736d83fa1fe1e33d15082d25e14aa32e1022210b90d4d4f6d17e555b871e"}
Sep 18 22:25:38.769001 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:38.768897    2577 generic.go:356] "Generic (PLEG): container finished" podID="c87c0676-cfcd-4e94-9535-3a5713220aba" containerID="52763b4837a0332a08dbecf7dd648e6dc0b1d828974058e9054c15856b8f9866" exitCode=0
Sep 18 22:25:38.769001 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:38.768985    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-59b357-s6t6s" event={"ID":"c87c0676-cfcd-4e94-9535-3a5713220aba","Type":"ContainerDied","Data":"52763b4837a0332a08dbecf7dd648e6dc0b1d828974058e9054c15856b8f9866"}
Sep 18 22:25:39.927176 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:39.927150    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-59b357-s6t6s"
Sep 18 22:25:39.997226 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:39.997188    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c87c0676-cfcd-4e94-9535-3a5713220aba-maas-api-service-ca\") pod \"c87c0676-cfcd-4e94-9535-3a5713220aba\" (UID: \"c87c0676-cfcd-4e94-9535-3a5713220aba\") "
Sep 18 22:25:39.997647 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:39.997621    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c87c0676-cfcd-4e94-9535-3a5713220aba-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c87c0676-cfcd-4e94-9535-3a5713220aba" (UID: "c87c0676-cfcd-4e94-9535-3a5713220aba"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:25:40.098860 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:40.098825    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c87c0676-cfcd-4e94-9535-3a5713220aba-maas-api-service-ca\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:25:40.783936 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:40.783899    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-59b357-s6t6s" event={"ID":"c87c0676-cfcd-4e94-9535-3a5713220aba","Type":"ContainerDied","Data":"c774736d83fa1fe1e33d15082d25e14aa32e1022210b90d4d4f6d17e555b871e"}
Sep 18 22:25:40.783936 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:40.783933    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-59b357-s6t6s"
Sep 18 22:25:40.784156 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:40.783962    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c774736d83fa1fe1e33d15082d25e14aa32e1022210b90d4d4f6d17e555b871e"
Sep 18 22:25:53.282015 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:53.281983    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-4583f0-openshift-default-68b9ddcbdd-gn8hz"]
Sep 18 22:25:53.282623 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:53.282441    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd344548-dc1f-4a5a-9813-a05fee6ade30" containerName="istio-proxy"
Sep 18 22:25:53.282623 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:53.282453    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd344548-dc1f-4a5a-9813-a05fee6ade30" containerName="istio-proxy"
Sep 18 22:25:53.282623 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:53.282477    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c87c0676-cfcd-4e94-9535-3a5713220aba" containerName="revoke-keys"
Sep 18 22:25:53.282623 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:53.282483    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c87c0676-cfcd-4e94-9535-3a5713220aba" containerName="revoke-keys"
Sep 18 22:25:53.282623 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:53.282566    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c87c0676-cfcd-4e94-9535-3a5713220aba" containerName="revoke-keys"
Sep 18 22:25:53.285668 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:53.285643    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-4583f0-openshift-default-68b9ddcbdd-gn8hz"
Sep 18 22:25:53.290827 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:53.290806    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-4583f0-openshift-default-dockercfg-f84hl\""
Sep 18 22:25:53.345625 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:53.345595    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsvrm\" (UniqueName: \"kubernetes.io/projected/3bc51d61-6a1c-416c-a87a-7017d24fd250-kube-api-access-fsvrm\") pod \"e2e-api-a-4583f0-openshift-default-68b9ddcbdd-gn8hz\" (UID: \"3bc51d61-6a1c-416c-a87a-7017d24fd250\") " pod="openshift-ingress/e2e-api-a-4583f0-openshift-default-68b9ddcbdd-gn8hz"
Sep 18 22:25:53.345820 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:53.345638    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3bc51d61-6a1c-416c-a87a-7017d24fd250-workload-certs\") pod \"e2e-api-a-4583f0-openshift-default-68b9ddcbdd-gn8hz\" (UID: \"3bc51d61-6a1c-416c-a87a-7017d24fd250\") " pod="openshift-ingress/e2e-api-a-4583f0-openshift-default-68b9ddcbdd-gn8hz"
Sep 18 22:25:53.345820 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:53.345691    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3bc51d61-6a1c-416c-a87a-7017d24fd250-istio-envoy\") pod \"e2e-api-a-4583f0-openshift-default-68b9ddcbdd-gn8hz\" (UID: \"3bc51d61-6a1c-416c-a87a-7017d24fd250\") " pod="openshift-ingress/e2e-api-a-4583f0-openshift-default-68b9ddcbdd-gn8hz"
Sep 18 22:25:53.345820 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:53.345711    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3bc51d61-6a1c-416c-a87a-7017d24fd250-workload-socket\") pod \"e2e-api-a-4583f0-openshift-default-68b9ddcbdd-gn8hz\" (UID: \"3bc51d61-6a1c-416c-a87a-7017d24fd250\") " pod="openshift-ingress/e2e-api-a-4583f0-openshift-default-68b9ddcbdd-gn8hz"
Sep 18 22:25:53.345820 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:53.345742    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3bc51d61-6a1c-416c-a87a-7017d24fd250-istio-data\") pod \"e2e-api-a-4583f0-openshift-default-68b9ddcbdd-gn8hz\" (UID: \"3bc51d61-6a1c-416c-a87a-7017d24fd250\") " pod="openshift-ingress/e2e-api-a-4583f0-openshift-default-68b9ddcbdd-gn8hz"
Sep 18 22:25:53.345820 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:53.345782    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3bc51d61-6a1c-416c-a87a-7017d24fd250-istio-podinfo\") pod \"e2e-api-a-4583f0-openshift-default-68b9ddcbdd-gn8hz\" (UID: \"3bc51d61-6a1c-416c-a87a-7017d24fd250\") " pod="openshift-ingress/e2e-api-a-4583f0-openshift-default-68b9ddcbdd-gn8hz"
Sep 18 22:25:53.345820 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:53.345809    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3bc51d61-6a1c-416c-a87a-7017d24fd250-istio-token\") pod \"e2e-api-a-4583f0-openshift-default-68b9ddcbdd-gn8hz\" (UID: \"3bc51d61-6a1c-416c-a87a-7017d24fd250\") " pod="openshift-ingress/e2e-api-a-4583f0-openshift-default-68b9ddcbdd-gn8hz"
Sep 18 22:25:53.346157 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:53.345858    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3bc51d61-6a1c-416c-a87a-7017d24fd250-istiod-ca-cert\") pod \"e2e-api-a-4583f0-openshift-default-68b9ddcbdd-gn8hz\" (UID: \"3bc51d61-6a1c-416c-a87a-7017d24fd250\") " pod="openshift-ingress/e2e-api-a-4583f0-openshift-default-68b9ddcbdd-gn8hz"
Sep 18 22:25:53.346157 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:53.345899    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3bc51d61-6a1c-416c-a87a-7017d24fd250-credential-socket\") pod \"e2e-api-a-4583f0-openshift-default-68b9ddcbdd-gn8hz\" (UID: \"3bc51d61-6a1c-416c-a87a-7017d24fd250\") " pod="openshift-ingress/e2e-api-a-4583f0-openshift-default-68b9ddcbdd-gn8hz"
Sep 18 22:25:53.354645 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:53.354594    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-4583f0-openshift-default-68b9ddcbdd-gn8hz"]
Sep 18 22:25:53.357135 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:53.357113    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-59b357-29829495-vx8qx"]
Sep 18 22:25:53.373920 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:53.373894    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-59b357-29829495-vx8qx"]
Sep 18 22:25:53.447222 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:53.447192    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3bc51d61-6a1c-416c-a87a-7017d24fd250-istio-podinfo\") pod \"e2e-api-a-4583f0-openshift-default-68b9ddcbdd-gn8hz\" (UID: \"3bc51d61-6a1c-416c-a87a-7017d24fd250\") " pod="openshift-ingress/e2e-api-a-4583f0-openshift-default-68b9ddcbdd-gn8hz"
Sep 18 22:25:53.447544 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:53.447509    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3bc51d61-6a1c-416c-a87a-7017d24fd250-istio-token\") pod \"e2e-api-a-4583f0-openshift-default-68b9ddcbdd-gn8hz\" (UID: \"3bc51d61-6a1c-416c-a87a-7017d24fd250\") " pod="openshift-ingress/e2e-api-a-4583f0-openshift-default-68b9ddcbdd-gn8hz"
Sep 18 22:25:53.448306 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:53.448073    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3bc51d61-6a1c-416c-a87a-7017d24fd250-istiod-ca-cert\") pod \"e2e-api-a-4583f0-openshift-default-68b9ddcbdd-gn8hz\" (UID: \"3bc51d61-6a1c-416c-a87a-7017d24fd250\") " pod="openshift-ingress/e2e-api-a-4583f0-openshift-default-68b9ddcbdd-gn8hz"
Sep 18 22:25:53.448823 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:53.448468    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3bc51d61-6a1c-416c-a87a-7017d24fd250-credential-socket\") pod \"e2e-api-a-4583f0-openshift-default-68b9ddcbdd-gn8hz\" (UID: \"3bc51d61-6a1c-416c-a87a-7017d24fd250\") " pod="openshift-ingress/e2e-api-a-4583f0-openshift-default-68b9ddcbdd-gn8hz"
Sep 18 22:25:53.448823 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:53.448528    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fsvrm\" (UniqueName: \"kubernetes.io/projected/3bc51d61-6a1c-416c-a87a-7017d24fd250-kube-api-access-fsvrm\") pod \"e2e-api-a-4583f0-openshift-default-68b9ddcbdd-gn8hz\" (UID: \"3bc51d61-6a1c-416c-a87a-7017d24fd250\") " pod="openshift-ingress/e2e-api-a-4583f0-openshift-default-68b9ddcbdd-gn8hz"
Sep 18 22:25:53.448823 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:53.448570    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3bc51d61-6a1c-416c-a87a-7017d24fd250-workload-certs\") pod \"e2e-api-a-4583f0-openshift-default-68b9ddcbdd-gn8hz\" (UID: \"3bc51d61-6a1c-416c-a87a-7017d24fd250\") " pod="openshift-ingress/e2e-api-a-4583f0-openshift-default-68b9ddcbdd-gn8hz"
Sep 18 22:25:53.448823 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:53.448645    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3bc51d61-6a1c-416c-a87a-7017d24fd250-istio-envoy\") pod \"e2e-api-a-4583f0-openshift-default-68b9ddcbdd-gn8hz\" (UID: \"3bc51d61-6a1c-416c-a87a-7017d24fd250\") " pod="openshift-ingress/e2e-api-a-4583f0-openshift-default-68b9ddcbdd-gn8hz"
Sep 18 22:25:53.448823 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:53.448676    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3bc51d61-6a1c-416c-a87a-7017d24fd250-workload-socket\") pod \"e2e-api-a-4583f0-openshift-default-68b9ddcbdd-gn8hz\" (UID: \"3bc51d61-6a1c-416c-a87a-7017d24fd250\") " pod="openshift-ingress/e2e-api-a-4583f0-openshift-default-68b9ddcbdd-gn8hz"
Sep 18 22:25:53.448823 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:53.448714    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3bc51d61-6a1c-416c-a87a-7017d24fd250-istio-data\") pod \"e2e-api-a-4583f0-openshift-default-68b9ddcbdd-gn8hz\" (UID: \"3bc51d61-6a1c-416c-a87a-7017d24fd250\") " pod="openshift-ingress/e2e-api-a-4583f0-openshift-default-68b9ddcbdd-gn8hz"
Sep 18 22:25:53.449208 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:53.448840    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3bc51d61-6a1c-416c-a87a-7017d24fd250-istiod-ca-cert\") pod \"e2e-api-a-4583f0-openshift-default-68b9ddcbdd-gn8hz\" (UID: \"3bc51d61-6a1c-416c-a87a-7017d24fd250\") " pod="openshift-ingress/e2e-api-a-4583f0-openshift-default-68b9ddcbdd-gn8hz"
Sep 18 22:25:53.449208 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:53.449009    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3bc51d61-6a1c-416c-a87a-7017d24fd250-workload-certs\") pod \"e2e-api-a-4583f0-openshift-default-68b9ddcbdd-gn8hz\" (UID: \"3bc51d61-6a1c-416c-a87a-7017d24fd250\") " pod="openshift-ingress/e2e-api-a-4583f0-openshift-default-68b9ddcbdd-gn8hz"
Sep 18 22:25:53.449641 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:53.449570    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3bc51d61-6a1c-416c-a87a-7017d24fd250-istio-data\") pod \"e2e-api-a-4583f0-openshift-default-68b9ddcbdd-gn8hz\" (UID: \"3bc51d61-6a1c-416c-a87a-7017d24fd250\") " pod="openshift-ingress/e2e-api-a-4583f0-openshift-default-68b9ddcbdd-gn8hz"
Sep 18 22:25:53.449924 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:53.449901    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3bc51d61-6a1c-416c-a87a-7017d24fd250-workload-socket\") pod \"e2e-api-a-4583f0-openshift-default-68b9ddcbdd-gn8hz\" (UID: \"3bc51d61-6a1c-416c-a87a-7017d24fd250\") " pod="openshift-ingress/e2e-api-a-4583f0-openshift-default-68b9ddcbdd-gn8hz"
Sep 18 22:25:53.450051 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:53.450032    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3bc51d61-6a1c-416c-a87a-7017d24fd250-credential-socket\") pod \"e2e-api-a-4583f0-openshift-default-68b9ddcbdd-gn8hz\" (UID: \"3bc51d61-6a1c-416c-a87a-7017d24fd250\") " pod="openshift-ingress/e2e-api-a-4583f0-openshift-default-68b9ddcbdd-gn8hz"
Sep 18 22:25:53.452220 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:53.452060    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3bc51d61-6a1c-416c-a87a-7017d24fd250-istio-podinfo\") pod \"e2e-api-a-4583f0-openshift-default-68b9ddcbdd-gn8hz\" (UID: \"3bc51d61-6a1c-416c-a87a-7017d24fd250\") " pod="openshift-ingress/e2e-api-a-4583f0-openshift-default-68b9ddcbdd-gn8hz"
Sep 18 22:25:53.455217 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:53.455177    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3bc51d61-6a1c-416c-a87a-7017d24fd250-istio-envoy\") pod \"e2e-api-a-4583f0-openshift-default-68b9ddcbdd-gn8hz\" (UID: \"3bc51d61-6a1c-416c-a87a-7017d24fd250\") " pod="openshift-ingress/e2e-api-a-4583f0-openshift-default-68b9ddcbdd-gn8hz"
Sep 18 22:25:53.467564 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:53.467517    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsvrm\" (UniqueName: \"kubernetes.io/projected/3bc51d61-6a1c-416c-a87a-7017d24fd250-kube-api-access-fsvrm\") pod \"e2e-api-a-4583f0-openshift-default-68b9ddcbdd-gn8hz\" (UID: \"3bc51d61-6a1c-416c-a87a-7017d24fd250\") " pod="openshift-ingress/e2e-api-a-4583f0-openshift-default-68b9ddcbdd-gn8hz"
Sep 18 22:25:53.480064 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:53.480017    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3bc51d61-6a1c-416c-a87a-7017d24fd250-istio-token\") pod \"e2e-api-a-4583f0-openshift-default-68b9ddcbdd-gn8hz\" (UID: \"3bc51d61-6a1c-416c-a87a-7017d24fd250\") " pod="openshift-ingress/e2e-api-a-4583f0-openshift-default-68b9ddcbdd-gn8hz"
Sep 18 22:25:53.598315 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:53.598285    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-4583f0-openshift-default-68b9ddcbdd-gn8hz"
Sep 18 22:25:53.910137 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:53.910038    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-4583f0-openshift-default-68b9ddcbdd-gn8hz"]
Sep 18 22:25:53.914221 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:25:53.914190    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bc51d61_6a1c_416c_a87a_7017d24fd250.slice/crio-a854e19e5275070620a09622c6bb55216066ba9a956a9cd78c56ca9c52b3cc9b WatchSource:0}: Error finding container a854e19e5275070620a09622c6bb55216066ba9a956a9cd78c56ca9c52b3cc9b: Status 404 returned error can't find the container with id a854e19e5275070620a09622c6bb55216066ba9a956a9cd78c56ca9c52b3cc9b
Sep 18 22:25:53.917157 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:53.917121    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:25:53.917260 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:53.917191    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:25:53.917260 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:53.917218    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:25:54.048541 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:54.048504    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-59b357-s6t6s"]
Sep 18 22:25:54.053031 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:54.053000    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-59b357-s6t6s"]
Sep 18 22:25:54.882859 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:54.882825    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-4583f0-openshift-default-68b9ddcbdd-gn8hz" event={"ID":"3bc51d61-6a1c-416c-a87a-7017d24fd250","Type":"ContainerStarted","Data":"02fa01de2df3e90d8a5357f1ded13434684e99e199c68088a6d7665e2ed753c9"}
Sep 18 22:25:54.883340 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:54.882883    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-4583f0-openshift-default-68b9ddcbdd-gn8hz" event={"ID":"3bc51d61-6a1c-416c-a87a-7017d24fd250","Type":"ContainerStarted","Data":"a854e19e5275070620a09622c6bb55216066ba9a956a9cd78c56ca9c52b3cc9b"}
Sep 18 22:25:54.921344 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:54.921278    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-4583f0-openshift-default-68b9ddcbdd-gn8hz" podStartSLOduration=1.921264271 podStartE2EDuration="1.921264271s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:25:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:25:54.918505618 +0000 UTC m=+1534.238177673" watchObservedRunningTime="2026-09-18 22:25:54.921264271 +0000 UTC m=+1534.240936325"
Sep 18 22:25:55.140297 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:55.140219    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a2f0aa1-ad17-42fa-b5eb-e25f2942963e" path="/var/lib/kubelet/pods/5a2f0aa1-ad17-42fa-b5eb-e25f2942963e/volumes"
Sep 18 22:25:55.140575 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:55.140561    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c87c0676-cfcd-4e94-9535-3a5713220aba" path="/var/lib/kubelet/pods/c87c0676-cfcd-4e94-9535-3a5713220aba/volumes"
Sep 18 22:25:55.599184 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:55.599154    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-4583f0-openshift-default-68b9ddcbdd-gn8hz"
Sep 18 22:25:55.604029 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:55.604004    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-4583f0-openshift-default-68b9ddcbdd-gn8hz"
Sep 18 22:25:55.889968 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:55.889868    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-4583f0-openshift-default-68b9ddcbdd-gn8hz"
Sep 18 22:25:55.890819 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:25:55.890800    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-4583f0-openshift-default-68b9ddcbdd-gn8hz"
Sep 18 22:26:04.234250 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:04.234219    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-59b357-openshift-default-84b8cd88c8-vjhfk"]
Sep 18 22:26:04.234656 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:04.234481    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-59b357-openshift-default-84b8cd88c8-vjhfk" podUID="7967e7b5-3983-40bb-b739-b54755b69979" containerName="istio-proxy" containerID="cri-o://571d200eb286d4c086a75d5299085c4f275303d95cb8a6f514bdfa77f52b0273" gracePeriod=30
Sep 18 22:26:09.498020 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:09.497996    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-59b357-openshift-default-84b8cd88c8-vjhfk"
Sep 18 22:26:09.615346 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:09.615317    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7967e7b5-3983-40bb-b739-b54755b69979-workload-socket\") pod \"7967e7b5-3983-40bb-b739-b54755b69979\" (UID: \"7967e7b5-3983-40bb-b739-b54755b69979\") "
Sep 18 22:26:09.615547 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:09.615372    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7967e7b5-3983-40bb-b739-b54755b69979-istiod-ca-cert\") pod \"7967e7b5-3983-40bb-b739-b54755b69979\" (UID: \"7967e7b5-3983-40bb-b739-b54755b69979\") "
Sep 18 22:26:09.615547 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:09.615397    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7967e7b5-3983-40bb-b739-b54755b69979-workload-certs\") pod \"7967e7b5-3983-40bb-b739-b54755b69979\" (UID: \"7967e7b5-3983-40bb-b739-b54755b69979\") "
Sep 18 22:26:09.615547 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:09.615436    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7967e7b5-3983-40bb-b739-b54755b69979-istio-envoy\") pod \"7967e7b5-3983-40bb-b739-b54755b69979\" (UID: \"7967e7b5-3983-40bb-b739-b54755b69979\") "
Sep 18 22:26:09.615547 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:09.615473    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7967e7b5-3983-40bb-b739-b54755b69979-istio-token\") pod \"7967e7b5-3983-40bb-b739-b54755b69979\" (UID: \"7967e7b5-3983-40bb-b739-b54755b69979\") "
Sep 18 22:26:09.615547 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:09.615497    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-njdnw\" (UniqueName: \"kubernetes.io/projected/7967e7b5-3983-40bb-b739-b54755b69979-kube-api-access-njdnw\") pod \"7967e7b5-3983-40bb-b739-b54755b69979\" (UID: \"7967e7b5-3983-40bb-b739-b54755b69979\") "
Sep 18 22:26:09.615814 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:09.615568    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7967e7b5-3983-40bb-b739-b54755b69979-istio-podinfo\") pod \"7967e7b5-3983-40bb-b739-b54755b69979\" (UID: \"7967e7b5-3983-40bb-b739-b54755b69979\") "
Sep 18 22:26:09.615814 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:09.615609    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7967e7b5-3983-40bb-b739-b54755b69979-istio-data\") pod \"7967e7b5-3983-40bb-b739-b54755b69979\" (UID: \"7967e7b5-3983-40bb-b739-b54755b69979\") "
Sep 18 22:26:09.615814 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:09.615690    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7967e7b5-3983-40bb-b739-b54755b69979-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7967e7b5-3983-40bb-b739-b54755b69979" (UID: "7967e7b5-3983-40bb-b739-b54755b69979"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:26:09.615814 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:09.615702    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7967e7b5-3983-40bb-b739-b54755b69979-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7967e7b5-3983-40bb-b739-b54755b69979" (UID: "7967e7b5-3983-40bb-b739-b54755b69979"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:26:09.615814 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:09.615771    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7967e7b5-3983-40bb-b739-b54755b69979-credential-socket\") pod \"7967e7b5-3983-40bb-b739-b54755b69979\" (UID: \"7967e7b5-3983-40bb-b739-b54755b69979\") "
Sep 18 22:26:09.616052 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:09.615853    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7967e7b5-3983-40bb-b739-b54755b69979-istio-data" (OuterVolumeSpecName: "istio-data") pod "7967e7b5-3983-40bb-b739-b54755b69979" (UID: "7967e7b5-3983-40bb-b739-b54755b69979"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:26:09.616052 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:09.615977    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7967e7b5-3983-40bb-b739-b54755b69979-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7967e7b5-3983-40bb-b739-b54755b69979" (UID: "7967e7b5-3983-40bb-b739-b54755b69979"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:26:09.616150 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:09.616116    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7967e7b5-3983-40bb-b739-b54755b69979-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7967e7b5-3983-40bb-b739-b54755b69979" (UID: "7967e7b5-3983-40bb-b739-b54755b69979"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:26:09.616269 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:09.616248    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7967e7b5-3983-40bb-b739-b54755b69979-workload-socket\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:26:09.616524 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:09.616276    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7967e7b5-3983-40bb-b739-b54755b69979-istiod-ca-cert\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:26:09.616524 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:09.616290    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7967e7b5-3983-40bb-b739-b54755b69979-workload-certs\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:26:09.616524 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:09.616302    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7967e7b5-3983-40bb-b739-b54755b69979-istio-data\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:26:09.616524 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:09.616314    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7967e7b5-3983-40bb-b739-b54755b69979-credential-socket\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:26:09.618037 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:09.618012    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7967e7b5-3983-40bb-b739-b54755b69979-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7967e7b5-3983-40bb-b739-b54755b69979" (UID: "7967e7b5-3983-40bb-b739-b54755b69979"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:26:09.618180 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:09.618151    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7967e7b5-3983-40bb-b739-b54755b69979-kube-api-access-njdnw" (OuterVolumeSpecName: "kube-api-access-njdnw") pod "7967e7b5-3983-40bb-b739-b54755b69979" (UID: "7967e7b5-3983-40bb-b739-b54755b69979"). InnerVolumeSpecName "kube-api-access-njdnw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:26:09.618317 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:09.618300    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7967e7b5-3983-40bb-b739-b54755b69979-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7967e7b5-3983-40bb-b739-b54755b69979" (UID: "7967e7b5-3983-40bb-b739-b54755b69979"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 18 22:26:09.618376 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:09.618347    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7967e7b5-3983-40bb-b739-b54755b69979-istio-token" (OuterVolumeSpecName: "istio-token") pod "7967e7b5-3983-40bb-b739-b54755b69979" (UID: "7967e7b5-3983-40bb-b739-b54755b69979"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:26:09.717123 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:09.717091    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7967e7b5-3983-40bb-b739-b54755b69979-istio-envoy\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:26:09.717123 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:09.717118    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7967e7b5-3983-40bb-b739-b54755b69979-istio-token\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:26:09.717123 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:09.717127    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-njdnw\" (UniqueName: \"kubernetes.io/projected/7967e7b5-3983-40bb-b739-b54755b69979-kube-api-access-njdnw\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:26:09.717344 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:09.717137    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7967e7b5-3983-40bb-b739-b54755b69979-istio-podinfo\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:26:09.985572 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:09.985491    2577 generic.go:356] "Generic (PLEG): container finished" podID="7967e7b5-3983-40bb-b739-b54755b69979" containerID="571d200eb286d4c086a75d5299085c4f275303d95cb8a6f514bdfa77f52b0273" exitCode=0
Sep 18 22:26:09.985572 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:09.985537    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-59b357-openshift-default-84b8cd88c8-vjhfk"
Sep 18 22:26:09.985751 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:09.985575    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-59b357-openshift-default-84b8cd88c8-vjhfk" event={"ID":"7967e7b5-3983-40bb-b739-b54755b69979","Type":"ContainerDied","Data":"571d200eb286d4c086a75d5299085c4f275303d95cb8a6f514bdfa77f52b0273"}
Sep 18 22:26:09.985751 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:09.985632    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-59b357-openshift-default-84b8cd88c8-vjhfk" event={"ID":"7967e7b5-3983-40bb-b739-b54755b69979","Type":"ContainerDied","Data":"5c90ea2b94029896a05523346f758cbee6cf3851bc37c72f29e0e60a2c27b83c"}
Sep 18 22:26:09.985751 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:09.985658    2577 scope.go:117] "RemoveContainer" containerID="571d200eb286d4c086a75d5299085c4f275303d95cb8a6f514bdfa77f52b0273"
Sep 18 22:26:09.995881 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:09.995863    2577 scope.go:117] "RemoveContainer" containerID="d19bcb384c1bd5fa144827669a012b6057a6bb637b72fc4e67337ea1dfbe9b14"
Sep 18 22:26:10.004709 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:10.004692    2577 scope.go:117] "RemoveContainer" containerID="571d200eb286d4c086a75d5299085c4f275303d95cb8a6f514bdfa77f52b0273"
Sep 18 22:26:10.004966 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:26:10.004942    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"571d200eb286d4c086a75d5299085c4f275303d95cb8a6f514bdfa77f52b0273\": container with ID starting with 571d200eb286d4c086a75d5299085c4f275303d95cb8a6f514bdfa77f52b0273 not found: ID does not exist" containerID="571d200eb286d4c086a75d5299085c4f275303d95cb8a6f514bdfa77f52b0273"
Sep 18 22:26:10.005012 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:10.004972    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"571d200eb286d4c086a75d5299085c4f275303d95cb8a6f514bdfa77f52b0273"} err="failed to get container status \"571d200eb286d4c086a75d5299085c4f275303d95cb8a6f514bdfa77f52b0273\": rpc error: code = NotFound desc = could not find container \"571d200eb286d4c086a75d5299085c4f275303d95cb8a6f514bdfa77f52b0273\": container with ID starting with 571d200eb286d4c086a75d5299085c4f275303d95cb8a6f514bdfa77f52b0273 not found: ID does not exist"
Sep 18 22:26:10.005012 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:10.004988    2577 scope.go:117] "RemoveContainer" containerID="d19bcb384c1bd5fa144827669a012b6057a6bb637b72fc4e67337ea1dfbe9b14"
Sep 18 22:26:10.005196 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:26:10.005182    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d19bcb384c1bd5fa144827669a012b6057a6bb637b72fc4e67337ea1dfbe9b14\": container with ID starting with d19bcb384c1bd5fa144827669a012b6057a6bb637b72fc4e67337ea1dfbe9b14 not found: ID does not exist" containerID="d19bcb384c1bd5fa144827669a012b6057a6bb637b72fc4e67337ea1dfbe9b14"
Sep 18 22:26:10.005239 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:10.005198    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d19bcb384c1bd5fa144827669a012b6057a6bb637b72fc4e67337ea1dfbe9b14"} err="failed to get container status \"d19bcb384c1bd5fa144827669a012b6057a6bb637b72fc4e67337ea1dfbe9b14\": rpc error: code = NotFound desc = could not find container \"d19bcb384c1bd5fa144827669a012b6057a6bb637b72fc4e67337ea1dfbe9b14\": container with ID starting with d19bcb384c1bd5fa144827669a012b6057a6bb637b72fc4e67337ea1dfbe9b14 not found: ID does not exist"
Sep 18 22:26:10.010206 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:10.010187    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-59b357-openshift-default-84b8cd88c8-vjhfk"]
Sep 18 22:26:10.015298 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:10.015275    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-59b357-openshift-default-84b8cd88c8-vjhfk"]
Sep 18 22:26:11.143086 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:11.143054    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7967e7b5-3983-40bb-b739-b54755b69979" path="/var/lib/kubelet/pods/7967e7b5-3983-40bb-b739-b54755b69979/volumes"
Sep 18 22:26:21.514721 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:21.514692    2577 scope.go:117] "RemoveContainer" containerID="caccbf94c5a96a975e1976ffa6b14be849a4e94076f7f48bfc80fd3b09fc07e3"
Sep 18 22:26:24.117380 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:24.117302    2577 generic.go:356] "Generic (PLEG): container finished" podID="3bc51d61-6a1c-416c-a87a-7017d24fd250" containerID="02fa01de2df3e90d8a5357f1ded13434684e99e199c68088a6d7665e2ed753c9" exitCode=0
Sep 18 22:26:24.117881 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:24.117377    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-4583f0-openshift-default-68b9ddcbdd-gn8hz" event={"ID":"3bc51d61-6a1c-416c-a87a-7017d24fd250","Type":"ContainerDied","Data":"02fa01de2df3e90d8a5357f1ded13434684e99e199c68088a6d7665e2ed753c9"}
Sep 18 22:26:24.117946 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:24.117916    2577 scope.go:117] "RemoveContainer" containerID="02fa01de2df3e90d8a5357f1ded13434684e99e199c68088a6d7665e2ed753c9"
Sep 18 22:26:24.119072 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:24.119045    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:26:24.119126 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:24.119112    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:26:24.119161 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:24.119146    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:26:25.129163 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:25.129119    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-4583f0-openshift-default-68b9ddcbdd-gn8hz" event={"ID":"3bc51d61-6a1c-416c-a87a-7017d24fd250","Type":"ContainerStarted","Data":"945aa89adeb4905292ab4dce354a19bb77fefed3cf1f80431156b64b4ae0b288"}
Sep 18 22:26:25.599273 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:25.599235    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-4583f0-openshift-default-68b9ddcbdd-gn8hz"
Sep 18 22:26:25.600237 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:25.600215    2577 patch_prober.go:28] interesting pod/e2e-api-a-4583f0-openshift-default-68b9ddcbdd-gn8hz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.95:15021/healthz/ready\": dial tcp 10.133.0.95:15021: connect: connection refused" start-of-body=
Sep 18 22:26:25.600344 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:25.600261    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-4583f0-openshift-default-68b9ddcbdd-gn8hz" podUID="3bc51d61-6a1c-416c-a87a-7017d24fd250" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.95:15021/healthz/ready\": dial tcp 10.133.0.95:15021: connect: connection refused"
Sep 18 22:26:25.890500 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:25.890380    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-4583f0-openshift-default-68b9ddcbdd-gn8hz"
Sep 18 22:26:26.598629 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:26.598590    2577 patch_prober.go:28] interesting pod/e2e-api-a-4583f0-openshift-default-68b9ddcbdd-gn8hz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.95:15021/healthz/ready\": dial tcp 10.133.0.95:15021: connect: connection refused" start-of-body=
Sep 18 22:26:26.599170 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:26.598651    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-4583f0-openshift-default-68b9ddcbdd-gn8hz" podUID="3bc51d61-6a1c-416c-a87a-7017d24fd250" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.95:15021/healthz/ready\": dial tcp 10.133.0.95:15021: connect: connection refused"
Sep 18 22:26:27.599089 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:27.599051    2577 patch_prober.go:28] interesting pod/e2e-api-a-4583f0-openshift-default-68b9ddcbdd-gn8hz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.95:15021/healthz/ready\": dial tcp 10.133.0.95:15021: connect: connection refused" start-of-body=
Sep 18 22:26:27.599526 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:27.599118    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-4583f0-openshift-default-68b9ddcbdd-gn8hz" podUID="3bc51d61-6a1c-416c-a87a-7017d24fd250" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.95:15021/healthz/ready\": dial tcp 10.133.0.95:15021: connect: connection refused"
Sep 18 22:26:27.704042 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:27.704011    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-b981e2-openshift-default-68877f56f6-sm5ms"]
Sep 18 22:26:27.704646 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:27.704631    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7967e7b5-3983-40bb-b739-b54755b69979" containerName="istio-proxy"
Sep 18 22:26:27.704741 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:27.704733    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="7967e7b5-3983-40bb-b739-b54755b69979" containerName="istio-proxy"
Sep 18 22:26:27.704805 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:27.704799    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7967e7b5-3983-40bb-b739-b54755b69979" containerName="istio-proxy"
Sep 18 22:26:27.704854 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:27.704848    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="7967e7b5-3983-40bb-b739-b54755b69979" containerName="istio-proxy"
Sep 18 22:26:27.704985 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:27.704976    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="7967e7b5-3983-40bb-b739-b54755b69979" containerName="istio-proxy"
Sep 18 22:26:27.708320 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:27.708304    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-b981e2-openshift-default-68877f56f6-sm5ms"
Sep 18 22:26:27.711330 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:27.711108    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-b981e2-openshift-default-dockercfg-2nmnr\""
Sep 18 22:26:27.721861 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:27.721838    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-b981e2-openshift-default-68877f56f6-sm5ms"]
Sep 18 22:26:27.802496 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:27.802461    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f2332048-f29f-4929-99a2-f3c1169a8943-istio-data\") pod \"e2e-api-b-b981e2-openshift-default-68877f56f6-sm5ms\" (UID: \"f2332048-f29f-4929-99a2-f3c1169a8943\") " pod="openshift-ingress/e2e-api-b-b981e2-openshift-default-68877f56f6-sm5ms"
Sep 18 22:26:27.802847 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:27.802824    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f2332048-f29f-4929-99a2-f3c1169a8943-istiod-ca-cert\") pod \"e2e-api-b-b981e2-openshift-default-68877f56f6-sm5ms\" (UID: \"f2332048-f29f-4929-99a2-f3c1169a8943\") " pod="openshift-ingress/e2e-api-b-b981e2-openshift-default-68877f56f6-sm5ms"
Sep 18 22:26:27.802994 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:27.802979    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f2332048-f29f-4929-99a2-f3c1169a8943-istio-podinfo\") pod \"e2e-api-b-b981e2-openshift-default-68877f56f6-sm5ms\" (UID: \"f2332048-f29f-4929-99a2-f3c1169a8943\") " pod="openshift-ingress/e2e-api-b-b981e2-openshift-default-68877f56f6-sm5ms"
Sep 18 22:26:27.803146 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:27.803131    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2332048-f29f-4929-99a2-f3c1169a8943-credential-socket\") pod \"e2e-api-b-b981e2-openshift-default-68877f56f6-sm5ms\" (UID: \"f2332048-f29f-4929-99a2-f3c1169a8943\") " pod="openshift-ingress/e2e-api-b-b981e2-openshift-default-68877f56f6-sm5ms"
Sep 18 22:26:27.803456 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:27.803392    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f2332048-f29f-4929-99a2-f3c1169a8943-workload-certs\") pod \"e2e-api-b-b981e2-openshift-default-68877f56f6-sm5ms\" (UID: \"f2332048-f29f-4929-99a2-f3c1169a8943\") " pod="openshift-ingress/e2e-api-b-b981e2-openshift-default-68877f56f6-sm5ms"
Sep 18 22:26:27.803621 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:27.803603    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f2332048-f29f-4929-99a2-f3c1169a8943-istio-envoy\") pod \"e2e-api-b-b981e2-openshift-default-68877f56f6-sm5ms\" (UID: \"f2332048-f29f-4929-99a2-f3c1169a8943\") " pod="openshift-ingress/e2e-api-b-b981e2-openshift-default-68877f56f6-sm5ms"
Sep 18 22:26:27.803932 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:27.803909    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f2332048-f29f-4929-99a2-f3c1169a8943-istio-token\") pod \"e2e-api-b-b981e2-openshift-default-68877f56f6-sm5ms\" (UID: \"f2332048-f29f-4929-99a2-f3c1169a8943\") " pod="openshift-ingress/e2e-api-b-b981e2-openshift-default-68877f56f6-sm5ms"
Sep 18 22:26:27.804079 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:27.804064    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzxs4\" (UniqueName: \"kubernetes.io/projected/f2332048-f29f-4929-99a2-f3c1169a8943-kube-api-access-xzxs4\") pod \"e2e-api-b-b981e2-openshift-default-68877f56f6-sm5ms\" (UID: \"f2332048-f29f-4929-99a2-f3c1169a8943\") " pod="openshift-ingress/e2e-api-b-b981e2-openshift-default-68877f56f6-sm5ms"
Sep 18 22:26:27.804231 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:27.804215    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2332048-f29f-4929-99a2-f3c1169a8943-workload-socket\") pod \"e2e-api-b-b981e2-openshift-default-68877f56f6-sm5ms\" (UID: \"f2332048-f29f-4929-99a2-f3c1169a8943\") " pod="openshift-ingress/e2e-api-b-b981e2-openshift-default-68877f56f6-sm5ms"
Sep 18 22:26:27.905787 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:27.905705    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f2332048-f29f-4929-99a2-f3c1169a8943-istiod-ca-cert\") pod \"e2e-api-b-b981e2-openshift-default-68877f56f6-sm5ms\" (UID: \"f2332048-f29f-4929-99a2-f3c1169a8943\") " pod="openshift-ingress/e2e-api-b-b981e2-openshift-default-68877f56f6-sm5ms"
Sep 18 22:26:27.905999 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:27.905983    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f2332048-f29f-4929-99a2-f3c1169a8943-istio-podinfo\") pod \"e2e-api-b-b981e2-openshift-default-68877f56f6-sm5ms\" (UID: \"f2332048-f29f-4929-99a2-f3c1169a8943\") " pod="openshift-ingress/e2e-api-b-b981e2-openshift-default-68877f56f6-sm5ms"
Sep 18 22:26:27.906117 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:27.906106    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2332048-f29f-4929-99a2-f3c1169a8943-credential-socket\") pod \"e2e-api-b-b981e2-openshift-default-68877f56f6-sm5ms\" (UID: \"f2332048-f29f-4929-99a2-f3c1169a8943\") " pod="openshift-ingress/e2e-api-b-b981e2-openshift-default-68877f56f6-sm5ms"
Sep 18 22:26:27.906197 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:27.906188    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f2332048-f29f-4929-99a2-f3c1169a8943-workload-certs\") pod \"e2e-api-b-b981e2-openshift-default-68877f56f6-sm5ms\" (UID: \"f2332048-f29f-4929-99a2-f3c1169a8943\") " pod="openshift-ingress/e2e-api-b-b981e2-openshift-default-68877f56f6-sm5ms"
Sep 18 22:26:27.906282 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:27.906272    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f2332048-f29f-4929-99a2-f3c1169a8943-istio-envoy\") pod \"e2e-api-b-b981e2-openshift-default-68877f56f6-sm5ms\" (UID: \"f2332048-f29f-4929-99a2-f3c1169a8943\") " pod="openshift-ingress/e2e-api-b-b981e2-openshift-default-68877f56f6-sm5ms"
Sep 18 22:26:27.906348 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:27.906318    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f2332048-f29f-4929-99a2-f3c1169a8943-istiod-ca-cert\") pod \"e2e-api-b-b981e2-openshift-default-68877f56f6-sm5ms\" (UID: \"f2332048-f29f-4929-99a2-f3c1169a8943\") " pod="openshift-ingress/e2e-api-b-b981e2-openshift-default-68877f56f6-sm5ms"
Sep 18 22:26:27.906506 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:27.906338    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f2332048-f29f-4929-99a2-f3c1169a8943-istio-token\") pod \"e2e-api-b-b981e2-openshift-default-68877f56f6-sm5ms\" (UID: \"f2332048-f29f-4929-99a2-f3c1169a8943\") " pod="openshift-ingress/e2e-api-b-b981e2-openshift-default-68877f56f6-sm5ms"
Sep 18 22:26:27.906506 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:27.906442    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzxs4\" (UniqueName: \"kubernetes.io/projected/f2332048-f29f-4929-99a2-f3c1169a8943-kube-api-access-xzxs4\") pod \"e2e-api-b-b981e2-openshift-default-68877f56f6-sm5ms\" (UID: \"f2332048-f29f-4929-99a2-f3c1169a8943\") " pod="openshift-ingress/e2e-api-b-b981e2-openshift-default-68877f56f6-sm5ms"
Sep 18 22:26:27.906648 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:27.906508    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2332048-f29f-4929-99a2-f3c1169a8943-workload-socket\") pod \"e2e-api-b-b981e2-openshift-default-68877f56f6-sm5ms\" (UID: \"f2332048-f29f-4929-99a2-f3c1169a8943\") " pod="openshift-ingress/e2e-api-b-b981e2-openshift-default-68877f56f6-sm5ms"
Sep 18 22:26:27.906648 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:27.906512    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2332048-f29f-4929-99a2-f3c1169a8943-credential-socket\") pod \"e2e-api-b-b981e2-openshift-default-68877f56f6-sm5ms\" (UID: \"f2332048-f29f-4929-99a2-f3c1169a8943\") " pod="openshift-ingress/e2e-api-b-b981e2-openshift-default-68877f56f6-sm5ms"
Sep 18 22:26:27.906648 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:27.906550    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f2332048-f29f-4929-99a2-f3c1169a8943-istio-data\") pod \"e2e-api-b-b981e2-openshift-default-68877f56f6-sm5ms\" (UID: \"f2332048-f29f-4929-99a2-f3c1169a8943\") " pod="openshift-ingress/e2e-api-b-b981e2-openshift-default-68877f56f6-sm5ms"
Sep 18 22:26:27.906648 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:27.906557    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f2332048-f29f-4929-99a2-f3c1169a8943-workload-certs\") pod \"e2e-api-b-b981e2-openshift-default-68877f56f6-sm5ms\" (UID: \"f2332048-f29f-4929-99a2-f3c1169a8943\") " pod="openshift-ingress/e2e-api-b-b981e2-openshift-default-68877f56f6-sm5ms"
Sep 18 22:26:27.907030 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:27.907010    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2332048-f29f-4929-99a2-f3c1169a8943-workload-socket\") pod \"e2e-api-b-b981e2-openshift-default-68877f56f6-sm5ms\" (UID: \"f2332048-f29f-4929-99a2-f3c1169a8943\") " pod="openshift-ingress/e2e-api-b-b981e2-openshift-default-68877f56f6-sm5ms"
Sep 18 22:26:27.907104 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:27.907059    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f2332048-f29f-4929-99a2-f3c1169a8943-istio-data\") pod \"e2e-api-b-b981e2-openshift-default-68877f56f6-sm5ms\" (UID: \"f2332048-f29f-4929-99a2-f3c1169a8943\") " pod="openshift-ingress/e2e-api-b-b981e2-openshift-default-68877f56f6-sm5ms"
Sep 18 22:26:27.908797 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:27.908774    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f2332048-f29f-4929-99a2-f3c1169a8943-istio-envoy\") pod \"e2e-api-b-b981e2-openshift-default-68877f56f6-sm5ms\" (UID: \"f2332048-f29f-4929-99a2-f3c1169a8943\") " pod="openshift-ingress/e2e-api-b-b981e2-openshift-default-68877f56f6-sm5ms"
Sep 18 22:26:27.908967 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:27.908944    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f2332048-f29f-4929-99a2-f3c1169a8943-istio-podinfo\") pod \"e2e-api-b-b981e2-openshift-default-68877f56f6-sm5ms\" (UID: \"f2332048-f29f-4929-99a2-f3c1169a8943\") " pod="openshift-ingress/e2e-api-b-b981e2-openshift-default-68877f56f6-sm5ms"
Sep 18 22:26:27.916342 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:27.916319    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f2332048-f29f-4929-99a2-f3c1169a8943-istio-token\") pod \"e2e-api-b-b981e2-openshift-default-68877f56f6-sm5ms\" (UID: \"f2332048-f29f-4929-99a2-f3c1169a8943\") " pod="openshift-ingress/e2e-api-b-b981e2-openshift-default-68877f56f6-sm5ms"
Sep 18 22:26:27.918099 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:27.918078    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzxs4\" (UniqueName: \"kubernetes.io/projected/f2332048-f29f-4929-99a2-f3c1169a8943-kube-api-access-xzxs4\") pod \"e2e-api-b-b981e2-openshift-default-68877f56f6-sm5ms\" (UID: \"f2332048-f29f-4929-99a2-f3c1169a8943\") " pod="openshift-ingress/e2e-api-b-b981e2-openshift-default-68877f56f6-sm5ms"
Sep 18 22:26:28.020712 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:28.020677    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-b981e2-openshift-default-68877f56f6-sm5ms"
Sep 18 22:26:28.339514 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:28.339492    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-b981e2-openshift-default-68877f56f6-sm5ms"]
Sep 18 22:26:28.341539 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:26:28.341509    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2332048_f29f_4929_99a2_f3c1169a8943.slice/crio-6e070f4dafb99ed13689c93fe5ccae3ea8f3773902e2db274db7182f0e4fb307 WatchSource:0}: Error finding container 6e070f4dafb99ed13689c93fe5ccae3ea8f3773902e2db274db7182f0e4fb307: Status 404 returned error can't find the container with id 6e070f4dafb99ed13689c93fe5ccae3ea8f3773902e2db274db7182f0e4fb307
Sep 18 22:26:28.343907 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:28.343866    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:26:28.344034 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:28.343955    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:26:28.344034 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:28.344004    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:26:28.599500 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:28.599422    2577 patch_prober.go:28] interesting pod/e2e-api-a-4583f0-openshift-default-68b9ddcbdd-gn8hz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.95:15021/healthz/ready\": dial tcp 10.133.0.95:15021: connect: connection refused" start-of-body=
Sep 18 22:26:28.599918 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:28.599890    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-4583f0-openshift-default-68b9ddcbdd-gn8hz" podUID="3bc51d61-6a1c-416c-a87a-7017d24fd250" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.95:15021/healthz/ready\": dial tcp 10.133.0.95:15021: connect: connection refused"
Sep 18 22:26:29.178401 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:29.178359    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-b981e2-openshift-default-68877f56f6-sm5ms" event={"ID":"f2332048-f29f-4929-99a2-f3c1169a8943","Type":"ContainerStarted","Data":"7178cc526180bda6fae51635718eaeffbdcb82eb3827699c80205a5b31338550"}
Sep 18 22:26:29.178611 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:29.178450    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-b981e2-openshift-default-68877f56f6-sm5ms" event={"ID":"f2332048-f29f-4929-99a2-f3c1169a8943","Type":"ContainerStarted","Data":"6e070f4dafb99ed13689c93fe5ccae3ea8f3773902e2db274db7182f0e4fb307"}
Sep 18 22:26:29.204028 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:29.203975    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-b981e2-openshift-default-68877f56f6-sm5ms" podStartSLOduration=2.203961375 podStartE2EDuration="2.203961375s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:26:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:26:29.200939948 +0000 UTC m=+1568.520612002" watchObservedRunningTime="2026-09-18 22:26:29.203961375 +0000 UTC m=+1568.523633429"
Sep 18 22:26:29.599145 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:29.599109    2577 patch_prober.go:28] interesting pod/e2e-api-a-4583f0-openshift-default-68b9ddcbdd-gn8hz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.95:15021/healthz/ready\": dial tcp 10.133.0.95:15021: connect: connection refused" start-of-body=
Sep 18 22:26:29.599331 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:29.599176    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-4583f0-openshift-default-68b9ddcbdd-gn8hz" podUID="3bc51d61-6a1c-416c-a87a-7017d24fd250" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.95:15021/healthz/ready\": dial tcp 10.133.0.95:15021: connect: connection refused"
Sep 18 22:26:30.021585 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:30.021495    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-b981e2-openshift-default-68877f56f6-sm5ms"
Sep 18 22:26:30.026920 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:30.026896    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-b981e2-openshift-default-68877f56f6-sm5ms"
Sep 18 22:26:30.185259 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:30.185224    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-b981e2-openshift-default-68877f56f6-sm5ms"
Sep 18 22:26:30.186322 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:30.186306    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-b981e2-openshift-default-68877f56f6-sm5ms"
Sep 18 22:26:30.636114 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:30.636085    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-4583f0-openshift-default-68b9ddcbdd-gn8hz"
Sep 18 22:26:30.637842 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:26:30.637816    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-4583f0-openshift-default-68b9ddcbdd-gn8hz"
Sep 18 22:27:04.196851 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:04.196808    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4583f0-fngwl"]
Sep 18 22:27:04.197637 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:04.197611    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="7967e7b5-3983-40bb-b739-b54755b69979" containerName="istio-proxy"
Sep 18 22:27:04.200732 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:04.200705    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4583f0-fngwl"
Sep 18 22:27:04.212925 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:04.212906    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-9g7m4\""
Sep 18 22:27:04.222784 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:04.222762    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4583f0-fngwl"]
Sep 18 22:27:04.286761 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:04.286730    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b5bda1c7-67ad-407a-a800-16c9ad2eb2a1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-4583f0-fngwl\" (UID: \"b5bda1c7-67ad-407a-a800-16c9ad2eb2a1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4583f0-fngwl"
Sep 18 22:27:04.388223 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:04.388189    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b5bda1c7-67ad-407a-a800-16c9ad2eb2a1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-4583f0-fngwl\" (UID: \"b5bda1c7-67ad-407a-a800-16c9ad2eb2a1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4583f0-fngwl"
Sep 18 22:27:04.388870 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:04.388851    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b5bda1c7-67ad-407a-a800-16c9ad2eb2a1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-4583f0-fngwl\" (UID: \"b5bda1c7-67ad-407a-a800-16c9ad2eb2a1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4583f0-fngwl"
Sep 18 22:27:04.512211 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:04.512121    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4583f0-fngwl"
Sep 18 22:27:04.812539 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:04.812510    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4583f0-fngwl"]
Sep 18 22:27:04.813024 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:27:04.813003    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5bda1c7_67ad_407a_a800_16c9ad2eb2a1.slice/crio-4af4960a6db9f7ac2e1750510edd05b6dc914531f89ad97ed2f169dc32bf2459 WatchSource:0}: Error finding container 4af4960a6db9f7ac2e1750510edd05b6dc914531f89ad97ed2f169dc32bf2459: Status 404 returned error can't find the container with id 4af4960a6db9f7ac2e1750510edd05b6dc914531f89ad97ed2f169dc32bf2459
Sep 18 22:27:05.412901 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:05.412812    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4583f0-fngwl" event={"ID":"b5bda1c7-67ad-407a-a800-16c9ad2eb2a1","Type":"ContainerStarted","Data":"c0c78c4b45f16ad4d7d6f81675b9e8ef2f80f914463e87d57c48b6ab6196869d"}
Sep 18 22:27:05.412901 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:05.412864    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4583f0-fngwl" event={"ID":"b5bda1c7-67ad-407a-a800-16c9ad2eb2a1","Type":"ContainerStarted","Data":"4af4960a6db9f7ac2e1750510edd05b6dc914531f89ad97ed2f169dc32bf2459"}
Sep 18 22:27:05.433472 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:05.433424    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4583f0-fngwl" podStartSLOduration=1.433393457 podStartE2EDuration="1.433393457s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:27:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:27:05.429441559 +0000 UTC m=+1604.749113605" watchObservedRunningTime="2026-09-18 22:27:05.433393457 +0000 UTC m=+1604.753065512"
Sep 18 22:27:06.421704 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:06.421669    2577 generic.go:356] "Generic (PLEG): container finished" podID="b5bda1c7-67ad-407a-a800-16c9ad2eb2a1" containerID="c0c78c4b45f16ad4d7d6f81675b9e8ef2f80f914463e87d57c48b6ab6196869d" exitCode=0
Sep 18 22:27:06.422127 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:06.421762    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4583f0-fngwl" event={"ID":"b5bda1c7-67ad-407a-a800-16c9ad2eb2a1","Type":"ContainerDied","Data":"c0c78c4b45f16ad4d7d6f81675b9e8ef2f80f914463e87d57c48b6ab6196869d"}
Sep 18 22:27:07.186977 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:07.186933    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7642-b37fd5"]
Sep 18 22:27:07.190521 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:07.190500    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7642-b37fd5"
Sep 18 22:27:07.193171 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:07.193147    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-t97qt\""
Sep 18 22:27:07.208008 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:07.207983    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7642-b37fd5"]
Sep 18 22:27:07.219319 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:07.219208    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hws8n\" (UniqueName: \"kubernetes.io/projected/c638fbca-be2b-4636-9e8c-12fe1e43cc71-kube-api-access-hws8n\") pod \"test-curl-7642-b37fd5\" (UID: \"c638fbca-be2b-4636-9e8c-12fe1e43cc71\") " pod="opendatahub/test-curl-7642-b37fd5"
Sep 18 22:27:07.320563 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:07.320527    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hws8n\" (UniqueName: \"kubernetes.io/projected/c638fbca-be2b-4636-9e8c-12fe1e43cc71-kube-api-access-hws8n\") pod \"test-curl-7642-b37fd5\" (UID: \"c638fbca-be2b-4636-9e8c-12fe1e43cc71\") " pod="opendatahub/test-curl-7642-b37fd5"
Sep 18 22:27:07.331629 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:07.331599    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hws8n\" (UniqueName: \"kubernetes.io/projected/c638fbca-be2b-4636-9e8c-12fe1e43cc71-kube-api-access-hws8n\") pod \"test-curl-7642-b37fd5\" (UID: \"c638fbca-be2b-4636-9e8c-12fe1e43cc71\") " pod="opendatahub/test-curl-7642-b37fd5"
Sep 18 22:27:07.500191 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:07.500158    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7642-b37fd5"
Sep 18 22:27:07.607657 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:07.607629    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4583f0-fngwl"
Sep 18 22:27:07.724831 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:07.724790    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b5bda1c7-67ad-407a-a800-16c9ad2eb2a1-maas-api-service-ca\") pod \"b5bda1c7-67ad-407a-a800-16c9ad2eb2a1\" (UID: \"b5bda1c7-67ad-407a-a800-16c9ad2eb2a1\") "
Sep 18 22:27:07.725188 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:07.725164    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5bda1c7-67ad-407a-a800-16c9ad2eb2a1-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b5bda1c7-67ad-407a-a800-16c9ad2eb2a1" (UID: "b5bda1c7-67ad-407a-a800-16c9ad2eb2a1"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:27:07.815140 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:27:07.815114    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc638fbca_be2b_4636_9e8c_12fe1e43cc71.slice/crio-71125d8603e44c5d370ffbb510064e84b05c85e80e609e107865e0271b1c08fa WatchSource:0}: Error finding container 71125d8603e44c5d370ffbb510064e84b05c85e80e609e107865e0271b1c08fa: Status 404 returned error can't find the container with id 71125d8603e44c5d370ffbb510064e84b05c85e80e609e107865e0271b1c08fa
Sep 18 22:27:07.815518 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:07.815497    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7642-b37fd5"]
Sep 18 22:27:07.826670 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:07.826643    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b5bda1c7-67ad-407a-a800-16c9ad2eb2a1-maas-api-service-ca\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:27:08.436143 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:08.436104    2577 generic.go:356] "Generic (PLEG): container finished" podID="f2332048-f29f-4929-99a2-f3c1169a8943" containerID="7178cc526180bda6fae51635718eaeffbdcb82eb3827699c80205a5b31338550" exitCode=0
Sep 18 22:27:08.436378 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:08.436185    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-b981e2-openshift-default-68877f56f6-sm5ms" event={"ID":"f2332048-f29f-4929-99a2-f3c1169a8943","Type":"ContainerDied","Data":"7178cc526180bda6fae51635718eaeffbdcb82eb3827699c80205a5b31338550"}
Sep 18 22:27:08.436684 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:08.436659    2577 scope.go:117] "RemoveContainer" containerID="7178cc526180bda6fae51635718eaeffbdcb82eb3827699c80205a5b31338550"
Sep 18 22:27:08.437744 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:08.437726    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4583f0-fngwl"
Sep 18 22:27:08.437833 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:08.437722    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4583f0-fngwl" event={"ID":"b5bda1c7-67ad-407a-a800-16c9ad2eb2a1","Type":"ContainerDied","Data":"4af4960a6db9f7ac2e1750510edd05b6dc914531f89ad97ed2f169dc32bf2459"}
Sep 18 22:27:08.437892 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:08.437855    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4af4960a6db9f7ac2e1750510edd05b6dc914531f89ad97ed2f169dc32bf2459"
Sep 18 22:27:08.437999 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:08.437965    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:27:08.438079 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:08.438058    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:27:08.438139 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:08.438116    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:27:08.439538 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:08.439489    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7642-b37fd5" event={"ID":"c638fbca-be2b-4636-9e8c-12fe1e43cc71","Type":"ContainerStarted","Data":"9ed6d87d99890d4c06066dc78126a58484dfe2fe9a404cdc3c7054cb660159dc"}
Sep 18 22:27:08.439538 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:08.439522    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7642-b37fd5" event={"ID":"c638fbca-be2b-4636-9e8c-12fe1e43cc71","Type":"ContainerStarted","Data":"71125d8603e44c5d370ffbb510064e84b05c85e80e609e107865e0271b1c08fa"}
Sep 18 22:27:08.507507 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:08.507441    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7642-b37fd5" podStartSLOduration=1.507406292 podStartE2EDuration="1.507406292s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:27:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:27:08.500822729 +0000 UTC m=+1607.820494783" watchObservedRunningTime="2026-09-18 22:27:08.507406292 +0000 UTC m=+1607.827078347"
Sep 18 22:27:09.176457 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:09.176402    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7642-b37fd5"]
Sep 18 22:27:09.179631 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:09.179603    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7642-b37fd5"]
Sep 18 22:27:09.450836 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:09.450739    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-b981e2-openshift-default-68877f56f6-sm5ms" event={"ID":"f2332048-f29f-4929-99a2-f3c1169a8943","Type":"ContainerStarted","Data":"412f95345c400593dd17daa29786c532655a6cc02d74b31b413f0c6199a9c892"}
Sep 18 22:27:09.451282 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:27:09.451257    2577 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7642-b37fd5" container="test-curl-7642-b37fd5"
Sep 18 22:27:10.021178 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:10.021138    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-b981e2-openshift-default-68877f56f6-sm5ms"
Sep 18 22:27:10.021646 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:10.021351    2577 patch_prober.go:28] interesting pod/e2e-api-b-b981e2-openshift-default-68877f56f6-sm5ms container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.96:15021/healthz/ready\": dial tcp 10.133.0.96:15021: connect: connection refused" start-of-body=
Sep 18 22:27:10.021646 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:10.021394    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-b981e2-openshift-default-68877f56f6-sm5ms" podUID="f2332048-f29f-4929-99a2-f3c1169a8943" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.96:15021/healthz/ready\": dial tcp 10.133.0.96:15021: connect: connection refused"
Sep 18 22:27:10.461580 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:10.461535    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7642-b37fd5" podUID="c638fbca-be2b-4636-9e8c-12fe1e43cc71" containerName="test-curl-7642-b37fd5" containerID="cri-o://9ed6d87d99890d4c06066dc78126a58484dfe2fe9a404cdc3c7054cb660159dc" gracePeriod=2
Sep 18 22:27:10.463960 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:27:10.463923    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7642-b37fd5\" is forbidden: User \"system:node:ip-10-0-141-99.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-141-99.ec2.internal' and this object" podUID="c638fbca-be2b-4636-9e8c-12fe1e43cc71" pod="opendatahub/test-curl-7642-b37fd5"
Sep 18 22:27:11.022090 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:11.022054    2577 patch_prober.go:28] interesting pod/e2e-api-b-b981e2-openshift-default-68877f56f6-sm5ms container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.96:15021/healthz/ready\": dial tcp 10.133.0.96:15021: connect: connection refused" start-of-body=
Sep 18 22:27:11.022491 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:11.022108    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-b981e2-openshift-default-68877f56f6-sm5ms" podUID="f2332048-f29f-4929-99a2-f3c1169a8943" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.96:15021/healthz/ready\": dial tcp 10.133.0.96:15021: connect: connection refused"
Sep 18 22:27:11.139210 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:27:11.139167    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7642-b37fd5\" is forbidden: User \"system:node:ip-10-0-141-99.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-141-99.ec2.internal' and this object" podUID="c638fbca-be2b-4636-9e8c-12fe1e43cc71" pod="opendatahub/test-curl-7642-b37fd5"
Sep 18 22:27:11.878786 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:11.878751    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-7f10d8/auth-test-model-7f10d8-kserve-64897c69c9-fzjxf"]
Sep 18 22:27:12.021773 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:12.021742    2577 patch_prober.go:28] interesting pod/e2e-api-b-b981e2-openshift-default-68877f56f6-sm5ms container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.96:15021/healthz/ready\": dial tcp 10.133.0.96:15021: connect: connection refused" start-of-body=
Sep 18 22:27:12.021944 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:12.021796    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-b981e2-openshift-default-68877f56f6-sm5ms" podUID="f2332048-f29f-4929-99a2-f3c1169a8943" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.96:15021/healthz/ready\": dial tcp 10.133.0.96:15021: connect: connection refused"
Sep 18 22:27:12.685526 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:12.685497    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7642-b37fd5"
Sep 18 22:27:12.788965 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:12.788867    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hws8n\" (UniqueName: \"kubernetes.io/projected/c638fbca-be2b-4636-9e8c-12fe1e43cc71-kube-api-access-hws8n\") pod \"c638fbca-be2b-4636-9e8c-12fe1e43cc71\" (UID: \"c638fbca-be2b-4636-9e8c-12fe1e43cc71\") "
Sep 18 22:27:12.791213 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:12.791182    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c638fbca-be2b-4636-9e8c-12fe1e43cc71-kube-api-access-hws8n" (OuterVolumeSpecName: "kube-api-access-hws8n") pod "c638fbca-be2b-4636-9e8c-12fe1e43cc71" (UID: "c638fbca-be2b-4636-9e8c-12fe1e43cc71"). InnerVolumeSpecName "kube-api-access-hws8n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:27:12.890304 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:12.890269    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hws8n\" (UniqueName: \"kubernetes.io/projected/c638fbca-be2b-4636-9e8c-12fe1e43cc71-kube-api-access-hws8n\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:27:13.021186 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:13.021147    2577 patch_prober.go:28] interesting pod/e2e-api-b-b981e2-openshift-default-68877f56f6-sm5ms container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.96:15021/healthz/ready\": dial tcp 10.133.0.96:15021: connect: connection refused" start-of-body=
Sep 18 22:27:13.021381 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:13.021207    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-b981e2-openshift-default-68877f56f6-sm5ms" podUID="f2332048-f29f-4929-99a2-f3c1169a8943" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.96:15021/healthz/ready\": dial tcp 10.133.0.96:15021: connect: connection refused"
Sep 18 22:27:13.141626 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:13.141587    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c638fbca-be2b-4636-9e8c-12fe1e43cc71" path="/var/lib/kubelet/pods/c638fbca-be2b-4636-9e8c-12fe1e43cc71/volumes"
Sep 18 22:27:13.489141 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:13.489048    2577 generic.go:356] "Generic (PLEG): container finished" podID="c638fbca-be2b-4636-9e8c-12fe1e43cc71" containerID="9ed6d87d99890d4c06066dc78126a58484dfe2fe9a404cdc3c7054cb660159dc" exitCode=137
Sep 18 22:27:13.489141 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:13.489121    2577 scope.go:117] "RemoveContainer" containerID="9ed6d87d99890d4c06066dc78126a58484dfe2fe9a404cdc3c7054cb660159dc"
Sep 18 22:27:13.489380 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:13.489368    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7642-b37fd5"
Sep 18 22:27:13.498607 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:13.498590    2577 scope.go:117] "RemoveContainer" containerID="9ed6d87d99890d4c06066dc78126a58484dfe2fe9a404cdc3c7054cb660159dc"
Sep 18 22:27:13.498867 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:27:13.498852    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ed6d87d99890d4c06066dc78126a58484dfe2fe9a404cdc3c7054cb660159dc\": container with ID starting with 9ed6d87d99890d4c06066dc78126a58484dfe2fe9a404cdc3c7054cb660159dc not found: ID does not exist" containerID="9ed6d87d99890d4c06066dc78126a58484dfe2fe9a404cdc3c7054cb660159dc"
Sep 18 22:27:13.498905 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:13.498876    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ed6d87d99890d4c06066dc78126a58484dfe2fe9a404cdc3c7054cb660159dc"} err="failed to get container status \"9ed6d87d99890d4c06066dc78126a58484dfe2fe9a404cdc3c7054cb660159dc\": rpc error: code = NotFound desc = could not find container \"9ed6d87d99890d4c06066dc78126a58484dfe2fe9a404cdc3c7054cb660159dc\": container with ID starting with 9ed6d87d99890d4c06066dc78126a58484dfe2fe9a404cdc3c7054cb660159dc not found: ID does not exist"
Sep 18 22:27:14.021173 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:14.021131    2577 patch_prober.go:28] interesting pod/e2e-api-b-b981e2-openshift-default-68877f56f6-sm5ms container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.96:15021/healthz/ready\": dial tcp 10.133.0.96:15021: connect: connection refused" start-of-body=
Sep 18 22:27:14.021622 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:14.021189    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-b981e2-openshift-default-68877f56f6-sm5ms" podUID="f2332048-f29f-4929-99a2-f3c1169a8943" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.96:15021/healthz/ready\": dial tcp 10.133.0.96:15021: connect: connection refused"
Sep 18 22:27:15.026207 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:15.026180    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-b981e2-openshift-default-68877f56f6-sm5ms"
Sep 18 22:27:15.026611 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:15.026437    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-b981e2-openshift-default-68877f56f6-sm5ms"
Sep 18 22:27:15.027244 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:15.027226    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-b981e2-openshift-default-68877f56f6-sm5ms"
Sep 18 22:27:20.407607 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:20.407572    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4583f0-fngwl"]
Sep 18 22:27:20.410253 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:20.410228    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4583f0-fngwl"]
Sep 18 22:27:21.140635 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:21.140608    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b5bda1c7-67ad-407a-a800-16c9ad2eb2a1" path="/var/lib/kubelet/pods/b5bda1c7-67ad-407a-a800-16c9ad2eb2a1/volumes"
Sep 18 22:27:21.545109 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:21.545016    2577 scope.go:117] "RemoveContainer" containerID="3bcd8b7df56008dc0fe173032c462a46edb23a641c6eeb1e0ff6e0bc3baab54f"
Sep 18 22:27:21.558090 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:21.558067    2577 scope.go:117] "RemoveContainer" containerID="e4e6637183d15e8a7c0fed7f3b54a344af195899548f9e586bd0402184eb54ac"
Sep 18 22:27:26.898612 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:26.898565    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-7f10d8/auth-test-model-7f10d8-kserve-64897c69c9-fzjxf" podUID="ead4a87f-b7bd-4e3e-84be-19ba130f48ac" containerName="main" containerID="cri-o://811c96f5414a091eb5b60bc380641c2b3e42bd8626a10b0125b73c5c05498494" gracePeriod=45
Sep 18 22:27:27.155811 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:27.155744    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-7f10d8/auth-test-model-7f10d8-kserve-64897c69c9-fzjxf"
Sep 18 22:27:27.242053 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:27.242019    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-77rjq\" (UniqueName: \"kubernetes.io/projected/ead4a87f-b7bd-4e3e-84be-19ba130f48ac-kube-api-access-77rjq\") pod \"ead4a87f-b7bd-4e3e-84be-19ba130f48ac\" (UID: \"ead4a87f-b7bd-4e3e-84be-19ba130f48ac\") "
Sep 18 22:27:27.242236 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:27.242073    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ead4a87f-b7bd-4e3e-84be-19ba130f48ac-home\") pod \"ead4a87f-b7bd-4e3e-84be-19ba130f48ac\" (UID: \"ead4a87f-b7bd-4e3e-84be-19ba130f48ac\") "
Sep 18 22:27:27.242236 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:27.242120    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ead4a87f-b7bd-4e3e-84be-19ba130f48ac-model-cache\") pod \"ead4a87f-b7bd-4e3e-84be-19ba130f48ac\" (UID: \"ead4a87f-b7bd-4e3e-84be-19ba130f48ac\") "
Sep 18 22:27:27.242236 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:27.242141    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ead4a87f-b7bd-4e3e-84be-19ba130f48ac-tmp-dir\") pod \"ead4a87f-b7bd-4e3e-84be-19ba130f48ac\" (UID: \"ead4a87f-b7bd-4e3e-84be-19ba130f48ac\") "
Sep 18 22:27:27.242236 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:27.242170    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ead4a87f-b7bd-4e3e-84be-19ba130f48ac-tls-certs\") pod \"ead4a87f-b7bd-4e3e-84be-19ba130f48ac\" (UID: \"ead4a87f-b7bd-4e3e-84be-19ba130f48ac\") "
Sep 18 22:27:27.242236 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:27.242198    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ead4a87f-b7bd-4e3e-84be-19ba130f48ac-dshm\") pod \"ead4a87f-b7bd-4e3e-84be-19ba130f48ac\" (UID: \"ead4a87f-b7bd-4e3e-84be-19ba130f48ac\") "
Sep 18 22:27:27.242548 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:27.242448    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ead4a87f-b7bd-4e3e-84be-19ba130f48ac-model-cache" (OuterVolumeSpecName: "model-cache") pod "ead4a87f-b7bd-4e3e-84be-19ba130f48ac" (UID: "ead4a87f-b7bd-4e3e-84be-19ba130f48ac"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:27:27.242548 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:27.242455    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ead4a87f-b7bd-4e3e-84be-19ba130f48ac-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ead4a87f-b7bd-4e3e-84be-19ba130f48ac" (UID: "ead4a87f-b7bd-4e3e-84be-19ba130f48ac"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:27:27.242548 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:27.242527    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ead4a87f-b7bd-4e3e-84be-19ba130f48ac-home" (OuterVolumeSpecName: "home") pod "ead4a87f-b7bd-4e3e-84be-19ba130f48ac" (UID: "ead4a87f-b7bd-4e3e-84be-19ba130f48ac"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:27:27.242719 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:27.242582    2577 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ead4a87f-b7bd-4e3e-84be-19ba130f48ac-model-cache\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:27:27.242719 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:27.242594    2577 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ead4a87f-b7bd-4e3e-84be-19ba130f48ac-tmp-dir\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:27:27.244577 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:27.244549    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ead4a87f-b7bd-4e3e-84be-19ba130f48ac-kube-api-access-77rjq" (OuterVolumeSpecName: "kube-api-access-77rjq") pod "ead4a87f-b7bd-4e3e-84be-19ba130f48ac" (UID: "ead4a87f-b7bd-4e3e-84be-19ba130f48ac"). InnerVolumeSpecName "kube-api-access-77rjq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:27:27.244714 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:27.244631    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ead4a87f-b7bd-4e3e-84be-19ba130f48ac-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ead4a87f-b7bd-4e3e-84be-19ba130f48ac" (UID: "ead4a87f-b7bd-4e3e-84be-19ba130f48ac"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 22:27:27.245994 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:27.245968    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ead4a87f-b7bd-4e3e-84be-19ba130f48ac-dshm" (OuterVolumeSpecName: "dshm") pod "ead4a87f-b7bd-4e3e-84be-19ba130f48ac" (UID: "ead4a87f-b7bd-4e3e-84be-19ba130f48ac"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:27:27.343794 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:27.343762    2577 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ead4a87f-b7bd-4e3e-84be-19ba130f48ac-tls-certs\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:27:27.343794 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:27.343786    2577 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ead4a87f-b7bd-4e3e-84be-19ba130f48ac-dshm\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:27:27.343794 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:27.343794    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-77rjq\" (UniqueName: \"kubernetes.io/projected/ead4a87f-b7bd-4e3e-84be-19ba130f48ac-kube-api-access-77rjq\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:27:27.343794 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:27.343803    2577 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ead4a87f-b7bd-4e3e-84be-19ba130f48ac-home\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:27:27.585420 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:27.585387    2577 generic.go:356] "Generic (PLEG): container finished" podID="ead4a87f-b7bd-4e3e-84be-19ba130f48ac" containerID="811c96f5414a091eb5b60bc380641c2b3e42bd8626a10b0125b73c5c05498494" exitCode=0
Sep 18 22:27:27.585589 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:27.585452    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-7f10d8/auth-test-model-7f10d8-kserve-64897c69c9-fzjxf" event={"ID":"ead4a87f-b7bd-4e3e-84be-19ba130f48ac","Type":"ContainerDied","Data":"811c96f5414a091eb5b60bc380641c2b3e42bd8626a10b0125b73c5c05498494"}
Sep 18 22:27:27.585589 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:27.585467    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-7f10d8/auth-test-model-7f10d8-kserve-64897c69c9-fzjxf"
Sep 18 22:27:27.585589 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:27.585487    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-7f10d8/auth-test-model-7f10d8-kserve-64897c69c9-fzjxf" event={"ID":"ead4a87f-b7bd-4e3e-84be-19ba130f48ac","Type":"ContainerDied","Data":"5c118acb7e59f3827fe865aac0a0e5f9785ee9d58b29fca6209cb6d4869ac7b0"}
Sep 18 22:27:27.585589 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:27.585504    2577 scope.go:117] "RemoveContainer" containerID="811c96f5414a091eb5b60bc380641c2b3e42bd8626a10b0125b73c5c05498494"
Sep 18 22:27:27.598639 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:27.598621    2577 scope.go:117] "RemoveContainer" containerID="811c96f5414a091eb5b60bc380641c2b3e42bd8626a10b0125b73c5c05498494"
Sep 18 22:27:27.598902 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:27:27.598875    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"811c96f5414a091eb5b60bc380641c2b3e42bd8626a10b0125b73c5c05498494\": container with ID starting with 811c96f5414a091eb5b60bc380641c2b3e42bd8626a10b0125b73c5c05498494 not found: ID does not exist" containerID="811c96f5414a091eb5b60bc380641c2b3e42bd8626a10b0125b73c5c05498494"
Sep 18 22:27:27.598998 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:27.598904    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"811c96f5414a091eb5b60bc380641c2b3e42bd8626a10b0125b73c5c05498494"} err="failed to get container status \"811c96f5414a091eb5b60bc380641c2b3e42bd8626a10b0125b73c5c05498494\": rpc error: code = NotFound desc = could not find container \"811c96f5414a091eb5b60bc380641c2b3e42bd8626a10b0125b73c5c05498494\": container with ID starting with 811c96f5414a091eb5b60bc380641c2b3e42bd8626a10b0125b73c5c05498494 not found: ID does not exist"
Sep 18 22:27:27.611943 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:27.611919    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-7f10d8/auth-test-model-7f10d8-kserve-64897c69c9-fzjxf"]
Sep 18 22:27:27.618635 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:27.618613    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-7f10d8/auth-test-model-7f10d8-kserve-64897c69c9-fzjxf"]
Sep 18 22:27:28.655500 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:28.655467    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-4583f0-openshift-default-68b9ddcbdd-gn8hz"]
Sep 18 22:27:28.655927 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:28.655682    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-4583f0-openshift-default-68b9ddcbdd-gn8hz" podUID="3bc51d61-6a1c-416c-a87a-7017d24fd250" containerName="istio-proxy" containerID="cri-o://945aa89adeb4905292ab4dce354a19bb77fefed3cf1f80431156b64b4ae0b288" gracePeriod=30
Sep 18 22:27:29.014823 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:29.014749    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-b981e2-8vxv8"]
Sep 18 22:27:29.015186 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:29.015174    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5bda1c7-67ad-407a-a800-16c9ad2eb2a1" containerName="revoke-keys"
Sep 18 22:27:29.015233 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:29.015188    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5bda1c7-67ad-407a-a800-16c9ad2eb2a1" containerName="revoke-keys"
Sep 18 22:27:29.015233 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:29.015211    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ead4a87f-b7bd-4e3e-84be-19ba130f48ac" containerName="main"
Sep 18 22:27:29.015233 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:29.015216    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="ead4a87f-b7bd-4e3e-84be-19ba130f48ac" containerName="main"
Sep 18 22:27:29.015233 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:29.015228    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c638fbca-be2b-4636-9e8c-12fe1e43cc71" containerName="test-curl-7642-b37fd5"
Sep 18 22:27:29.015233 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:29.015234    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c638fbca-be2b-4636-9e8c-12fe1e43cc71" containerName="test-curl-7642-b37fd5"
Sep 18 22:27:29.015383 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:29.015300    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5bda1c7-67ad-407a-a800-16c9ad2eb2a1" containerName="revoke-keys"
Sep 18 22:27:29.015383 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:29.015310    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c638fbca-be2b-4636-9e8c-12fe1e43cc71" containerName="test-curl-7642-b37fd5"
Sep 18 22:27:29.015383 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:29.015317    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="ead4a87f-b7bd-4e3e-84be-19ba130f48ac" containerName="main"
Sep 18 22:27:29.019398 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:29.019382    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-b981e2-8vxv8"
Sep 18 22:27:29.021744 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:29.021721    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-9g7m4\""
Sep 18 22:27:29.027247 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:29.027208    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-b981e2-8vxv8"]
Sep 18 22:27:29.061528 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:29.061497    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/50825646-6dfe-4520-9263-965deea79652-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-b981e2-8vxv8\" (UID: \"50825646-6dfe-4520-9263-965deea79652\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-b981e2-8vxv8"
Sep 18 22:27:29.141425 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:29.141384    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ead4a87f-b7bd-4e3e-84be-19ba130f48ac" path="/var/lib/kubelet/pods/ead4a87f-b7bd-4e3e-84be-19ba130f48ac/volumes"
Sep 18 22:27:29.163065 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:29.163038    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/50825646-6dfe-4520-9263-965deea79652-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-b981e2-8vxv8\" (UID: \"50825646-6dfe-4520-9263-965deea79652\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-b981e2-8vxv8"
Sep 18 22:27:29.163641 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:29.163621    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/50825646-6dfe-4520-9263-965deea79652-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-b981e2-8vxv8\" (UID: \"50825646-6dfe-4520-9263-965deea79652\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-b981e2-8vxv8"
Sep 18 22:27:29.330696 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:29.330666    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-b981e2-8vxv8"
Sep 18 22:27:29.614592 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:29.614563    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-b981e2-8vxv8"]
Sep 18 22:27:29.615065 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:27:29.615037    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50825646_6dfe_4520_9263_965deea79652.slice/crio-bfe6635dc9e4f2eea704f3fe3064d711ea100b190d4041cff2ca8de9383b1821 WatchSource:0}: Error finding container bfe6635dc9e4f2eea704f3fe3064d711ea100b190d4041cff2ca8de9383b1821: Status 404 returned error can't find the container with id bfe6635dc9e4f2eea704f3fe3064d711ea100b190d4041cff2ca8de9383b1821
Sep 18 22:27:30.609154 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:30.609124    2577 generic.go:356] "Generic (PLEG): container finished" podID="50825646-6dfe-4520-9263-965deea79652" containerID="7e7247bc4a66c7774a1cdea6dae596db71a6000e337f836aae583e5edf81c3a8" exitCode=0
Sep 18 22:27:30.609601 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:30.609211    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-b981e2-8vxv8" event={"ID":"50825646-6dfe-4520-9263-965deea79652","Type":"ContainerDied","Data":"7e7247bc4a66c7774a1cdea6dae596db71a6000e337f836aae583e5edf81c3a8"}
Sep 18 22:27:30.609601 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:30.609275    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-b981e2-8vxv8" event={"ID":"50825646-6dfe-4520-9263-965deea79652","Type":"ContainerStarted","Data":"bfe6635dc9e4f2eea704f3fe3064d711ea100b190d4041cff2ca8de9383b1821"}
Sep 18 22:27:30.638478 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:30.638443    2577 patch_prober.go:28] interesting pod/e2e-api-a-4583f0-openshift-default-68b9ddcbdd-gn8hz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 18 22:27:30.638618 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:30.638504    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-4583f0-openshift-default-68b9ddcbdd-gn8hz" podUID="3bc51d61-6a1c-416c-a87a-7017d24fd250" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 22:27:31.739169 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:31.739147    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-b981e2-8vxv8"
Sep 18 22:27:31.790242 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:31.790216    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/50825646-6dfe-4520-9263-965deea79652-maas-api-service-ca\") pod \"50825646-6dfe-4520-9263-965deea79652\" (UID: \"50825646-6dfe-4520-9263-965deea79652\") "
Sep 18 22:27:31.790566 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:31.790543    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50825646-6dfe-4520-9263-965deea79652-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "50825646-6dfe-4520-9263-965deea79652" (UID: "50825646-6dfe-4520-9263-965deea79652"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:27:31.790654 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:31.790628    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/50825646-6dfe-4520-9263-965deea79652-maas-api-service-ca\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:27:32.621883 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:32.621857    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-b981e2-8vxv8"
Sep 18 22:27:32.622061 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:32.621858    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-b981e2-8vxv8" event={"ID":"50825646-6dfe-4520-9263-965deea79652","Type":"ContainerDied","Data":"bfe6635dc9e4f2eea704f3fe3064d711ea100b190d4041cff2ca8de9383b1821"}
Sep 18 22:27:32.622061 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:32.621985    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bfe6635dc9e4f2eea704f3fe3064d711ea100b190d4041cff2ca8de9383b1821"
Sep 18 22:27:33.926229 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:33.926165    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-4583f0-openshift-default-68b9ddcbdd-gn8hz"
Sep 18 22:27:34.011731 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:34.011688    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3bc51d61-6a1c-416c-a87a-7017d24fd250-istiod-ca-cert\") pod \"3bc51d61-6a1c-416c-a87a-7017d24fd250\" (UID: \"3bc51d61-6a1c-416c-a87a-7017d24fd250\") "
Sep 18 22:27:34.011731 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:34.011734    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3bc51d61-6a1c-416c-a87a-7017d24fd250-istio-podinfo\") pod \"3bc51d61-6a1c-416c-a87a-7017d24fd250\" (UID: \"3bc51d61-6a1c-416c-a87a-7017d24fd250\") "
Sep 18 22:27:34.012000 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:34.011856    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3bc51d61-6a1c-416c-a87a-7017d24fd250-workload-socket\") pod \"3bc51d61-6a1c-416c-a87a-7017d24fd250\" (UID: \"3bc51d61-6a1c-416c-a87a-7017d24fd250\") "
Sep 18 22:27:34.012000 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:34.011911    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3bc51d61-6a1c-416c-a87a-7017d24fd250-workload-certs\") pod \"3bc51d61-6a1c-416c-a87a-7017d24fd250\" (UID: \"3bc51d61-6a1c-416c-a87a-7017d24fd250\") "
Sep 18 22:27:34.012000 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:34.011943    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3bc51d61-6a1c-416c-a87a-7017d24fd250-istio-token\") pod \"3bc51d61-6a1c-416c-a87a-7017d24fd250\" (UID: \"3bc51d61-6a1c-416c-a87a-7017d24fd250\") "
Sep 18 22:27:34.012000 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:34.011979    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3bc51d61-6a1c-416c-a87a-7017d24fd250-istio-data\") pod \"3bc51d61-6a1c-416c-a87a-7017d24fd250\" (UID: \"3bc51d61-6a1c-416c-a87a-7017d24fd250\") "
Sep 18 22:27:34.012209 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:34.012013    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fsvrm\" (UniqueName: \"kubernetes.io/projected/3bc51d61-6a1c-416c-a87a-7017d24fd250-kube-api-access-fsvrm\") pod \"3bc51d61-6a1c-416c-a87a-7017d24fd250\" (UID: \"3bc51d61-6a1c-416c-a87a-7017d24fd250\") "
Sep 18 22:27:34.012209 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:34.012050    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3bc51d61-6a1c-416c-a87a-7017d24fd250-credential-socket\") pod \"3bc51d61-6a1c-416c-a87a-7017d24fd250\" (UID: \"3bc51d61-6a1c-416c-a87a-7017d24fd250\") "
Sep 18 22:27:34.012209 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:34.012078    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3bc51d61-6a1c-416c-a87a-7017d24fd250-istio-envoy\") pod \"3bc51d61-6a1c-416c-a87a-7017d24fd250\" (UID: \"3bc51d61-6a1c-416c-a87a-7017d24fd250\") "
Sep 18 22:27:34.012209 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:34.012195    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3bc51d61-6a1c-416c-a87a-7017d24fd250-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3bc51d61-6a1c-416c-a87a-7017d24fd250" (UID: "3bc51d61-6a1c-416c-a87a-7017d24fd250"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:27:34.012445 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:34.012209    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3bc51d61-6a1c-416c-a87a-7017d24fd250-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3bc51d61-6a1c-416c-a87a-7017d24fd250" (UID: "3bc51d61-6a1c-416c-a87a-7017d24fd250"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:27:34.012445 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:34.012375    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3bc51d61-6a1c-416c-a87a-7017d24fd250-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3bc51d61-6a1c-416c-a87a-7017d24fd250" (UID: "3bc51d61-6a1c-416c-a87a-7017d24fd250"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:27:34.012445 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:34.012425    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3bc51d61-6a1c-416c-a87a-7017d24fd250-istio-data" (OuterVolumeSpecName: "istio-data") pod "3bc51d61-6a1c-416c-a87a-7017d24fd250" (UID: "3bc51d61-6a1c-416c-a87a-7017d24fd250"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:27:34.012779 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:34.012567    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3bc51d61-6a1c-416c-a87a-7017d24fd250-workload-certs\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:27:34.012779 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:34.012588    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3bc51d61-6a1c-416c-a87a-7017d24fd250-istio-data\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:27:34.012779 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:34.012601    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3bc51d61-6a1c-416c-a87a-7017d24fd250-credential-socket\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:27:34.012779 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:34.012615    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3bc51d61-6a1c-416c-a87a-7017d24fd250-istiod-ca-cert\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:27:34.013002 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:34.012872    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3bc51d61-6a1c-416c-a87a-7017d24fd250-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3bc51d61-6a1c-416c-a87a-7017d24fd250" (UID: "3bc51d61-6a1c-416c-a87a-7017d24fd250"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:27:34.014272 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:34.014245    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3bc51d61-6a1c-416c-a87a-7017d24fd250-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3bc51d61-6a1c-416c-a87a-7017d24fd250" (UID: "3bc51d61-6a1c-416c-a87a-7017d24fd250"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 18 22:27:34.014375 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:34.014273    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3bc51d61-6a1c-416c-a87a-7017d24fd250-istio-token" (OuterVolumeSpecName: "istio-token") pod "3bc51d61-6a1c-416c-a87a-7017d24fd250" (UID: "3bc51d61-6a1c-416c-a87a-7017d24fd250"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:27:34.014873 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:34.014855    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3bc51d61-6a1c-416c-a87a-7017d24fd250-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3bc51d61-6a1c-416c-a87a-7017d24fd250" (UID: "3bc51d61-6a1c-416c-a87a-7017d24fd250"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:27:34.014963 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:34.014935    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3bc51d61-6a1c-416c-a87a-7017d24fd250-kube-api-access-fsvrm" (OuterVolumeSpecName: "kube-api-access-fsvrm") pod "3bc51d61-6a1c-416c-a87a-7017d24fd250" (UID: "3bc51d61-6a1c-416c-a87a-7017d24fd250"). InnerVolumeSpecName "kube-api-access-fsvrm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:27:34.113546 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:34.113508    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3bc51d61-6a1c-416c-a87a-7017d24fd250-workload-socket\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:27:34.113546 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:34.113540    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3bc51d61-6a1c-416c-a87a-7017d24fd250-istio-token\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:27:34.113546 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:34.113553    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fsvrm\" (UniqueName: \"kubernetes.io/projected/3bc51d61-6a1c-416c-a87a-7017d24fd250-kube-api-access-fsvrm\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:27:34.113792 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:34.113567    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3bc51d61-6a1c-416c-a87a-7017d24fd250-istio-envoy\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:27:34.113792 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:34.113578    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3bc51d61-6a1c-416c-a87a-7017d24fd250-istio-podinfo\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:27:34.637283 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:34.637247    2577 generic.go:356] "Generic (PLEG): container finished" podID="3bc51d61-6a1c-416c-a87a-7017d24fd250" containerID="945aa89adeb4905292ab4dce354a19bb77fefed3cf1f80431156b64b4ae0b288" exitCode=0
Sep 18 22:27:34.637556 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:34.637290    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-4583f0-openshift-default-68b9ddcbdd-gn8hz" event={"ID":"3bc51d61-6a1c-416c-a87a-7017d24fd250","Type":"ContainerDied","Data":"945aa89adeb4905292ab4dce354a19bb77fefed3cf1f80431156b64b4ae0b288"}
Sep 18 22:27:34.637556 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:34.637308    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-4583f0-openshift-default-68b9ddcbdd-gn8hz"
Sep 18 22:27:34.637556 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:34.637331    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-4583f0-openshift-default-68b9ddcbdd-gn8hz" event={"ID":"3bc51d61-6a1c-416c-a87a-7017d24fd250","Type":"ContainerDied","Data":"a854e19e5275070620a09622c6bb55216066ba9a956a9cd78c56ca9c52b3cc9b"}
Sep 18 22:27:34.637556 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:34.637359    2577 scope.go:117] "RemoveContainer" containerID="945aa89adeb4905292ab4dce354a19bb77fefed3cf1f80431156b64b4ae0b288"
Sep 18 22:27:34.647894 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:34.647870    2577 scope.go:117] "RemoveContainer" containerID="02fa01de2df3e90d8a5357f1ded13434684e99e199c68088a6d7665e2ed753c9"
Sep 18 22:27:34.658360 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:34.658343    2577 scope.go:117] "RemoveContainer" containerID="945aa89adeb4905292ab4dce354a19bb77fefed3cf1f80431156b64b4ae0b288"
Sep 18 22:27:34.658651 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:27:34.658632    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"945aa89adeb4905292ab4dce354a19bb77fefed3cf1f80431156b64b4ae0b288\": container with ID starting with 945aa89adeb4905292ab4dce354a19bb77fefed3cf1f80431156b64b4ae0b288 not found: ID does not exist" containerID="945aa89adeb4905292ab4dce354a19bb77fefed3cf1f80431156b64b4ae0b288"
Sep 18 22:27:34.658719 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:34.658658    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"945aa89adeb4905292ab4dce354a19bb77fefed3cf1f80431156b64b4ae0b288"} err="failed to get container status \"945aa89adeb4905292ab4dce354a19bb77fefed3cf1f80431156b64b4ae0b288\": rpc error: code = NotFound desc = could not find container \"945aa89adeb4905292ab4dce354a19bb77fefed3cf1f80431156b64b4ae0b288\": container with ID starting with 945aa89adeb4905292ab4dce354a19bb77fefed3cf1f80431156b64b4ae0b288 not found: ID does not exist"
Sep 18 22:27:34.658719 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:34.658674    2577 scope.go:117] "RemoveContainer" containerID="02fa01de2df3e90d8a5357f1ded13434684e99e199c68088a6d7665e2ed753c9"
Sep 18 22:27:34.658946 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:27:34.658927    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02fa01de2df3e90d8a5357f1ded13434684e99e199c68088a6d7665e2ed753c9\": container with ID starting with 02fa01de2df3e90d8a5357f1ded13434684e99e199c68088a6d7665e2ed753c9 not found: ID does not exist" containerID="02fa01de2df3e90d8a5357f1ded13434684e99e199c68088a6d7665e2ed753c9"
Sep 18 22:27:34.659002 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:34.658957    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02fa01de2df3e90d8a5357f1ded13434684e99e199c68088a6d7665e2ed753c9"} err="failed to get container status \"02fa01de2df3e90d8a5357f1ded13434684e99e199c68088a6d7665e2ed753c9\": rpc error: code = NotFound desc = could not find container \"02fa01de2df3e90d8a5357f1ded13434684e99e199c68088a6d7665e2ed753c9\": container with ID starting with 02fa01de2df3e90d8a5357f1ded13434684e99e199c68088a6d7665e2ed753c9 not found: ID does not exist"
Sep 18 22:27:34.665505 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:34.665485    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-4583f0-openshift-default-68b9ddcbdd-gn8hz"]
Sep 18 22:27:34.670610 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:34.670584    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-4583f0-openshift-default-68b9ddcbdd-gn8hz"]
Sep 18 22:27:35.140870 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:35.140843    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3bc51d61-6a1c-416c-a87a-7017d24fd250" path="/var/lib/kubelet/pods/3bc51d61-6a1c-416c-a87a-7017d24fd250/volumes"
Sep 18 22:27:45.161346 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:45.161308    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-b981e2-8vxv8"]
Sep 18 22:27:45.181229 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:45.181191    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-b981e2-8vxv8"]
Sep 18 22:27:47.140563 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:47.140531    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="50825646-6dfe-4520-9263-965deea79652" path="/var/lib/kubelet/pods/50825646-6dfe-4520-9263-965deea79652/volumes"
Sep 18 22:27:52.428160 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:52.428128    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-b981e2-openshift-default-68877f56f6-sm5ms"]
Sep 18 22:27:52.428602 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:52.428384    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-b981e2-openshift-default-68877f56f6-sm5ms" podUID="f2332048-f29f-4929-99a2-f3c1169a8943" containerName="istio-proxy" containerID="cri-o://412f95345c400593dd17daa29786c532655a6cc02d74b31b413f0c6199a9c892" gracePeriod=30
Sep 18 22:27:52.810652 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:52.810620    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-62f806-ch465"]
Sep 18 22:27:52.811035 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:52.811022    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3bc51d61-6a1c-416c-a87a-7017d24fd250" containerName="istio-proxy"
Sep 18 22:27:52.811081 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:52.811037    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="3bc51d61-6a1c-416c-a87a-7017d24fd250" containerName="istio-proxy"
Sep 18 22:27:52.811081 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:52.811063    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50825646-6dfe-4520-9263-965deea79652" containerName="revoke-keys"
Sep 18 22:27:52.811081 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:52.811069    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="50825646-6dfe-4520-9263-965deea79652" containerName="revoke-keys"
Sep 18 22:27:52.811183 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:52.811132    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="3bc51d61-6a1c-416c-a87a-7017d24fd250" containerName="istio-proxy"
Sep 18 22:27:52.811183 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:52.811141    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="3bc51d61-6a1c-416c-a87a-7017d24fd250" containerName="istio-proxy"
Sep 18 22:27:52.811183 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:52.811148    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="50825646-6dfe-4520-9263-965deea79652" containerName="revoke-keys"
Sep 18 22:27:52.814288 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:52.814268    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-62f806-ch465"
Sep 18 22:27:52.817222 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:52.817200    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-9g7m4\""
Sep 18 22:27:52.826697 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:52.826668    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-62f806-ch465"]
Sep 18 22:27:52.904524 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:52.904492    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/637cd174-47cb-4a86-90f1-3ec8040c4381-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-62f806-ch465\" (UID: \"637cd174-47cb-4a86-90f1-3ec8040c4381\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-62f806-ch465"
Sep 18 22:27:53.005831 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:53.005783    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/637cd174-47cb-4a86-90f1-3ec8040c4381-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-62f806-ch465\" (UID: \"637cd174-47cb-4a86-90f1-3ec8040c4381\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-62f806-ch465"
Sep 18 22:27:53.006438 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:53.006392    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/637cd174-47cb-4a86-90f1-3ec8040c4381-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-62f806-ch465\" (UID: \"637cd174-47cb-4a86-90f1-3ec8040c4381\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-62f806-ch465"
Sep 18 22:27:53.125590 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:53.125513    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-62f806-ch465"
Sep 18 22:27:53.406786 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:53.406763    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-62f806-ch465"]
Sep 18 22:27:53.407907 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:27:53.407885    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod637cd174_47cb_4a86_90f1_3ec8040c4381.slice/crio-30a911a3a1632a60c68850211209ef6267392476d541ac77146444dd7c26b96f WatchSource:0}: Error finding container 30a911a3a1632a60c68850211209ef6267392476d541ac77146444dd7c26b96f: Status 404 returned error can't find the container with id 30a911a3a1632a60c68850211209ef6267392476d541ac77146444dd7c26b96f
Sep 18 22:27:53.773818 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:53.773787    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-62f806-ch465" event={"ID":"637cd174-47cb-4a86-90f1-3ec8040c4381","Type":"ContainerStarted","Data":"060009e7922e16582f4e68bcccaa5aa3070ca87c377240ae6289f7464fed48d6"}
Sep 18 22:27:53.774261 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:53.773839    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-62f806-ch465" event={"ID":"637cd174-47cb-4a86-90f1-3ec8040c4381","Type":"ContainerStarted","Data":"30a911a3a1632a60c68850211209ef6267392476d541ac77146444dd7c26b96f"}
Sep 18 22:27:53.792593 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:53.792534    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-62f806-ch465" podStartSLOduration=1.792514741 podStartE2EDuration="1.792514741s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:27:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:27:53.789065168 +0000 UTC m=+1653.108737224" watchObservedRunningTime="2026-09-18 22:27:53.792514741 +0000 UTC m=+1653.112186797"
Sep 18 22:27:54.781572 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:54.781538    2577 generic.go:356] "Generic (PLEG): container finished" podID="637cd174-47cb-4a86-90f1-3ec8040c4381" containerID="060009e7922e16582f4e68bcccaa5aa3070ca87c377240ae6289f7464fed48d6" exitCode=0
Sep 18 22:27:54.782000 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:54.781633    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-62f806-ch465" event={"ID":"637cd174-47cb-4a86-90f1-3ec8040c4381","Type":"ContainerDied","Data":"060009e7922e16582f4e68bcccaa5aa3070ca87c377240ae6289f7464fed48d6"}
Sep 18 22:27:55.929121 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:55.929097    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-62f806-ch465"
Sep 18 22:27:56.036580 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:56.036554    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/637cd174-47cb-4a86-90f1-3ec8040c4381-maas-api-service-ca\") pod \"637cd174-47cb-4a86-90f1-3ec8040c4381\" (UID: \"637cd174-47cb-4a86-90f1-3ec8040c4381\") "
Sep 18 22:27:56.036906 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:56.036878    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/637cd174-47cb-4a86-90f1-3ec8040c4381-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "637cd174-47cb-4a86-90f1-3ec8040c4381" (UID: "637cd174-47cb-4a86-90f1-3ec8040c4381"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:27:56.138282 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:56.138253    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/637cd174-47cb-4a86-90f1-3ec8040c4381-maas-api-service-ca\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:27:56.795511 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:56.795486    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-62f806-ch465"
Sep 18 22:27:56.795691 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:56.795481    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-62f806-ch465" event={"ID":"637cd174-47cb-4a86-90f1-3ec8040c4381","Type":"ContainerDied","Data":"30a911a3a1632a60c68850211209ef6267392476d541ac77146444dd7c26b96f"}
Sep 18 22:27:56.795691 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:56.795622    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="30a911a3a1632a60c68850211209ef6267392476d541ac77146444dd7c26b96f"
Sep 18 22:27:57.699441 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:57.699374    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-b981e2-openshift-default-68877f56f6-sm5ms"
Sep 18 22:27:57.803497 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:57.803467    2577 generic.go:356] "Generic (PLEG): container finished" podID="f2332048-f29f-4929-99a2-f3c1169a8943" containerID="412f95345c400593dd17daa29786c532655a6cc02d74b31b413f0c6199a9c892" exitCode=0
Sep 18 22:27:57.803664 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:57.803516    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-b981e2-openshift-default-68877f56f6-sm5ms"
Sep 18 22:27:57.803664 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:57.803544    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-b981e2-openshift-default-68877f56f6-sm5ms" event={"ID":"f2332048-f29f-4929-99a2-f3c1169a8943","Type":"ContainerDied","Data":"412f95345c400593dd17daa29786c532655a6cc02d74b31b413f0c6199a9c892"}
Sep 18 22:27:57.803664 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:57.803599    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-b981e2-openshift-default-68877f56f6-sm5ms" event={"ID":"f2332048-f29f-4929-99a2-f3c1169a8943","Type":"ContainerDied","Data":"6e070f4dafb99ed13689c93fe5ccae3ea8f3773902e2db274db7182f0e4fb307"}
Sep 18 22:27:57.803664 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:57.803624    2577 scope.go:117] "RemoveContainer" containerID="412f95345c400593dd17daa29786c532655a6cc02d74b31b413f0c6199a9c892"
Sep 18 22:27:57.813246 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:57.813230    2577 scope.go:117] "RemoveContainer" containerID="7178cc526180bda6fae51635718eaeffbdcb82eb3827699c80205a5b31338550"
Sep 18 22:27:57.822017 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:57.822001    2577 scope.go:117] "RemoveContainer" containerID="412f95345c400593dd17daa29786c532655a6cc02d74b31b413f0c6199a9c892"
Sep 18 22:27:57.822294 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:27:57.822275    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"412f95345c400593dd17daa29786c532655a6cc02d74b31b413f0c6199a9c892\": container with ID starting with 412f95345c400593dd17daa29786c532655a6cc02d74b31b413f0c6199a9c892 not found: ID does not exist" containerID="412f95345c400593dd17daa29786c532655a6cc02d74b31b413f0c6199a9c892"
Sep 18 22:27:57.822369 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:57.822306    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"412f95345c400593dd17daa29786c532655a6cc02d74b31b413f0c6199a9c892"} err="failed to get container status \"412f95345c400593dd17daa29786c532655a6cc02d74b31b413f0c6199a9c892\": rpc error: code = NotFound desc = could not find container \"412f95345c400593dd17daa29786c532655a6cc02d74b31b413f0c6199a9c892\": container with ID starting with 412f95345c400593dd17daa29786c532655a6cc02d74b31b413f0c6199a9c892 not found: ID does not exist"
Sep 18 22:27:57.822369 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:57.822328    2577 scope.go:117] "RemoveContainer" containerID="7178cc526180bda6fae51635718eaeffbdcb82eb3827699c80205a5b31338550"
Sep 18 22:27:57.822615 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:27:57.822596    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7178cc526180bda6fae51635718eaeffbdcb82eb3827699c80205a5b31338550\": container with ID starting with 7178cc526180bda6fae51635718eaeffbdcb82eb3827699c80205a5b31338550 not found: ID does not exist" containerID="7178cc526180bda6fae51635718eaeffbdcb82eb3827699c80205a5b31338550"
Sep 18 22:27:57.822659 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:57.822620    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7178cc526180bda6fae51635718eaeffbdcb82eb3827699c80205a5b31338550"} err="failed to get container status \"7178cc526180bda6fae51635718eaeffbdcb82eb3827699c80205a5b31338550\": rpc error: code = NotFound desc = could not find container \"7178cc526180bda6fae51635718eaeffbdcb82eb3827699c80205a5b31338550\": container with ID starting with 7178cc526180bda6fae51635718eaeffbdcb82eb3827699c80205a5b31338550 not found: ID does not exist"
Sep 18 22:27:57.856005 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:57.855979    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2332048-f29f-4929-99a2-f3c1169a8943-workload-socket\") pod \"f2332048-f29f-4929-99a2-f3c1169a8943\" (UID: \"f2332048-f29f-4929-99a2-f3c1169a8943\") "
Sep 18 22:27:57.856130 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:57.856029    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f2332048-f29f-4929-99a2-f3c1169a8943-istio-envoy\") pod \"f2332048-f29f-4929-99a2-f3c1169a8943\" (UID: \"f2332048-f29f-4929-99a2-f3c1169a8943\") "
Sep 18 22:27:57.856130 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:57.856051    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f2332048-f29f-4929-99a2-f3c1169a8943-workload-certs\") pod \"f2332048-f29f-4929-99a2-f3c1169a8943\" (UID: \"f2332048-f29f-4929-99a2-f3c1169a8943\") "
Sep 18 22:27:57.856130 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:57.856075    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f2332048-f29f-4929-99a2-f3c1169a8943-istio-token\") pod \"f2332048-f29f-4929-99a2-f3c1169a8943\" (UID: \"f2332048-f29f-4929-99a2-f3c1169a8943\") "
Sep 18 22:27:57.856303 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:57.856148    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xzxs4\" (UniqueName: \"kubernetes.io/projected/f2332048-f29f-4929-99a2-f3c1169a8943-kube-api-access-xzxs4\") pod \"f2332048-f29f-4929-99a2-f3c1169a8943\" (UID: \"f2332048-f29f-4929-99a2-f3c1169a8943\") "
Sep 18 22:27:57.856303 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:57.856188    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f2332048-f29f-4929-99a2-f3c1169a8943-istiod-ca-cert\") pod \"f2332048-f29f-4929-99a2-f3c1169a8943\" (UID: \"f2332048-f29f-4929-99a2-f3c1169a8943\") "
Sep 18 22:27:57.856303 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:57.856289    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2332048-f29f-4929-99a2-f3c1169a8943-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f2332048-f29f-4929-99a2-f3c1169a8943" (UID: "f2332048-f29f-4929-99a2-f3c1169a8943"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:27:57.856453 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:57.856316    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f2332048-f29f-4929-99a2-f3c1169a8943-istio-data\") pod \"f2332048-f29f-4929-99a2-f3c1169a8943\" (UID: \"f2332048-f29f-4929-99a2-f3c1169a8943\") "
Sep 18 22:27:57.856453 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:57.856353    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2332048-f29f-4929-99a2-f3c1169a8943-credential-socket\") pod \"f2332048-f29f-4929-99a2-f3c1169a8943\" (UID: \"f2332048-f29f-4929-99a2-f3c1169a8943\") "
Sep 18 22:27:57.856453 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:57.856368    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2332048-f29f-4929-99a2-f3c1169a8943-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f2332048-f29f-4929-99a2-f3c1169a8943" (UID: "f2332048-f29f-4929-99a2-f3c1169a8943"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:27:57.856453 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:57.856386    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f2332048-f29f-4929-99a2-f3c1169a8943-istio-podinfo\") pod \"f2332048-f29f-4929-99a2-f3c1169a8943\" (UID: \"f2332048-f29f-4929-99a2-f3c1169a8943\") "
Sep 18 22:27:57.856664 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:57.856589    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2332048-f29f-4929-99a2-f3c1169a8943-istio-data" (OuterVolumeSpecName: "istio-data") pod "f2332048-f29f-4929-99a2-f3c1169a8943" (UID: "f2332048-f29f-4929-99a2-f3c1169a8943"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:27:57.856664 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:57.856608    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2332048-f29f-4929-99a2-f3c1169a8943-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f2332048-f29f-4929-99a2-f3c1169a8943" (UID: "f2332048-f29f-4929-99a2-f3c1169a8943"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:27:57.856921 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:57.856898    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f2332048-f29f-4929-99a2-f3c1169a8943-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f2332048-f29f-4929-99a2-f3c1169a8943" (UID: "f2332048-f29f-4929-99a2-f3c1169a8943"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:27:57.857160 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:57.856884    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2332048-f29f-4929-99a2-f3c1169a8943-workload-socket\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:27:57.857160 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:57.856973    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f2332048-f29f-4929-99a2-f3c1169a8943-workload-certs\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:27:57.857160 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:57.856995    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f2332048-f29f-4929-99a2-f3c1169a8943-istio-data\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:27:57.857160 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:57.857053    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2332048-f29f-4929-99a2-f3c1169a8943-credential-socket\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:27:57.858622 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:57.858597    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2332048-f29f-4929-99a2-f3c1169a8943-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f2332048-f29f-4929-99a2-f3c1169a8943" (UID: "f2332048-f29f-4929-99a2-f3c1169a8943"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:27:57.858711 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:57.858620    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2332048-f29f-4929-99a2-f3c1169a8943-istio-token" (OuterVolumeSpecName: "istio-token") pod "f2332048-f29f-4929-99a2-f3c1169a8943" (UID: "f2332048-f29f-4929-99a2-f3c1169a8943"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:27:57.858711 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:57.858690    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f2332048-f29f-4929-99a2-f3c1169a8943-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f2332048-f29f-4929-99a2-f3c1169a8943" (UID: "f2332048-f29f-4929-99a2-f3c1169a8943"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 18 22:27:57.858711 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:57.858685    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2332048-f29f-4929-99a2-f3c1169a8943-kube-api-access-xzxs4" (OuterVolumeSpecName: "kube-api-access-xzxs4") pod "f2332048-f29f-4929-99a2-f3c1169a8943" (UID: "f2332048-f29f-4929-99a2-f3c1169a8943"). InnerVolumeSpecName "kube-api-access-xzxs4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:27:57.958517 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:57.958425    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f2332048-f29f-4929-99a2-f3c1169a8943-istio-podinfo\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:27:57.958517 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:57.958454    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f2332048-f29f-4929-99a2-f3c1169a8943-istio-envoy\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:27:57.958517 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:57.958466    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f2332048-f29f-4929-99a2-f3c1169a8943-istio-token\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:27:57.958517 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:57.958479    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xzxs4\" (UniqueName: \"kubernetes.io/projected/f2332048-f29f-4929-99a2-f3c1169a8943-kube-api-access-xzxs4\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:27:57.958517 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:57.958490    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f2332048-f29f-4929-99a2-f3c1169a8943-istiod-ca-cert\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:27:58.127152 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:58.127119    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-b981e2-openshift-default-68877f56f6-sm5ms"]
Sep 18 22:27:58.134685 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:58.134661    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-b981e2-openshift-default-68877f56f6-sm5ms"]
Sep 18 22:27:59.140849 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:27:59.140816    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f2332048-f29f-4929-99a2-f3c1169a8943" path="/var/lib/kubelet/pods/f2332048-f29f-4929-99a2-f3c1169a8943/volumes"
Sep 18 22:28:03.724646 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:03.724604    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-62f806-db68bc95c-5d5dg"]
Sep 18 22:28:03.725158 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:03.724853    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-62f806-db68bc95c-5d5dg" podUID="d8937bbd-8ac8-4021-8cf1-dcb95cd64ef6" containerName="payload-processing" containerID="cri-o://1bd9d51a0fbbf4b4e33b2c7cf709fb95a645a618fa7b495dadd2a00ba9d37926" gracePeriod=30
Sep 18 22:28:03.853351 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:03.853321    2577 generic.go:356] "Generic (PLEG): container finished" podID="d8937bbd-8ac8-4021-8cf1-dcb95cd64ef6" containerID="1bd9d51a0fbbf4b4e33b2c7cf709fb95a645a618fa7b495dadd2a00ba9d37926" exitCode=0
Sep 18 22:28:03.853588 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:03.853438    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-62f806-db68bc95c-5d5dg" event={"ID":"d8937bbd-8ac8-4021-8cf1-dcb95cd64ef6","Type":"ContainerDied","Data":"1bd9d51a0fbbf4b4e33b2c7cf709fb95a645a618fa7b495dadd2a00ba9d37926"}
Sep 18 22:28:03.995567 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:03.995540    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-62f806-db68bc95c-5d5dg"
Sep 18 22:28:04.025402 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:04.025368    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sdckg\" (UniqueName: \"kubernetes.io/projected/d8937bbd-8ac8-4021-8cf1-dcb95cd64ef6-kube-api-access-sdckg\") pod \"d8937bbd-8ac8-4021-8cf1-dcb95cd64ef6\" (UID: \"d8937bbd-8ac8-4021-8cf1-dcb95cd64ef6\") "
Sep 18 22:28:04.025622 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:04.025453    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d8937bbd-8ac8-4021-8cf1-dcb95cd64ef6-plugins-config-volume\") pod \"d8937bbd-8ac8-4021-8cf1-dcb95cd64ef6\" (UID: \"d8937bbd-8ac8-4021-8cf1-dcb95cd64ef6\") "
Sep 18 22:28:04.025827 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:04.025804    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d8937bbd-8ac8-4021-8cf1-dcb95cd64ef6-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d8937bbd-8ac8-4021-8cf1-dcb95cd64ef6" (UID: "d8937bbd-8ac8-4021-8cf1-dcb95cd64ef6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:28:04.027738 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:04.027709    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8937bbd-8ac8-4021-8cf1-dcb95cd64ef6-kube-api-access-sdckg" (OuterVolumeSpecName: "kube-api-access-sdckg") pod "d8937bbd-8ac8-4021-8cf1-dcb95cd64ef6" (UID: "d8937bbd-8ac8-4021-8cf1-dcb95cd64ef6"). InnerVolumeSpecName "kube-api-access-sdckg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:28:04.126939 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:04.126900    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sdckg\" (UniqueName: \"kubernetes.io/projected/d8937bbd-8ac8-4021-8cf1-dcb95cd64ef6-kube-api-access-sdckg\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:28:04.126939 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:04.126933    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d8937bbd-8ac8-4021-8cf1-dcb95cd64ef6-plugins-config-volume\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:28:04.212489 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:04.212434    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-62f806-ch465"]
Sep 18 22:28:04.215453 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:04.215404    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-62f806-ch465"]
Sep 18 22:28:04.868551 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:04.868520    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-62f806-db68bc95c-5d5dg"
Sep 18 22:28:04.869060 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:04.868548    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-62f806-db68bc95c-5d5dg" event={"ID":"d8937bbd-8ac8-4021-8cf1-dcb95cd64ef6","Type":"ContainerDied","Data":"59b19f39c3e32e52ab5e872354e800534b89d5d2050e8f5bc3eb60a13d37c615"}
Sep 18 22:28:04.869060 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:04.868637    2577 scope.go:117] "RemoveContainer" containerID="1bd9d51a0fbbf4b4e33b2c7cf709fb95a645a618fa7b495dadd2a00ba9d37926"
Sep 18 22:28:04.895216 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:04.895191    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-62f806-db68bc95c-5d5dg"]
Sep 18 22:28:04.900310 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:04.900286    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-62f806-db68bc95c-5d5dg"]
Sep 18 22:28:05.139740 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:05.139660    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="637cd174-47cb-4a86-90f1-3ec8040c4381" path="/var/lib/kubelet/pods/637cd174-47cb-4a86-90f1-3ec8040c4381/volumes"
Sep 18 22:28:05.140102 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:05.140086    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d8937bbd-8ac8-4021-8cf1-dcb95cd64ef6" path="/var/lib/kubelet/pods/d8937bbd-8ac8-4021-8cf1-dcb95cd64ef6/volumes"
Sep 18 22:28:11.665623 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:11.665595    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-62f806-openshift-default-678f9b6b98-7xbhc"]
Sep 18 22:28:11.666248 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:11.665914    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-62f806-openshift-default-678f9b6b98-7xbhc" podUID="c4215060-d143-4fd8-80f4-10f9cb813087" containerName="istio-proxy" containerID="cri-o://4febde2bce2e2a11a551a86fb0a8a4a42eab472a06e46b7332bd576efb007334" gracePeriod=30
Sep 18 22:28:12.052112 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:12.052025    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-aa9dcd-wjzsx"]
Sep 18 22:28:12.052468 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:12.052455    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3bc51d61-6a1c-416c-a87a-7017d24fd250" containerName="istio-proxy"
Sep 18 22:28:12.052516 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:12.052470    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="3bc51d61-6a1c-416c-a87a-7017d24fd250" containerName="istio-proxy"
Sep 18 22:28:12.052516 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:12.052478    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2332048-f29f-4929-99a2-f3c1169a8943" containerName="istio-proxy"
Sep 18 22:28:12.052516 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:12.052483    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2332048-f29f-4929-99a2-f3c1169a8943" containerName="istio-proxy"
Sep 18 22:28:12.052516 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:12.052496    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8937bbd-8ac8-4021-8cf1-dcb95cd64ef6" containerName="payload-processing"
Sep 18 22:28:12.052516 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:12.052502    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8937bbd-8ac8-4021-8cf1-dcb95cd64ef6" containerName="payload-processing"
Sep 18 22:28:12.052742 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:12.052525    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="637cd174-47cb-4a86-90f1-3ec8040c4381" containerName="revoke-keys"
Sep 18 22:28:12.052742 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:12.052533    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="637cd174-47cb-4a86-90f1-3ec8040c4381" containerName="revoke-keys"
Sep 18 22:28:12.052742 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:12.052643    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8937bbd-8ac8-4021-8cf1-dcb95cd64ef6" containerName="payload-processing"
Sep 18 22:28:12.052742 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:12.052654    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2332048-f29f-4929-99a2-f3c1169a8943" containerName="istio-proxy"
Sep 18 22:28:12.052742 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:12.052661    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2332048-f29f-4929-99a2-f3c1169a8943" containerName="istio-proxy"
Sep 18 22:28:12.052742 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:12.052672    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="637cd174-47cb-4a86-90f1-3ec8040c4381" containerName="revoke-keys"
Sep 18 22:28:12.057255 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:12.057236    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-aa9dcd-wjzsx"
Sep 18 22:28:12.060421 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:12.060390    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-9g7m4\""
Sep 18 22:28:12.068371 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:12.068349    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-aa9dcd-wjzsx"]
Sep 18 22:28:12.104259 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:12.104227    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c2db4f6f-0c43-4254-ba73-f745c810d07a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-aa9dcd-wjzsx\" (UID: \"c2db4f6f-0c43-4254-ba73-f745c810d07a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-aa9dcd-wjzsx"
Sep 18 22:28:12.205508 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:12.205477    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c2db4f6f-0c43-4254-ba73-f745c810d07a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-aa9dcd-wjzsx\" (UID: \"c2db4f6f-0c43-4254-ba73-f745c810d07a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-aa9dcd-wjzsx"
Sep 18 22:28:12.206135 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:12.206112    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c2db4f6f-0c43-4254-ba73-f745c810d07a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-aa9dcd-wjzsx\" (UID: \"c2db4f6f-0c43-4254-ba73-f745c810d07a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-aa9dcd-wjzsx"
Sep 18 22:28:12.368520 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:12.368481    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-aa9dcd-wjzsx"
Sep 18 22:28:12.681783 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:28:12.681754    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2db4f6f_0c43_4254_ba73_f745c810d07a.slice/crio-b57bf852ee3f89fefa14108b3f1bae11910d6459b818ff9f437a3c298b14e817 WatchSource:0}: Error finding container b57bf852ee3f89fefa14108b3f1bae11910d6459b818ff9f437a3c298b14e817: Status 404 returned error can't find the container with id b57bf852ee3f89fefa14108b3f1bae11910d6459b818ff9f437a3c298b14e817
Sep 18 22:28:12.687251 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:12.687224    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-aa9dcd-wjzsx"]
Sep 18 22:28:12.923693 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:12.923660    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-aa9dcd-wjzsx" event={"ID":"c2db4f6f-0c43-4254-ba73-f745c810d07a","Type":"ContainerStarted","Data":"b57bf852ee3f89fefa14108b3f1bae11910d6459b818ff9f437a3c298b14e817"}
Sep 18 22:28:13.931114 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:13.931081    2577 generic.go:356] "Generic (PLEG): container finished" podID="c2db4f6f-0c43-4254-ba73-f745c810d07a" containerID="1079a846c97007b3366a273258cdb1fb9df3cee8f142066a805350411f395b79" exitCode=0
Sep 18 22:28:13.931555 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:13.931129    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-aa9dcd-wjzsx" event={"ID":"c2db4f6f-0c43-4254-ba73-f745c810d07a","Type":"ContainerDied","Data":"1079a846c97007b3366a273258cdb1fb9df3cee8f142066a805350411f395b79"}
Sep 18 22:28:15.073175 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:15.073149    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-aa9dcd-wjzsx"
Sep 18 22:28:15.132419 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:15.132389    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c2db4f6f-0c43-4254-ba73-f745c810d07a-maas-api-service-ca\") pod \"c2db4f6f-0c43-4254-ba73-f745c810d07a\" (UID: \"c2db4f6f-0c43-4254-ba73-f745c810d07a\") "
Sep 18 22:28:15.132739 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:15.132717    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2db4f6f-0c43-4254-ba73-f745c810d07a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c2db4f6f-0c43-4254-ba73-f745c810d07a" (UID: "c2db4f6f-0c43-4254-ba73-f745c810d07a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:28:15.233560 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:15.233458    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c2db4f6f-0c43-4254-ba73-f745c810d07a-maas-api-service-ca\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:28:15.948863 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:15.948803    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-aa9dcd-wjzsx" event={"ID":"c2db4f6f-0c43-4254-ba73-f745c810d07a","Type":"ContainerDied","Data":"b57bf852ee3f89fefa14108b3f1bae11910d6459b818ff9f437a3c298b14e817"}
Sep 18 22:28:15.949109 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:15.948876    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b57bf852ee3f89fefa14108b3f1bae11910d6459b818ff9f437a3c298b14e817"
Sep 18 22:28:15.949109 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:15.948946    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-aa9dcd-wjzsx"
Sep 18 22:28:16.687456 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:16.687395    2577 patch_prober.go:28] interesting pod/e2e-shared-a-w2-62f806-openshift-default-678f9b6b98-7xbhc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused" start-of-body=
Sep 18 22:28:16.691991 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:16.689028    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w2-62f806-openshift-default-678f9b6b98-7xbhc" podUID="c4215060-d143-4fd8-80f4-10f9cb813087" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused"
Sep 18 22:28:16.918044 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:16.918017    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-62f806-openshift-default-678f9b6b98-7xbhc"
Sep 18 22:28:16.958606 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:16.958526    2577 generic.go:356] "Generic (PLEG): container finished" podID="c4215060-d143-4fd8-80f4-10f9cb813087" containerID="4febde2bce2e2a11a551a86fb0a8a4a42eab472a06e46b7332bd576efb007334" exitCode=0
Sep 18 22:28:16.958606 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:16.958577    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-62f806-openshift-default-678f9b6b98-7xbhc"
Sep 18 22:28:16.958777 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:16.958601    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-62f806-openshift-default-678f9b6b98-7xbhc" event={"ID":"c4215060-d143-4fd8-80f4-10f9cb813087","Type":"ContainerDied","Data":"4febde2bce2e2a11a551a86fb0a8a4a42eab472a06e46b7332bd576efb007334"}
Sep 18 22:28:16.958777 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:16.958685    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-62f806-openshift-default-678f9b6b98-7xbhc" event={"ID":"c4215060-d143-4fd8-80f4-10f9cb813087","Type":"ContainerDied","Data":"bef46372081fd8b9a1d8b147e3a08c06b533381bd6744667d651aa4ea2c5f56e"}
Sep 18 22:28:16.958777 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:16.958716    2577 scope.go:117] "RemoveContainer" containerID="4febde2bce2e2a11a551a86fb0a8a4a42eab472a06e46b7332bd576efb007334"
Sep 18 22:28:16.971446 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:16.971400    2577 scope.go:117] "RemoveContainer" containerID="f5ba7370c92a89914cfb95335e202380bf4034f9ce02d1a2e804174bd16f56ef"
Sep 18 22:28:16.981774 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:16.981757    2577 scope.go:117] "RemoveContainer" containerID="4febde2bce2e2a11a551a86fb0a8a4a42eab472a06e46b7332bd576efb007334"
Sep 18 22:28:16.982023 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:28:16.982004    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4febde2bce2e2a11a551a86fb0a8a4a42eab472a06e46b7332bd576efb007334\": container with ID starting with 4febde2bce2e2a11a551a86fb0a8a4a42eab472a06e46b7332bd576efb007334 not found: ID does not exist" containerID="4febde2bce2e2a11a551a86fb0a8a4a42eab472a06e46b7332bd576efb007334"
Sep 18 22:28:16.982082 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:16.982032    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4febde2bce2e2a11a551a86fb0a8a4a42eab472a06e46b7332bd576efb007334"} err="failed to get container status \"4febde2bce2e2a11a551a86fb0a8a4a42eab472a06e46b7332bd576efb007334\": rpc error: code = NotFound desc = could not find container \"4febde2bce2e2a11a551a86fb0a8a4a42eab472a06e46b7332bd576efb007334\": container with ID starting with 4febde2bce2e2a11a551a86fb0a8a4a42eab472a06e46b7332bd576efb007334 not found: ID does not exist"
Sep 18 22:28:16.982082 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:16.982049    2577 scope.go:117] "RemoveContainer" containerID="f5ba7370c92a89914cfb95335e202380bf4034f9ce02d1a2e804174bd16f56ef"
Sep 18 22:28:16.982324 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:28:16.982307    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5ba7370c92a89914cfb95335e202380bf4034f9ce02d1a2e804174bd16f56ef\": container with ID starting with f5ba7370c92a89914cfb95335e202380bf4034f9ce02d1a2e804174bd16f56ef not found: ID does not exist" containerID="f5ba7370c92a89914cfb95335e202380bf4034f9ce02d1a2e804174bd16f56ef"
Sep 18 22:28:16.982371 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:16.982331    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5ba7370c92a89914cfb95335e202380bf4034f9ce02d1a2e804174bd16f56ef"} err="failed to get container status \"f5ba7370c92a89914cfb95335e202380bf4034f9ce02d1a2e804174bd16f56ef\": rpc error: code = NotFound desc = could not find container \"f5ba7370c92a89914cfb95335e202380bf4034f9ce02d1a2e804174bd16f56ef\": container with ID starting with f5ba7370c92a89914cfb95335e202380bf4034f9ce02d1a2e804174bd16f56ef not found: ID does not exist"
Sep 18 22:28:17.052682 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:17.052648    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4215060-d143-4fd8-80f4-10f9cb813087-credential-socket\") pod \"c4215060-d143-4fd8-80f4-10f9cb813087\" (UID: \"c4215060-d143-4fd8-80f4-10f9cb813087\") "
Sep 18 22:28:17.052868 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:17.052700    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c4215060-d143-4fd8-80f4-10f9cb813087-istio-envoy\") pod \"c4215060-d143-4fd8-80f4-10f9cb813087\" (UID: \"c4215060-d143-4fd8-80f4-10f9cb813087\") "
Sep 18 22:28:17.052868 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:17.052746    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c4215060-d143-4fd8-80f4-10f9cb813087-istio-data\") pod \"c4215060-d143-4fd8-80f4-10f9cb813087\" (UID: \"c4215060-d143-4fd8-80f4-10f9cb813087\") "
Sep 18 22:28:17.052868 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:17.052765    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c4215060-d143-4fd8-80f4-10f9cb813087-istiod-ca-cert\") pod \"c4215060-d143-4fd8-80f4-10f9cb813087\" (UID: \"c4215060-d143-4fd8-80f4-10f9cb813087\") "
Sep 18 22:28:17.052868 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:17.052799    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4215060-d143-4fd8-80f4-10f9cb813087-workload-socket\") pod \"c4215060-d143-4fd8-80f4-10f9cb813087\" (UID: \"c4215060-d143-4fd8-80f4-10f9cb813087\") "
Sep 18 22:28:17.052868 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:17.052821    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c4215060-d143-4fd8-80f4-10f9cb813087-istio-podinfo\") pod \"c4215060-d143-4fd8-80f4-10f9cb813087\" (UID: \"c4215060-d143-4fd8-80f4-10f9cb813087\") "
Sep 18 22:28:17.053153 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:17.052880    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c4215060-d143-4fd8-80f4-10f9cb813087-istio-token\") pod \"c4215060-d143-4fd8-80f4-10f9cb813087\" (UID: \"c4215060-d143-4fd8-80f4-10f9cb813087\") "
Sep 18 22:28:17.053153 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:17.052943    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4215060-d143-4fd8-80f4-10f9cb813087-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c4215060-d143-4fd8-80f4-10f9cb813087" (UID: "c4215060-d143-4fd8-80f4-10f9cb813087"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:28:17.053153 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:17.052953    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c4215060-d143-4fd8-80f4-10f9cb813087-workload-certs\") pod \"c4215060-d143-4fd8-80f4-10f9cb813087\" (UID: \"c4215060-d143-4fd8-80f4-10f9cb813087\") "
Sep 18 22:28:17.053153 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:17.053038    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rdhhf\" (UniqueName: \"kubernetes.io/projected/c4215060-d143-4fd8-80f4-10f9cb813087-kube-api-access-rdhhf\") pod \"c4215060-d143-4fd8-80f4-10f9cb813087\" (UID: \"c4215060-d143-4fd8-80f4-10f9cb813087\") "
Sep 18 22:28:17.053153 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:17.053042    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4215060-d143-4fd8-80f4-10f9cb813087-istio-data" (OuterVolumeSpecName: "istio-data") pod "c4215060-d143-4fd8-80f4-10f9cb813087" (UID: "c4215060-d143-4fd8-80f4-10f9cb813087"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:28:17.053153 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:17.053101    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4215060-d143-4fd8-80f4-10f9cb813087-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c4215060-d143-4fd8-80f4-10f9cb813087" (UID: "c4215060-d143-4fd8-80f4-10f9cb813087"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:28:17.053153 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:17.053137    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4215060-d143-4fd8-80f4-10f9cb813087-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c4215060-d143-4fd8-80f4-10f9cb813087" (UID: "c4215060-d143-4fd8-80f4-10f9cb813087"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:28:17.053562 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:17.053195    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c4215060-d143-4fd8-80f4-10f9cb813087-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c4215060-d143-4fd8-80f4-10f9cb813087" (UID: "c4215060-d143-4fd8-80f4-10f9cb813087"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:28:17.053562 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:17.053457    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c4215060-d143-4fd8-80f4-10f9cb813087-workload-certs\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:28:17.053562 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:17.053476    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4215060-d143-4fd8-80f4-10f9cb813087-credential-socket\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:28:17.053562 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:17.053488    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c4215060-d143-4fd8-80f4-10f9cb813087-istio-data\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:28:17.053562 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:17.053502    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c4215060-d143-4fd8-80f4-10f9cb813087-istiod-ca-cert\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:28:17.053562 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:17.053514    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4215060-d143-4fd8-80f4-10f9cb813087-workload-socket\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:28:17.055499 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:17.055451    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4215060-d143-4fd8-80f4-10f9cb813087-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c4215060-d143-4fd8-80f4-10f9cb813087" (UID: "c4215060-d143-4fd8-80f4-10f9cb813087"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:28:17.055499 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:17.055454    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4215060-d143-4fd8-80f4-10f9cb813087-kube-api-access-rdhhf" (OuterVolumeSpecName: "kube-api-access-rdhhf") pod "c4215060-d143-4fd8-80f4-10f9cb813087" (UID: "c4215060-d143-4fd8-80f4-10f9cb813087"). InnerVolumeSpecName "kube-api-access-rdhhf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:28:17.055737 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:17.055717    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4215060-d143-4fd8-80f4-10f9cb813087-istio-token" (OuterVolumeSpecName: "istio-token") pod "c4215060-d143-4fd8-80f4-10f9cb813087" (UID: "c4215060-d143-4fd8-80f4-10f9cb813087"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:28:17.055802 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:17.055779    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c4215060-d143-4fd8-80f4-10f9cb813087-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c4215060-d143-4fd8-80f4-10f9cb813087" (UID: "c4215060-d143-4fd8-80f4-10f9cb813087"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 18 22:28:17.154837 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:17.154805    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c4215060-d143-4fd8-80f4-10f9cb813087-istio-podinfo\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:28:17.154837 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:17.154830    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c4215060-d143-4fd8-80f4-10f9cb813087-istio-token\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:28:17.155006 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:17.154844    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rdhhf\" (UniqueName: \"kubernetes.io/projected/c4215060-d143-4fd8-80f4-10f9cb813087-kube-api-access-rdhhf\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:28:17.155006 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:17.154857    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c4215060-d143-4fd8-80f4-10f9cb813087-istio-envoy\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:28:17.289255 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:17.289179    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-62f806-openshift-default-678f9b6b98-7xbhc"]
Sep 18 22:28:17.304960 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:17.304923    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-62f806-openshift-default-678f9b6b98-7xbhc"]
Sep 18 22:28:19.140363 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:19.140331    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4215060-d143-4fd8-80f4-10f9cb813087" path="/var/lib/kubelet/pods/c4215060-d143-4fd8-80f4-10f9cb813087/volumes"
Sep 18 22:28:23.053429 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:23.053378    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-aa9dcd-wjzsx"]
Sep 18 22:28:23.061445 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:23.061379    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-aa9dcd-wjzsx"]
Sep 18 22:28:23.142177 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:23.142140    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c2db4f6f-0c43-4254-ba73-f745c810d07a" path="/var/lib/kubelet/pods/c2db4f6f-0c43-4254-ba73-f745c810d07a/volumes"
Sep 18 22:28:30.094376 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:30.094338    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-aa9dcd-openshift-default-6dcc9d97fb-4z9l2"]
Sep 18 22:28:30.094794 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:30.094562    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w2-aa9dcd-openshift-default-6dcc9d97fb-4z9l2" podUID="0ca4a048-4332-4aa2-867a-7b7fc269ee04" containerName="istio-proxy" containerID="cri-o://02f705ba02ee32346d473609881ec9ad6565057e6a8c3fa346d1175da4b3315e" gracePeriod=30
Sep 18 22:28:33.495585 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:33.495543    2577 patch_prober.go:28] interesting pod/e2e-shared-b-w2-aa9dcd-openshift-default-6dcc9d97fb-4z9l2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 18 22:28:33.495966 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:33.495610    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w2-aa9dcd-openshift-default-6dcc9d97fb-4z9l2" podUID="0ca4a048-4332-4aa2-867a-7b7fc269ee04" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 22:28:35.353469 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:35.353444    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-aa9dcd-openshift-default-6dcc9d97fb-4z9l2"
Sep 18 22:28:35.532196 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:35.532103    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ca4a048-4332-4aa2-867a-7b7fc269ee04-workload-socket\") pod \"0ca4a048-4332-4aa2-867a-7b7fc269ee04\" (UID: \"0ca4a048-4332-4aa2-867a-7b7fc269ee04\") "
Sep 18 22:28:35.532196 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:35.532139    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0ca4a048-4332-4aa2-867a-7b7fc269ee04-istio-podinfo\") pod \"0ca4a048-4332-4aa2-867a-7b7fc269ee04\" (UID: \"0ca4a048-4332-4aa2-867a-7b7fc269ee04\") "
Sep 18 22:28:35.532467 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:35.532207    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0ca4a048-4332-4aa2-867a-7b7fc269ee04-istio-data\") pod \"0ca4a048-4332-4aa2-867a-7b7fc269ee04\" (UID: \"0ca4a048-4332-4aa2-867a-7b7fc269ee04\") "
Sep 18 22:28:35.532467 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:35.532230    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0ca4a048-4332-4aa2-867a-7b7fc269ee04-istiod-ca-cert\") pod \"0ca4a048-4332-4aa2-867a-7b7fc269ee04\" (UID: \"0ca4a048-4332-4aa2-867a-7b7fc269ee04\") "
Sep 18 22:28:35.532467 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:35.532385    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0ca4a048-4332-4aa2-867a-7b7fc269ee04-workload-certs\") pod \"0ca4a048-4332-4aa2-867a-7b7fc269ee04\" (UID: \"0ca4a048-4332-4aa2-867a-7b7fc269ee04\") "
Sep 18 22:28:35.532467 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:35.532448    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ca4a048-4332-4aa2-867a-7b7fc269ee04-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0ca4a048-4332-4aa2-867a-7b7fc269ee04" (UID: "0ca4a048-4332-4aa2-867a-7b7fc269ee04"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:28:35.532467 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:35.532463    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0ca4a048-4332-4aa2-867a-7b7fc269ee04-istio-envoy\") pod \"0ca4a048-4332-4aa2-867a-7b7fc269ee04\" (UID: \"0ca4a048-4332-4aa2-867a-7b7fc269ee04\") "
Sep 18 22:28:35.532784 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:35.532518    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ca4a048-4332-4aa2-867a-7b7fc269ee04-istio-data" (OuterVolumeSpecName: "istio-data") pod "0ca4a048-4332-4aa2-867a-7b7fc269ee04" (UID: "0ca4a048-4332-4aa2-867a-7b7fc269ee04"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:28:35.532784 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:35.532540    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0ca4a048-4332-4aa2-867a-7b7fc269ee04-istio-token\") pod \"0ca4a048-4332-4aa2-867a-7b7fc269ee04\" (UID: \"0ca4a048-4332-4aa2-867a-7b7fc269ee04\") "
Sep 18 22:28:35.532784 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:35.532571    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ca4a048-4332-4aa2-867a-7b7fc269ee04-credential-socket\") pod \"0ca4a048-4332-4aa2-867a-7b7fc269ee04\" (UID: \"0ca4a048-4332-4aa2-867a-7b7fc269ee04\") "
Sep 18 22:28:35.532784 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:35.532617    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-722qs\" (UniqueName: \"kubernetes.io/projected/0ca4a048-4332-4aa2-867a-7b7fc269ee04-kube-api-access-722qs\") pod \"0ca4a048-4332-4aa2-867a-7b7fc269ee04\" (UID: \"0ca4a048-4332-4aa2-867a-7b7fc269ee04\") "
Sep 18 22:28:35.532784 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:35.532638    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ca4a048-4332-4aa2-867a-7b7fc269ee04-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0ca4a048-4332-4aa2-867a-7b7fc269ee04" (UID: "0ca4a048-4332-4aa2-867a-7b7fc269ee04"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:28:35.532784 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:35.532663    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ca4a048-4332-4aa2-867a-7b7fc269ee04-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0ca4a048-4332-4aa2-867a-7b7fc269ee04" (UID: "0ca4a048-4332-4aa2-867a-7b7fc269ee04"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:28:35.533258 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:35.532861    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ca4a048-4332-4aa2-867a-7b7fc269ee04-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0ca4a048-4332-4aa2-867a-7b7fc269ee04" (UID: "0ca4a048-4332-4aa2-867a-7b7fc269ee04"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:28:35.533258 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:35.533040    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ca4a048-4332-4aa2-867a-7b7fc269ee04-workload-socket\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:28:35.533258 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:35.533062    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0ca4a048-4332-4aa2-867a-7b7fc269ee04-istio-data\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:28:35.533258 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:35.533076    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0ca4a048-4332-4aa2-867a-7b7fc269ee04-istiod-ca-cert\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:28:35.533258 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:35.533089    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0ca4a048-4332-4aa2-867a-7b7fc269ee04-workload-certs\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:28:35.533258 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:35.533122    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ca4a048-4332-4aa2-867a-7b7fc269ee04-credential-socket\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:28:35.534909 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:35.534885    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ca4a048-4332-4aa2-867a-7b7fc269ee04-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0ca4a048-4332-4aa2-867a-7b7fc269ee04" (UID: "0ca4a048-4332-4aa2-867a-7b7fc269ee04"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:28:35.535024 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:35.534926    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ca4a048-4332-4aa2-867a-7b7fc269ee04-istio-token" (OuterVolumeSpecName: "istio-token") pod "0ca4a048-4332-4aa2-867a-7b7fc269ee04" (UID: "0ca4a048-4332-4aa2-867a-7b7fc269ee04"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:28:35.535024 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:35.534921    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0ca4a048-4332-4aa2-867a-7b7fc269ee04-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0ca4a048-4332-4aa2-867a-7b7fc269ee04" (UID: "0ca4a048-4332-4aa2-867a-7b7fc269ee04"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 18 22:28:35.535745 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:35.535725    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ca4a048-4332-4aa2-867a-7b7fc269ee04-kube-api-access-722qs" (OuterVolumeSpecName: "kube-api-access-722qs") pod "0ca4a048-4332-4aa2-867a-7b7fc269ee04" (UID: "0ca4a048-4332-4aa2-867a-7b7fc269ee04"). InnerVolumeSpecName "kube-api-access-722qs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:28:35.634014 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:35.633974    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0ca4a048-4332-4aa2-867a-7b7fc269ee04-istio-envoy\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:28:35.634014 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:35.634006    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0ca4a048-4332-4aa2-867a-7b7fc269ee04-istio-token\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:28:35.634014 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:35.634017    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-722qs\" (UniqueName: \"kubernetes.io/projected/0ca4a048-4332-4aa2-867a-7b7fc269ee04-kube-api-access-722qs\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:28:35.634014 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:35.634027    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0ca4a048-4332-4aa2-867a-7b7fc269ee04-istio-podinfo\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:28:36.088176 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:36.088143    2577 generic.go:356] "Generic (PLEG): container finished" podID="0ca4a048-4332-4aa2-867a-7b7fc269ee04" containerID="02f705ba02ee32346d473609881ec9ad6565057e6a8c3fa346d1175da4b3315e" exitCode=0
Sep 18 22:28:36.088345 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:36.088188    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-aa9dcd-openshift-default-6dcc9d97fb-4z9l2" event={"ID":"0ca4a048-4332-4aa2-867a-7b7fc269ee04","Type":"ContainerDied","Data":"02f705ba02ee32346d473609881ec9ad6565057e6a8c3fa346d1175da4b3315e"}
Sep 18 22:28:36.088345 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:36.088242    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-aa9dcd-openshift-default-6dcc9d97fb-4z9l2" event={"ID":"0ca4a048-4332-4aa2-867a-7b7fc269ee04","Type":"ContainerDied","Data":"2e81eafbb14848078123c0cff792bb0f4dec152070f9ba13fe4d03824f4dda12"}
Sep 18 22:28:36.088345 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:36.088256    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-aa9dcd-openshift-default-6dcc9d97fb-4z9l2"
Sep 18 22:28:36.088345 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:36.088271    2577 scope.go:117] "RemoveContainer" containerID="02f705ba02ee32346d473609881ec9ad6565057e6a8c3fa346d1175da4b3315e"
Sep 18 22:28:36.098819 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:36.098794    2577 scope.go:117] "RemoveContainer" containerID="2fe3212e8fb873017c765170b035ac76490400412aa8fa02833dde2481541273"
Sep 18 22:28:36.107233 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:36.107218    2577 scope.go:117] "RemoveContainer" containerID="02f705ba02ee32346d473609881ec9ad6565057e6a8c3fa346d1175da4b3315e"
Sep 18 22:28:36.107526 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:28:36.107510    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02f705ba02ee32346d473609881ec9ad6565057e6a8c3fa346d1175da4b3315e\": container with ID starting with 02f705ba02ee32346d473609881ec9ad6565057e6a8c3fa346d1175da4b3315e not found: ID does not exist" containerID="02f705ba02ee32346d473609881ec9ad6565057e6a8c3fa346d1175da4b3315e"
Sep 18 22:28:36.107598 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:36.107537    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02f705ba02ee32346d473609881ec9ad6565057e6a8c3fa346d1175da4b3315e"} err="failed to get container status \"02f705ba02ee32346d473609881ec9ad6565057e6a8c3fa346d1175da4b3315e\": rpc error: code = NotFound desc = could not find container \"02f705ba02ee32346d473609881ec9ad6565057e6a8c3fa346d1175da4b3315e\": container with ID starting with 02f705ba02ee32346d473609881ec9ad6565057e6a8c3fa346d1175da4b3315e not found: ID does not exist"
Sep 18 22:28:36.107598 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:36.107558    2577 scope.go:117] "RemoveContainer" containerID="2fe3212e8fb873017c765170b035ac76490400412aa8fa02833dde2481541273"
Sep 18 22:28:36.107877 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:28:36.107824    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2fe3212e8fb873017c765170b035ac76490400412aa8fa02833dde2481541273\": container with ID starting with 2fe3212e8fb873017c765170b035ac76490400412aa8fa02833dde2481541273 not found: ID does not exist" containerID="2fe3212e8fb873017c765170b035ac76490400412aa8fa02833dde2481541273"
Sep 18 22:28:36.107877 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:36.107853    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2fe3212e8fb873017c765170b035ac76490400412aa8fa02833dde2481541273"} err="failed to get container status \"2fe3212e8fb873017c765170b035ac76490400412aa8fa02833dde2481541273\": rpc error: code = NotFound desc = could not find container \"2fe3212e8fb873017c765170b035ac76490400412aa8fa02833dde2481541273\": container with ID starting with 2fe3212e8fb873017c765170b035ac76490400412aa8fa02833dde2481541273 not found: ID does not exist"
Sep 18 22:28:36.112072 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:36.112048    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-aa9dcd-openshift-default-6dcc9d97fb-4z9l2"]
Sep 18 22:28:36.114483 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:36.114465    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-aa9dcd-openshift-default-6dcc9d97fb-4z9l2"]
Sep 18 22:28:37.140505 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:37.140472    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ca4a048-4332-4aa2-867a-7b7fc269ee04" path="/var/lib/kubelet/pods/0ca4a048-4332-4aa2-867a-7b7fc269ee04/volumes"
Sep 18 22:28:45.653936 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:45.653858    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7642-81bfe7"]
Sep 18 22:28:45.654382 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:45.654236    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4215060-d143-4fd8-80f4-10f9cb813087" containerName="istio-proxy"
Sep 18 22:28:45.654382 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:45.654247    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4215060-d143-4fd8-80f4-10f9cb813087" containerName="istio-proxy"
Sep 18 22:28:45.654382 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:45.654254    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2db4f6f-0c43-4254-ba73-f745c810d07a" containerName="revoke-keys"
Sep 18 22:28:45.654382 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:45.654259    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2db4f6f-0c43-4254-ba73-f745c810d07a" containerName="revoke-keys"
Sep 18 22:28:45.654382 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:45.654267    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4215060-d143-4fd8-80f4-10f9cb813087" containerName="istio-proxy"
Sep 18 22:28:45.654382 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:45.654273    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4215060-d143-4fd8-80f4-10f9cb813087" containerName="istio-proxy"
Sep 18 22:28:45.654382 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:45.654280    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ca4a048-4332-4aa2-867a-7b7fc269ee04" containerName="istio-proxy"
Sep 18 22:28:45.654382 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:45.654287    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ca4a048-4332-4aa2-867a-7b7fc269ee04" containerName="istio-proxy"
Sep 18 22:28:45.654382 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:45.654301    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2332048-f29f-4929-99a2-f3c1169a8943" containerName="istio-proxy"
Sep 18 22:28:45.654382 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:45.654306    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2332048-f29f-4929-99a2-f3c1169a8943" containerName="istio-proxy"
Sep 18 22:28:45.654382 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:45.654368    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ca4a048-4332-4aa2-867a-7b7fc269ee04" containerName="istio-proxy"
Sep 18 22:28:45.654382 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:45.654375    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4215060-d143-4fd8-80f4-10f9cb813087" containerName="istio-proxy"
Sep 18 22:28:45.654382 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:45.654381    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ca4a048-4332-4aa2-867a-7b7fc269ee04" containerName="istio-proxy"
Sep 18 22:28:45.654382 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:45.654387    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2db4f6f-0c43-4254-ba73-f745c810d07a" containerName="revoke-keys"
Sep 18 22:28:45.654828 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:45.654394    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4215060-d143-4fd8-80f4-10f9cb813087" containerName="istio-proxy"
Sep 18 22:28:45.658805 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:45.658788    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7642-81bfe7"
Sep 18 22:28:45.661207 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:45.661186    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-t97qt\""
Sep 18 22:28:45.667995 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:45.667971    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7642-81bfe7"]
Sep 18 22:28:45.725038 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:45.725007    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26nb7\" (UniqueName: \"kubernetes.io/projected/366a171b-33ef-41c5-9148-e22cecf038a0-kube-api-access-26nb7\") pod \"test-curl-7642-81bfe7\" (UID: \"366a171b-33ef-41c5-9148-e22cecf038a0\") " pod="opendatahub/test-curl-7642-81bfe7"
Sep 18 22:28:45.826290 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:45.826257    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26nb7\" (UniqueName: \"kubernetes.io/projected/366a171b-33ef-41c5-9148-e22cecf038a0-kube-api-access-26nb7\") pod \"test-curl-7642-81bfe7\" (UID: \"366a171b-33ef-41c5-9148-e22cecf038a0\") " pod="opendatahub/test-curl-7642-81bfe7"
Sep 18 22:28:45.836469 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:45.836449    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-26nb7\" (UniqueName: \"kubernetes.io/projected/366a171b-33ef-41c5-9148-e22cecf038a0-kube-api-access-26nb7\") pod \"test-curl-7642-81bfe7\" (UID: \"366a171b-33ef-41c5-9148-e22cecf038a0\") " pod="opendatahub/test-curl-7642-81bfe7"
Sep 18 22:28:45.969653 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:45.969573    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7642-81bfe7"
Sep 18 22:28:46.242744 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:46.242716    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7642-81bfe7"]
Sep 18 22:28:46.244291 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:28:46.244267    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod366a171b_33ef_41c5_9148_e22cecf038a0.slice/crio-6974d7af1a796857b66bdb92984f716903c6e6900ab1ca571b4a22af1f42fa3c WatchSource:0}: Error finding container 6974d7af1a796857b66bdb92984f716903c6e6900ab1ca571b4a22af1f42fa3c: Status 404 returned error can't find the container with id 6974d7af1a796857b66bdb92984f716903c6e6900ab1ca571b4a22af1f42fa3c
Sep 18 22:28:47.156036 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:47.155992    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7642-81bfe7" event={"ID":"366a171b-33ef-41c5-9148-e22cecf038a0","Type":"ContainerStarted","Data":"889af9e542c62ef86f8187e1fc149ffff9da3cba77a3382042dbce627ffaa5d5"}
Sep 18 22:28:47.156513 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:47.156049    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7642-81bfe7" event={"ID":"366a171b-33ef-41c5-9148-e22cecf038a0","Type":"ContainerStarted","Data":"6974d7af1a796857b66bdb92984f716903c6e6900ab1ca571b4a22af1f42fa3c"}
Sep 18 22:28:47.814102 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:47.814042    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7642-81bfe7" podStartSLOduration=2.814026705 podStartE2EDuration="2.814026705s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:28:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:28:47.185953136 +0000 UTC m=+1706.505625192" watchObservedRunningTime="2026-09-18 22:28:47.814026705 +0000 UTC m=+1707.133698759"
Sep 18 22:28:47.815130 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:47.815106    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7642-81bfe7"]
Sep 18 22:28:47.820248 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:47.820225    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7642-81bfe7"]
Sep 18 22:28:47.936270 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:47.936192    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7642-ef8830"]
Sep 18 22:28:47.936647 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:47.936631    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="366a171b-33ef-41c5-9148-e22cecf038a0" containerName="test-curl-7642-81bfe7"
Sep 18 22:28:47.936710 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:47.936649    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="366a171b-33ef-41c5-9148-e22cecf038a0" containerName="test-curl-7642-81bfe7"
Sep 18 22:28:47.936710 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:47.936663    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ca4a048-4332-4aa2-867a-7b7fc269ee04" containerName="istio-proxy"
Sep 18 22:28:47.936710 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:47.936669    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ca4a048-4332-4aa2-867a-7b7fc269ee04" containerName="istio-proxy"
Sep 18 22:28:47.936808 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:47.936732    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="366a171b-33ef-41c5-9148-e22cecf038a0" containerName="test-curl-7642-81bfe7"
Sep 18 22:28:47.939850 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:47.939835    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7642-ef8830"
Sep 18 22:28:47.949924 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:47.949896    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7642-ef8830"]
Sep 18 22:28:48.047017 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:48.046982    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n477q\" (UniqueName: \"kubernetes.io/projected/faec552b-8e13-4e04-bc94-cb9b8f744e48-kube-api-access-n477q\") pod \"test-curl-7642-ef8830\" (UID: \"faec552b-8e13-4e04-bc94-cb9b8f744e48\") " pod="opendatahub/test-curl-7642-ef8830"
Sep 18 22:28:48.147572 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:48.147539    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n477q\" (UniqueName: \"kubernetes.io/projected/faec552b-8e13-4e04-bc94-cb9b8f744e48-kube-api-access-n477q\") pod \"test-curl-7642-ef8830\" (UID: \"faec552b-8e13-4e04-bc94-cb9b8f744e48\") " pod="opendatahub/test-curl-7642-ef8830"
Sep 18 22:28:48.157520 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:48.157497    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n477q\" (UniqueName: \"kubernetes.io/projected/faec552b-8e13-4e04-bc94-cb9b8f744e48-kube-api-access-n477q\") pod \"test-curl-7642-ef8830\" (UID: \"faec552b-8e13-4e04-bc94-cb9b8f744e48\") " pod="opendatahub/test-curl-7642-ef8830"
Sep 18 22:28:48.164844 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:28:48.164821    2577 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7642-81bfe7" container="test-curl-7642-81bfe7"
Sep 18 22:28:48.250432 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:48.250339    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7642-ef8830"
Sep 18 22:28:48.526023 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:48.525998    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7642-ef8830"]
Sep 18 22:28:48.527100 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:28:48.527080    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfaec552b_8e13_4e04_bc94_cb9b8f744e48.slice/crio-6f8fa4e2eae39c293f4c3e1aa73a32b82b547209b0f167c8291e874d4e39863c WatchSource:0}: Error finding container 6f8fa4e2eae39c293f4c3e1aa73a32b82b547209b0f167c8291e874d4e39863c: Status 404 returned error can't find the container with id 6f8fa4e2eae39c293f4c3e1aa73a32b82b547209b0f167c8291e874d4e39863c
Sep 18 22:28:49.171927 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:49.171892    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7642-ef8830" event={"ID":"faec552b-8e13-4e04-bc94-cb9b8f744e48","Type":"ContainerStarted","Data":"4a1d08e4fcc6869b6fe67d52c0c47c3a0b6c09061bbcd4592c28db1826909aa8"}
Sep 18 22:28:49.172345 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:49.171938    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7642-ef8830" event={"ID":"faec552b-8e13-4e04-bc94-cb9b8f744e48","Type":"ContainerStarted","Data":"6f8fa4e2eae39c293f4c3e1aa73a32b82b547209b0f167c8291e874d4e39863c"}
Sep 18 22:28:49.172345 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:49.172104    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7642-81bfe7" podUID="366a171b-33ef-41c5-9148-e22cecf038a0" containerName="test-curl-7642-81bfe7" containerID="cri-o://889af9e542c62ef86f8187e1fc149ffff9da3cba77a3382042dbce627ffaa5d5" gracePeriod=2
Sep 18 22:28:49.190235 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:49.190183    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7642-ef8830" podStartSLOduration=2.190165289 podStartE2EDuration="2.190165289s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:28:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:28:49.187187189 +0000 UTC m=+1708.506859244" watchObservedRunningTime="2026-09-18 22:28:49.190165289 +0000 UTC m=+1708.509837343"
Sep 18 22:28:49.833002 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:49.832953    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7642-ef8830"]
Sep 18 22:28:49.841790 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:49.841764    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7642-ef8830"]
Sep 18 22:28:50.178374 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:28:50.178346    2577 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7642-ef8830" container="test-curl-7642-ef8830"
Sep 18 22:28:51.185089 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:51.185058    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7642-ef8830" podUID="faec552b-8e13-4e04-bc94-cb9b8f744e48" containerName="test-curl-7642-ef8830" containerID="cri-o://4a1d08e4fcc6869b6fe67d52c0c47c3a0b6c09061bbcd4592c28db1826909aa8" gracePeriod=2
Sep 18 22:28:51.286650 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:51.286622    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7642-81bfe7"
Sep 18 22:28:51.381101 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:51.381027    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-26nb7\" (UniqueName: \"kubernetes.io/projected/366a171b-33ef-41c5-9148-e22cecf038a0-kube-api-access-26nb7\") pod \"366a171b-33ef-41c5-9148-e22cecf038a0\" (UID: \"366a171b-33ef-41c5-9148-e22cecf038a0\") "
Sep 18 22:28:51.383387 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:51.383361    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/366a171b-33ef-41c5-9148-e22cecf038a0-kube-api-access-26nb7" (OuterVolumeSpecName: "kube-api-access-26nb7") pod "366a171b-33ef-41c5-9148-e22cecf038a0" (UID: "366a171b-33ef-41c5-9148-e22cecf038a0"). InnerVolumeSpecName "kube-api-access-26nb7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:28:51.482609 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:51.482580    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-26nb7\" (UniqueName: \"kubernetes.io/projected/366a171b-33ef-41c5-9148-e22cecf038a0-kube-api-access-26nb7\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:28:52.193019 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:52.192989    2577 generic.go:356] "Generic (PLEG): container finished" podID="366a171b-33ef-41c5-9148-e22cecf038a0" containerID="889af9e542c62ef86f8187e1fc149ffff9da3cba77a3382042dbce627ffaa5d5" exitCode=137
Sep 18 22:28:52.193436 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:52.193025    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7642-81bfe7"
Sep 18 22:28:52.193436 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:52.193043    2577 scope.go:117] "RemoveContainer" containerID="889af9e542c62ef86f8187e1fc149ffff9da3cba77a3382042dbce627ffaa5d5"
Sep 18 22:28:52.203087 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:52.203073    2577 scope.go:117] "RemoveContainer" containerID="889af9e542c62ef86f8187e1fc149ffff9da3cba77a3382042dbce627ffaa5d5"
Sep 18 22:28:52.203345 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:28:52.203322    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"889af9e542c62ef86f8187e1fc149ffff9da3cba77a3382042dbce627ffaa5d5\": container with ID starting with 889af9e542c62ef86f8187e1fc149ffff9da3cba77a3382042dbce627ffaa5d5 not found: ID does not exist" containerID="889af9e542c62ef86f8187e1fc149ffff9da3cba77a3382042dbce627ffaa5d5"
Sep 18 22:28:52.203440 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:52.203354    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"889af9e542c62ef86f8187e1fc149ffff9da3cba77a3382042dbce627ffaa5d5"} err="failed to get container status \"889af9e542c62ef86f8187e1fc149ffff9da3cba77a3382042dbce627ffaa5d5\": rpc error: code = NotFound desc = could not find container \"889af9e542c62ef86f8187e1fc149ffff9da3cba77a3382042dbce627ffaa5d5\": container with ID starting with 889af9e542c62ef86f8187e1fc149ffff9da3cba77a3382042dbce627ffaa5d5 not found: ID does not exist"
Sep 18 22:28:52.203488 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:28:52.203462    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7642-81bfe7\" is forbidden: User \"system:node:ip-10-0-141-99.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-141-99.ec2.internal' and this object" podUID="366a171b-33ef-41c5-9148-e22cecf038a0" pod="opendatahub/test-curl-7642-81bfe7"
Sep 18 22:28:53.140291 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:53.140248    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="366a171b-33ef-41c5-9148-e22cecf038a0" path="/var/lib/kubelet/pods/366a171b-33ef-41c5-9148-e22cecf038a0/volumes"
Sep 18 22:28:53.307974 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:53.307952    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7642-ef8830"
Sep 18 22:28:53.399447 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:53.399365    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n477q\" (UniqueName: \"kubernetes.io/projected/faec552b-8e13-4e04-bc94-cb9b8f744e48-kube-api-access-n477q\") pod \"faec552b-8e13-4e04-bc94-cb9b8f744e48\" (UID: \"faec552b-8e13-4e04-bc94-cb9b8f744e48\") "
Sep 18 22:28:53.401493 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:53.401460    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/faec552b-8e13-4e04-bc94-cb9b8f744e48-kube-api-access-n477q" (OuterVolumeSpecName: "kube-api-access-n477q") pod "faec552b-8e13-4e04-bc94-cb9b8f744e48" (UID: "faec552b-8e13-4e04-bc94-cb9b8f744e48"). InnerVolumeSpecName "kube-api-access-n477q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:28:53.500378 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:53.500345    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n477q\" (UniqueName: \"kubernetes.io/projected/faec552b-8e13-4e04-bc94-cb9b8f744e48-kube-api-access-n477q\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:28:54.208638 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:54.208600    2577 generic.go:356] "Generic (PLEG): container finished" podID="faec552b-8e13-4e04-bc94-cb9b8f744e48" containerID="4a1d08e4fcc6869b6fe67d52c0c47c3a0b6c09061bbcd4592c28db1826909aa8" exitCode=137
Sep 18 22:28:54.208840 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:54.208645    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7642-ef8830"
Sep 18 22:28:54.208840 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:54.208706    2577 scope.go:117] "RemoveContainer" containerID="4a1d08e4fcc6869b6fe67d52c0c47c3a0b6c09061bbcd4592c28db1826909aa8"
Sep 18 22:28:54.217843 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:54.217828    2577 scope.go:117] "RemoveContainer" containerID="4a1d08e4fcc6869b6fe67d52c0c47c3a0b6c09061bbcd4592c28db1826909aa8"
Sep 18 22:28:54.218134 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:28:54.218116    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a1d08e4fcc6869b6fe67d52c0c47c3a0b6c09061bbcd4592c28db1826909aa8\": container with ID starting with 4a1d08e4fcc6869b6fe67d52c0c47c3a0b6c09061bbcd4592c28db1826909aa8 not found: ID does not exist" containerID="4a1d08e4fcc6869b6fe67d52c0c47c3a0b6c09061bbcd4592c28db1826909aa8"
Sep 18 22:28:54.218193 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:54.218142    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a1d08e4fcc6869b6fe67d52c0c47c3a0b6c09061bbcd4592c28db1826909aa8"} err="failed to get container status \"4a1d08e4fcc6869b6fe67d52c0c47c3a0b6c09061bbcd4592c28db1826909aa8\": rpc error: code = NotFound desc = could not find container \"4a1d08e4fcc6869b6fe67d52c0c47c3a0b6c09061bbcd4592c28db1826909aa8\": container with ID starting with 4a1d08e4fcc6869b6fe67d52c0c47c3a0b6c09061bbcd4592c28db1826909aa8 not found: ID does not exist"
Sep 18 22:28:54.220183 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:28:54.220165    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7642-ef8830\" is forbidden: User \"system:node:ip-10-0-141-99.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-141-99.ec2.internal' and this object" podUID="faec552b-8e13-4e04-bc94-cb9b8f744e48" pod="opendatahub/test-curl-7642-ef8830"
Sep 18 22:28:55.140336 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:55.140306    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="faec552b-8e13-4e04-bc94-cb9b8f744e48" path="/var/lib/kubelet/pods/faec552b-8e13-4e04-bc94-cb9b8f744e48/volumes"
Sep 18 22:28:57.338369 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:57.338332    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w3-123a30/rate-test-model-123a30-kserve-77fc5958f9-vtv84"]
Sep 18 22:28:57.338788 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:57.338774    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="faec552b-8e13-4e04-bc94-cb9b8f744e48" containerName="test-curl-7642-ef8830"
Sep 18 22:28:57.338836 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:57.338789    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="faec552b-8e13-4e04-bc94-cb9b8f744e48" containerName="test-curl-7642-ef8830"
Sep 18 22:28:57.338868 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:57.338858    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="faec552b-8e13-4e04-bc94-cb9b8f744e48" containerName="test-curl-7642-ef8830"
Sep 18 22:28:57.343241 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:57.343218    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-123a30/rate-test-model-123a30-kserve-77fc5958f9-vtv84"
Sep 18 22:28:57.345867 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:57.345844    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-123a30\"/\"rate-test-model-123a30-kserve-self-signed-certs\""
Sep 18 22:28:57.346619 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:57.346599    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-123a30\"/\"kube-root-ca.crt\""
Sep 18 22:28:57.346761 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:57.346657    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-123a30\"/\"default-dockercfg-jn7hd\""
Sep 18 22:28:57.353216 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:57.353182    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-123a30\"/\"openshift-service-ca.crt\""
Sep 18 22:28:57.367951 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:57.367870    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-123a30/rate-test-model-123a30-kserve-77fc5958f9-vtv84"]
Sep 18 22:28:57.441379 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:57.441345    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmdb7\" (UniqueName: \"kubernetes.io/projected/f3bce32f-6686-49f2-8e3d-97bffedab0a4-kube-api-access-cmdb7\") pod \"rate-test-model-123a30-kserve-77fc5958f9-vtv84\" (UID: \"f3bce32f-6686-49f2-8e3d-97bffedab0a4\") " pod="ai-tenant-e2e-shared-a-w3-123a30/rate-test-model-123a30-kserve-77fc5958f9-vtv84"
Sep 18 22:28:57.441594 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:57.441384    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f3bce32f-6686-49f2-8e3d-97bffedab0a4-dshm\") pod \"rate-test-model-123a30-kserve-77fc5958f9-vtv84\" (UID: \"f3bce32f-6686-49f2-8e3d-97bffedab0a4\") " pod="ai-tenant-e2e-shared-a-w3-123a30/rate-test-model-123a30-kserve-77fc5958f9-vtv84"
Sep 18 22:28:57.441594 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:57.441429    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3bce32f-6686-49f2-8e3d-97bffedab0a4-tmp-dir\") pod \"rate-test-model-123a30-kserve-77fc5958f9-vtv84\" (UID: \"f3bce32f-6686-49f2-8e3d-97bffedab0a4\") " pod="ai-tenant-e2e-shared-a-w3-123a30/rate-test-model-123a30-kserve-77fc5958f9-vtv84"
Sep 18 22:28:57.441594 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:57.441488    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f3bce32f-6686-49f2-8e3d-97bffedab0a4-home\") pod \"rate-test-model-123a30-kserve-77fc5958f9-vtv84\" (UID: \"f3bce32f-6686-49f2-8e3d-97bffedab0a4\") " pod="ai-tenant-e2e-shared-a-w3-123a30/rate-test-model-123a30-kserve-77fc5958f9-vtv84"
Sep 18 22:28:57.441594 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:57.441567    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f3bce32f-6686-49f2-8e3d-97bffedab0a4-model-cache\") pod \"rate-test-model-123a30-kserve-77fc5958f9-vtv84\" (UID: \"f3bce32f-6686-49f2-8e3d-97bffedab0a4\") " pod="ai-tenant-e2e-shared-a-w3-123a30/rate-test-model-123a30-kserve-77fc5958f9-vtv84"
Sep 18 22:28:57.441735 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:57.441630    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f3bce32f-6686-49f2-8e3d-97bffedab0a4-tls-certs\") pod \"rate-test-model-123a30-kserve-77fc5958f9-vtv84\" (UID: \"f3bce32f-6686-49f2-8e3d-97bffedab0a4\") " pod="ai-tenant-e2e-shared-a-w3-123a30/rate-test-model-123a30-kserve-77fc5958f9-vtv84"
Sep 18 22:28:57.543038 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:57.543006    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f3bce32f-6686-49f2-8e3d-97bffedab0a4-model-cache\") pod \"rate-test-model-123a30-kserve-77fc5958f9-vtv84\" (UID: \"f3bce32f-6686-49f2-8e3d-97bffedab0a4\") " pod="ai-tenant-e2e-shared-a-w3-123a30/rate-test-model-123a30-kserve-77fc5958f9-vtv84"
Sep 18 22:28:57.543229 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:57.543076    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f3bce32f-6686-49f2-8e3d-97bffedab0a4-tls-certs\") pod \"rate-test-model-123a30-kserve-77fc5958f9-vtv84\" (UID: \"f3bce32f-6686-49f2-8e3d-97bffedab0a4\") " pod="ai-tenant-e2e-shared-a-w3-123a30/rate-test-model-123a30-kserve-77fc5958f9-vtv84"
Sep 18 22:28:57.543229 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:57.543134    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmdb7\" (UniqueName: \"kubernetes.io/projected/f3bce32f-6686-49f2-8e3d-97bffedab0a4-kube-api-access-cmdb7\") pod \"rate-test-model-123a30-kserve-77fc5958f9-vtv84\" (UID: \"f3bce32f-6686-49f2-8e3d-97bffedab0a4\") " pod="ai-tenant-e2e-shared-a-w3-123a30/rate-test-model-123a30-kserve-77fc5958f9-vtv84"
Sep 18 22:28:57.543229 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:57.543164    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f3bce32f-6686-49f2-8e3d-97bffedab0a4-dshm\") pod \"rate-test-model-123a30-kserve-77fc5958f9-vtv84\" (UID: \"f3bce32f-6686-49f2-8e3d-97bffedab0a4\") " pod="ai-tenant-e2e-shared-a-w3-123a30/rate-test-model-123a30-kserve-77fc5958f9-vtv84"
Sep 18 22:28:57.543229 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:57.543190    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3bce32f-6686-49f2-8e3d-97bffedab0a4-tmp-dir\") pod \"rate-test-model-123a30-kserve-77fc5958f9-vtv84\" (UID: \"f3bce32f-6686-49f2-8e3d-97bffedab0a4\") " pod="ai-tenant-e2e-shared-a-w3-123a30/rate-test-model-123a30-kserve-77fc5958f9-vtv84"
Sep 18 22:28:57.543229 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:57.543212    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f3bce32f-6686-49f2-8e3d-97bffedab0a4-home\") pod \"rate-test-model-123a30-kserve-77fc5958f9-vtv84\" (UID: \"f3bce32f-6686-49f2-8e3d-97bffedab0a4\") " pod="ai-tenant-e2e-shared-a-w3-123a30/rate-test-model-123a30-kserve-77fc5958f9-vtv84"
Sep 18 22:28:57.543606 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:57.543522    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f3bce32f-6686-49f2-8e3d-97bffedab0a4-model-cache\") pod \"rate-test-model-123a30-kserve-77fc5958f9-vtv84\" (UID: \"f3bce32f-6686-49f2-8e3d-97bffedab0a4\") " pod="ai-tenant-e2e-shared-a-w3-123a30/rate-test-model-123a30-kserve-77fc5958f9-vtv84"
Sep 18 22:28:57.543606 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:57.543583    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3bce32f-6686-49f2-8e3d-97bffedab0a4-tmp-dir\") pod \"rate-test-model-123a30-kserve-77fc5958f9-vtv84\" (UID: \"f3bce32f-6686-49f2-8e3d-97bffedab0a4\") " pod="ai-tenant-e2e-shared-a-w3-123a30/rate-test-model-123a30-kserve-77fc5958f9-vtv84"
Sep 18 22:28:57.543683 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:57.543636    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f3bce32f-6686-49f2-8e3d-97bffedab0a4-home\") pod \"rate-test-model-123a30-kserve-77fc5958f9-vtv84\" (UID: \"f3bce32f-6686-49f2-8e3d-97bffedab0a4\") " pod="ai-tenant-e2e-shared-a-w3-123a30/rate-test-model-123a30-kserve-77fc5958f9-vtv84"
Sep 18 22:28:57.545843 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:57.545814    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f3bce32f-6686-49f2-8e3d-97bffedab0a4-dshm\") pod \"rate-test-model-123a30-kserve-77fc5958f9-vtv84\" (UID: \"f3bce32f-6686-49f2-8e3d-97bffedab0a4\") " pod="ai-tenant-e2e-shared-a-w3-123a30/rate-test-model-123a30-kserve-77fc5958f9-vtv84"
Sep 18 22:28:57.545843 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:57.545840    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f3bce32f-6686-49f2-8e3d-97bffedab0a4-tls-certs\") pod \"rate-test-model-123a30-kserve-77fc5958f9-vtv84\" (UID: \"f3bce32f-6686-49f2-8e3d-97bffedab0a4\") " pod="ai-tenant-e2e-shared-a-w3-123a30/rate-test-model-123a30-kserve-77fc5958f9-vtv84"
Sep 18 22:28:57.556608 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:57.556581    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmdb7\" (UniqueName: \"kubernetes.io/projected/f3bce32f-6686-49f2-8e3d-97bffedab0a4-kube-api-access-cmdb7\") pod \"rate-test-model-123a30-kserve-77fc5958f9-vtv84\" (UID: \"f3bce32f-6686-49f2-8e3d-97bffedab0a4\") " pod="ai-tenant-e2e-shared-a-w3-123a30/rate-test-model-123a30-kserve-77fc5958f9-vtv84"
Sep 18 22:28:57.653687 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:57.653602    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-123a30/rate-test-model-123a30-kserve-77fc5958f9-vtv84"
Sep 18 22:28:57.949279 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:57.949249    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-123a30/rate-test-model-123a30-kserve-77fc5958f9-vtv84"]
Sep 18 22:28:57.951526 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:28:57.951467    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf3bce32f_6686_49f2_8e3d_97bffedab0a4.slice/crio-79cf686c7a36a0338d730b56628694e9b8d762a09a770eaf7c83009d29ff68cf WatchSource:0}: Error finding container 79cf686c7a36a0338d730b56628694e9b8d762a09a770eaf7c83009d29ff68cf: Status 404 returned error can't find the container with id 79cf686c7a36a0338d730b56628694e9b8d762a09a770eaf7c83009d29ff68cf
Sep 18 22:28:58.237706 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:58.237605    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-123a30/rate-test-model-123a30-kserve-77fc5958f9-vtv84" event={"ID":"f3bce32f-6686-49f2-8e3d-97bffedab0a4","Type":"ContainerStarted","Data":"17b5a60bc98839a758b202e5f853046ba9dab2ce188fba370cd081ad0e364165"}
Sep 18 22:28:58.237706 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:58.237651    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-123a30/rate-test-model-123a30-kserve-77fc5958f9-vtv84" event={"ID":"f3bce32f-6686-49f2-8e3d-97bffedab0a4","Type":"ContainerStarted","Data":"79cf686c7a36a0338d730b56628694e9b8d762a09a770eaf7c83009d29ff68cf"}
Sep 18 22:28:58.265477 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:28:58.265406    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w3-123a30/rate-test-model-123a30-kserve-77fc5958f9-vtv84" podStartSLOduration=1.265388473 podStartE2EDuration="1.265388473s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:28:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:28:58.262038818 +0000 UTC m=+1717.581710874" watchObservedRunningTime="2026-09-18 22:28:58.265388473 +0000 UTC m=+1717.585060574"
Sep 18 22:29:07.653716 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:29:07.653674    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w3-123a30/rate-test-model-123a30-kserve-77fc5958f9-vtv84"
Sep 18 22:29:07.654147 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:29:07.653737    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w3-123a30/rate-test-model-123a30-kserve-77fc5958f9-vtv84"
Sep 18 22:29:07.666959 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:29:07.666929    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w3-123a30/rate-test-model-123a30-kserve-77fc5958f9-vtv84"
Sep 18 22:29:08.319221 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:29:08.319193    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w3-123a30/rate-test-model-123a30-kserve-77fc5958f9-vtv84"
Sep 18 22:30:04.149768 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:04.149724    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-123a30/rate-test-model-123a30-kserve-77fc5958f9-vtv84"]
Sep 18 22:30:10.033213 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:10.033176    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-123a30-29829510-465gb"]
Sep 18 22:30:10.036737 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:10.036719    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-123a30-29829510-465gb"
Sep 18 22:30:10.044563 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:10.044546    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-9g7m4\""
Sep 18 22:30:10.046119 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:10.046091    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-123a30-29829510-465gb"
Sep 18 22:30:10.754248 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:10.754216    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-123a30-29829510-465gb"]
Sep 18 22:30:12.222918 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:12.222885    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-123a30-29829510-465gb"]
Sep 18 22:30:12.231217 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:30:12.231194    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf545f765_90c2_4813_9add_ea2ce1ae8607.slice/crio-9cdb5a74b49070494a21e61e5fddd60fe57777697f3d53e001352c979708d22c WatchSource:0}: Error finding container 9cdb5a74b49070494a21e61e5fddd60fe57777697f3d53e001352c979708d22c: Status 404 returned error can't find the container with id 9cdb5a74b49070494a21e61e5fddd60fe57777697f3d53e001352c979708d22c
Sep 18 22:30:12.443204 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:12.443129    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-adba81-openshift-default-554cf9cf44-4sggd"]
Sep 18 22:30:12.447761 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:12.447181    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-adba81-openshift-default-554cf9cf44-4sggd"
Sep 18 22:30:12.492491 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:30:12.492393    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"e2e-ipp-a-adba81-openshift-default-554cf9cf44-4sggd\" is forbidden: User \"system:node:ip-10-0-141-99.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-141-99.ec2.internal' and this object" podUID="6596cfcc-f03e-413e-9aa8-6a95f74a0eee" pod="openshift-ingress/e2e-ipp-a-adba81-openshift-default-554cf9cf44-4sggd"
Sep 18 22:30:12.556036 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:12.556009    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6596cfcc-f03e-413e-9aa8-6a95f74a0eee-istio-podinfo\") pod \"e2e-ipp-a-adba81-openshift-default-554cf9cf44-4sggd\" (UID: \"6596cfcc-f03e-413e-9aa8-6a95f74a0eee\") " pod="openshift-ingress/e2e-ipp-a-adba81-openshift-default-554cf9cf44-4sggd"
Sep 18 22:30:12.556154 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:12.556043    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6596cfcc-f03e-413e-9aa8-6a95f74a0eee-credential-socket\") pod \"e2e-ipp-a-adba81-openshift-default-554cf9cf44-4sggd\" (UID: \"6596cfcc-f03e-413e-9aa8-6a95f74a0eee\") " pod="openshift-ingress/e2e-ipp-a-adba81-openshift-default-554cf9cf44-4sggd"
Sep 18 22:30:12.556154 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:12.556129    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6596cfcc-f03e-413e-9aa8-6a95f74a0eee-istio-token\") pod \"e2e-ipp-a-adba81-openshift-default-554cf9cf44-4sggd\" (UID: \"6596cfcc-f03e-413e-9aa8-6a95f74a0eee\") " pod="openshift-ingress/e2e-ipp-a-adba81-openshift-default-554cf9cf44-4sggd"
Sep 18 22:30:12.556267 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:12.556170    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5mz7\" (UniqueName: \"kubernetes.io/projected/6596cfcc-f03e-413e-9aa8-6a95f74a0eee-kube-api-access-q5mz7\") pod \"e2e-ipp-a-adba81-openshift-default-554cf9cf44-4sggd\" (UID: \"6596cfcc-f03e-413e-9aa8-6a95f74a0eee\") " pod="openshift-ingress/e2e-ipp-a-adba81-openshift-default-554cf9cf44-4sggd"
Sep 18 22:30:12.556267 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:12.556209    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6596cfcc-f03e-413e-9aa8-6a95f74a0eee-istio-envoy\") pod \"e2e-ipp-a-adba81-openshift-default-554cf9cf44-4sggd\" (UID: \"6596cfcc-f03e-413e-9aa8-6a95f74a0eee\") " pod="openshift-ingress/e2e-ipp-a-adba81-openshift-default-554cf9cf44-4sggd"
Sep 18 22:30:12.556267 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:12.556258    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6596cfcc-f03e-413e-9aa8-6a95f74a0eee-workload-certs\") pod \"e2e-ipp-a-adba81-openshift-default-554cf9cf44-4sggd\" (UID: \"6596cfcc-f03e-413e-9aa8-6a95f74a0eee\") " pod="openshift-ingress/e2e-ipp-a-adba81-openshift-default-554cf9cf44-4sggd"
Sep 18 22:30:12.556439 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:12.556312    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6596cfcc-f03e-413e-9aa8-6a95f74a0eee-istiod-ca-cert\") pod \"e2e-ipp-a-adba81-openshift-default-554cf9cf44-4sggd\" (UID: \"6596cfcc-f03e-413e-9aa8-6a95f74a0eee\") " pod="openshift-ingress/e2e-ipp-a-adba81-openshift-default-554cf9cf44-4sggd"
Sep 18 22:30:12.556439 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:12.556357    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6596cfcc-f03e-413e-9aa8-6a95f74a0eee-workload-socket\") pod \"e2e-ipp-a-adba81-openshift-default-554cf9cf44-4sggd\" (UID: \"6596cfcc-f03e-413e-9aa8-6a95f74a0eee\") " pod="openshift-ingress/e2e-ipp-a-adba81-openshift-default-554cf9cf44-4sggd"
Sep 18 22:30:12.556439 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:12.556377    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6596cfcc-f03e-413e-9aa8-6a95f74a0eee-istio-data\") pod \"e2e-ipp-a-adba81-openshift-default-554cf9cf44-4sggd\" (UID: \"6596cfcc-f03e-413e-9aa8-6a95f74a0eee\") " pod="openshift-ingress/e2e-ipp-a-adba81-openshift-default-554cf9cf44-4sggd"
Sep 18 22:30:12.607510 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:12.607482    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-adba81-openshift-default-554cf9cf44-4sggd"]
Sep 18 22:30:12.656919 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:12.656894    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6596cfcc-f03e-413e-9aa8-6a95f74a0eee-istio-podinfo\") pod \"e2e-ipp-a-adba81-openshift-default-554cf9cf44-4sggd\" (UID: \"6596cfcc-f03e-413e-9aa8-6a95f74a0eee\") " pod="openshift-ingress/e2e-ipp-a-adba81-openshift-default-554cf9cf44-4sggd"
Sep 18 22:30:12.657088 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:12.656924    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6596cfcc-f03e-413e-9aa8-6a95f74a0eee-credential-socket\") pod \"e2e-ipp-a-adba81-openshift-default-554cf9cf44-4sggd\" (UID: \"6596cfcc-f03e-413e-9aa8-6a95f74a0eee\") " pod="openshift-ingress/e2e-ipp-a-adba81-openshift-default-554cf9cf44-4sggd"
Sep 18 22:30:12.657088 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:12.657007    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6596cfcc-f03e-413e-9aa8-6a95f74a0eee-istio-token\") pod \"e2e-ipp-a-adba81-openshift-default-554cf9cf44-4sggd\" (UID: \"6596cfcc-f03e-413e-9aa8-6a95f74a0eee\") " pod="openshift-ingress/e2e-ipp-a-adba81-openshift-default-554cf9cf44-4sggd"
Sep 18 22:30:12.657088 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:12.657036    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5mz7\" (UniqueName: \"kubernetes.io/projected/6596cfcc-f03e-413e-9aa8-6a95f74a0eee-kube-api-access-q5mz7\") pod \"e2e-ipp-a-adba81-openshift-default-554cf9cf44-4sggd\" (UID: \"6596cfcc-f03e-413e-9aa8-6a95f74a0eee\") " pod="openshift-ingress/e2e-ipp-a-adba81-openshift-default-554cf9cf44-4sggd"
Sep 18 22:30:12.657088 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:12.657063    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6596cfcc-f03e-413e-9aa8-6a95f74a0eee-istio-envoy\") pod \"e2e-ipp-a-adba81-openshift-default-554cf9cf44-4sggd\" (UID: \"6596cfcc-f03e-413e-9aa8-6a95f74a0eee\") " pod="openshift-ingress/e2e-ipp-a-adba81-openshift-default-554cf9cf44-4sggd"
Sep 18 22:30:12.657322 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:12.657199    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6596cfcc-f03e-413e-9aa8-6a95f74a0eee-workload-certs\") pod \"e2e-ipp-a-adba81-openshift-default-554cf9cf44-4sggd\" (UID: \"6596cfcc-f03e-413e-9aa8-6a95f74a0eee\") " pod="openshift-ingress/e2e-ipp-a-adba81-openshift-default-554cf9cf44-4sggd"
Sep 18 22:30:12.657322 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:12.657271    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6596cfcc-f03e-413e-9aa8-6a95f74a0eee-istiod-ca-cert\") pod \"e2e-ipp-a-adba81-openshift-default-554cf9cf44-4sggd\" (UID: \"6596cfcc-f03e-413e-9aa8-6a95f74a0eee\") " pod="openshift-ingress/e2e-ipp-a-adba81-openshift-default-554cf9cf44-4sggd"
Sep 18 22:30:12.657322 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:12.657317    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6596cfcc-f03e-413e-9aa8-6a95f74a0eee-credential-socket\") pod \"e2e-ipp-a-adba81-openshift-default-554cf9cf44-4sggd\" (UID: \"6596cfcc-f03e-413e-9aa8-6a95f74a0eee\") " pod="openshift-ingress/e2e-ipp-a-adba81-openshift-default-554cf9cf44-4sggd"
Sep 18 22:30:12.657529 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:12.657329    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6596cfcc-f03e-413e-9aa8-6a95f74a0eee-workload-socket\") pod \"e2e-ipp-a-adba81-openshift-default-554cf9cf44-4sggd\" (UID: \"6596cfcc-f03e-413e-9aa8-6a95f74a0eee\") " pod="openshift-ingress/e2e-ipp-a-adba81-openshift-default-554cf9cf44-4sggd"
Sep 18 22:30:12.657529 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:12.657371    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6596cfcc-f03e-413e-9aa8-6a95f74a0eee-istio-data\") pod \"e2e-ipp-a-adba81-openshift-default-554cf9cf44-4sggd\" (UID: \"6596cfcc-f03e-413e-9aa8-6a95f74a0eee\") " pod="openshift-ingress/e2e-ipp-a-adba81-openshift-default-554cf9cf44-4sggd"
Sep 18 22:30:12.657613 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:12.657559    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6596cfcc-f03e-413e-9aa8-6a95f74a0eee-workload-certs\") pod \"e2e-ipp-a-adba81-openshift-default-554cf9cf44-4sggd\" (UID: \"6596cfcc-f03e-413e-9aa8-6a95f74a0eee\") " pod="openshift-ingress/e2e-ipp-a-adba81-openshift-default-554cf9cf44-4sggd"
Sep 18 22:30:12.657701 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:12.657678    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6596cfcc-f03e-413e-9aa8-6a95f74a0eee-workload-socket\") pod \"e2e-ipp-a-adba81-openshift-default-554cf9cf44-4sggd\" (UID: \"6596cfcc-f03e-413e-9aa8-6a95f74a0eee\") " pod="openshift-ingress/e2e-ipp-a-adba81-openshift-default-554cf9cf44-4sggd"
Sep 18 22:30:12.657770 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:12.657698    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6596cfcc-f03e-413e-9aa8-6a95f74a0eee-istio-data\") pod \"e2e-ipp-a-adba81-openshift-default-554cf9cf44-4sggd\" (UID: \"6596cfcc-f03e-413e-9aa8-6a95f74a0eee\") " pod="openshift-ingress/e2e-ipp-a-adba81-openshift-default-554cf9cf44-4sggd"
Sep 18 22:30:12.658618 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:12.658599    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6596cfcc-f03e-413e-9aa8-6a95f74a0eee-istiod-ca-cert\") pod \"e2e-ipp-a-adba81-openshift-default-554cf9cf44-4sggd\" (UID: \"6596cfcc-f03e-413e-9aa8-6a95f74a0eee\") " pod="openshift-ingress/e2e-ipp-a-adba81-openshift-default-554cf9cf44-4sggd"
Sep 18 22:30:12.659538 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:12.659520    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6596cfcc-f03e-413e-9aa8-6a95f74a0eee-istio-envoy\") pod \"e2e-ipp-a-adba81-openshift-default-554cf9cf44-4sggd\" (UID: \"6596cfcc-f03e-413e-9aa8-6a95f74a0eee\") " pod="openshift-ingress/e2e-ipp-a-adba81-openshift-default-554cf9cf44-4sggd"
Sep 18 22:30:12.659916 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:12.659895    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6596cfcc-f03e-413e-9aa8-6a95f74a0eee-istio-podinfo\") pod \"e2e-ipp-a-adba81-openshift-default-554cf9cf44-4sggd\" (UID: \"6596cfcc-f03e-413e-9aa8-6a95f74a0eee\") " pod="openshift-ingress/e2e-ipp-a-adba81-openshift-default-554cf9cf44-4sggd"
Sep 18 22:30:12.695691 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:12.695670    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6596cfcc-f03e-413e-9aa8-6a95f74a0eee-istio-token\") pod \"e2e-ipp-a-adba81-openshift-default-554cf9cf44-4sggd\" (UID: \"6596cfcc-f03e-413e-9aa8-6a95f74a0eee\") " pod="openshift-ingress/e2e-ipp-a-adba81-openshift-default-554cf9cf44-4sggd"
Sep 18 22:30:12.703427 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:12.703382    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-123a30-29829510-465gb" event={"ID":"f545f765-90c2-4813-9add-ea2ce1ae8607","Type":"ContainerStarted","Data":"664fc487c7587a76934db5867666374046693fb4938e1cc59121c04f0800484f"}
Sep 18 22:30:12.703546 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:12.703484    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-123a30-29829510-465gb" event={"ID":"f545f765-90c2-4813-9add-ea2ce1ae8607","Type":"ContainerStarted","Data":"9cdb5a74b49070494a21e61e5fddd60fe57777697f3d53e001352c979708d22c"}
Sep 18 22:30:12.709870 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:12.709846    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5mz7\" (UniqueName: \"kubernetes.io/projected/6596cfcc-f03e-413e-9aa8-6a95f74a0eee-kube-api-access-q5mz7\") pod \"e2e-ipp-a-adba81-openshift-default-554cf9cf44-4sggd\" (UID: \"6596cfcc-f03e-413e-9aa8-6a95f74a0eee\") " pod="openshift-ingress/e2e-ipp-a-adba81-openshift-default-554cf9cf44-4sggd"
Sep 18 22:30:12.771428 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:12.771340    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-adba81-openshift-default-554cf9cf44-4sggd"
Sep 18 22:30:12.885822 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:12.885768    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-123a30-29829510-465gb" podStartSLOduration=3.885750966 podStartE2EDuration="3.885750966s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:30:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:30:12.88227433 +0000 UTC m=+1792.201946384" watchObservedRunningTime="2026-09-18 22:30:12.885750966 +0000 UTC m=+1792.205423021"
Sep 18 22:30:13.097109 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:30:13.097079    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6596cfcc_f03e_413e_9aa8_6a95f74a0eee.slice/crio-5b3fc1bd971bc1bf2cbd006d56e70e4f5494230c0efea99f42848a120bac37f0 WatchSource:0}: Error finding container 5b3fc1bd971bc1bf2cbd006d56e70e4f5494230c0efea99f42848a120bac37f0: Status 404 returned error can't find the container with id 5b3fc1bd971bc1bf2cbd006d56e70e4f5494230c0efea99f42848a120bac37f0
Sep 18 22:30:13.098368 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:13.098341    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-adba81-openshift-default-554cf9cf44-4sggd"]
Sep 18 22:30:13.099496 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:13.099466    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:30:13.099575 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:13.099529    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:30:13.099575 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:13.099558    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:30:13.711833 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:13.711722    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-adba81-openshift-default-554cf9cf44-4sggd" event={"ID":"6596cfcc-f03e-413e-9aa8-6a95f74a0eee","Type":"ContainerStarted","Data":"8d91f9f7d000d92f53a964f5c8723383ed480a1f1f6805501d4d83f3d4b8e4b1"}
Sep 18 22:30:13.711833 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:13.711785    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-adba81-openshift-default-554cf9cf44-4sggd" event={"ID":"6596cfcc-f03e-413e-9aa8-6a95f74a0eee","Type":"ContainerStarted","Data":"5b3fc1bd971bc1bf2cbd006d56e70e4f5494230c0efea99f42848a120bac37f0"}
Sep 18 22:30:13.713472 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:13.713449    2577 generic.go:356] "Generic (PLEG): container finished" podID="f545f765-90c2-4813-9add-ea2ce1ae8607" containerID="664fc487c7587a76934db5867666374046693fb4938e1cc59121c04f0800484f" exitCode=0
Sep 18 22:30:13.713580 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:13.713510    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-123a30-29829510-465gb" event={"ID":"f545f765-90c2-4813-9add-ea2ce1ae8607","Type":"ContainerDied","Data":"664fc487c7587a76934db5867666374046693fb4938e1cc59121c04f0800484f"}
Sep 18 22:30:13.755765 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:13.755714    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-adba81-openshift-default-554cf9cf44-4sggd" podStartSLOduration=1.755697272 podStartE2EDuration="1.755697272s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:30:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:30:13.752836512 +0000 UTC m=+1793.072508568" watchObservedRunningTime="2026-09-18 22:30:13.755697272 +0000 UTC m=+1793.075369327"
Sep 18 22:30:13.771488 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:13.771458    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-adba81-openshift-default-554cf9cf44-4sggd"
Sep 18 22:30:14.778816 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:14.778787    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-adba81-openshift-default-554cf9cf44-4sggd"
Sep 18 22:30:14.859681 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:14.859657    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-123a30-29829510-465gb"
Sep 18 22:30:15.727645 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:15.727618    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-123a30-29829510-465gb"
Sep 18 22:30:15.727645 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:15.727623    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-123a30-29829510-465gb" event={"ID":"f545f765-90c2-4813-9add-ea2ce1ae8607","Type":"ContainerDied","Data":"9cdb5a74b49070494a21e61e5fddd60fe57777697f3d53e001352c979708d22c"}
Sep 18 22:30:15.727866 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:15.727684    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9cdb5a74b49070494a21e61e5fddd60fe57777697f3d53e001352c979708d22c"
Sep 18 22:30:15.728083 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:15.728067    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-adba81-openshift-default-554cf9cf44-4sggd"
Sep 18 22:30:15.729198 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:15.729173    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-adba81-openshift-default-554cf9cf44-4sggd"
Sep 18 22:30:19.169073 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:19.169022    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w3-123a30/rate-test-model-123a30-kserve-77fc5958f9-vtv84" podUID="f3bce32f-6686-49f2-8e3d-97bffedab0a4" containerName="main" containerID="cri-o://17b5a60bc98839a758b202e5f853046ba9dab2ce188fba370cd081ad0e364165" gracePeriod=45
Sep 18 22:30:19.412182 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:19.412159    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-123a30/rate-test-model-123a30-kserve-77fc5958f9-vtv84"
Sep 18 22:30:19.521840 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:19.521765    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f3bce32f-6686-49f2-8e3d-97bffedab0a4-home\") pod \"f3bce32f-6686-49f2-8e3d-97bffedab0a4\" (UID: \"f3bce32f-6686-49f2-8e3d-97bffedab0a4\") "
Sep 18 22:30:19.521840 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:19.521793    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f3bce32f-6686-49f2-8e3d-97bffedab0a4-tls-certs\") pod \"f3bce32f-6686-49f2-8e3d-97bffedab0a4\" (UID: \"f3bce32f-6686-49f2-8e3d-97bffedab0a4\") "
Sep 18 22:30:19.522070 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:19.521844    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f3bce32f-6686-49f2-8e3d-97bffedab0a4-dshm\") pod \"f3bce32f-6686-49f2-8e3d-97bffedab0a4\" (UID: \"f3bce32f-6686-49f2-8e3d-97bffedab0a4\") "
Sep 18 22:30:19.522070 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:19.521866    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f3bce32f-6686-49f2-8e3d-97bffedab0a4-model-cache\") pod \"f3bce32f-6686-49f2-8e3d-97bffedab0a4\" (UID: \"f3bce32f-6686-49f2-8e3d-97bffedab0a4\") "
Sep 18 22:30:19.522070 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:19.521946    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cmdb7\" (UniqueName: \"kubernetes.io/projected/f3bce32f-6686-49f2-8e3d-97bffedab0a4-kube-api-access-cmdb7\") pod \"f3bce32f-6686-49f2-8e3d-97bffedab0a4\" (UID: \"f3bce32f-6686-49f2-8e3d-97bffedab0a4\") "
Sep 18 22:30:19.522070 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:19.522018    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3bce32f-6686-49f2-8e3d-97bffedab0a4-tmp-dir\") pod \"f3bce32f-6686-49f2-8e3d-97bffedab0a4\" (UID: \"f3bce32f-6686-49f2-8e3d-97bffedab0a4\") "
Sep 18 22:30:19.522070 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:19.522053    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3bce32f-6686-49f2-8e3d-97bffedab0a4-home" (OuterVolumeSpecName: "home") pod "f3bce32f-6686-49f2-8e3d-97bffedab0a4" (UID: "f3bce32f-6686-49f2-8e3d-97bffedab0a4"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:30:19.522353 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:19.522154    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3bce32f-6686-49f2-8e3d-97bffedab0a4-model-cache" (OuterVolumeSpecName: "model-cache") pod "f3bce32f-6686-49f2-8e3d-97bffedab0a4" (UID: "f3bce32f-6686-49f2-8e3d-97bffedab0a4"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:30:19.522353 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:19.522339    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3bce32f-6686-49f2-8e3d-97bffedab0a4-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f3bce32f-6686-49f2-8e3d-97bffedab0a4" (UID: "f3bce32f-6686-49f2-8e3d-97bffedab0a4"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:30:19.522549 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:19.522472    2577 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f3bce32f-6686-49f2-8e3d-97bffedab0a4-home\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:30:19.522549 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:19.522485    2577 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f3bce32f-6686-49f2-8e3d-97bffedab0a4-model-cache\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:30:19.522549 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:19.522497    2577 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3bce32f-6686-49f2-8e3d-97bffedab0a4-tmp-dir\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:30:19.524078 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:19.524052    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3bce32f-6686-49f2-8e3d-97bffedab0a4-dshm" (OuterVolumeSpecName: "dshm") pod "f3bce32f-6686-49f2-8e3d-97bffedab0a4" (UID: "f3bce32f-6686-49f2-8e3d-97bffedab0a4"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:30:19.524598 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:19.524576    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3bce32f-6686-49f2-8e3d-97bffedab0a4-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f3bce32f-6686-49f2-8e3d-97bffedab0a4" (UID: "f3bce32f-6686-49f2-8e3d-97bffedab0a4"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 22:30:19.524674 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:19.524574    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3bce32f-6686-49f2-8e3d-97bffedab0a4-kube-api-access-cmdb7" (OuterVolumeSpecName: "kube-api-access-cmdb7") pod "f3bce32f-6686-49f2-8e3d-97bffedab0a4" (UID: "f3bce32f-6686-49f2-8e3d-97bffedab0a4"). InnerVolumeSpecName "kube-api-access-cmdb7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:30:19.623818 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:19.623785    2577 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f3bce32f-6686-49f2-8e3d-97bffedab0a4-tls-certs\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:30:19.623818 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:19.623812    2577 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f3bce32f-6686-49f2-8e3d-97bffedab0a4-dshm\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:30:19.623818 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:19.623825    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cmdb7\" (UniqueName: \"kubernetes.io/projected/f3bce32f-6686-49f2-8e3d-97bffedab0a4-kube-api-access-cmdb7\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:30:19.752868 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:19.752835    2577 generic.go:356] "Generic (PLEG): container finished" podID="f3bce32f-6686-49f2-8e3d-97bffedab0a4" containerID="17b5a60bc98839a758b202e5f853046ba9dab2ce188fba370cd081ad0e364165" exitCode=0
Sep 18 22:30:19.753022 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:19.752877    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-123a30/rate-test-model-123a30-kserve-77fc5958f9-vtv84"
Sep 18 22:30:19.753022 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:19.752934    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-123a30/rate-test-model-123a30-kserve-77fc5958f9-vtv84" event={"ID":"f3bce32f-6686-49f2-8e3d-97bffedab0a4","Type":"ContainerDied","Data":"17b5a60bc98839a758b202e5f853046ba9dab2ce188fba370cd081ad0e364165"}
Sep 18 22:30:19.753022 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:19.752991    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-123a30/rate-test-model-123a30-kserve-77fc5958f9-vtv84" event={"ID":"f3bce32f-6686-49f2-8e3d-97bffedab0a4","Type":"ContainerDied","Data":"79cf686c7a36a0338d730b56628694e9b8d762a09a770eaf7c83009d29ff68cf"}
Sep 18 22:30:19.753022 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:19.753015    2577 scope.go:117] "RemoveContainer" containerID="17b5a60bc98839a758b202e5f853046ba9dab2ce188fba370cd081ad0e364165"
Sep 18 22:30:19.763320 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:19.763305    2577 scope.go:117] "RemoveContainer" containerID="17b5a60bc98839a758b202e5f853046ba9dab2ce188fba370cd081ad0e364165"
Sep 18 22:30:19.763607 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:30:19.763588    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"17b5a60bc98839a758b202e5f853046ba9dab2ce188fba370cd081ad0e364165\": container with ID starting with 17b5a60bc98839a758b202e5f853046ba9dab2ce188fba370cd081ad0e364165 not found: ID does not exist" containerID="17b5a60bc98839a758b202e5f853046ba9dab2ce188fba370cd081ad0e364165"
Sep 18 22:30:19.763683 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:19.763614    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17b5a60bc98839a758b202e5f853046ba9dab2ce188fba370cd081ad0e364165"} err="failed to get container status \"17b5a60bc98839a758b202e5f853046ba9dab2ce188fba370cd081ad0e364165\": rpc error: code = NotFound desc = could not find container \"17b5a60bc98839a758b202e5f853046ba9dab2ce188fba370cd081ad0e364165\": container with ID starting with 17b5a60bc98839a758b202e5f853046ba9dab2ce188fba370cd081ad0e364165 not found: ID does not exist"
Sep 18 22:30:19.797951 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:19.797892    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-123a30/rate-test-model-123a30-kserve-77fc5958f9-vtv84"]
Sep 18 22:30:19.814339 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:19.814310    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w3-123a30/rate-test-model-123a30-kserve-77fc5958f9-vtv84"]
Sep 18 22:30:21.147830 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:21.147785    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3bce32f-6686-49f2-8e3d-97bffedab0a4" path="/var/lib/kubelet/pods/f3bce32f-6686-49f2-8e3d-97bffedab0a4/volumes"
Sep 18 22:30:21.264382 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:21.264354    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-h2847_125d5bb0-54b7-4dff-aa80-e737f2791533/console-operator/1.log"
Sep 18 22:30:21.270946 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:21.270918    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-h2847_125d5bb0-54b7-4dff-aa80-e737f2791533/console-operator/1.log"
Sep 18 22:30:21.662190 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:21.662155    2577 scope.go:117] "RemoveContainer" containerID="54f124668a344ef38ee6e99525df0fd38c823b811819d397b1f0dd5b4454e5ed"
Sep 18 22:30:35.861201 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:35.861166    2577 generic.go:356] "Generic (PLEG): container finished" podID="6596cfcc-f03e-413e-9aa8-6a95f74a0eee" containerID="8d91f9f7d000d92f53a964f5c8723383ed480a1f1f6805501d4d83f3d4b8e4b1" exitCode=0
Sep 18 22:30:35.861657 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:35.861234    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-adba81-openshift-default-554cf9cf44-4sggd" event={"ID":"6596cfcc-f03e-413e-9aa8-6a95f74a0eee","Type":"ContainerDied","Data":"8d91f9f7d000d92f53a964f5c8723383ed480a1f1f6805501d4d83f3d4b8e4b1"}
Sep 18 22:30:35.861706 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:35.861660    2577 scope.go:117] "RemoveContainer" containerID="8d91f9f7d000d92f53a964f5c8723383ed480a1f1f6805501d4d83f3d4b8e4b1"
Sep 18 22:30:35.862742 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:35.862711    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:30:35.862860 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:35.862800    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:30:35.862931 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:35.862857    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:30:36.874212 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:36.874171    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-adba81-openshift-default-554cf9cf44-4sggd" event={"ID":"6596cfcc-f03e-413e-9aa8-6a95f74a0eee","Type":"ContainerStarted","Data":"f93c1ae4f6a53c39f6ef5d983fa7ae790c544964a0f2bc51d8f81141dbf554dd"}
Sep 18 22:30:37.772498 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:37.772453    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-adba81-openshift-default-554cf9cf44-4sggd"
Sep 18 22:30:37.772730 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:37.772709    2577 patch_prober.go:28] interesting pod/e2e-ipp-a-adba81-openshift-default-554cf9cf44-4sggd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.106:15021/healthz/ready\": dial tcp 10.133.0.106:15021: connect: connection refused" start-of-body=
Sep 18 22:30:37.772782 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:37.772756    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-adba81-openshift-default-554cf9cf44-4sggd" podUID="6596cfcc-f03e-413e-9aa8-6a95f74a0eee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.106:15021/healthz/ready\": dial tcp 10.133.0.106:15021: connect: connection refused"
Sep 18 22:30:38.772319 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:38.772279    2577 patch_prober.go:28] interesting pod/e2e-ipp-a-adba81-openshift-default-554cf9cf44-4sggd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.106:15021/healthz/ready\": dial tcp 10.133.0.106:15021: connect: connection refused" start-of-body=
Sep 18 22:30:38.772742 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:38.772336    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-adba81-openshift-default-554cf9cf44-4sggd" podUID="6596cfcc-f03e-413e-9aa8-6a95f74a0eee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.106:15021/healthz/ready\": dial tcp 10.133.0.106:15021: connect: connection refused"
Sep 18 22:30:39.772569 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:39.772527    2577 patch_prober.go:28] interesting pod/e2e-ipp-a-adba81-openshift-default-554cf9cf44-4sggd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.106:15021/healthz/ready\": dial tcp 10.133.0.106:15021: connect: connection refused" start-of-body=
Sep 18 22:30:39.772975 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:39.772589    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-adba81-openshift-default-554cf9cf44-4sggd" podUID="6596cfcc-f03e-413e-9aa8-6a95f74a0eee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.106:15021/healthz/ready\": dial tcp 10.133.0.106:15021: connect: connection refused"
Sep 18 22:30:40.771843 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:40.771804    2577 patch_prober.go:28] interesting pod/e2e-ipp-a-adba81-openshift-default-554cf9cf44-4sggd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.106:15021/healthz/ready\": dial tcp 10.133.0.106:15021: connect: connection refused" start-of-body=
Sep 18 22:30:40.772032 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:40.771863    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-adba81-openshift-default-554cf9cf44-4sggd" podUID="6596cfcc-f03e-413e-9aa8-6a95f74a0eee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.106:15021/healthz/ready\": dial tcp 10.133.0.106:15021: connect: connection refused"
Sep 18 22:30:41.772510 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:41.772472    2577 patch_prober.go:28] interesting pod/e2e-ipp-a-adba81-openshift-default-554cf9cf44-4sggd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.106:15021/healthz/ready\": dial tcp 10.133.0.106:15021: connect: connection refused" start-of-body=
Sep 18 22:30:41.772993 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:41.772529    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-adba81-openshift-default-554cf9cf44-4sggd" podUID="6596cfcc-f03e-413e-9aa8-6a95f74a0eee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.106:15021/healthz/ready\": dial tcp 10.133.0.106:15021: connect: connection refused"
Sep 18 22:30:42.776144 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:42.776109    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-adba81-openshift-default-554cf9cf44-4sggd"
Sep 18 22:30:42.776621 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:42.776593    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-adba81-openshift-default-554cf9cf44-4sggd"
Sep 18 22:30:42.777382 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:42.777364    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-adba81-openshift-default-554cf9cf44-4sggd"
Sep 18 22:30:47.094144 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:47.094114    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn"]
Sep 18 22:30:47.094562 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:47.094549    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3bce32f-6686-49f2-8e3d-97bffedab0a4" containerName="main"
Sep 18 22:30:47.094606 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:47.094564    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3bce32f-6686-49f2-8e3d-97bffedab0a4" containerName="main"
Sep 18 22:30:47.094606 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:47.094580    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f545f765-90c2-4813-9add-ea2ce1ae8607" containerName="cleanup"
Sep 18 22:30:47.094606 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:47.094586    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f545f765-90c2-4813-9add-ea2ce1ae8607" containerName="cleanup"
Sep 18 22:30:47.094708 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:47.094638    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3bce32f-6686-49f2-8e3d-97bffedab0a4" containerName="main"
Sep 18 22:30:47.094708 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:47.094647    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f545f765-90c2-4813-9add-ea2ce1ae8607" containerName="cleanup"
Sep 18 22:30:47.097929 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:47.097910    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn"
Sep 18 22:30:47.108702 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:47.108676    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-58a8ca-openshift-default-dockercfg-7wm29\""
Sep 18 22:30:47.147315 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:47.147256    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn"]
Sep 18 22:30:47.211233 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:47.211198    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0fe39b00-0eda-4437-9b45-526e17cdaf71-istio-envoy\") pod \"e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn\" (UID: \"0fe39b00-0eda-4437-9b45-526e17cdaf71\") " pod="openshift-ingress/e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn"
Sep 18 22:30:47.211233 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:47.211236    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0fe39b00-0eda-4437-9b45-526e17cdaf71-istio-data\") pod \"e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn\" (UID: \"0fe39b00-0eda-4437-9b45-526e17cdaf71\") " pod="openshift-ingress/e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn"
Sep 18 22:30:47.211524 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:47.211262    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvvb4\" (UniqueName: \"kubernetes.io/projected/0fe39b00-0eda-4437-9b45-526e17cdaf71-kube-api-access-rvvb4\") pod \"e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn\" (UID: \"0fe39b00-0eda-4437-9b45-526e17cdaf71\") " pod="openshift-ingress/e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn"
Sep 18 22:30:47.211524 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:47.211313    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0fe39b00-0eda-4437-9b45-526e17cdaf71-workload-socket\") pod \"e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn\" (UID: \"0fe39b00-0eda-4437-9b45-526e17cdaf71\") " pod="openshift-ingress/e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn"
Sep 18 22:30:47.211524 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:47.211360    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0fe39b00-0eda-4437-9b45-526e17cdaf71-workload-certs\") pod \"e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn\" (UID: \"0fe39b00-0eda-4437-9b45-526e17cdaf71\") " pod="openshift-ingress/e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn"
Sep 18 22:30:47.211524 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:47.211441    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0fe39b00-0eda-4437-9b45-526e17cdaf71-credential-socket\") pod \"e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn\" (UID: \"0fe39b00-0eda-4437-9b45-526e17cdaf71\") " pod="openshift-ingress/e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn"
Sep 18 22:30:47.211524 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:47.211498    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0fe39b00-0eda-4437-9b45-526e17cdaf71-istiod-ca-cert\") pod \"e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn\" (UID: \"0fe39b00-0eda-4437-9b45-526e17cdaf71\") " pod="openshift-ingress/e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn"
Sep 18 22:30:47.211797 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:47.211529    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0fe39b00-0eda-4437-9b45-526e17cdaf71-istio-token\") pod \"e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn\" (UID: \"0fe39b00-0eda-4437-9b45-526e17cdaf71\") " pod="openshift-ingress/e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn"
Sep 18 22:30:47.211797 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:47.211574    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0fe39b00-0eda-4437-9b45-526e17cdaf71-istio-podinfo\") pod \"e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn\" (UID: \"0fe39b00-0eda-4437-9b45-526e17cdaf71\") " pod="openshift-ingress/e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn"
Sep 18 22:30:47.312783 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:47.312746    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0fe39b00-0eda-4437-9b45-526e17cdaf71-workload-certs\") pod \"e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn\" (UID: \"0fe39b00-0eda-4437-9b45-526e17cdaf71\") " pod="openshift-ingress/e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn"
Sep 18 22:30:47.312953 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:47.312794    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0fe39b00-0eda-4437-9b45-526e17cdaf71-credential-socket\") pod \"e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn\" (UID: \"0fe39b00-0eda-4437-9b45-526e17cdaf71\") " pod="openshift-ingress/e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn"
Sep 18 22:30:47.312953 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:47.312831    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0fe39b00-0eda-4437-9b45-526e17cdaf71-istiod-ca-cert\") pod \"e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn\" (UID: \"0fe39b00-0eda-4437-9b45-526e17cdaf71\") " pod="openshift-ingress/e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn"
Sep 18 22:30:47.312953 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:47.312853    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0fe39b00-0eda-4437-9b45-526e17cdaf71-istio-token\") pod \"e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn\" (UID: \"0fe39b00-0eda-4437-9b45-526e17cdaf71\") " pod="openshift-ingress/e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn"
Sep 18 22:30:47.312953 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:47.312889    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0fe39b00-0eda-4437-9b45-526e17cdaf71-istio-podinfo\") pod \"e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn\" (UID: \"0fe39b00-0eda-4437-9b45-526e17cdaf71\") " pod="openshift-ingress/e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn"
Sep 18 22:30:47.313174 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:47.312987    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0fe39b00-0eda-4437-9b45-526e17cdaf71-istio-envoy\") pod \"e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn\" (UID: \"0fe39b00-0eda-4437-9b45-526e17cdaf71\") " pod="openshift-ingress/e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn"
Sep 18 22:30:47.313174 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:47.313019    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0fe39b00-0eda-4437-9b45-526e17cdaf71-istio-data\") pod \"e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn\" (UID: \"0fe39b00-0eda-4437-9b45-526e17cdaf71\") " pod="openshift-ingress/e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn"
Sep 18 22:30:47.313174 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:47.313058    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvvb4\" (UniqueName: \"kubernetes.io/projected/0fe39b00-0eda-4437-9b45-526e17cdaf71-kube-api-access-rvvb4\") pod \"e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn\" (UID: \"0fe39b00-0eda-4437-9b45-526e17cdaf71\") " pod="openshift-ingress/e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn"
Sep 18 22:30:47.313174 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:47.313091    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0fe39b00-0eda-4437-9b45-526e17cdaf71-workload-socket\") pod \"e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn\" (UID: \"0fe39b00-0eda-4437-9b45-526e17cdaf71\") " pod="openshift-ingress/e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn"
Sep 18 22:30:47.313384 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:47.313183    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0fe39b00-0eda-4437-9b45-526e17cdaf71-workload-certs\") pod \"e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn\" (UID: \"0fe39b00-0eda-4437-9b45-526e17cdaf71\") " pod="openshift-ingress/e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn"
Sep 18 22:30:47.313384 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:47.313340    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0fe39b00-0eda-4437-9b45-526e17cdaf71-istio-data\") pod \"e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn\" (UID: \"0fe39b00-0eda-4437-9b45-526e17cdaf71\") " pod="openshift-ingress/e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn"
Sep 18 22:30:47.313528 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:47.313499    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0fe39b00-0eda-4437-9b45-526e17cdaf71-workload-socket\") pod \"e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn\" (UID: \"0fe39b00-0eda-4437-9b45-526e17cdaf71\") " pod="openshift-ingress/e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn"
Sep 18 22:30:47.313572 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:47.313526    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0fe39b00-0eda-4437-9b45-526e17cdaf71-credential-socket\") pod \"e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn\" (UID: \"0fe39b00-0eda-4437-9b45-526e17cdaf71\") " pod="openshift-ingress/e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn"
Sep 18 22:30:47.313659 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:47.313643    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0fe39b00-0eda-4437-9b45-526e17cdaf71-istiod-ca-cert\") pod \"e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn\" (UID: \"0fe39b00-0eda-4437-9b45-526e17cdaf71\") " pod="openshift-ingress/e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn"
Sep 18 22:30:47.315463 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:47.315440    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0fe39b00-0eda-4437-9b45-526e17cdaf71-istio-envoy\") pod \"e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn\" (UID: \"0fe39b00-0eda-4437-9b45-526e17cdaf71\") " pod="openshift-ingress/e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn"
Sep 18 22:30:47.315774 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:47.315751    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0fe39b00-0eda-4437-9b45-526e17cdaf71-istio-podinfo\") pod \"e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn\" (UID: \"0fe39b00-0eda-4437-9b45-526e17cdaf71\") " pod="openshift-ingress/e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn"
Sep 18 22:30:47.337562 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:47.337530    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0fe39b00-0eda-4437-9b45-526e17cdaf71-istio-token\") pod \"e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn\" (UID: \"0fe39b00-0eda-4437-9b45-526e17cdaf71\") " pod="openshift-ingress/e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn"
Sep 18 22:30:47.349986 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:47.349918    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvvb4\" (UniqueName: \"kubernetes.io/projected/0fe39b00-0eda-4437-9b45-526e17cdaf71-kube-api-access-rvvb4\") pod \"e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn\" (UID: \"0fe39b00-0eda-4437-9b45-526e17cdaf71\") " pod="openshift-ingress/e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn"
Sep 18 22:30:47.412872 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:47.412843    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn"
Sep 18 22:30:47.727924 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:47.727842    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn"]
Sep 18 22:30:47.738736 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:30:47.738701    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fe39b00_0eda_4437_9b45_526e17cdaf71.slice/crio-6abe45ce99456c8051d8042ca4470b0f5e9456b77826fda8db33252c0c5476be WatchSource:0}: Error finding container 6abe45ce99456c8051d8042ca4470b0f5e9456b77826fda8db33252c0c5476be: Status 404 returned error can't find the container with id 6abe45ce99456c8051d8042ca4470b0f5e9456b77826fda8db33252c0c5476be
Sep 18 22:30:47.740875 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:47.740840    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:30:47.740971 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:47.740908    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:30:47.740971 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:47.740934    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:30:47.944888 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:47.944850    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn" event={"ID":"0fe39b00-0eda-4437-9b45-526e17cdaf71","Type":"ContainerStarted","Data":"1246da5e522a6b83ced0b12addaef2451e11bc0469a3c6229c5b14adeee7e327"}
Sep 18 22:30:47.945089 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:47.944923    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn" event={"ID":"0fe39b00-0eda-4437-9b45-526e17cdaf71","Type":"ContainerStarted","Data":"6abe45ce99456c8051d8042ca4470b0f5e9456b77826fda8db33252c0c5476be"}
Sep 18 22:30:47.985384 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:47.985262    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn" podStartSLOduration=1.985244313 podStartE2EDuration="1.985244313s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:30:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:30:47.98477043 +0000 UTC m=+1827.304442486" watchObservedRunningTime="2026-09-18 22:30:47.985244313 +0000 UTC m=+1827.304916368"
Sep 18 22:30:48.413290 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:48.413257    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn"
Sep 18 22:30:48.418646 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:48.418624    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn"
Sep 18 22:30:48.954138 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:48.954104    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn"
Sep 18 22:30:48.955198 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:30:48.955175    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn"
Sep 18 22:31:04.996606 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:31:04.996568    2577 patch_prober.go:28] interesting pod/e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.107:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 18 22:31:04.997044 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:31:04.996632    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn" podUID="0fe39b00-0eda-4437-9b45-526e17cdaf71" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.107:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 18 22:31:08.080167 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:31:08.080136    2577 generic.go:356] "Generic (PLEG): container finished" podID="0fe39b00-0eda-4437-9b45-526e17cdaf71" containerID="1246da5e522a6b83ced0b12addaef2451e11bc0469a3c6229c5b14adeee7e327" exitCode=0
Sep 18 22:31:08.080621 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:31:08.080218    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn" event={"ID":"0fe39b00-0eda-4437-9b45-526e17cdaf71","Type":"ContainerDied","Data":"1246da5e522a6b83ced0b12addaef2451e11bc0469a3c6229c5b14adeee7e327"}
Sep 18 22:31:08.080672 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:31:08.080649    2577 scope.go:117] "RemoveContainer" containerID="1246da5e522a6b83ced0b12addaef2451e11bc0469a3c6229c5b14adeee7e327"
Sep 18 22:31:08.081792 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:31:08.081750    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:31:08.081925 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:31:08.081850    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:31:08.081925 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:31:08.081900    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:31:09.088745 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:31:09.088712    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn" event={"ID":"0fe39b00-0eda-4437-9b45-526e17cdaf71","Type":"ContainerStarted","Data":"2cec9a21cf51c450b8e8f1038921540f49b4135eca553210a60297f56324bc0f"}
Sep 18 22:31:09.413963 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:31:09.413872    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn"
Sep 18 22:31:09.414124 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:31:09.414106    2577 patch_prober.go:28] interesting pod/e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.107:15021/healthz/ready\": dial tcp 10.133.0.107:15021: connect: connection refused" start-of-body=
Sep 18 22:31:09.414172 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:31:09.414153    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn" podUID="0fe39b00-0eda-4437-9b45-526e17cdaf71" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.107:15021/healthz/ready\": dial tcp 10.133.0.107:15021: connect: connection refused"
Sep 18 22:31:10.413940 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:31:10.413905    2577 patch_prober.go:28] interesting pod/e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.107:15021/healthz/ready\": dial tcp 10.133.0.107:15021: connect: connection refused" start-of-body=
Sep 18 22:31:10.414402 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:31:10.413982    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn" podUID="0fe39b00-0eda-4437-9b45-526e17cdaf71" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.107:15021/healthz/ready\": dial tcp 10.133.0.107:15021: connect: connection refused"
Sep 18 22:31:11.414010 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:31:11.413981    2577 patch_prober.go:28] interesting pod/e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.107:15021/healthz/ready\": dial tcp 10.133.0.107:15021: connect: connection refused" start-of-body=
Sep 18 22:31:11.414372 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:31:11.414029    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn" podUID="0fe39b00-0eda-4437-9b45-526e17cdaf71" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.107:15021/healthz/ready\": dial tcp 10.133.0.107:15021: connect: connection refused"
Sep 18 22:31:12.413218 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:31:12.413181    2577 patch_prober.go:28] interesting pod/e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.107:15021/healthz/ready\": dial tcp 10.133.0.107:15021: connect: connection refused" start-of-body=
Sep 18 22:31:12.413445 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:31:12.413234    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn" podUID="0fe39b00-0eda-4437-9b45-526e17cdaf71" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.107:15021/healthz/ready\": dial tcp 10.133.0.107:15021: connect: connection refused"
Sep 18 22:31:13.413502 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:31:13.413462    2577 patch_prober.go:28] interesting pod/e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.107:15021/healthz/ready\": dial tcp 10.133.0.107:15021: connect: connection refused" start-of-body=
Sep 18 22:31:13.413928 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:31:13.413522    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn" podUID="0fe39b00-0eda-4437-9b45-526e17cdaf71" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.107:15021/healthz/ready\": dial tcp 10.133.0.107:15021: connect: connection refused"
Sep 18 22:31:14.418619 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:31:14.418583    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn"
Sep 18 22:31:14.419098 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:31:14.418994    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn"
Sep 18 22:31:14.419807 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:31:14.419786    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn"
Sep 18 22:32:07.593067 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:32:07.593031    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-3aa245-openshift-default-7774dcdfbd-zrpr7"]
Sep 18 22:32:07.597302 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:32:07.597283    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-3aa245-openshift-default-7774dcdfbd-zrpr7"
Sep 18 22:32:07.603961 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:32:07.603934    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-3aa245-openshift-default-dockercfg-rtc22\""
Sep 18 22:32:07.619734 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:32:07.619705    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-3aa245-openshift-default-7774dcdfbd-zrpr7"]
Sep 18 22:32:07.695464 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:32:07.694386    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/71768d7c-9dd0-44ac-a9e7-6d366c6c707f-istio-data\") pod \"e2e-ipp-cleanup-3aa245-openshift-default-7774dcdfbd-zrpr7\" (UID: \"71768d7c-9dd0-44ac-a9e7-6d366c6c707f\") " pod="openshift-ingress/e2e-ipp-cleanup-3aa245-openshift-default-7774dcdfbd-zrpr7"
Sep 18 22:32:07.695464 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:32:07.694473    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/71768d7c-9dd0-44ac-a9e7-6d366c6c707f-istio-podinfo\") pod \"e2e-ipp-cleanup-3aa245-openshift-default-7774dcdfbd-zrpr7\" (UID: \"71768d7c-9dd0-44ac-a9e7-6d366c6c707f\") " pod="openshift-ingress/e2e-ipp-cleanup-3aa245-openshift-default-7774dcdfbd-zrpr7"
Sep 18 22:32:07.695464 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:32:07.694531    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/71768d7c-9dd0-44ac-a9e7-6d366c6c707f-istiod-ca-cert\") pod \"e2e-ipp-cleanup-3aa245-openshift-default-7774dcdfbd-zrpr7\" (UID: \"71768d7c-9dd0-44ac-a9e7-6d366c6c707f\") " pod="openshift-ingress/e2e-ipp-cleanup-3aa245-openshift-default-7774dcdfbd-zrpr7"
Sep 18 22:32:07.695464 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:32:07.694572    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/71768d7c-9dd0-44ac-a9e7-6d366c6c707f-istio-envoy\") pod \"e2e-ipp-cleanup-3aa245-openshift-default-7774dcdfbd-zrpr7\" (UID: \"71768d7c-9dd0-44ac-a9e7-6d366c6c707f\") " pod="openshift-ingress/e2e-ipp-cleanup-3aa245-openshift-default-7774dcdfbd-zrpr7"
Sep 18 22:32:07.695464 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:32:07.694615    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/71768d7c-9dd0-44ac-a9e7-6d366c6c707f-workload-socket\") pod \"e2e-ipp-cleanup-3aa245-openshift-default-7774dcdfbd-zrpr7\" (UID: \"71768d7c-9dd0-44ac-a9e7-6d366c6c707f\") " pod="openshift-ingress/e2e-ipp-cleanup-3aa245-openshift-default-7774dcdfbd-zrpr7"
Sep 18 22:32:07.695464 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:32:07.694640    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/71768d7c-9dd0-44ac-a9e7-6d366c6c707f-istio-token\") pod \"e2e-ipp-cleanup-3aa245-openshift-default-7774dcdfbd-zrpr7\" (UID: \"71768d7c-9dd0-44ac-a9e7-6d366c6c707f\") " pod="openshift-ingress/e2e-ipp-cleanup-3aa245-openshift-default-7774dcdfbd-zrpr7"
Sep 18 22:32:07.695464 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:32:07.694702    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/71768d7c-9dd0-44ac-a9e7-6d366c6c707f-credential-socket\") pod \"e2e-ipp-cleanup-3aa245-openshift-default-7774dcdfbd-zrpr7\" (UID: \"71768d7c-9dd0-44ac-a9e7-6d366c6c707f\") " pod="openshift-ingress/e2e-ipp-cleanup-3aa245-openshift-default-7774dcdfbd-zrpr7"
Sep 18 22:32:07.695464 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:32:07.694726    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/71768d7c-9dd0-44ac-a9e7-6d366c6c707f-workload-certs\") pod \"e2e-ipp-cleanup-3aa245-openshift-default-7774dcdfbd-zrpr7\" (UID: \"71768d7c-9dd0-44ac-a9e7-6d366c6c707f\") " pod="openshift-ingress/e2e-ipp-cleanup-3aa245-openshift-default-7774dcdfbd-zrpr7"
Sep 18 22:32:07.695464 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:32:07.694752    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdw6r\" (UniqueName: \"kubernetes.io/projected/71768d7c-9dd0-44ac-a9e7-6d366c6c707f-kube-api-access-rdw6r\") pod \"e2e-ipp-cleanup-3aa245-openshift-default-7774dcdfbd-zrpr7\" (UID: \"71768d7c-9dd0-44ac-a9e7-6d366c6c707f\") " pod="openshift-ingress/e2e-ipp-cleanup-3aa245-openshift-default-7774dcdfbd-zrpr7"
Sep 18 22:32:07.795824 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:32:07.795789    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/71768d7c-9dd0-44ac-a9e7-6d366c6c707f-istio-podinfo\") pod \"e2e-ipp-cleanup-3aa245-openshift-default-7774dcdfbd-zrpr7\" (UID: \"71768d7c-9dd0-44ac-a9e7-6d366c6c707f\") " pod="openshift-ingress/e2e-ipp-cleanup-3aa245-openshift-default-7774dcdfbd-zrpr7"
Sep 18 22:32:07.796027 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:32:07.795848    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/71768d7c-9dd0-44ac-a9e7-6d366c6c707f-istiod-ca-cert\") pod \"e2e-ipp-cleanup-3aa245-openshift-default-7774dcdfbd-zrpr7\" (UID: \"71768d7c-9dd0-44ac-a9e7-6d366c6c707f\") " pod="openshift-ingress/e2e-ipp-cleanup-3aa245-openshift-default-7774dcdfbd-zrpr7"
Sep 18 22:32:07.796027 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:32:07.795877    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/71768d7c-9dd0-44ac-a9e7-6d366c6c707f-istio-envoy\") pod \"e2e-ipp-cleanup-3aa245-openshift-default-7774dcdfbd-zrpr7\" (UID: \"71768d7c-9dd0-44ac-a9e7-6d366c6c707f\") " pod="openshift-ingress/e2e-ipp-cleanup-3aa245-openshift-default-7774dcdfbd-zrpr7"
Sep 18 22:32:07.796027 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:32:07.795903    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/71768d7c-9dd0-44ac-a9e7-6d366c6c707f-workload-socket\") pod \"e2e-ipp-cleanup-3aa245-openshift-default-7774dcdfbd-zrpr7\" (UID: \"71768d7c-9dd0-44ac-a9e7-6d366c6c707f\") " pod="openshift-ingress/e2e-ipp-cleanup-3aa245-openshift-default-7774dcdfbd-zrpr7"
Sep 18 22:32:07.796027 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:32:07.795927    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/71768d7c-9dd0-44ac-a9e7-6d366c6c707f-istio-token\") pod \"e2e-ipp-cleanup-3aa245-openshift-default-7774dcdfbd-zrpr7\" (UID: \"71768d7c-9dd0-44ac-a9e7-6d366c6c707f\") " pod="openshift-ingress/e2e-ipp-cleanup-3aa245-openshift-default-7774dcdfbd-zrpr7"
Sep 18 22:32:07.796027 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:32:07.795979    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/71768d7c-9dd0-44ac-a9e7-6d366c6c707f-credential-socket\") pod \"e2e-ipp-cleanup-3aa245-openshift-default-7774dcdfbd-zrpr7\" (UID: \"71768d7c-9dd0-44ac-a9e7-6d366c6c707f\") " pod="openshift-ingress/e2e-ipp-cleanup-3aa245-openshift-default-7774dcdfbd-zrpr7"
Sep 18 22:32:07.796027 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:32:07.796007    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/71768d7c-9dd0-44ac-a9e7-6d366c6c707f-workload-certs\") pod \"e2e-ipp-cleanup-3aa245-openshift-default-7774dcdfbd-zrpr7\" (UID: \"71768d7c-9dd0-44ac-a9e7-6d366c6c707f\") " pod="openshift-ingress/e2e-ipp-cleanup-3aa245-openshift-default-7774dcdfbd-zrpr7"
Sep 18 22:32:07.796377 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:32:07.796030    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdw6r\" (UniqueName: \"kubernetes.io/projected/71768d7c-9dd0-44ac-a9e7-6d366c6c707f-kube-api-access-rdw6r\") pod \"e2e-ipp-cleanup-3aa245-openshift-default-7774dcdfbd-zrpr7\" (UID: \"71768d7c-9dd0-44ac-a9e7-6d366c6c707f\") " pod="openshift-ingress/e2e-ipp-cleanup-3aa245-openshift-default-7774dcdfbd-zrpr7"
Sep 18 22:32:07.796377 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:32:07.796095    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/71768d7c-9dd0-44ac-a9e7-6d366c6c707f-istio-data\") pod \"e2e-ipp-cleanup-3aa245-openshift-default-7774dcdfbd-zrpr7\" (UID: \"71768d7c-9dd0-44ac-a9e7-6d366c6c707f\") " pod="openshift-ingress/e2e-ipp-cleanup-3aa245-openshift-default-7774dcdfbd-zrpr7"
Sep 18 22:32:07.796509 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:32:07.796388    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/71768d7c-9dd0-44ac-a9e7-6d366c6c707f-workload-socket\") pod \"e2e-ipp-cleanup-3aa245-openshift-default-7774dcdfbd-zrpr7\" (UID: \"71768d7c-9dd0-44ac-a9e7-6d366c6c707f\") " pod="openshift-ingress/e2e-ipp-cleanup-3aa245-openshift-default-7774dcdfbd-zrpr7"
Sep 18 22:32:07.796509 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:32:07.796491    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/71768d7c-9dd0-44ac-a9e7-6d366c6c707f-workload-certs\") pod \"e2e-ipp-cleanup-3aa245-openshift-default-7774dcdfbd-zrpr7\" (UID: \"71768d7c-9dd0-44ac-a9e7-6d366c6c707f\") " pod="openshift-ingress/e2e-ipp-cleanup-3aa245-openshift-default-7774dcdfbd-zrpr7"
Sep 18 22:32:07.796647 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:32:07.796628    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/71768d7c-9dd0-44ac-a9e7-6d366c6c707f-istio-data\") pod \"e2e-ipp-cleanup-3aa245-openshift-default-7774dcdfbd-zrpr7\" (UID: \"71768d7c-9dd0-44ac-a9e7-6d366c6c707f\") " pod="openshift-ingress/e2e-ipp-cleanup-3aa245-openshift-default-7774dcdfbd-zrpr7"
Sep 18 22:32:07.796878 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:32:07.796679    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/71768d7c-9dd0-44ac-a9e7-6d366c6c707f-credential-socket\") pod \"e2e-ipp-cleanup-3aa245-openshift-default-7774dcdfbd-zrpr7\" (UID: \"71768d7c-9dd0-44ac-a9e7-6d366c6c707f\") " pod="openshift-ingress/e2e-ipp-cleanup-3aa245-openshift-default-7774dcdfbd-zrpr7"
Sep 18 22:32:07.796878 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:32:07.796827    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/71768d7c-9dd0-44ac-a9e7-6d366c6c707f-istiod-ca-cert\") pod \"e2e-ipp-cleanup-3aa245-openshift-default-7774dcdfbd-zrpr7\" (UID: \"71768d7c-9dd0-44ac-a9e7-6d366c6c707f\") " pod="openshift-ingress/e2e-ipp-cleanup-3aa245-openshift-default-7774dcdfbd-zrpr7"
Sep 18 22:32:07.798512 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:32:07.798493    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/71768d7c-9dd0-44ac-a9e7-6d366c6c707f-istio-envoy\") pod \"e2e-ipp-cleanup-3aa245-openshift-default-7774dcdfbd-zrpr7\" (UID: \"71768d7c-9dd0-44ac-a9e7-6d366c6c707f\") " pod="openshift-ingress/e2e-ipp-cleanup-3aa245-openshift-default-7774dcdfbd-zrpr7"
Sep 18 22:32:07.798673 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:32:07.798653    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/71768d7c-9dd0-44ac-a9e7-6d366c6c707f-istio-podinfo\") pod \"e2e-ipp-cleanup-3aa245-openshift-default-7774dcdfbd-zrpr7\" (UID: \"71768d7c-9dd0-44ac-a9e7-6d366c6c707f\") " pod="openshift-ingress/e2e-ipp-cleanup-3aa245-openshift-default-7774dcdfbd-zrpr7"
Sep 18 22:32:07.806927 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:32:07.806909    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdw6r\" (UniqueName: \"kubernetes.io/projected/71768d7c-9dd0-44ac-a9e7-6d366c6c707f-kube-api-access-rdw6r\") pod \"e2e-ipp-cleanup-3aa245-openshift-default-7774dcdfbd-zrpr7\" (UID: \"71768d7c-9dd0-44ac-a9e7-6d366c6c707f\") " pod="openshift-ingress/e2e-ipp-cleanup-3aa245-openshift-default-7774dcdfbd-zrpr7"
Sep 18 22:32:07.808438 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:32:07.808399    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/71768d7c-9dd0-44ac-a9e7-6d366c6c707f-istio-token\") pod \"e2e-ipp-cleanup-3aa245-openshift-default-7774dcdfbd-zrpr7\" (UID: \"71768d7c-9dd0-44ac-a9e7-6d366c6c707f\") " pod="openshift-ingress/e2e-ipp-cleanup-3aa245-openshift-default-7774dcdfbd-zrpr7"
Sep 18 22:32:07.908444 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:32:07.908348    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-3aa245-openshift-default-7774dcdfbd-zrpr7"
Sep 18 22:32:08.215167 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:32:08.215138    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-3aa245-openshift-default-7774dcdfbd-zrpr7"]
Sep 18 22:32:08.215514 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:32:08.215493    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71768d7c_9dd0_44ac_a9e7_6d366c6c707f.slice/crio-c94c9f022a7449f3b5baf40656f6e38db917912ad159dba4b4e4ab15a3bb16a6 WatchSource:0}: Error finding container c94c9f022a7449f3b5baf40656f6e38db917912ad159dba4b4e4ab15a3bb16a6: Status 404 returned error can't find the container with id c94c9f022a7449f3b5baf40656f6e38db917912ad159dba4b4e4ab15a3bb16a6
Sep 18 22:32:08.217749 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:32:08.217705    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:32:08.217840 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:32:08.217766    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:32:08.217840 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:32:08.217797    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:32:08.460362 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:32:08.460328    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-3aa245-openshift-default-7774dcdfbd-zrpr7" event={"ID":"71768d7c-9dd0-44ac-a9e7-6d366c6c707f","Type":"ContainerStarted","Data":"0737e04878adaa9a6c4e8fc222d612525b7123f347a0ad416e7da636c0dbdf14"}
Sep 18 22:32:08.460527 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:32:08.460379    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-3aa245-openshift-default-7774dcdfbd-zrpr7" event={"ID":"71768d7c-9dd0-44ac-a9e7-6d366c6c707f","Type":"ContainerStarted","Data":"c94c9f022a7449f3b5baf40656f6e38db917912ad159dba4b4e4ab15a3bb16a6"}
Sep 18 22:32:08.503969 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:32:08.503864    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-3aa245-openshift-default-7774dcdfbd-zrpr7" podStartSLOduration=1.503847982 podStartE2EDuration="1.503847982s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:32:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:32:08.502846141 +0000 UTC m=+1907.822518196" watchObservedRunningTime="2026-09-18 22:32:08.503847982 +0000 UTC m=+1907.823520037"
Sep 18 22:32:08.908815 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:32:08.908779    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-3aa245-openshift-default-7774dcdfbd-zrpr7"
Sep 18 22:32:09.914799 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:32:09.914770    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-3aa245-openshift-default-7774dcdfbd-zrpr7"
Sep 18 22:32:10.473007 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:32:10.472970    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-3aa245-openshift-default-7774dcdfbd-zrpr7"
Sep 18 22:32:10.474176 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:32:10.474157    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-3aa245-openshift-default-7774dcdfbd-zrpr7"
Sep 18 22:32:21.703092 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:32:21.703009    2577 scope.go:117] "RemoveContainer" containerID="52763b4837a0332a08dbecf7dd648e6dc0b1d828974058e9054c15856b8f9866"
Sep 18 22:32:32.622538 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:32:32.622508    2577 generic.go:356] "Generic (PLEG): container finished" podID="71768d7c-9dd0-44ac-a9e7-6d366c6c707f" containerID="0737e04878adaa9a6c4e8fc222d612525b7123f347a0ad416e7da636c0dbdf14" exitCode=0
Sep 18 22:32:32.622953 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:32:32.622563    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-3aa245-openshift-default-7774dcdfbd-zrpr7" event={"ID":"71768d7c-9dd0-44ac-a9e7-6d366c6c707f","Type":"ContainerDied","Data":"0737e04878adaa9a6c4e8fc222d612525b7123f347a0ad416e7da636c0dbdf14"}
Sep 18 22:32:32.622953 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:32:32.622932    2577 scope.go:117] "RemoveContainer" containerID="0737e04878adaa9a6c4e8fc222d612525b7123f347a0ad416e7da636c0dbdf14"
Sep 18 22:32:32.624096 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:32:32.624060    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:32:32.624203 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:32:32.624135    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:32:32.624203 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:32:32.624168    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 18 22:32:33.630096 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:32:33.630059    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-3aa245-openshift-default-7774dcdfbd-zrpr7" event={"ID":"71768d7c-9dd0-44ac-a9e7-6d366c6c707f","Type":"ContainerStarted","Data":"ad0ac307dbe32aca53c4b8e964833f557e6583352c7e7e47f63ed0720ea2c87c"}
Sep 18 22:32:33.909269 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:32:33.909183    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-3aa245-openshift-default-7774dcdfbd-zrpr7"
Sep 18 22:32:33.909473 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:32:33.909447    2577 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-3aa245-openshift-default-7774dcdfbd-zrpr7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.108:15021/healthz/ready\": dial tcp 10.133.0.108:15021: connect: connection refused" start-of-body=
Sep 18 22:32:33.909523 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:32:33.909508    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-3aa245-openshift-default-7774dcdfbd-zrpr7" podUID="71768d7c-9dd0-44ac-a9e7-6d366c6c707f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.108:15021/healthz/ready\": dial tcp 10.133.0.108:15021: connect: connection refused"
Sep 18 22:32:34.909035 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:32:34.908999    2577 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-3aa245-openshift-default-7774dcdfbd-zrpr7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.108:15021/healthz/ready\": dial tcp 10.133.0.108:15021: connect: connection refused" start-of-body=
Sep 18 22:32:34.909454 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:32:34.909059    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-3aa245-openshift-default-7774dcdfbd-zrpr7" podUID="71768d7c-9dd0-44ac-a9e7-6d366c6c707f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.108:15021/healthz/ready\": dial tcp 10.133.0.108:15021: connect: connection refused"
Sep 18 22:32:35.908989 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:32:35.908951    2577 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-3aa245-openshift-default-7774dcdfbd-zrpr7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.108:15021/healthz/ready\": dial tcp 10.133.0.108:15021: connect: connection refused" start-of-body=
Sep 18 22:32:35.909158 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:32:35.909025    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-3aa245-openshift-default-7774dcdfbd-zrpr7" podUID="71768d7c-9dd0-44ac-a9e7-6d366c6c707f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.108:15021/healthz/ready\": dial tcp 10.133.0.108:15021: connect: connection refused"
Sep 18 22:32:36.908911 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:32:36.908878    2577 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-3aa245-openshift-default-7774dcdfbd-zrpr7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.108:15021/healthz/ready\": dial tcp 10.133.0.108:15021: connect: connection refused" start-of-body=
Sep 18 22:32:36.909106 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:32:36.908932    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-3aa245-openshift-default-7774dcdfbd-zrpr7" podUID="71768d7c-9dd0-44ac-a9e7-6d366c6c707f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.108:15021/healthz/ready\": dial tcp 10.133.0.108:15021: connect: connection refused"
Sep 18 22:32:37.909148 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:32:37.909113    2577 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-3aa245-openshift-default-7774dcdfbd-zrpr7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.108:15021/healthz/ready\": dial tcp 10.133.0.108:15021: connect: connection refused" start-of-body=
Sep 18 22:32:37.909564 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:32:37.909161    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-3aa245-openshift-default-7774dcdfbd-zrpr7" podUID="71768d7c-9dd0-44ac-a9e7-6d366c6c707f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.108:15021/healthz/ready\": dial tcp 10.133.0.108:15021: connect: connection refused"
Sep 18 22:32:38.909379 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:32:38.909343    2577 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-3aa245-openshift-default-7774dcdfbd-zrpr7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.108:15021/healthz/ready\": dial tcp 10.133.0.108:15021: connect: connection refused" start-of-body=
Sep 18 22:32:38.909794 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:32:38.909400    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-3aa245-openshift-default-7774dcdfbd-zrpr7" podUID="71768d7c-9dd0-44ac-a9e7-6d366c6c707f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.108:15021/healthz/ready\": dial tcp 10.133.0.108:15021: connect: connection refused"
Sep 18 22:32:39.913134 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:32:39.913104    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-3aa245-openshift-default-7774dcdfbd-zrpr7"
Sep 18 22:32:39.913586 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:32:39.913564    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-3aa245-openshift-default-7774dcdfbd-zrpr7"
Sep 18 22:32:39.914308 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:32:39.914290    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-3aa245-openshift-default-7774dcdfbd-zrpr7"
Sep 18 22:32:41.343840 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:32:41.343803    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-3aa245-9rgjh"]
Sep 18 22:32:41.346621 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:32:41.346601    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-3aa245-9rgjh"
Sep 18 22:32:41.349799 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:32:41.349777    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-9g7m4\""
Sep 18 22:32:41.361371 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:32:41.361344    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-3aa245-9rgjh"]
Sep 18 22:32:41.456790 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:32:41.456766    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/86b3bb6d-566b-4c04-828c-6cf82f89724a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-3aa245-9rgjh\" (UID: \"86b3bb6d-566b-4c04-828c-6cf82f89724a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-3aa245-9rgjh"
Sep 18 22:32:41.558484 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:32:41.558449    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/86b3bb6d-566b-4c04-828c-6cf82f89724a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-3aa245-9rgjh\" (UID: \"86b3bb6d-566b-4c04-828c-6cf82f89724a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-3aa245-9rgjh"
Sep 18 22:32:41.558957 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:32:41.558939    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/86b3bb6d-566b-4c04-828c-6cf82f89724a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-3aa245-9rgjh\" (UID: \"86b3bb6d-566b-4c04-828c-6cf82f89724a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-3aa245-9rgjh"
Sep 18 22:32:41.657061 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:32:41.656988    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-3aa245-9rgjh"
Sep 18 22:32:41.934336 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:32:41.934310    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-3aa245-9rgjh"]
Sep 18 22:32:41.935501 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:32:41.935474    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86b3bb6d_566b_4c04_828c_6cf82f89724a.slice/crio-1763fa538d6d9066d85ff55210005fd0de04a2c9f482b9c38c126a6fdd79fdaf WatchSource:0}: Error finding container 1763fa538d6d9066d85ff55210005fd0de04a2c9f482b9c38c126a6fdd79fdaf: Status 404 returned error can't find the container with id 1763fa538d6d9066d85ff55210005fd0de04a2c9f482b9c38c126a6fdd79fdaf
Sep 18 22:32:42.702979 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:32:42.702947    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-3aa245-9rgjh" event={"ID":"86b3bb6d-566b-4c04-828c-6cf82f89724a","Type":"ContainerStarted","Data":"6537820b339c77c49e720000d71372131c1fd3d278bf28df5968db703ce2f6a0"}
Sep 18 22:32:42.703524 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:32:42.703008    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-3aa245-9rgjh" event={"ID":"86b3bb6d-566b-4c04-828c-6cf82f89724a","Type":"ContainerStarted","Data":"1763fa538d6d9066d85ff55210005fd0de04a2c9f482b9c38c126a6fdd79fdaf"}
Sep 18 22:32:42.731038 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:32:42.730991    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-3aa245-9rgjh" podStartSLOduration=1.730977689 podStartE2EDuration="1.730977689s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:32:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:32:42.728823149 +0000 UTC m=+1942.048495203" watchObservedRunningTime="2026-09-18 22:32:42.730977689 +0000 UTC m=+1942.050649744"
Sep 18 22:32:43.710605 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:32:43.710575    2577 generic.go:356] "Generic (PLEG): container finished" podID="86b3bb6d-566b-4c04-828c-6cf82f89724a" containerID="6537820b339c77c49e720000d71372131c1fd3d278bf28df5968db703ce2f6a0" exitCode=0
Sep 18 22:32:43.711009 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:32:43.710658    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-3aa245-9rgjh" event={"ID":"86b3bb6d-566b-4c04-828c-6cf82f89724a","Type":"ContainerDied","Data":"6537820b339c77c49e720000d71372131c1fd3d278bf28df5968db703ce2f6a0"}
Sep 18 22:32:44.857598 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:32:44.857573    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-3aa245-9rgjh"
Sep 18 22:32:44.991676 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:32:44.991593    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/86b3bb6d-566b-4c04-828c-6cf82f89724a-maas-api-service-ca\") pod \"86b3bb6d-566b-4c04-828c-6cf82f89724a\" (UID: \"86b3bb6d-566b-4c04-828c-6cf82f89724a\") "
Sep 18 22:32:44.991970 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:32:44.991947    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86b3bb6d-566b-4c04-828c-6cf82f89724a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "86b3bb6d-566b-4c04-828c-6cf82f89724a" (UID: "86b3bb6d-566b-4c04-828c-6cf82f89724a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:32:45.093187 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:32:45.093154    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/86b3bb6d-566b-4c04-828c-6cf82f89724a-maas-api-service-ca\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:32:45.724449 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:32:45.724402    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-3aa245-9rgjh"
Sep 18 22:32:45.724605 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:32:45.724394    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-3aa245-9rgjh" event={"ID":"86b3bb6d-566b-4c04-828c-6cf82f89724a","Type":"ContainerDied","Data":"1763fa538d6d9066d85ff55210005fd0de04a2c9f482b9c38c126a6fdd79fdaf"}
Sep 18 22:32:45.724605 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:32:45.724553    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1763fa538d6d9066d85ff55210005fd0de04a2c9f482b9c38c126a6fdd79fdaf"
Sep 18 22:32:53.871032 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:32:53.870999    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-3aa245-9rgjh"]
Sep 18 22:32:53.878331 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:32:53.878304    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-3aa245-9rgjh"]
Sep 18 22:32:55.140289 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:32:55.140258    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="86b3bb6d-566b-4c04-828c-6cf82f89724a" path="/var/lib/kubelet/pods/86b3bb6d-566b-4c04-828c-6cf82f89724a/volumes"
Sep 18 22:33:01.059298 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:33:01.059255    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-3aa245-openshift-default-7774dcdfbd-zrpr7"]
Sep 18 22:33:01.061254 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:33:01.061182    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-3aa245-openshift-default-7774dcdfbd-zrpr7" podUID="71768d7c-9dd0-44ac-a9e7-6d366c6c707f" containerName="istio-proxy" containerID="cri-o://ad0ac307dbe32aca53c4b8e964833f557e6583352c7e7e47f63ed0720ea2c87c" gracePeriod=30
Sep 18 22:33:04.701836 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:33:04.701803    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-adba81-p4t88"]
Sep 18 22:33:04.702237 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:33:04.702223    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86b3bb6d-566b-4c04-828c-6cf82f89724a" containerName="revoke-keys"
Sep 18 22:33:04.702237 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:33:04.702238    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="86b3bb6d-566b-4c04-828c-6cf82f89724a" containerName="revoke-keys"
Sep 18 22:33:04.702312 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:33:04.702297    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="86b3bb6d-566b-4c04-828c-6cf82f89724a" containerName="revoke-keys"
Sep 18 22:33:04.705364 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:33:04.705348    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-adba81-p4t88"
Sep 18 22:33:04.708281 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:33:04.708262    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-9g7m4\""
Sep 18 22:33:04.715923 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:33:04.715899    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-adba81-p4t88"]
Sep 18 22:33:04.797386 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:33:04.797347    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1b7aee3-94de-4a51-8b22-316c67e27cbe-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-adba81-p4t88\" (UID: \"c1b7aee3-94de-4a51-8b22-316c67e27cbe\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-adba81-p4t88"
Sep 18 22:33:04.898263 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:33:04.898218    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1b7aee3-94de-4a51-8b22-316c67e27cbe-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-adba81-p4t88\" (UID: \"c1b7aee3-94de-4a51-8b22-316c67e27cbe\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-adba81-p4t88"
Sep 18 22:33:04.898866 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:33:04.898848    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1b7aee3-94de-4a51-8b22-316c67e27cbe-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-adba81-p4t88\" (UID: \"c1b7aee3-94de-4a51-8b22-316c67e27cbe\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-adba81-p4t88"
Sep 18 22:33:05.017084 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:33:05.017011    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-adba81-p4t88"
Sep 18 22:33:05.298528 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:33:05.298499    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-adba81-p4t88"]
Sep 18 22:33:05.299578 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:33:05.299553    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1b7aee3_94de_4a51_8b22_316c67e27cbe.slice/crio-d876fe178c8a48f1f74b11eb98cf57dbeab32338df1b4623bf0e705382955fea WatchSource:0}: Error finding container d876fe178c8a48f1f74b11eb98cf57dbeab32338df1b4623bf0e705382955fea: Status 404 returned error can't find the container with id d876fe178c8a48f1f74b11eb98cf57dbeab32338df1b4623bf0e705382955fea
Sep 18 22:33:05.862382 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:33:05.862340    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-adba81-p4t88" event={"ID":"c1b7aee3-94de-4a51-8b22-316c67e27cbe","Type":"ContainerStarted","Data":"c2960de7386bb66133e15c20db59ec606dc4932dad7dd424cca09c6c9d635c5c"}
Sep 18 22:33:05.862834 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:33:05.862462    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-adba81-p4t88" event={"ID":"c1b7aee3-94de-4a51-8b22-316c67e27cbe","Type":"ContainerStarted","Data":"d876fe178c8a48f1f74b11eb98cf57dbeab32338df1b4623bf0e705382955fea"}
Sep 18 22:33:05.881488 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:33:05.881440    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-adba81-p4t88" podStartSLOduration=1.881427785 podStartE2EDuration="1.881427785s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:33:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:33:05.878605782 +0000 UTC m=+1965.198277838" watchObservedRunningTime="2026-09-18 22:33:05.881427785 +0000 UTC m=+1965.201099858"
Sep 18 22:33:06.314529 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:33:06.314501    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-3aa245-openshift-default-7774dcdfbd-zrpr7"
Sep 18 22:33:06.410146 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:33:06.410068    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/71768d7c-9dd0-44ac-a9e7-6d366c6c707f-istio-envoy\") pod \"71768d7c-9dd0-44ac-a9e7-6d366c6c707f\" (UID: \"71768d7c-9dd0-44ac-a9e7-6d366c6c707f\") "
Sep 18 22:33:06.410146 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:33:06.410130    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/71768d7c-9dd0-44ac-a9e7-6d366c6c707f-workload-certs\") pod \"71768d7c-9dd0-44ac-a9e7-6d366c6c707f\" (UID: \"71768d7c-9dd0-44ac-a9e7-6d366c6c707f\") "
Sep 18 22:33:06.410328 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:33:06.410224    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/71768d7c-9dd0-44ac-a9e7-6d366c6c707f-credential-socket\") pod \"71768d7c-9dd0-44ac-a9e7-6d366c6c707f\" (UID: \"71768d7c-9dd0-44ac-a9e7-6d366c6c707f\") "
Sep 18 22:33:06.410328 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:33:06.410291    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/71768d7c-9dd0-44ac-a9e7-6d366c6c707f-istio-podinfo\") pod \"71768d7c-9dd0-44ac-a9e7-6d366c6c707f\" (UID: \"71768d7c-9dd0-44ac-a9e7-6d366c6c707f\") "
Sep 18 22:33:06.410328 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:33:06.410317    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/71768d7c-9dd0-44ac-a9e7-6d366c6c707f-istiod-ca-cert\") pod \"71768d7c-9dd0-44ac-a9e7-6d366c6c707f\" (UID: \"71768d7c-9dd0-44ac-a9e7-6d366c6c707f\") "
Sep 18 22:33:06.410516 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:33:06.410350    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/71768d7c-9dd0-44ac-a9e7-6d366c6c707f-workload-socket\") pod \"71768d7c-9dd0-44ac-a9e7-6d366c6c707f\" (UID: \"71768d7c-9dd0-44ac-a9e7-6d366c6c707f\") "
Sep 18 22:33:06.410516 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:33:06.410455    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rdw6r\" (UniqueName: \"kubernetes.io/projected/71768d7c-9dd0-44ac-a9e7-6d366c6c707f-kube-api-access-rdw6r\") pod \"71768d7c-9dd0-44ac-a9e7-6d366c6c707f\" (UID: \"71768d7c-9dd0-44ac-a9e7-6d366c6c707f\") "
Sep 18 22:33:06.410516 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:33:06.410458    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71768d7c-9dd0-44ac-a9e7-6d366c6c707f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "71768d7c-9dd0-44ac-a9e7-6d366c6c707f" (UID: "71768d7c-9dd0-44ac-a9e7-6d366c6c707f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:33:06.410516 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:33:06.410478    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71768d7c-9dd0-44ac-a9e7-6d366c6c707f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "71768d7c-9dd0-44ac-a9e7-6d366c6c707f" (UID: "71768d7c-9dd0-44ac-a9e7-6d366c6c707f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:33:06.410516 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:33:06.410498    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/71768d7c-9dd0-44ac-a9e7-6d366c6c707f-istio-token\") pod \"71768d7c-9dd0-44ac-a9e7-6d366c6c707f\" (UID: \"71768d7c-9dd0-44ac-a9e7-6d366c6c707f\") "
Sep 18 22:33:06.410772 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:33:06.410554    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/71768d7c-9dd0-44ac-a9e7-6d366c6c707f-istio-data\") pod \"71768d7c-9dd0-44ac-a9e7-6d366c6c707f\" (UID: \"71768d7c-9dd0-44ac-a9e7-6d366c6c707f\") "
Sep 18 22:33:06.410772 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:33:06.410690    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71768d7c-9dd0-44ac-a9e7-6d366c6c707f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "71768d7c-9dd0-44ac-a9e7-6d366c6c707f" (UID: "71768d7c-9dd0-44ac-a9e7-6d366c6c707f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:33:06.410772 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:33:06.410706    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71768d7c-9dd0-44ac-a9e7-6d366c6c707f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "71768d7c-9dd0-44ac-a9e7-6d366c6c707f" (UID: "71768d7c-9dd0-44ac-a9e7-6d366c6c707f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:33:06.410979 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:33:06.410958    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/71768d7c-9dd0-44ac-a9e7-6d366c6c707f-workload-certs\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:33:06.411127 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:33:06.410984    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/71768d7c-9dd0-44ac-a9e7-6d366c6c707f-credential-socket\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:33:06.411127 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:33:06.410999    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/71768d7c-9dd0-44ac-a9e7-6d366c6c707f-istiod-ca-cert\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:33:06.411127 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:33:06.411013    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/71768d7c-9dd0-44ac-a9e7-6d366c6c707f-workload-socket\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:33:06.411127 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:33:06.411061    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71768d7c-9dd0-44ac-a9e7-6d366c6c707f-istio-data" (OuterVolumeSpecName: "istio-data") pod "71768d7c-9dd0-44ac-a9e7-6d366c6c707f" (UID: "71768d7c-9dd0-44ac-a9e7-6d366c6c707f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:33:06.412595 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:33:06.412571    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71768d7c-9dd0-44ac-a9e7-6d366c6c707f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "71768d7c-9dd0-44ac-a9e7-6d366c6c707f" (UID: "71768d7c-9dd0-44ac-a9e7-6d366c6c707f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:33:06.412899 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:33:06.412884    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71768d7c-9dd0-44ac-a9e7-6d366c6c707f-istio-token" (OuterVolumeSpecName: "istio-token") pod "71768d7c-9dd0-44ac-a9e7-6d366c6c707f" (UID: "71768d7c-9dd0-44ac-a9e7-6d366c6c707f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:33:06.413182 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:33:06.413162    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71768d7c-9dd0-44ac-a9e7-6d366c6c707f-kube-api-access-rdw6r" (OuterVolumeSpecName: "kube-api-access-rdw6r") pod "71768d7c-9dd0-44ac-a9e7-6d366c6c707f" (UID: "71768d7c-9dd0-44ac-a9e7-6d366c6c707f"). InnerVolumeSpecName "kube-api-access-rdw6r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:33:06.413182 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:33:06.413163    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/71768d7c-9dd0-44ac-a9e7-6d366c6c707f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "71768d7c-9dd0-44ac-a9e7-6d366c6c707f" (UID: "71768d7c-9dd0-44ac-a9e7-6d366c6c707f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 18 22:33:06.512209 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:33:06.512176    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rdw6r\" (UniqueName: \"kubernetes.io/projected/71768d7c-9dd0-44ac-a9e7-6d366c6c707f-kube-api-access-rdw6r\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:33:06.512209 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:33:06.512207    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/71768d7c-9dd0-44ac-a9e7-6d366c6c707f-istio-token\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:33:06.512209 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:33:06.512217    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/71768d7c-9dd0-44ac-a9e7-6d366c6c707f-istio-data\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:33:06.512468 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:33:06.512224    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/71768d7c-9dd0-44ac-a9e7-6d366c6c707f-istio-envoy\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:33:06.512468 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:33:06.512232    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/71768d7c-9dd0-44ac-a9e7-6d366c6c707f-istio-podinfo\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:33:06.870003 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:33:06.869968    2577 generic.go:356] "Generic (PLEG): container finished" podID="71768d7c-9dd0-44ac-a9e7-6d366c6c707f" containerID="ad0ac307dbe32aca53c4b8e964833f557e6583352c7e7e47f63ed0720ea2c87c" exitCode=0
Sep 18 22:33:06.870496 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:33:06.870032    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-3aa245-openshift-default-7774dcdfbd-zrpr7"
Sep 18 22:33:06.870496 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:33:06.870057    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-3aa245-openshift-default-7774dcdfbd-zrpr7" event={"ID":"71768d7c-9dd0-44ac-a9e7-6d366c6c707f","Type":"ContainerDied","Data":"ad0ac307dbe32aca53c4b8e964833f557e6583352c7e7e47f63ed0720ea2c87c"}
Sep 18 22:33:06.870496 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:33:06.870112    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-3aa245-openshift-default-7774dcdfbd-zrpr7" event={"ID":"71768d7c-9dd0-44ac-a9e7-6d366c6c707f","Type":"ContainerDied","Data":"c94c9f022a7449f3b5baf40656f6e38db917912ad159dba4b4e4ab15a3bb16a6"}
Sep 18 22:33:06.870496 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:33:06.870141    2577 scope.go:117] "RemoveContainer" containerID="ad0ac307dbe32aca53c4b8e964833f557e6583352c7e7e47f63ed0720ea2c87c"
Sep 18 22:33:06.871971 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:33:06.871950    2577 generic.go:356] "Generic (PLEG): container finished" podID="c1b7aee3-94de-4a51-8b22-316c67e27cbe" containerID="c2960de7386bb66133e15c20db59ec606dc4932dad7dd424cca09c6c9d635c5c" exitCode=0
Sep 18 22:33:06.872087 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:33:06.872036    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-adba81-p4t88" event={"ID":"c1b7aee3-94de-4a51-8b22-316c67e27cbe","Type":"ContainerDied","Data":"c2960de7386bb66133e15c20db59ec606dc4932dad7dd424cca09c6c9d635c5c"}
Sep 18 22:33:06.881033 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:33:06.881016    2577 scope.go:117] "RemoveContainer" containerID="0737e04878adaa9a6c4e8fc222d612525b7123f347a0ad416e7da636c0dbdf14"
Sep 18 22:33:06.889664 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:33:06.889649    2577 scope.go:117] "RemoveContainer" containerID="ad0ac307dbe32aca53c4b8e964833f557e6583352c7e7e47f63ed0720ea2c87c"
Sep 18 22:33:06.889931 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:33:06.889909    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad0ac307dbe32aca53c4b8e964833f557e6583352c7e7e47f63ed0720ea2c87c\": container with ID starting with ad0ac307dbe32aca53c4b8e964833f557e6583352c7e7e47f63ed0720ea2c87c not found: ID does not exist" containerID="ad0ac307dbe32aca53c4b8e964833f557e6583352c7e7e47f63ed0720ea2c87c"
Sep 18 22:33:06.889993 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:33:06.889937    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad0ac307dbe32aca53c4b8e964833f557e6583352c7e7e47f63ed0720ea2c87c"} err="failed to get container status \"ad0ac307dbe32aca53c4b8e964833f557e6583352c7e7e47f63ed0720ea2c87c\": rpc error: code = NotFound desc = could not find container \"ad0ac307dbe32aca53c4b8e964833f557e6583352c7e7e47f63ed0720ea2c87c\": container with ID starting with ad0ac307dbe32aca53c4b8e964833f557e6583352c7e7e47f63ed0720ea2c87c not found: ID does not exist"
Sep 18 22:33:06.889993 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:33:06.889955    2577 scope.go:117] "RemoveContainer" containerID="0737e04878adaa9a6c4e8fc222d612525b7123f347a0ad416e7da636c0dbdf14"
Sep 18 22:33:06.890190 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:33:06.890175    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0737e04878adaa9a6c4e8fc222d612525b7123f347a0ad416e7da636c0dbdf14\": container with ID starting with 0737e04878adaa9a6c4e8fc222d612525b7123f347a0ad416e7da636c0dbdf14 not found: ID does not exist" containerID="0737e04878adaa9a6c4e8fc222d612525b7123f347a0ad416e7da636c0dbdf14"
Sep 18 22:33:06.890245 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:33:06.890195    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0737e04878adaa9a6c4e8fc222d612525b7123f347a0ad416e7da636c0dbdf14"} err="failed to get container status \"0737e04878adaa9a6c4e8fc222d612525b7123f347a0ad416e7da636c0dbdf14\": rpc error: code = NotFound desc = could not find container \"0737e04878adaa9a6c4e8fc222d612525b7123f347a0ad416e7da636c0dbdf14\": container with ID starting with 0737e04878adaa9a6c4e8fc222d612525b7123f347a0ad416e7da636c0dbdf14 not found: ID does not exist"
Sep 18 22:33:06.925209 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:33:06.925186    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-3aa245-openshift-default-7774dcdfbd-zrpr7"]
Sep 18 22:33:06.928914 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:33:06.928892    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-3aa245-openshift-default-7774dcdfbd-zrpr7"]
Sep 18 22:33:07.140287 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:33:07.140203    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="71768d7c-9dd0-44ac-a9e7-6d366c6c707f" path="/var/lib/kubelet/pods/71768d7c-9dd0-44ac-a9e7-6d366c6c707f/volumes"
Sep 18 22:33:08.015111 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:33:08.015082    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-adba81-p4t88"
Sep 18 22:33:08.130232 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:33:08.130149    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1b7aee3-94de-4a51-8b22-316c67e27cbe-maas-api-service-ca\") pod \"c1b7aee3-94de-4a51-8b22-316c67e27cbe\" (UID: \"c1b7aee3-94de-4a51-8b22-316c67e27cbe\") "
Sep 18 22:33:08.130519 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:33:08.130497    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c1b7aee3-94de-4a51-8b22-316c67e27cbe-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c1b7aee3-94de-4a51-8b22-316c67e27cbe" (UID: "c1b7aee3-94de-4a51-8b22-316c67e27cbe"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:33:08.231365 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:33:08.231318    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1b7aee3-94de-4a51-8b22-316c67e27cbe-maas-api-service-ca\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:33:08.886979 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:33:08.886952    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-adba81-p4t88"
Sep 18 22:33:08.887149 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:33:08.886985    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-adba81-p4t88" event={"ID":"c1b7aee3-94de-4a51-8b22-316c67e27cbe","Type":"ContainerDied","Data":"d876fe178c8a48f1f74b11eb98cf57dbeab32338df1b4623bf0e705382955fea"}
Sep 18 22:33:08.887149 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:33:08.887025    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d876fe178c8a48f1f74b11eb98cf57dbeab32338df1b4623bf0e705382955fea"
Sep 18 22:33:20.933950 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:33:20.933910    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-adba81-p4t88"]
Sep 18 22:33:20.936881 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:33:20.936855    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-adba81-p4t88"]
Sep 18 22:33:21.140268 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:33:21.140232    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c1b7aee3-94de-4a51-8b22-316c67e27cbe" path="/var/lib/kubelet/pods/c1b7aee3-94de-4a51-8b22-316c67e27cbe/volumes"
Sep 18 22:33:21.731225 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:33:21.731197    2577 scope.go:117] "RemoveContainer" containerID="c0c78c4b45f16ad4d7d6f81675b9e8ef2f80f914463e87d57c48b6ab6196869d"
Sep 18 22:34:10.810890 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:10.810856    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-adba81-openshift-default-554cf9cf44-4sggd"]
Sep 18 22:34:10.811388 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:10.811061    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-adba81-openshift-default-554cf9cf44-4sggd" podUID="6596cfcc-f03e-413e-9aa8-6a95f74a0eee" containerName="istio-proxy" containerID="cri-o://f93c1ae4f6a53c39f6ef5d983fa7ae790c544964a0f2bc51d8f81141dbf554dd" gracePeriod=30
Sep 18 22:34:12.778816 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:12.778774    2577 patch_prober.go:28] interesting pod/e2e-ipp-a-adba81-openshift-default-554cf9cf44-4sggd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 18 22:34:12.779204 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:12.778846    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-adba81-openshift-default-554cf9cf44-4sggd" podUID="6596cfcc-f03e-413e-9aa8-6a95f74a0eee" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 22:34:16.061850 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:16.061827    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-adba81-openshift-default-554cf9cf44-4sggd"
Sep 18 22:34:16.198069 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:16.197987    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6596cfcc-f03e-413e-9aa8-6a95f74a0eee-istio-podinfo\") pod \"6596cfcc-f03e-413e-9aa8-6a95f74a0eee\" (UID: \"6596cfcc-f03e-413e-9aa8-6a95f74a0eee\") "
Sep 18 22:34:16.198069 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:16.198025    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6596cfcc-f03e-413e-9aa8-6a95f74a0eee-istio-token\") pod \"6596cfcc-f03e-413e-9aa8-6a95f74a0eee\" (UID: \"6596cfcc-f03e-413e-9aa8-6a95f74a0eee\") "
Sep 18 22:34:16.198069 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:16.198043    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6596cfcc-f03e-413e-9aa8-6a95f74a0eee-istio-envoy\") pod \"6596cfcc-f03e-413e-9aa8-6a95f74a0eee\" (UID: \"6596cfcc-f03e-413e-9aa8-6a95f74a0eee\") "
Sep 18 22:34:16.198069 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:16.198068    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6596cfcc-f03e-413e-9aa8-6a95f74a0eee-workload-socket\") pod \"6596cfcc-f03e-413e-9aa8-6a95f74a0eee\" (UID: \"6596cfcc-f03e-413e-9aa8-6a95f74a0eee\") "
Sep 18 22:34:16.198381 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:16.198099    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6596cfcc-f03e-413e-9aa8-6a95f74a0eee-credential-socket\") pod \"6596cfcc-f03e-413e-9aa8-6a95f74a0eee\" (UID: \"6596cfcc-f03e-413e-9aa8-6a95f74a0eee\") "
Sep 18 22:34:16.198381 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:16.198153    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6596cfcc-f03e-413e-9aa8-6a95f74a0eee-workload-certs\") pod \"6596cfcc-f03e-413e-9aa8-6a95f74a0eee\" (UID: \"6596cfcc-f03e-413e-9aa8-6a95f74a0eee\") "
Sep 18 22:34:16.198381 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:16.198228    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q5mz7\" (UniqueName: \"kubernetes.io/projected/6596cfcc-f03e-413e-9aa8-6a95f74a0eee-kube-api-access-q5mz7\") pod \"6596cfcc-f03e-413e-9aa8-6a95f74a0eee\" (UID: \"6596cfcc-f03e-413e-9aa8-6a95f74a0eee\") "
Sep 18 22:34:16.198381 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:16.198263    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6596cfcc-f03e-413e-9aa8-6a95f74a0eee-istiod-ca-cert\") pod \"6596cfcc-f03e-413e-9aa8-6a95f74a0eee\" (UID: \"6596cfcc-f03e-413e-9aa8-6a95f74a0eee\") "
Sep 18 22:34:16.198381 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:16.198312    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6596cfcc-f03e-413e-9aa8-6a95f74a0eee-istio-data\") pod \"6596cfcc-f03e-413e-9aa8-6a95f74a0eee\" (UID: \"6596cfcc-f03e-413e-9aa8-6a95f74a0eee\") "
Sep 18 22:34:16.198684 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:16.198376    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6596cfcc-f03e-413e-9aa8-6a95f74a0eee-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6596cfcc-f03e-413e-9aa8-6a95f74a0eee" (UID: "6596cfcc-f03e-413e-9aa8-6a95f74a0eee"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:34:16.198684 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:16.198509    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6596cfcc-f03e-413e-9aa8-6a95f74a0eee-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6596cfcc-f03e-413e-9aa8-6a95f74a0eee" (UID: "6596cfcc-f03e-413e-9aa8-6a95f74a0eee"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:34:16.198684 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:16.198540    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6596cfcc-f03e-413e-9aa8-6a95f74a0eee-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6596cfcc-f03e-413e-9aa8-6a95f74a0eee" (UID: "6596cfcc-f03e-413e-9aa8-6a95f74a0eee"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:34:16.198845 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:16.198698    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6596cfcc-f03e-413e-9aa8-6a95f74a0eee-istio-data" (OuterVolumeSpecName: "istio-data") pod "6596cfcc-f03e-413e-9aa8-6a95f74a0eee" (UID: "6596cfcc-f03e-413e-9aa8-6a95f74a0eee"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:34:16.198845 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:16.198758    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6596cfcc-f03e-413e-9aa8-6a95f74a0eee-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6596cfcc-f03e-413e-9aa8-6a95f74a0eee" (UID: "6596cfcc-f03e-413e-9aa8-6a95f74a0eee"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:34:16.198960 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:16.198926    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6596cfcc-f03e-413e-9aa8-6a95f74a0eee-workload-socket\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:34:16.198960 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:16.198946    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6596cfcc-f03e-413e-9aa8-6a95f74a0eee-credential-socket\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:34:16.199045 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:16.198960    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6596cfcc-f03e-413e-9aa8-6a95f74a0eee-workload-certs\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:34:16.199045 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:16.198972    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6596cfcc-f03e-413e-9aa8-6a95f74a0eee-istiod-ca-cert\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:34:16.199045 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:16.198984    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6596cfcc-f03e-413e-9aa8-6a95f74a0eee-istio-data\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:34:16.200558 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:16.200532    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6596cfcc-f03e-413e-9aa8-6a95f74a0eee-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6596cfcc-f03e-413e-9aa8-6a95f74a0eee" (UID: "6596cfcc-f03e-413e-9aa8-6a95f74a0eee"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 18 22:34:16.200735 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:16.200716    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6596cfcc-f03e-413e-9aa8-6a95f74a0eee-kube-api-access-q5mz7" (OuterVolumeSpecName: "kube-api-access-q5mz7") pod "6596cfcc-f03e-413e-9aa8-6a95f74a0eee" (UID: "6596cfcc-f03e-413e-9aa8-6a95f74a0eee"). InnerVolumeSpecName "kube-api-access-q5mz7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:34:16.201037 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:16.201021    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6596cfcc-f03e-413e-9aa8-6a95f74a0eee-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6596cfcc-f03e-413e-9aa8-6a95f74a0eee" (UID: "6596cfcc-f03e-413e-9aa8-6a95f74a0eee"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:34:16.201133 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:16.201118    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6596cfcc-f03e-413e-9aa8-6a95f74a0eee-istio-token" (OuterVolumeSpecName: "istio-token") pod "6596cfcc-f03e-413e-9aa8-6a95f74a0eee" (UID: "6596cfcc-f03e-413e-9aa8-6a95f74a0eee"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:34:16.299811 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:16.299776    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q5mz7\" (UniqueName: \"kubernetes.io/projected/6596cfcc-f03e-413e-9aa8-6a95f74a0eee-kube-api-access-q5mz7\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:34:16.299811 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:16.299802    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6596cfcc-f03e-413e-9aa8-6a95f74a0eee-istio-podinfo\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:34:16.299811 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:16.299814    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6596cfcc-f03e-413e-9aa8-6a95f74a0eee-istio-token\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:34:16.300021 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:16.299826    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6596cfcc-f03e-413e-9aa8-6a95f74a0eee-istio-envoy\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:34:16.301398 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:16.301375    2577 generic.go:356] "Generic (PLEG): container finished" podID="6596cfcc-f03e-413e-9aa8-6a95f74a0eee" containerID="f93c1ae4f6a53c39f6ef5d983fa7ae790c544964a0f2bc51d8f81141dbf554dd" exitCode=0
Sep 18 22:34:16.301524 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:16.301440    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-adba81-openshift-default-554cf9cf44-4sggd" event={"ID":"6596cfcc-f03e-413e-9aa8-6a95f74a0eee","Type":"ContainerDied","Data":"f93c1ae4f6a53c39f6ef5d983fa7ae790c544964a0f2bc51d8f81141dbf554dd"}
Sep 18 22:34:16.301524 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:16.301453    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-adba81-openshift-default-554cf9cf44-4sggd"
Sep 18 22:34:16.301524 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:16.301497    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-adba81-openshift-default-554cf9cf44-4sggd" event={"ID":"6596cfcc-f03e-413e-9aa8-6a95f74a0eee","Type":"ContainerDied","Data":"5b3fc1bd971bc1bf2cbd006d56e70e4f5494230c0efea99f42848a120bac37f0"}
Sep 18 22:34:16.301524 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:16.301520    2577 scope.go:117] "RemoveContainer" containerID="f93c1ae4f6a53c39f6ef5d983fa7ae790c544964a0f2bc51d8f81141dbf554dd"
Sep 18 22:34:16.311395 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:16.311380    2577 scope.go:117] "RemoveContainer" containerID="8d91f9f7d000d92f53a964f5c8723383ed480a1f1f6805501d4d83f3d4b8e4b1"
Sep 18 22:34:16.319847 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:16.319830    2577 scope.go:117] "RemoveContainer" containerID="f93c1ae4f6a53c39f6ef5d983fa7ae790c544964a0f2bc51d8f81141dbf554dd"
Sep 18 22:34:16.320118 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:34:16.320099    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f93c1ae4f6a53c39f6ef5d983fa7ae790c544964a0f2bc51d8f81141dbf554dd\": container with ID starting with f93c1ae4f6a53c39f6ef5d983fa7ae790c544964a0f2bc51d8f81141dbf554dd not found: ID does not exist" containerID="f93c1ae4f6a53c39f6ef5d983fa7ae790c544964a0f2bc51d8f81141dbf554dd"
Sep 18 22:34:16.320167 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:16.320138    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f93c1ae4f6a53c39f6ef5d983fa7ae790c544964a0f2bc51d8f81141dbf554dd"} err="failed to get container status \"f93c1ae4f6a53c39f6ef5d983fa7ae790c544964a0f2bc51d8f81141dbf554dd\": rpc error: code = NotFound desc = could not find container \"f93c1ae4f6a53c39f6ef5d983fa7ae790c544964a0f2bc51d8f81141dbf554dd\": container with ID starting with f93c1ae4f6a53c39f6ef5d983fa7ae790c544964a0f2bc51d8f81141dbf554dd not found: ID does not exist"
Sep 18 22:34:16.320167 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:16.320154    2577 scope.go:117] "RemoveContainer" containerID="8d91f9f7d000d92f53a964f5c8723383ed480a1f1f6805501d4d83f3d4b8e4b1"
Sep 18 22:34:16.320391 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:34:16.320372    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d91f9f7d000d92f53a964f5c8723383ed480a1f1f6805501d4d83f3d4b8e4b1\": container with ID starting with 8d91f9f7d000d92f53a964f5c8723383ed480a1f1f6805501d4d83f3d4b8e4b1 not found: ID does not exist" containerID="8d91f9f7d000d92f53a964f5c8723383ed480a1f1f6805501d4d83f3d4b8e4b1"
Sep 18 22:34:16.320474 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:16.320401    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d91f9f7d000d92f53a964f5c8723383ed480a1f1f6805501d4d83f3d4b8e4b1"} err="failed to get container status \"8d91f9f7d000d92f53a964f5c8723383ed480a1f1f6805501d4d83f3d4b8e4b1\": rpc error: code = NotFound desc = could not find container \"8d91f9f7d000d92f53a964f5c8723383ed480a1f1f6805501d4d83f3d4b8e4b1\": container with ID starting with 8d91f9f7d000d92f53a964f5c8723383ed480a1f1f6805501d4d83f3d4b8e4b1 not found: ID does not exist"
Sep 18 22:34:16.327178 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:16.327151    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-adba81-openshift-default-554cf9cf44-4sggd"]
Sep 18 22:34:16.329695 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:16.329663    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-adba81-openshift-default-554cf9cf44-4sggd"]
Sep 18 22:34:17.140031 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:17.140000    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6596cfcc-f03e-413e-9aa8-6a95f74a0eee" path="/var/lib/kubelet/pods/6596cfcc-f03e-413e-9aa8-6a95f74a0eee/volumes"
Sep 18 22:34:21.760558 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:21.760525    2577 scope.go:117] "RemoveContainer" containerID="7e7247bc4a66c7774a1cdea6dae596db71a6000e337f836aae583e5edf81c3a8"
Sep 18 22:34:21.769334 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:21.769312    2577 scope.go:117] "RemoveContainer" containerID="060009e7922e16582f4e68bcccaa5aa3070ca87c377240ae6289f7464fed48d6"
Sep 18 22:34:21.778002 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:21.777984    2577 scope.go:117] "RemoveContainer" containerID="1079a846c97007b3366a273258cdb1fb9df3cee8f142066a805350411f395b79"
Sep 18 22:34:29.375099 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:29.375066    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn"]
Sep 18 22:34:29.375570 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:29.375301    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn" podUID="0fe39b00-0eda-4437-9b45-526e17cdaf71" containerName="istio-proxy" containerID="cri-o://2cec9a21cf51c450b8e8f1038921540f49b4135eca553210a60297f56324bc0f" gracePeriod=30
Sep 18 22:34:29.420959 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:29.420927    2577 patch_prober.go:28] interesting pod/e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 18 22:34:29.421124 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:29.421001    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn" podUID="0fe39b00-0eda-4437-9b45-526e17cdaf71" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 22:34:34.632903 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:34.632877    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn"
Sep 18 22:34:34.680069 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:34.679980    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0fe39b00-0eda-4437-9b45-526e17cdaf71-istiod-ca-cert\") pod \"0fe39b00-0eda-4437-9b45-526e17cdaf71\" (UID: \"0fe39b00-0eda-4437-9b45-526e17cdaf71\") "
Sep 18 22:34:34.680069 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:34.680047    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0fe39b00-0eda-4437-9b45-526e17cdaf71-istio-token\") pod \"0fe39b00-0eda-4437-9b45-526e17cdaf71\" (UID: \"0fe39b00-0eda-4437-9b45-526e17cdaf71\") "
Sep 18 22:34:34.680261 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:34.680076    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0fe39b00-0eda-4437-9b45-526e17cdaf71-workload-socket\") pod \"0fe39b00-0eda-4437-9b45-526e17cdaf71\" (UID: \"0fe39b00-0eda-4437-9b45-526e17cdaf71\") "
Sep 18 22:34:34.680326 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:34.680259    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0fe39b00-0eda-4437-9b45-526e17cdaf71-credential-socket\") pod \"0fe39b00-0eda-4437-9b45-526e17cdaf71\" (UID: \"0fe39b00-0eda-4437-9b45-526e17cdaf71\") "
Sep 18 22:34:34.680383 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:34.680339    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0fe39b00-0eda-4437-9b45-526e17cdaf71-istio-podinfo\") pod \"0fe39b00-0eda-4437-9b45-526e17cdaf71\" (UID: \"0fe39b00-0eda-4437-9b45-526e17cdaf71\") "
Sep 18 22:34:34.680383 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:34.680372    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0fe39b00-0eda-4437-9b45-526e17cdaf71-workload-certs\") pod \"0fe39b00-0eda-4437-9b45-526e17cdaf71\" (UID: \"0fe39b00-0eda-4437-9b45-526e17cdaf71\") "
Sep 18 22:34:34.680521 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:34.680432    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0fe39b00-0eda-4437-9b45-526e17cdaf71-istio-data\") pod \"0fe39b00-0eda-4437-9b45-526e17cdaf71\" (UID: \"0fe39b00-0eda-4437-9b45-526e17cdaf71\") "
Sep 18 22:34:34.680521 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:34.680462    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rvvb4\" (UniqueName: \"kubernetes.io/projected/0fe39b00-0eda-4437-9b45-526e17cdaf71-kube-api-access-rvvb4\") pod \"0fe39b00-0eda-4437-9b45-526e17cdaf71\" (UID: \"0fe39b00-0eda-4437-9b45-526e17cdaf71\") "
Sep 18 22:34:34.680521 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:34.680504    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0fe39b00-0eda-4437-9b45-526e17cdaf71-istio-envoy\") pod \"0fe39b00-0eda-4437-9b45-526e17cdaf71\" (UID: \"0fe39b00-0eda-4437-9b45-526e17cdaf71\") "
Sep 18 22:34:34.680679 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:34.680584    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0fe39b00-0eda-4437-9b45-526e17cdaf71-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0fe39b00-0eda-4437-9b45-526e17cdaf71" (UID: "0fe39b00-0eda-4437-9b45-526e17cdaf71"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:34:34.680679 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:34.680592    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0fe39b00-0eda-4437-9b45-526e17cdaf71-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0fe39b00-0eda-4437-9b45-526e17cdaf71" (UID: "0fe39b00-0eda-4437-9b45-526e17cdaf71"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:34:34.680790 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:34.680712    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0fe39b00-0eda-4437-9b45-526e17cdaf71-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0fe39b00-0eda-4437-9b45-526e17cdaf71" (UID: "0fe39b00-0eda-4437-9b45-526e17cdaf71"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:34:34.680871 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:34.680847    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0fe39b00-0eda-4437-9b45-526e17cdaf71-workload-certs\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:34:34.680936 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:34.680871    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0fe39b00-0eda-4437-9b45-526e17cdaf71-istiod-ca-cert\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:34:34.680936 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:34.680885    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0fe39b00-0eda-4437-9b45-526e17cdaf71-workload-socket\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:34:34.680936 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:34.680925    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0fe39b00-0eda-4437-9b45-526e17cdaf71-istio-data" (OuterVolumeSpecName: "istio-data") pod "0fe39b00-0eda-4437-9b45-526e17cdaf71" (UID: "0fe39b00-0eda-4437-9b45-526e17cdaf71"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:34:34.681226 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:34.681206    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0fe39b00-0eda-4437-9b45-526e17cdaf71-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0fe39b00-0eda-4437-9b45-526e17cdaf71" (UID: "0fe39b00-0eda-4437-9b45-526e17cdaf71"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:34:34.682804 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:34.682779    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0fe39b00-0eda-4437-9b45-526e17cdaf71-istio-token" (OuterVolumeSpecName: "istio-token") pod "0fe39b00-0eda-4437-9b45-526e17cdaf71" (UID: "0fe39b00-0eda-4437-9b45-526e17cdaf71"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:34:34.683149 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:34.683124    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0fe39b00-0eda-4437-9b45-526e17cdaf71-kube-api-access-rvvb4" (OuterVolumeSpecName: "kube-api-access-rvvb4") pod "0fe39b00-0eda-4437-9b45-526e17cdaf71" (UID: "0fe39b00-0eda-4437-9b45-526e17cdaf71"). InnerVolumeSpecName "kube-api-access-rvvb4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:34:34.683346 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:34.683326    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0fe39b00-0eda-4437-9b45-526e17cdaf71-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0fe39b00-0eda-4437-9b45-526e17cdaf71" (UID: "0fe39b00-0eda-4437-9b45-526e17cdaf71"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:34:34.683468 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:34.683354    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0fe39b00-0eda-4437-9b45-526e17cdaf71-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0fe39b00-0eda-4437-9b45-526e17cdaf71" (UID: "0fe39b00-0eda-4437-9b45-526e17cdaf71"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 18 22:34:34.781762 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:34.781729    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0fe39b00-0eda-4437-9b45-526e17cdaf71-istio-token\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:34:34.781762 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:34.781760    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0fe39b00-0eda-4437-9b45-526e17cdaf71-credential-socket\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:34:34.781762 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:34.781770    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0fe39b00-0eda-4437-9b45-526e17cdaf71-istio-podinfo\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:34:34.782008 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:34.781779    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0fe39b00-0eda-4437-9b45-526e17cdaf71-istio-data\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:34:34.782008 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:34.781787    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rvvb4\" (UniqueName: \"kubernetes.io/projected/0fe39b00-0eda-4437-9b45-526e17cdaf71-kube-api-access-rvvb4\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:34:34.782008 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:34.781796    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0fe39b00-0eda-4437-9b45-526e17cdaf71-istio-envoy\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:34:35.421778 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:35.421698    2577 generic.go:356] "Generic (PLEG): container finished" podID="0fe39b00-0eda-4437-9b45-526e17cdaf71" containerID="2cec9a21cf51c450b8e8f1038921540f49b4135eca553210a60297f56324bc0f" exitCode=0
Sep 18 22:34:35.421778 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:35.421763    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn"
Sep 18 22:34:35.421968 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:35.421781    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn" event={"ID":"0fe39b00-0eda-4437-9b45-526e17cdaf71","Type":"ContainerDied","Data":"2cec9a21cf51c450b8e8f1038921540f49b4135eca553210a60297f56324bc0f"}
Sep 18 22:34:35.421968 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:35.421836    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn" event={"ID":"0fe39b00-0eda-4437-9b45-526e17cdaf71","Type":"ContainerDied","Data":"6abe45ce99456c8051d8042ca4470b0f5e9456b77826fda8db33252c0c5476be"}
Sep 18 22:34:35.421968 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:35.421857    2577 scope.go:117] "RemoveContainer" containerID="2cec9a21cf51c450b8e8f1038921540f49b4135eca553210a60297f56324bc0f"
Sep 18 22:34:35.431512 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:35.431488    2577 scope.go:117] "RemoveContainer" containerID="1246da5e522a6b83ced0b12addaef2451e11bc0469a3c6229c5b14adeee7e327"
Sep 18 22:34:35.440473 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:35.440456    2577 scope.go:117] "RemoveContainer" containerID="2cec9a21cf51c450b8e8f1038921540f49b4135eca553210a60297f56324bc0f"
Sep 18 22:34:35.440715 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:34:35.440695    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2cec9a21cf51c450b8e8f1038921540f49b4135eca553210a60297f56324bc0f\": container with ID starting with 2cec9a21cf51c450b8e8f1038921540f49b4135eca553210a60297f56324bc0f not found: ID does not exist" containerID="2cec9a21cf51c450b8e8f1038921540f49b4135eca553210a60297f56324bc0f"
Sep 18 22:34:35.440774 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:35.440727    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2cec9a21cf51c450b8e8f1038921540f49b4135eca553210a60297f56324bc0f"} err="failed to get container status \"2cec9a21cf51c450b8e8f1038921540f49b4135eca553210a60297f56324bc0f\": rpc error: code = NotFound desc = could not find container \"2cec9a21cf51c450b8e8f1038921540f49b4135eca553210a60297f56324bc0f\": container with ID starting with 2cec9a21cf51c450b8e8f1038921540f49b4135eca553210a60297f56324bc0f not found: ID does not exist"
Sep 18 22:34:35.440774 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:35.440741    2577 scope.go:117] "RemoveContainer" containerID="1246da5e522a6b83ced0b12addaef2451e11bc0469a3c6229c5b14adeee7e327"
Sep 18 22:34:35.440961 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:34:35.440947    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1246da5e522a6b83ced0b12addaef2451e11bc0469a3c6229c5b14adeee7e327\": container with ID starting with 1246da5e522a6b83ced0b12addaef2451e11bc0469a3c6229c5b14adeee7e327 not found: ID does not exist" containerID="1246da5e522a6b83ced0b12addaef2451e11bc0469a3c6229c5b14adeee7e327"
Sep 18 22:34:35.441011 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:35.440965    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1246da5e522a6b83ced0b12addaef2451e11bc0469a3c6229c5b14adeee7e327"} err="failed to get container status \"1246da5e522a6b83ced0b12addaef2451e11bc0469a3c6229c5b14adeee7e327\": rpc error: code = NotFound desc = could not find container \"1246da5e522a6b83ced0b12addaef2451e11bc0469a3c6229c5b14adeee7e327\": container with ID starting with 1246da5e522a6b83ced0b12addaef2451e11bc0469a3c6229c5b14adeee7e327 not found: ID does not exist"
Sep 18 22:34:35.453447 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:35.453399    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn"]
Sep 18 22:34:35.457849 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:35.457825    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn"]
Sep 18 22:34:37.140368 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:37.140337    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0fe39b00-0eda-4437-9b45-526e17cdaf71" path="/var/lib/kubelet/pods/0fe39b00-0eda-4437-9b45-526e17cdaf71/volumes"
Sep 18 22:34:40.448126 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:40.448096    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-123a30-29829510-465gb"]
Sep 18 22:34:40.452481 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:40.452452    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-123a30-29829510-465gb"]
Sep 18 22:34:40.495824 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:40.495780    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-123a30-5f56bf8b75-h2dwv"]
Sep 18 22:34:40.496123 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:40.496086    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-123a30-5f56bf8b75-h2dwv" podUID="a4479845-a02e-4784-93e0-a25d20d12f5c" containerName="payload-processing" containerID="cri-o://8e04137f8168216f413ac896fb9336676ee16d81b7f8b51f821276fe335dc15b" gracePeriod=30
Sep 18 22:34:40.766071 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:40.766044    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-123a30-5f56bf8b75-h2dwv"
Sep 18 22:34:40.840607 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:40.839955    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2jkdh\" (UniqueName: \"kubernetes.io/projected/a4479845-a02e-4784-93e0-a25d20d12f5c-kube-api-access-2jkdh\") pod \"a4479845-a02e-4784-93e0-a25d20d12f5c\" (UID: \"a4479845-a02e-4784-93e0-a25d20d12f5c\") "
Sep 18 22:34:40.840607 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:40.840066    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a4479845-a02e-4784-93e0-a25d20d12f5c-plugins-config-volume\") pod \"a4479845-a02e-4784-93e0-a25d20d12f5c\" (UID: \"a4479845-a02e-4784-93e0-a25d20d12f5c\") "
Sep 18 22:34:40.842030 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:40.841978    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a4479845-a02e-4784-93e0-a25d20d12f5c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a4479845-a02e-4784-93e0-a25d20d12f5c" (UID: "a4479845-a02e-4784-93e0-a25d20d12f5c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:34:40.850807 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:40.850761    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4479845-a02e-4784-93e0-a25d20d12f5c-kube-api-access-2jkdh" (OuterVolumeSpecName: "kube-api-access-2jkdh") pod "a4479845-a02e-4784-93e0-a25d20d12f5c" (UID: "a4479845-a02e-4784-93e0-a25d20d12f5c"). InnerVolumeSpecName "kube-api-access-2jkdh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:34:40.941204 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:40.941168    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a4479845-a02e-4784-93e0-a25d20d12f5c-plugins-config-volume\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:34:40.941204 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:40.941200    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2jkdh\" (UniqueName: \"kubernetes.io/projected/a4479845-a02e-4784-93e0-a25d20d12f5c-kube-api-access-2jkdh\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:34:41.140107 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:41.140073    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f545f765-90c2-4813-9add-ea2ce1ae8607" path="/var/lib/kubelet/pods/f545f765-90c2-4813-9add-ea2ce1ae8607/volumes"
Sep 18 22:34:41.461056 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:41.460966    2577 generic.go:356] "Generic (PLEG): container finished" podID="a4479845-a02e-4784-93e0-a25d20d12f5c" containerID="8e04137f8168216f413ac896fb9336676ee16d81b7f8b51f821276fe335dc15b" exitCode=0
Sep 18 22:34:41.461056 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:41.461021    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-123a30-5f56bf8b75-h2dwv"
Sep 18 22:34:41.461557 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:41.461058    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-123a30-5f56bf8b75-h2dwv" event={"ID":"a4479845-a02e-4784-93e0-a25d20d12f5c","Type":"ContainerDied","Data":"8e04137f8168216f413ac896fb9336676ee16d81b7f8b51f821276fe335dc15b"}
Sep 18 22:34:41.461557 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:41.461113    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-123a30-5f56bf8b75-h2dwv" event={"ID":"a4479845-a02e-4784-93e0-a25d20d12f5c","Type":"ContainerDied","Data":"1ab96065fe2087d5b04c1a12984975c5770a724a1b915f826141a62abf81903b"}
Sep 18 22:34:41.461557 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:41.461139    2577 scope.go:117] "RemoveContainer" containerID="8e04137f8168216f413ac896fb9336676ee16d81b7f8b51f821276fe335dc15b"
Sep 18 22:34:41.470080 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:41.470062    2577 scope.go:117] "RemoveContainer" containerID="8e04137f8168216f413ac896fb9336676ee16d81b7f8b51f821276fe335dc15b"
Sep 18 22:34:41.470357 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:34:41.470337    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e04137f8168216f413ac896fb9336676ee16d81b7f8b51f821276fe335dc15b\": container with ID starting with 8e04137f8168216f413ac896fb9336676ee16d81b7f8b51f821276fe335dc15b not found: ID does not exist" containerID="8e04137f8168216f413ac896fb9336676ee16d81b7f8b51f821276fe335dc15b"
Sep 18 22:34:41.470400 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:41.470365    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e04137f8168216f413ac896fb9336676ee16d81b7f8b51f821276fe335dc15b"} err="failed to get container status \"8e04137f8168216f413ac896fb9336676ee16d81b7f8b51f821276fe335dc15b\": rpc error: code = NotFound desc = could not find container \"8e04137f8168216f413ac896fb9336676ee16d81b7f8b51f821276fe335dc15b\": container with ID starting with 8e04137f8168216f413ac896fb9336676ee16d81b7f8b51f821276fe335dc15b not found: ID does not exist"
Sep 18 22:34:41.485148 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:41.485127    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-123a30-5f56bf8b75-h2dwv"]
Sep 18 22:34:41.495710 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:41.495688    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-123a30-5f56bf8b75-h2dwv"]
Sep 18 22:34:43.139863 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:43.139787    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a4479845-a02e-4784-93e0-a25d20d12f5c" path="/var/lib/kubelet/pods/a4479845-a02e-4784-93e0-a25d20d12f5c/volumes"
Sep 18 22:34:49.127285 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:49.127253    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-123a30-openshift-default-79444bfb7b-8l2hl"]
Sep 18 22:34:49.127710 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:49.127512    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w3-123a30-openshift-default-79444bfb7b-8l2hl" podUID="d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6" containerName="istio-proxy" containerID="cri-o://37f76bc335906830d73e87ea74aeb12552b3e5fbd15bda321a36d220aa119f51" gracePeriod=30
Sep 18 22:34:49.496347 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:49.496266    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7f10d8-plxs8"]
Sep 18 22:34:49.496756 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:49.496735    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6596cfcc-f03e-413e-9aa8-6a95f74a0eee" containerName="istio-proxy"
Sep 18 22:34:49.496849 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:49.496758    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="6596cfcc-f03e-413e-9aa8-6a95f74a0eee" containerName="istio-proxy"
Sep 18 22:34:49.496849 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:49.496783    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1b7aee3-94de-4a51-8b22-316c67e27cbe" containerName="revoke-keys"
Sep 18 22:34:49.496849 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:49.496792    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1b7aee3-94de-4a51-8b22-316c67e27cbe" containerName="revoke-keys"
Sep 18 22:34:49.496849 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:49.496810    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71768d7c-9dd0-44ac-a9e7-6d366c6c707f" containerName="istio-proxy"
Sep 18 22:34:49.496849 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:49.496819    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="71768d7c-9dd0-44ac-a9e7-6d366c6c707f" containerName="istio-proxy"
Sep 18 22:34:49.496849 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:49.496842    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4479845-a02e-4784-93e0-a25d20d12f5c" containerName="payload-processing"
Sep 18 22:34:49.496849 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:49.496851    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4479845-a02e-4784-93e0-a25d20d12f5c" containerName="payload-processing"
Sep 18 22:34:49.497111 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:49.496862    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0fe39b00-0eda-4437-9b45-526e17cdaf71" containerName="istio-proxy"
Sep 18 22:34:49.497111 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:49.496870    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="0fe39b00-0eda-4437-9b45-526e17cdaf71" containerName="istio-proxy"
Sep 18 22:34:49.497111 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:49.496887    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0fe39b00-0eda-4437-9b45-526e17cdaf71" containerName="istio-proxy"
Sep 18 22:34:49.497111 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:49.496895    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="0fe39b00-0eda-4437-9b45-526e17cdaf71" containerName="istio-proxy"
Sep 18 22:34:49.497111 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:49.496910    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71768d7c-9dd0-44ac-a9e7-6d366c6c707f" containerName="istio-proxy"
Sep 18 22:34:49.497111 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:49.496918    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="71768d7c-9dd0-44ac-a9e7-6d366c6c707f" containerName="istio-proxy"
Sep 18 22:34:49.497111 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:49.497017    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="6596cfcc-f03e-413e-9aa8-6a95f74a0eee" containerName="istio-proxy"
Sep 18 22:34:49.497111 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:49.497028    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4479845-a02e-4784-93e0-a25d20d12f5c" containerName="payload-processing"
Sep 18 22:34:49.497111 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:49.497039    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="71768d7c-9dd0-44ac-a9e7-6d366c6c707f" containerName="istio-proxy"
Sep 18 22:34:49.497111 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:49.497048    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="0fe39b00-0eda-4437-9b45-526e17cdaf71" containerName="istio-proxy"
Sep 18 22:34:49.497111 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:49.497057    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="71768d7c-9dd0-44ac-a9e7-6d366c6c707f" containerName="istio-proxy"
Sep 18 22:34:49.497111 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:49.497068    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c1b7aee3-94de-4a51-8b22-316c67e27cbe" containerName="revoke-keys"
Sep 18 22:34:49.501596 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:49.501575    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7f10d8-plxs8"
Sep 18 22:34:49.504345 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:49.504323    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-9g7m4\""
Sep 18 22:34:49.514656 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:49.514633    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7f10d8-plxs8"]
Sep 18 22:34:49.621671 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:49.621643    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/49c713aa-18ea-45bd-bd45-12a960724a0a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-7f10d8-plxs8\" (UID: \"49c713aa-18ea-45bd-bd45-12a960724a0a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7f10d8-plxs8"
Sep 18 22:34:49.722789 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:49.722753    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/49c713aa-18ea-45bd-bd45-12a960724a0a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-7f10d8-plxs8\" (UID: \"49c713aa-18ea-45bd-bd45-12a960724a0a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7f10d8-plxs8"
Sep 18 22:34:49.723366 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:49.723345    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/49c713aa-18ea-45bd-bd45-12a960724a0a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-7f10d8-plxs8\" (UID: \"49c713aa-18ea-45bd-bd45-12a960724a0a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7f10d8-plxs8"
Sep 18 22:34:49.811734 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:49.811709    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7f10d8-plxs8"
Sep 18 22:34:49.965966 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:49.965925    2577 patch_prober.go:28] interesting pod/e2e-shared-a-w3-123a30-openshift-default-79444bfb7b-8l2hl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 18 22:34:49.966136 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:49.965991    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w3-123a30-openshift-default-79444bfb7b-8l2hl" podUID="d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 22:34:50.098609 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:50.098584    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7f10d8-plxs8"]
Sep 18 22:34:50.100142 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:34:50.100112    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49c713aa_18ea_45bd_bd45_12a960724a0a.slice/crio-e172ac98db9fd3cd02360195ab985b32090df15fe51fc22c5dce500d7ac2b3d6 WatchSource:0}: Error finding container e172ac98db9fd3cd02360195ab985b32090df15fe51fc22c5dce500d7ac2b3d6: Status 404 returned error can't find the container with id e172ac98db9fd3cd02360195ab985b32090df15fe51fc22c5dce500d7ac2b3d6
Sep 18 22:34:50.516466 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:50.516430    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7f10d8-plxs8" event={"ID":"49c713aa-18ea-45bd-bd45-12a960724a0a","Type":"ContainerStarted","Data":"c01a51322ffcf5e08b63dc0835d9b480185342a0b968fca6170e9eb0dd4286f0"}
Sep 18 22:34:50.516888 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:50.516514    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7f10d8-plxs8" event={"ID":"49c713aa-18ea-45bd-bd45-12a960724a0a","Type":"ContainerStarted","Data":"e172ac98db9fd3cd02360195ab985b32090df15fe51fc22c5dce500d7ac2b3d6"}
Sep 18 22:34:50.535248 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:50.535202    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7f10d8-plxs8" podStartSLOduration=1.535190265 podStartE2EDuration="1.535190265s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:34:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:34:50.534093389 +0000 UTC m=+2069.853765443" watchObservedRunningTime="2026-09-18 22:34:50.535190265 +0000 UTC m=+2069.854862321"
Sep 18 22:34:51.524161 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:51.524127    2577 generic.go:356] "Generic (PLEG): container finished" podID="49c713aa-18ea-45bd-bd45-12a960724a0a" containerID="c01a51322ffcf5e08b63dc0835d9b480185342a0b968fca6170e9eb0dd4286f0" exitCode=0
Sep 18 22:34:51.524515 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:51.524215    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7f10d8-plxs8" event={"ID":"49c713aa-18ea-45bd-bd45-12a960724a0a","Type":"ContainerDied","Data":"c01a51322ffcf5e08b63dc0835d9b480185342a0b968fca6170e9eb0dd4286f0"}
Sep 18 22:34:52.660713 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:52.660691    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7f10d8-plxs8"
Sep 18 22:34:52.751064 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:52.751035    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/49c713aa-18ea-45bd-bd45-12a960724a0a-maas-api-service-ca\") pod \"49c713aa-18ea-45bd-bd45-12a960724a0a\" (UID: \"49c713aa-18ea-45bd-bd45-12a960724a0a\") "
Sep 18 22:34:52.751368 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:52.751343    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49c713aa-18ea-45bd-bd45-12a960724a0a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "49c713aa-18ea-45bd-bd45-12a960724a0a" (UID: "49c713aa-18ea-45bd-bd45-12a960724a0a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:34:52.852152 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:52.852113    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/49c713aa-18ea-45bd-bd45-12a960724a0a-maas-api-service-ca\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:34:53.538606 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:53.538522    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7f10d8-plxs8"
Sep 18 22:34:53.538606 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:53.538555    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7f10d8-plxs8" event={"ID":"49c713aa-18ea-45bd-bd45-12a960724a0a","Type":"ContainerDied","Data":"e172ac98db9fd3cd02360195ab985b32090df15fe51fc22c5dce500d7ac2b3d6"}
Sep 18 22:34:53.538606 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:53.538599    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e172ac98db9fd3cd02360195ab985b32090df15fe51fc22c5dce500d7ac2b3d6"
Sep 18 22:34:54.385597 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:54.385572    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-123a30-openshift-default-79444bfb7b-8l2hl"
Sep 18 22:34:54.465700 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:54.465623    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nwpjg\" (UniqueName: \"kubernetes.io/projected/d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6-kube-api-access-nwpjg\") pod \"d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6\" (UID: \"d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6\") "
Sep 18 22:34:54.465700 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:54.465667    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6-istio-token\") pod \"d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6\" (UID: \"d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6\") "
Sep 18 22:34:54.465700 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:54.465686    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6-credential-socket\") pod \"d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6\" (UID: \"d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6\") "
Sep 18 22:34:54.465971 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:54.465707    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6-workload-socket\") pod \"d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6\" (UID: \"d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6\") "
Sep 18 22:34:54.465971 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:54.465829    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6-istio-data\") pod \"d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6\" (UID: \"d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6\") "
Sep 18 22:34:54.465971 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:54.465869    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6-istio-envoy\") pod \"d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6\" (UID: \"d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6\") "
Sep 18 22:34:54.465971 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:54.465920    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6-istio-podinfo\") pod \"d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6\" (UID: \"d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6\") "
Sep 18 22:34:54.465971 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:54.465969    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6-istiod-ca-cert\") pod \"d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6\" (UID: \"d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6\") "
Sep 18 22:34:54.466247 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:54.465993    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6-workload-certs\") pod \"d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6\" (UID: \"d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6\") "
Sep 18 22:34:54.466247 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:54.466004    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6" (UID: "d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:34:54.466247 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:54.466048    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6" (UID: "d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:34:54.466621 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:54.466099    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6-istio-data" (OuterVolumeSpecName: "istio-data") pod "d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6" (UID: "d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:34:54.466621 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:54.466320    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6-credential-socket\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:34:54.466621 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:54.466398    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6" (UID: "d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:34:54.466621 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:54.466560    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6" (UID: "d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:34:54.468040 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:54.468014    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6-istio-token" (OuterVolumeSpecName: "istio-token") pod "d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6" (UID: "d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:34:54.468149 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:54.468052    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6-kube-api-access-nwpjg" (OuterVolumeSpecName: "kube-api-access-nwpjg") pod "d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6" (UID: "d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6"). InnerVolumeSpecName "kube-api-access-nwpjg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:34:54.468560 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:54.468539    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6" (UID: "d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 18 22:34:54.468643 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:54.468543    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6" (UID: "d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:34:54.547452 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:54.547392    2577 generic.go:356] "Generic (PLEG): container finished" podID="d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6" containerID="37f76bc335906830d73e87ea74aeb12552b3e5fbd15bda321a36d220aa119f51" exitCode=0
Sep 18 22:34:54.547568 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:54.547448    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-123a30-openshift-default-79444bfb7b-8l2hl" event={"ID":"d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6","Type":"ContainerDied","Data":"37f76bc335906830d73e87ea74aeb12552b3e5fbd15bda321a36d220aa119f51"}
Sep 18 22:34:54.547568 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:54.547470    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-123a30-openshift-default-79444bfb7b-8l2hl"
Sep 18 22:34:54.547568 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:54.547506    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-123a30-openshift-default-79444bfb7b-8l2hl" event={"ID":"d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6","Type":"ContainerDied","Data":"8ae6ece908a563e1327c719f1bb0b9a2181c2ba4090f62b14961f78e586e3101"}
Sep 18 22:34:54.547568 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:54.547527    2577 scope.go:117] "RemoveContainer" containerID="37f76bc335906830d73e87ea74aeb12552b3e5fbd15bda321a36d220aa119f51"
Sep 18 22:34:54.557469 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:54.557453    2577 scope.go:117] "RemoveContainer" containerID="9e7bf3980af39f51186cd857833ef12f9960033ae0d09e16083bda8703bafd20"
Sep 18 22:34:54.565977 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:54.565954    2577 scope.go:117] "RemoveContainer" containerID="37f76bc335906830d73e87ea74aeb12552b3e5fbd15bda321a36d220aa119f51"
Sep 18 22:34:54.566234 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:34:54.566216    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"37f76bc335906830d73e87ea74aeb12552b3e5fbd15bda321a36d220aa119f51\": container with ID starting with 37f76bc335906830d73e87ea74aeb12552b3e5fbd15bda321a36d220aa119f51 not found: ID does not exist" containerID="37f76bc335906830d73e87ea74aeb12552b3e5fbd15bda321a36d220aa119f51"
Sep 18 22:34:54.566283 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:54.566244    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37f76bc335906830d73e87ea74aeb12552b3e5fbd15bda321a36d220aa119f51"} err="failed to get container status \"37f76bc335906830d73e87ea74aeb12552b3e5fbd15bda321a36d220aa119f51\": rpc error: code = NotFound desc = could not find container \"37f76bc335906830d73e87ea74aeb12552b3e5fbd15bda321a36d220aa119f51\": container with ID starting with 37f76bc335906830d73e87ea74aeb12552b3e5fbd15bda321a36d220aa119f51 not found: ID does not exist"
Sep 18 22:34:54.566283 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:54.566260    2577 scope.go:117] "RemoveContainer" containerID="9e7bf3980af39f51186cd857833ef12f9960033ae0d09e16083bda8703bafd20"
Sep 18 22:34:54.566542 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:34:54.566526    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e7bf3980af39f51186cd857833ef12f9960033ae0d09e16083bda8703bafd20\": container with ID starting with 9e7bf3980af39f51186cd857833ef12f9960033ae0d09e16083bda8703bafd20 not found: ID does not exist" containerID="9e7bf3980af39f51186cd857833ef12f9960033ae0d09e16083bda8703bafd20"
Sep 18 22:34:54.566595 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:54.566547    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e7bf3980af39f51186cd857833ef12f9960033ae0d09e16083bda8703bafd20"} err="failed to get container status \"9e7bf3980af39f51186cd857833ef12f9960033ae0d09e16083bda8703bafd20\": rpc error: code = NotFound desc = could not find container \"9e7bf3980af39f51186cd857833ef12f9960033ae0d09e16083bda8703bafd20\": container with ID starting with 9e7bf3980af39f51186cd857833ef12f9960033ae0d09e16083bda8703bafd20 not found: ID does not exist"
Sep 18 22:34:54.566792 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:54.566779    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6-istio-data\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:34:54.566834 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:54.566797    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6-istio-envoy\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:34:54.566834 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:54.566805    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6-istio-podinfo\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:34:54.566834 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:54.566814    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6-istiod-ca-cert\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:34:54.566834 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:54.566821    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6-workload-certs\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:34:54.566834 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:54.566829    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nwpjg\" (UniqueName: \"kubernetes.io/projected/d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6-kube-api-access-nwpjg\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:34:54.566979 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:54.566836    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6-istio-token\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:34:54.566979 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:54.566845    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6-workload-socket\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:34:54.570499 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:54.570478    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-123a30-openshift-default-79444bfb7b-8l2hl"]
Sep 18 22:34:54.576744 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:54.576724    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-123a30-openshift-default-79444bfb7b-8l2hl"]
Sep 18 22:34:55.139560 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:34:55.139520    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6" path="/var/lib/kubelet/pods/d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6/volumes"
Sep 18 22:35:00.830731 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:35:00.830696    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7f10d8-plxs8"]
Sep 18 22:35:00.837997 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:35:00.837973    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7f10d8-plxs8"]
Sep 18 22:35:01.139558 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:35:01.139484    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="49c713aa-18ea-45bd-bd45-12a960724a0a" path="/var/lib/kubelet/pods/49c713aa-18ea-45bd-bd45-12a960724a0a/volumes"
Sep 18 22:35:09.227072 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:35:09.227031    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58-7xtq5"]
Sep 18 22:35:09.227529 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:35:09.227263    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58-7xtq5" podUID="9ca5b41e-920d-4dc0-9636-22d83ade195d" containerName="istio-proxy" containerID="cri-o://ac693703ac4b5180ec41e90a4b1760734f9378e240c6cd178c3684fc4e686ff4" gracePeriod=30
Sep 18 22:35:14.212813 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:35:14.212775    2577 patch_prober.go:28] interesting pod/e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58-7xtq5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 18 22:35:14.213286 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:35:14.212848    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58-7xtq5" podUID="9ca5b41e-920d-4dc0-9636-22d83ade195d" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 22:35:14.506589 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:35:14.506560    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58-7xtq5"
Sep 18 22:35:14.536228 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:35:14.536205    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ca5b41e-920d-4dc0-9636-22d83ade195d-credential-socket\") pod \"9ca5b41e-920d-4dc0-9636-22d83ade195d\" (UID: \"9ca5b41e-920d-4dc0-9636-22d83ade195d\") "
Sep 18 22:35:14.536390 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:35:14.536239    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ca5b41e-920d-4dc0-9636-22d83ade195d-istio-token\") pod \"9ca5b41e-920d-4dc0-9636-22d83ade195d\" (UID: \"9ca5b41e-920d-4dc0-9636-22d83ade195d\") "
Sep 18 22:35:14.536390 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:35:14.536281    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ca5b41e-920d-4dc0-9636-22d83ade195d-istio-podinfo\") pod \"9ca5b41e-920d-4dc0-9636-22d83ade195d\" (UID: \"9ca5b41e-920d-4dc0-9636-22d83ade195d\") "
Sep 18 22:35:14.536390 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:35:14.536300    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ca5b41e-920d-4dc0-9636-22d83ade195d-workload-certs\") pod \"9ca5b41e-920d-4dc0-9636-22d83ade195d\" (UID: \"9ca5b41e-920d-4dc0-9636-22d83ade195d\") "
Sep 18 22:35:14.536390 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:35:14.536341    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ca5b41e-920d-4dc0-9636-22d83ade195d-workload-socket\") pod \"9ca5b41e-920d-4dc0-9636-22d83ade195d\" (UID: \"9ca5b41e-920d-4dc0-9636-22d83ade195d\") "
Sep 18 22:35:14.536390 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:35:14.536357    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ca5b41e-920d-4dc0-9636-22d83ade195d-istio-data\") pod \"9ca5b41e-920d-4dc0-9636-22d83ade195d\" (UID: \"9ca5b41e-920d-4dc0-9636-22d83ade195d\") "
Sep 18 22:35:14.536703 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:35:14.536499    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7cjkz\" (UniqueName: \"kubernetes.io/projected/9ca5b41e-920d-4dc0-9636-22d83ade195d-kube-api-access-7cjkz\") pod \"9ca5b41e-920d-4dc0-9636-22d83ade195d\" (UID: \"9ca5b41e-920d-4dc0-9636-22d83ade195d\") "
Sep 18 22:35:14.536703 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:35:14.536549    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ca5b41e-920d-4dc0-9636-22d83ade195d-istio-envoy\") pod \"9ca5b41e-920d-4dc0-9636-22d83ade195d\" (UID: \"9ca5b41e-920d-4dc0-9636-22d83ade195d\") "
Sep 18 22:35:14.536703 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:35:14.536557    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ca5b41e-920d-4dc0-9636-22d83ade195d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9ca5b41e-920d-4dc0-9636-22d83ade195d" (UID: "9ca5b41e-920d-4dc0-9636-22d83ade195d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:35:14.536703 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:35:14.536589    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ca5b41e-920d-4dc0-9636-22d83ade195d-istiod-ca-cert\") pod \"9ca5b41e-920d-4dc0-9636-22d83ade195d\" (UID: \"9ca5b41e-920d-4dc0-9636-22d83ade195d\") "
Sep 18 22:35:14.536703 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:35:14.536642    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ca5b41e-920d-4dc0-9636-22d83ade195d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9ca5b41e-920d-4dc0-9636-22d83ade195d" (UID: "9ca5b41e-920d-4dc0-9636-22d83ade195d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:35:14.536703 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:35:14.536657    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ca5b41e-920d-4dc0-9636-22d83ade195d-istio-data" (OuterVolumeSpecName: "istio-data") pod "9ca5b41e-920d-4dc0-9636-22d83ade195d" (UID: "9ca5b41e-920d-4dc0-9636-22d83ade195d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:35:14.536703 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:35:14.536670    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ca5b41e-920d-4dc0-9636-22d83ade195d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9ca5b41e-920d-4dc0-9636-22d83ade195d" (UID: "9ca5b41e-920d-4dc0-9636-22d83ade195d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:35:14.537243 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:35:14.536858    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ca5b41e-920d-4dc0-9636-22d83ade195d-credential-socket\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:35:14.537243 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:35:14.536878    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ca5b41e-920d-4dc0-9636-22d83ade195d-workload-certs\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:35:14.537243 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:35:14.536889    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ca5b41e-920d-4dc0-9636-22d83ade195d-workload-socket\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:35:14.537243 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:35:14.536898    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ca5b41e-920d-4dc0-9636-22d83ade195d-istio-data\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:35:14.537489 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:35:14.537240    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ca5b41e-920d-4dc0-9636-22d83ade195d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9ca5b41e-920d-4dc0-9636-22d83ade195d" (UID: "9ca5b41e-920d-4dc0-9636-22d83ade195d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:35:14.538793 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:35:14.538757    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ca5b41e-920d-4dc0-9636-22d83ade195d-istio-token" (OuterVolumeSpecName: "istio-token") pod "9ca5b41e-920d-4dc0-9636-22d83ade195d" (UID: "9ca5b41e-920d-4dc0-9636-22d83ade195d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:35:14.538888 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:35:14.538811    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ca5b41e-920d-4dc0-9636-22d83ade195d-kube-api-access-7cjkz" (OuterVolumeSpecName: "kube-api-access-7cjkz") pod "9ca5b41e-920d-4dc0-9636-22d83ade195d" (UID: "9ca5b41e-920d-4dc0-9636-22d83ade195d"). InnerVolumeSpecName "kube-api-access-7cjkz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:35:14.538888 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:35:14.538827    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9ca5b41e-920d-4dc0-9636-22d83ade195d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9ca5b41e-920d-4dc0-9636-22d83ade195d" (UID: "9ca5b41e-920d-4dc0-9636-22d83ade195d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 18 22:35:14.538997 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:35:14.538983    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ca5b41e-920d-4dc0-9636-22d83ade195d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9ca5b41e-920d-4dc0-9636-22d83ade195d" (UID: "9ca5b41e-920d-4dc0-9636-22d83ade195d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:35:14.637898 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:35:14.637858    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ca5b41e-920d-4dc0-9636-22d83ade195d-istio-token\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:35:14.637898 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:35:14.637886    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ca5b41e-920d-4dc0-9636-22d83ade195d-istio-podinfo\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:35:14.637898 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:35:14.637895    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7cjkz\" (UniqueName: \"kubernetes.io/projected/9ca5b41e-920d-4dc0-9636-22d83ade195d-kube-api-access-7cjkz\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:35:14.637898 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:35:14.637903    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ca5b41e-920d-4dc0-9636-22d83ade195d-istio-envoy\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:35:14.638172 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:35:14.637911    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ca5b41e-920d-4dc0-9636-22d83ade195d-istiod-ca-cert\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:35:14.670945 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:35:14.670915    2577 generic.go:356] "Generic (PLEG): container finished" podID="9ca5b41e-920d-4dc0-9636-22d83ade195d" containerID="ac693703ac4b5180ec41e90a4b1760734f9378e240c6cd178c3684fc4e686ff4" exitCode=0
Sep 18 22:35:14.671112 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:35:14.670983    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58-7xtq5"
Sep 18 22:35:14.671112 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:35:14.671007    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58-7xtq5" event={"ID":"9ca5b41e-920d-4dc0-9636-22d83ade195d","Type":"ContainerDied","Data":"ac693703ac4b5180ec41e90a4b1760734f9378e240c6cd178c3684fc4e686ff4"}
Sep 18 22:35:14.671112 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:35:14.671059    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58-7xtq5" event={"ID":"9ca5b41e-920d-4dc0-9636-22d83ade195d","Type":"ContainerDied","Data":"d4564edc0c6cb6fe8a5bf80be94f649824493536a8f1bbe2a67207d85f4ed5eb"}
Sep 18 22:35:14.671112 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:35:14.671090    2577 scope.go:117] "RemoveContainer" containerID="ac693703ac4b5180ec41e90a4b1760734f9378e240c6cd178c3684fc4e686ff4"
Sep 18 22:35:14.681002 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:35:14.680969    2577 scope.go:117] "RemoveContainer" containerID="3c87d3775fc0ea04fa2a50fcc3416a219eedce1d12f2cdc9fc3713e872d03094"
Sep 18 22:35:14.692473 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:35:14.692452    2577 scope.go:117] "RemoveContainer" containerID="ac693703ac4b5180ec41e90a4b1760734f9378e240c6cd178c3684fc4e686ff4"
Sep 18 22:35:14.692773 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:35:14.692755    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac693703ac4b5180ec41e90a4b1760734f9378e240c6cd178c3684fc4e686ff4\": container with ID starting with ac693703ac4b5180ec41e90a4b1760734f9378e240c6cd178c3684fc4e686ff4 not found: ID does not exist" containerID="ac693703ac4b5180ec41e90a4b1760734f9378e240c6cd178c3684fc4e686ff4"
Sep 18 22:35:14.692838 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:35:14.692783    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac693703ac4b5180ec41e90a4b1760734f9378e240c6cd178c3684fc4e686ff4"} err="failed to get container status \"ac693703ac4b5180ec41e90a4b1760734f9378e240c6cd178c3684fc4e686ff4\": rpc error: code = NotFound desc = could not find container \"ac693703ac4b5180ec41e90a4b1760734f9378e240c6cd178c3684fc4e686ff4\": container with ID starting with ac693703ac4b5180ec41e90a4b1760734f9378e240c6cd178c3684fc4e686ff4 not found: ID does not exist"
Sep 18 22:35:14.692838 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:35:14.692800    2577 scope.go:117] "RemoveContainer" containerID="3c87d3775fc0ea04fa2a50fcc3416a219eedce1d12f2cdc9fc3713e872d03094"
Sep 18 22:35:14.693139 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:35:14.693119    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c87d3775fc0ea04fa2a50fcc3416a219eedce1d12f2cdc9fc3713e872d03094\": container with ID starting with 3c87d3775fc0ea04fa2a50fcc3416a219eedce1d12f2cdc9fc3713e872d03094 not found: ID does not exist" containerID="3c87d3775fc0ea04fa2a50fcc3416a219eedce1d12f2cdc9fc3713e872d03094"
Sep 18 22:35:14.693227 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:35:14.693142    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c87d3775fc0ea04fa2a50fcc3416a219eedce1d12f2cdc9fc3713e872d03094"} err="failed to get container status \"3c87d3775fc0ea04fa2a50fcc3416a219eedce1d12f2cdc9fc3713e872d03094\": rpc error: code = NotFound desc = could not find container \"3c87d3775fc0ea04fa2a50fcc3416a219eedce1d12f2cdc9fc3713e872d03094\": container with ID starting with 3c87d3775fc0ea04fa2a50fcc3416a219eedce1d12f2cdc9fc3713e872d03094 not found: ID does not exist"
Sep 18 22:35:14.699932 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:35:14.699904    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58-7xtq5"]
Sep 18 22:35:14.705166 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:35:14.705140    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58-7xtq5"]
Sep 18 22:35:15.139551 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:35:15.139517    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ca5b41e-920d-4dc0-9636-22d83ade195d" path="/var/lib/kubelet/pods/9ca5b41e-920d-4dc0-9636-22d83ade195d/volumes"
Sep 18 22:35:21.303195 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:35:21.303167    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-h2847_125d5bb0-54b7-4dff-aa80-e737f2791533/console-operator/1.log"
Sep 18 22:35:21.312164 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:35:21.312143    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-h2847_125d5bb0-54b7-4dff-aa80-e737f2791533/console-operator/1.log"
Sep 18 22:36:21.841006 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:36:21.840966    2577 scope.go:117] "RemoveContainer" containerID="664fc487c7587a76934db5867666374046693fb4938e1cc59121c04f0800484f"
Sep 18 22:37:59.158458 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:37:59.158341    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-gmb2m"]
Sep 18 22:37:59.161069 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:37:59.158576    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-gmb2m" podUID="6581201a-a056-4623-bec6-9640d66edf9e" containerName="manager" containerID="cri-o://e0965408a21aa36c8269798218de1459bee26718c4dafc87a3194c8eae5227d0" gracePeriod=10
Sep 18 22:37:59.807472 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:37:59.807448    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-gmb2m"
Sep 18 22:37:59.903094 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:37:59.903007    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gkcfm\" (UniqueName: \"kubernetes.io/projected/6581201a-a056-4623-bec6-9640d66edf9e-kube-api-access-gkcfm\") pod \"6581201a-a056-4623-bec6-9640d66edf9e\" (UID: \"6581201a-a056-4623-bec6-9640d66edf9e\") "
Sep 18 22:37:59.903240 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:37:59.903112    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6581201a-a056-4623-bec6-9640d66edf9e-extensions-socket-volume\") pod \"6581201a-a056-4623-bec6-9640d66edf9e\" (UID: \"6581201a-a056-4623-bec6-9640d66edf9e\") "
Sep 18 22:37:59.903498 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:37:59.903463    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6581201a-a056-4623-bec6-9640d66edf9e-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "6581201a-a056-4623-bec6-9640d66edf9e" (UID: "6581201a-a056-4623-bec6-9640d66edf9e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:37:59.905207 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:37:59.905185    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6581201a-a056-4623-bec6-9640d66edf9e-kube-api-access-gkcfm" (OuterVolumeSpecName: "kube-api-access-gkcfm") pod "6581201a-a056-4623-bec6-9640d66edf9e" (UID: "6581201a-a056-4623-bec6-9640d66edf9e"). InnerVolumeSpecName "kube-api-access-gkcfm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:38:00.004682 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:38:00.004652    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gkcfm\" (UniqueName: \"kubernetes.io/projected/6581201a-a056-4623-bec6-9640d66edf9e-kube-api-access-gkcfm\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:38:00.004682 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:38:00.004678    2577 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6581201a-a056-4623-bec6-9640d66edf9e-extensions-socket-volume\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:38:00.627867 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:38:00.627836    2577 generic.go:356] "Generic (PLEG): container finished" podID="6581201a-a056-4623-bec6-9640d66edf9e" containerID="e0965408a21aa36c8269798218de1459bee26718c4dafc87a3194c8eae5227d0" exitCode=0
Sep 18 22:38:00.628302 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:38:00.627885    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-gmb2m"
Sep 18 22:38:00.628302 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:38:00.627920    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-gmb2m" event={"ID":"6581201a-a056-4623-bec6-9640d66edf9e","Type":"ContainerDied","Data":"e0965408a21aa36c8269798218de1459bee26718c4dafc87a3194c8eae5227d0"}
Sep 18 22:38:00.628302 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:38:00.627974    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-gmb2m" event={"ID":"6581201a-a056-4623-bec6-9640d66edf9e","Type":"ContainerDied","Data":"b3f125a543944eb53239307634ec50da51429da0ae3a27a77bc7fe940d3a688c"}
Sep 18 22:38:00.628302 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:38:00.627995    2577 scope.go:117] "RemoveContainer" containerID="e0965408a21aa36c8269798218de1459bee26718c4dafc87a3194c8eae5227d0"
Sep 18 22:38:00.638164 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:38:00.638143    2577 scope.go:117] "RemoveContainer" containerID="e0965408a21aa36c8269798218de1459bee26718c4dafc87a3194c8eae5227d0"
Sep 18 22:38:00.638439 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:38:00.638398    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e0965408a21aa36c8269798218de1459bee26718c4dafc87a3194c8eae5227d0\": container with ID starting with e0965408a21aa36c8269798218de1459bee26718c4dafc87a3194c8eae5227d0 not found: ID does not exist" containerID="e0965408a21aa36c8269798218de1459bee26718c4dafc87a3194c8eae5227d0"
Sep 18 22:38:00.638501 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:38:00.638452    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0965408a21aa36c8269798218de1459bee26718c4dafc87a3194c8eae5227d0"} err="failed to get container status \"e0965408a21aa36c8269798218de1459bee26718c4dafc87a3194c8eae5227d0\": rpc error: code = NotFound desc = could not find container \"e0965408a21aa36c8269798218de1459bee26718c4dafc87a3194c8eae5227d0\": container with ID starting with e0965408a21aa36c8269798218de1459bee26718c4dafc87a3194c8eae5227d0 not found: ID does not exist"
Sep 18 22:38:00.651825 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:38:00.651798    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-gmb2m"]
Sep 18 22:38:00.656232 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:38:00.656210    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-gmb2m"]
Sep 18 22:38:01.139675 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:38:01.139642    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6581201a-a056-4623-bec6-9640d66edf9e" path="/var/lib/kubelet/pods/6581201a-a056-4623-bec6-9640d66edf9e/volumes"
Sep 18 22:38:59.853684 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:38:59.853653    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-4bsw8"]
Sep 18 22:38:59.854154 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:38:59.854031    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ca5b41e-920d-4dc0-9636-22d83ade195d" containerName="istio-proxy"
Sep 18 22:38:59.854154 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:38:59.854042    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ca5b41e-920d-4dc0-9636-22d83ade195d" containerName="istio-proxy"
Sep 18 22:38:59.854154 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:38:59.854051    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6" containerName="istio-proxy"
Sep 18 22:38:59.854154 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:38:59.854057    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6" containerName="istio-proxy"
Sep 18 22:38:59.854154 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:38:59.854072    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6" containerName="istio-proxy"
Sep 18 22:38:59.854154 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:38:59.854078    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6" containerName="istio-proxy"
Sep 18 22:38:59.854154 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:38:59.854086    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6596cfcc-f03e-413e-9aa8-6a95f74a0eee" containerName="istio-proxy"
Sep 18 22:38:59.854154 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:38:59.854093    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="6596cfcc-f03e-413e-9aa8-6a95f74a0eee" containerName="istio-proxy"
Sep 18 22:38:59.854154 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:38:59.854112    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49c713aa-18ea-45bd-bd45-12a960724a0a" containerName="revoke-keys"
Sep 18 22:38:59.854154 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:38:59.854120    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="49c713aa-18ea-45bd-bd45-12a960724a0a" containerName="revoke-keys"
Sep 18 22:38:59.854154 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:38:59.854130    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6581201a-a056-4623-bec6-9640d66edf9e" containerName="manager"
Sep 18 22:38:59.854154 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:38:59.854134    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="6581201a-a056-4623-bec6-9640d66edf9e" containerName="manager"
Sep 18 22:38:59.854577 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:38:59.854187    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ca5b41e-920d-4dc0-9636-22d83ade195d" containerName="istio-proxy"
Sep 18 22:38:59.854577 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:38:59.854194    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6" containerName="istio-proxy"
Sep 18 22:38:59.854577 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:38:59.854201    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="49c713aa-18ea-45bd-bd45-12a960724a0a" containerName="revoke-keys"
Sep 18 22:38:59.854577 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:38:59.854206    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="6596cfcc-f03e-413e-9aa8-6a95f74a0eee" containerName="istio-proxy"
Sep 18 22:38:59.854577 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:38:59.854212    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="6581201a-a056-4623-bec6-9640d66edf9e" containerName="manager"
Sep 18 22:38:59.854577 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:38:59.854217    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="0fe39b00-0eda-4437-9b45-526e17cdaf71" containerName="istio-proxy"
Sep 18 22:38:59.857319 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:38:59.857295    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-4bsw8"
Sep 18 22:38:59.859775 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:38:59.859754    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-zz7vq\""
Sep 18 22:38:59.876293 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:38:59.876270    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-4bsw8"]
Sep 18 22:38:59.924076 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:38:59.924047    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txtlg\" (UniqueName: \"kubernetes.io/projected/9b594b73-9e8e-47e5-9e43-8de72ffa8ee0-kube-api-access-txtlg\") pod \"kuadrant-operator-controller-manager-5769f99d9f-4bsw8\" (UID: \"9b594b73-9e8e-47e5-9e43-8de72ffa8ee0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-4bsw8"
Sep 18 22:38:59.924206 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:38:59.924090    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9b594b73-9e8e-47e5-9e43-8de72ffa8ee0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-4bsw8\" (UID: \"9b594b73-9e8e-47e5-9e43-8de72ffa8ee0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-4bsw8"
Sep 18 22:39:00.025627 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:39:00.025598    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txtlg\" (UniqueName: \"kubernetes.io/projected/9b594b73-9e8e-47e5-9e43-8de72ffa8ee0-kube-api-access-txtlg\") pod \"kuadrant-operator-controller-manager-5769f99d9f-4bsw8\" (UID: \"9b594b73-9e8e-47e5-9e43-8de72ffa8ee0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-4bsw8"
Sep 18 22:39:00.025780 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:39:00.025638    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9b594b73-9e8e-47e5-9e43-8de72ffa8ee0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-4bsw8\" (UID: \"9b594b73-9e8e-47e5-9e43-8de72ffa8ee0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-4bsw8"
Sep 18 22:39:00.025951 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:39:00.025936    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9b594b73-9e8e-47e5-9e43-8de72ffa8ee0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-4bsw8\" (UID: \"9b594b73-9e8e-47e5-9e43-8de72ffa8ee0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-4bsw8"
Sep 18 22:39:00.045482 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:39:00.045459    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-txtlg\" (UniqueName: \"kubernetes.io/projected/9b594b73-9e8e-47e5-9e43-8de72ffa8ee0-kube-api-access-txtlg\") pod \"kuadrant-operator-controller-manager-5769f99d9f-4bsw8\" (UID: \"9b594b73-9e8e-47e5-9e43-8de72ffa8ee0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-4bsw8"
Sep 18 22:39:00.168632 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:39:00.168554    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-4bsw8"
Sep 18 22:39:00.457307 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:39:00.457281    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b594b73_9e8e_47e5_9e43_8de72ffa8ee0.slice/crio-2cb054817257b80bea89acf090f1a486abfeae5bf81762604576149d23bf3db9 WatchSource:0}: Error finding container 2cb054817257b80bea89acf090f1a486abfeae5bf81762604576149d23bf3db9: Status 404 returned error can't find the container with id 2cb054817257b80bea89acf090f1a486abfeae5bf81762604576149d23bf3db9
Sep 18 22:39:00.457725 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:39:00.457703    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-4bsw8"]
Sep 18 22:39:00.962525 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:39:00.962491    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-4bsw8" event={"ID":"9b594b73-9e8e-47e5-9e43-8de72ffa8ee0","Type":"ContainerStarted","Data":"e2ffcb5302716b1b61d8ef2b2eec952be47c83cfc4fc865bdcf198b57ae17f87"}
Sep 18 22:39:00.962899 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:39:00.962545    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-4bsw8" event={"ID":"9b594b73-9e8e-47e5-9e43-8de72ffa8ee0","Type":"ContainerStarted","Data":"2cb054817257b80bea89acf090f1a486abfeae5bf81762604576149d23bf3db9"}
Sep 18 22:39:00.962899 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:39:00.962686    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-4bsw8"
Sep 18 22:39:01.007799 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:39:01.007761    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-4bsw8" podStartSLOduration=2.007748069 podStartE2EDuration="2.007748069s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:38:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:39:01.006652484 +0000 UTC m=+2320.326324538" watchObservedRunningTime="2026-09-18 22:39:01.007748069 +0000 UTC m=+2320.327420124"
Sep 18 22:39:11.970573 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:39:11.970541    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-4bsw8"
Sep 18 22:39:21.884049 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:39:21.884019    2577 scope.go:117] "RemoveContainer" containerID="6537820b339c77c49e720000d71372131c1fd3d278bf28df5968db703ce2f6a0"
Sep 18 22:39:21.894960 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:39:21.894941    2577 scope.go:117] "RemoveContainer" containerID="c2960de7386bb66133e15c20db59ec606dc4932dad7dd424cca09c6c9d635c5c"
Sep 18 22:40:03.338705 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:40:03.338673    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-361c0305-kserve-5b5d5fd8cf-wtwz7"]
Sep 18 22:40:03.339180 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:40:03.339030    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ca5b41e-920d-4dc0-9636-22d83ade195d" containerName="istio-proxy"
Sep 18 22:40:03.339180 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:40:03.339041    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ca5b41e-920d-4dc0-9636-22d83ade195d" containerName="istio-proxy"
Sep 18 22:40:03.339180 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:40:03.339108    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ca5b41e-920d-4dc0-9636-22d83ade195d" containerName="istio-proxy"
Sep 18 22:40:03.339180 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:40:03.339115    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="d57cb1cb-ce02-4f2c-9814-e9bc0ea775c6" containerName="istio-proxy"
Sep 18 22:40:03.342150 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:40:03.342125    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-361c0305-kserve-5b5d5fd8cf-wtwz7"
Sep 18 22:40:03.345167 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:40:03.345144    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 18 22:40:03.345167 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:40:03.345144    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 18 22:40:03.345975 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:40:03.345955    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-361c0305-kserve-self-signed-certs\""
Sep 18 22:40:03.346080 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:40:03.345994    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-wjjvs\""
Sep 18 22:40:03.374721 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:40:03.374697    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-361c0305-kserve-5b5d5fd8cf-wtwz7"]
Sep 18 22:40:03.456842 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:40:03.456806    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0676391a-db97-47b2-b2de-7475d6476fd9-tls-certs\") pod \"e2e-same-id-b-361c0305-kserve-5b5d5fd8cf-wtwz7\" (UID: \"0676391a-db97-47b2-b2de-7475d6476fd9\") " pod="llm/e2e-same-id-b-361c0305-kserve-5b5d5fd8cf-wtwz7"
Sep 18 22:40:03.456842 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:40:03.456847    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0676391a-db97-47b2-b2de-7475d6476fd9-home\") pod \"e2e-same-id-b-361c0305-kserve-5b5d5fd8cf-wtwz7\" (UID: \"0676391a-db97-47b2-b2de-7475d6476fd9\") " pod="llm/e2e-same-id-b-361c0305-kserve-5b5d5fd8cf-wtwz7"
Sep 18 22:40:03.457044 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:40:03.456912    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0676391a-db97-47b2-b2de-7475d6476fd9-tmp-dir\") pod \"e2e-same-id-b-361c0305-kserve-5b5d5fd8cf-wtwz7\" (UID: \"0676391a-db97-47b2-b2de-7475d6476fd9\") " pod="llm/e2e-same-id-b-361c0305-kserve-5b5d5fd8cf-wtwz7"
Sep 18 22:40:03.457044 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:40:03.456986    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0676391a-db97-47b2-b2de-7475d6476fd9-model-cache\") pod \"e2e-same-id-b-361c0305-kserve-5b5d5fd8cf-wtwz7\" (UID: \"0676391a-db97-47b2-b2de-7475d6476fd9\") " pod="llm/e2e-same-id-b-361c0305-kserve-5b5d5fd8cf-wtwz7"
Sep 18 22:40:03.457044 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:40:03.457015    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pmzj\" (UniqueName: \"kubernetes.io/projected/0676391a-db97-47b2-b2de-7475d6476fd9-kube-api-access-8pmzj\") pod \"e2e-same-id-b-361c0305-kserve-5b5d5fd8cf-wtwz7\" (UID: \"0676391a-db97-47b2-b2de-7475d6476fd9\") " pod="llm/e2e-same-id-b-361c0305-kserve-5b5d5fd8cf-wtwz7"
Sep 18 22:40:03.457151 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:40:03.457047    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0676391a-db97-47b2-b2de-7475d6476fd9-dshm\") pod \"e2e-same-id-b-361c0305-kserve-5b5d5fd8cf-wtwz7\" (UID: \"0676391a-db97-47b2-b2de-7475d6476fd9\") " pod="llm/e2e-same-id-b-361c0305-kserve-5b5d5fd8cf-wtwz7"
Sep 18 22:40:03.557554 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:40:03.557517    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0676391a-db97-47b2-b2de-7475d6476fd9-tls-certs\") pod \"e2e-same-id-b-361c0305-kserve-5b5d5fd8cf-wtwz7\" (UID: \"0676391a-db97-47b2-b2de-7475d6476fd9\") " pod="llm/e2e-same-id-b-361c0305-kserve-5b5d5fd8cf-wtwz7"
Sep 18 22:40:03.557554 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:40:03.557552    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0676391a-db97-47b2-b2de-7475d6476fd9-home\") pod \"e2e-same-id-b-361c0305-kserve-5b5d5fd8cf-wtwz7\" (UID: \"0676391a-db97-47b2-b2de-7475d6476fd9\") " pod="llm/e2e-same-id-b-361c0305-kserve-5b5d5fd8cf-wtwz7"
Sep 18 22:40:03.557797 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:40:03.557585    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0676391a-db97-47b2-b2de-7475d6476fd9-tmp-dir\") pod \"e2e-same-id-b-361c0305-kserve-5b5d5fd8cf-wtwz7\" (UID: \"0676391a-db97-47b2-b2de-7475d6476fd9\") " pod="llm/e2e-same-id-b-361c0305-kserve-5b5d5fd8cf-wtwz7"
Sep 18 22:40:03.557797 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:40:03.557629    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0676391a-db97-47b2-b2de-7475d6476fd9-model-cache\") pod \"e2e-same-id-b-361c0305-kserve-5b5d5fd8cf-wtwz7\" (UID: \"0676391a-db97-47b2-b2de-7475d6476fd9\") " pod="llm/e2e-same-id-b-361c0305-kserve-5b5d5fd8cf-wtwz7"
Sep 18 22:40:03.557797 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:40:03.557648    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pmzj\" (UniqueName: \"kubernetes.io/projected/0676391a-db97-47b2-b2de-7475d6476fd9-kube-api-access-8pmzj\") pod \"e2e-same-id-b-361c0305-kserve-5b5d5fd8cf-wtwz7\" (UID: \"0676391a-db97-47b2-b2de-7475d6476fd9\") " pod="llm/e2e-same-id-b-361c0305-kserve-5b5d5fd8cf-wtwz7"
Sep 18 22:40:03.557797 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:40:03.557674    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0676391a-db97-47b2-b2de-7475d6476fd9-dshm\") pod \"e2e-same-id-b-361c0305-kserve-5b5d5fd8cf-wtwz7\" (UID: \"0676391a-db97-47b2-b2de-7475d6476fd9\") " pod="llm/e2e-same-id-b-361c0305-kserve-5b5d5fd8cf-wtwz7"
Sep 18 22:40:03.558045 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:40:03.558023    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0676391a-db97-47b2-b2de-7475d6476fd9-home\") pod \"e2e-same-id-b-361c0305-kserve-5b5d5fd8cf-wtwz7\" (UID: \"0676391a-db97-47b2-b2de-7475d6476fd9\") " pod="llm/e2e-same-id-b-361c0305-kserve-5b5d5fd8cf-wtwz7"
Sep 18 22:40:03.558097 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:40:03.558063    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0676391a-db97-47b2-b2de-7475d6476fd9-tmp-dir\") pod \"e2e-same-id-b-361c0305-kserve-5b5d5fd8cf-wtwz7\" (UID: \"0676391a-db97-47b2-b2de-7475d6476fd9\") " pod="llm/e2e-same-id-b-361c0305-kserve-5b5d5fd8cf-wtwz7"
Sep 18 22:40:03.558133 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:40:03.558104    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0676391a-db97-47b2-b2de-7475d6476fd9-model-cache\") pod \"e2e-same-id-b-361c0305-kserve-5b5d5fd8cf-wtwz7\" (UID: \"0676391a-db97-47b2-b2de-7475d6476fd9\") " pod="llm/e2e-same-id-b-361c0305-kserve-5b5d5fd8cf-wtwz7"
Sep 18 22:40:03.560126 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:40:03.560104    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0676391a-db97-47b2-b2de-7475d6476fd9-dshm\") pod \"e2e-same-id-b-361c0305-kserve-5b5d5fd8cf-wtwz7\" (UID: \"0676391a-db97-47b2-b2de-7475d6476fd9\") " pod="llm/e2e-same-id-b-361c0305-kserve-5b5d5fd8cf-wtwz7"
Sep 18 22:40:03.560275 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:40:03.560260    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0676391a-db97-47b2-b2de-7475d6476fd9-tls-certs\") pod \"e2e-same-id-b-361c0305-kserve-5b5d5fd8cf-wtwz7\" (UID: \"0676391a-db97-47b2-b2de-7475d6476fd9\") " pod="llm/e2e-same-id-b-361c0305-kserve-5b5d5fd8cf-wtwz7"
Sep 18 22:40:03.582218 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:40:03.582191    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pmzj\" (UniqueName: \"kubernetes.io/projected/0676391a-db97-47b2-b2de-7475d6476fd9-kube-api-access-8pmzj\") pod \"e2e-same-id-b-361c0305-kserve-5b5d5fd8cf-wtwz7\" (UID: \"0676391a-db97-47b2-b2de-7475d6476fd9\") " pod="llm/e2e-same-id-b-361c0305-kserve-5b5d5fd8cf-wtwz7"
Sep 18 22:40:03.651521 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:40:03.651437    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-361c0305-kserve-5b5d5fd8cf-wtwz7"
Sep 18 22:40:03.941204 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:40:03.941177    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-361c0305-kserve-5b5d5fd8cf-wtwz7"]
Sep 18 22:40:03.943008 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:40:03.942980    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0676391a_db97_47b2_b2de_7475d6476fd9.slice/crio-3c0cde12f9e8764f2475069d31ce3487d10b6f819a9beaaf15096f9eb15f9e91 WatchSource:0}: Error finding container 3c0cde12f9e8764f2475069d31ce3487d10b6f819a9beaaf15096f9eb15f9e91: Status 404 returned error can't find the container with id 3c0cde12f9e8764f2475069d31ce3487d10b6f819a9beaaf15096f9eb15f9e91
Sep 18 22:40:04.316100 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:40:04.316066    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-361c0305-kserve-5b5d5fd8cf-wtwz7" event={"ID":"0676391a-db97-47b2-b2de-7475d6476fd9","Type":"ContainerStarted","Data":"c0015286ef1d6216db642654fdda71a3183c34cd250db3ec5bb4b79d002ddf8a"}
Sep 18 22:40:04.316288 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:40:04.316109    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-361c0305-kserve-5b5d5fd8cf-wtwz7" event={"ID":"0676391a-db97-47b2-b2de-7475d6476fd9","Type":"ContainerStarted","Data":"3c0cde12f9e8764f2475069d31ce3487d10b6f819a9beaaf15096f9eb15f9e91"}
Sep 18 22:40:04.348858 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:40:04.346308    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-361c0305-kserve-5b5d5fd8cf-wtwz7" podStartSLOduration=1.346287211 podStartE2EDuration="1.346287211s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:40:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:40:04.339807298 +0000 UTC m=+2383.659479355" watchObservedRunningTime="2026-09-18 22:40:04.346287211 +0000 UTC m=+2383.665959268"
Sep 18 22:40:13.651840 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:40:13.651804    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-361c0305-kserve-5b5d5fd8cf-wtwz7"
Sep 18 22:40:13.652402 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:40:13.651914    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-361c0305-kserve-5b5d5fd8cf-wtwz7"
Sep 18 22:40:13.664989 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:40:13.664943    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-361c0305-kserve-5b5d5fd8cf-wtwz7"
Sep 18 22:40:14.383693 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:40:14.383662    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-361c0305-kserve-5b5d5fd8cf-wtwz7"
Sep 18 22:40:21.072389 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:40:21.072356    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-361c0305-kserve-5b5d5fd8cf-wtwz7"]
Sep 18 22:40:21.342446 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:40:21.342340    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-h2847_125d5bb0-54b7-4dff-aa80-e737f2791533/console-operator/1.log"
Sep 18 22:40:21.359260 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:40:21.359236    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-h2847_125d5bb0-54b7-4dff-aa80-e737f2791533/console-operator/1.log"
Sep 18 22:40:36.092040 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:40:36.091966    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-361c0305-kserve-5b5d5fd8cf-wtwz7" podUID="0676391a-db97-47b2-b2de-7475d6476fd9" containerName="main" containerID="cri-o://c0015286ef1d6216db642654fdda71a3183c34cd250db3ec5bb4b79d002ddf8a" gracePeriod=45
Sep 18 22:40:36.343847 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:40:36.343788    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-361c0305-kserve-5b5d5fd8cf-wtwz7"
Sep 18 22:40:36.454316 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:40:36.454277    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8pmzj\" (UniqueName: \"kubernetes.io/projected/0676391a-db97-47b2-b2de-7475d6476fd9-kube-api-access-8pmzj\") pod \"0676391a-db97-47b2-b2de-7475d6476fd9\" (UID: \"0676391a-db97-47b2-b2de-7475d6476fd9\") "
Sep 18 22:40:36.454531 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:40:36.454326    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0676391a-db97-47b2-b2de-7475d6476fd9-tls-certs\") pod \"0676391a-db97-47b2-b2de-7475d6476fd9\" (UID: \"0676391a-db97-47b2-b2de-7475d6476fd9\") "
Sep 18 22:40:36.454531 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:40:36.454357    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0676391a-db97-47b2-b2de-7475d6476fd9-model-cache\") pod \"0676391a-db97-47b2-b2de-7475d6476fd9\" (UID: \"0676391a-db97-47b2-b2de-7475d6476fd9\") "
Sep 18 22:40:36.454531 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:40:36.454387    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0676391a-db97-47b2-b2de-7475d6476fd9-tmp-dir\") pod \"0676391a-db97-47b2-b2de-7475d6476fd9\" (UID: \"0676391a-db97-47b2-b2de-7475d6476fd9\") "
Sep 18 22:40:36.454531 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:40:36.454433    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0676391a-db97-47b2-b2de-7475d6476fd9-home\") pod \"0676391a-db97-47b2-b2de-7475d6476fd9\" (UID: \"0676391a-db97-47b2-b2de-7475d6476fd9\") "
Sep 18 22:40:36.454775 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:40:36.454699    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0676391a-db97-47b2-b2de-7475d6476fd9-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "0676391a-db97-47b2-b2de-7475d6476fd9" (UID: "0676391a-db97-47b2-b2de-7475d6476fd9"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:40:36.454775 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:40:36.454692    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0676391a-db97-47b2-b2de-7475d6476fd9-model-cache" (OuterVolumeSpecName: "model-cache") pod "0676391a-db97-47b2-b2de-7475d6476fd9" (UID: "0676391a-db97-47b2-b2de-7475d6476fd9"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:40:36.454775 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:40:36.454758    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0676391a-db97-47b2-b2de-7475d6476fd9-home" (OuterVolumeSpecName: "home") pod "0676391a-db97-47b2-b2de-7475d6476fd9" (UID: "0676391a-db97-47b2-b2de-7475d6476fd9"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:40:36.454942 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:40:36.454823    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0676391a-db97-47b2-b2de-7475d6476fd9-dshm\") pod \"0676391a-db97-47b2-b2de-7475d6476fd9\" (UID: \"0676391a-db97-47b2-b2de-7475d6476fd9\") "
Sep 18 22:40:36.455113 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:40:36.455098    2577 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0676391a-db97-47b2-b2de-7475d6476fd9-model-cache\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:40:36.455181 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:40:36.455141    2577 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0676391a-db97-47b2-b2de-7475d6476fd9-tmp-dir\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:40:36.455181 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:40:36.455155    2577 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0676391a-db97-47b2-b2de-7475d6476fd9-home\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:40:36.457079 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:40:36.457049    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0676391a-db97-47b2-b2de-7475d6476fd9-dshm" (OuterVolumeSpecName: "dshm") pod "0676391a-db97-47b2-b2de-7475d6476fd9" (UID: "0676391a-db97-47b2-b2de-7475d6476fd9"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:40:36.457271 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:40:36.457248    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0676391a-db97-47b2-b2de-7475d6476fd9-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "0676391a-db97-47b2-b2de-7475d6476fd9" (UID: "0676391a-db97-47b2-b2de-7475d6476fd9"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 22:40:36.457346 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:40:36.457278    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0676391a-db97-47b2-b2de-7475d6476fd9-kube-api-access-8pmzj" (OuterVolumeSpecName: "kube-api-access-8pmzj") pod "0676391a-db97-47b2-b2de-7475d6476fd9" (UID: "0676391a-db97-47b2-b2de-7475d6476fd9"). InnerVolumeSpecName "kube-api-access-8pmzj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:40:36.501674 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:40:36.501644    2577 generic.go:356] "Generic (PLEG): container finished" podID="0676391a-db97-47b2-b2de-7475d6476fd9" containerID="c0015286ef1d6216db642654fdda71a3183c34cd250db3ec5bb4b79d002ddf8a" exitCode=0
Sep 18 22:40:36.501782 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:40:36.501680    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-361c0305-kserve-5b5d5fd8cf-wtwz7"
Sep 18 22:40:36.501782 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:40:36.501723    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-361c0305-kserve-5b5d5fd8cf-wtwz7" event={"ID":"0676391a-db97-47b2-b2de-7475d6476fd9","Type":"ContainerDied","Data":"c0015286ef1d6216db642654fdda71a3183c34cd250db3ec5bb4b79d002ddf8a"}
Sep 18 22:40:36.501782 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:40:36.501766    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-361c0305-kserve-5b5d5fd8cf-wtwz7" event={"ID":"0676391a-db97-47b2-b2de-7475d6476fd9","Type":"ContainerDied","Data":"3c0cde12f9e8764f2475069d31ce3487d10b6f819a9beaaf15096f9eb15f9e91"}
Sep 18 22:40:36.501896 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:40:36.501786    2577 scope.go:117] "RemoveContainer" containerID="c0015286ef1d6216db642654fdda71a3183c34cd250db3ec5bb4b79d002ddf8a"
Sep 18 22:40:36.514059 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:40:36.514039    2577 scope.go:117] "RemoveContainer" containerID="c0015286ef1d6216db642654fdda71a3183c34cd250db3ec5bb4b79d002ddf8a"
Sep 18 22:40:36.514367 ip-10-0-141-99 kubenswrapper[2577]: E0918 22:40:36.514348    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c0015286ef1d6216db642654fdda71a3183c34cd250db3ec5bb4b79d002ddf8a\": container with ID starting with c0015286ef1d6216db642654fdda71a3183c34cd250db3ec5bb4b79d002ddf8a not found: ID does not exist" containerID="c0015286ef1d6216db642654fdda71a3183c34cd250db3ec5bb4b79d002ddf8a"
Sep 18 22:40:36.514449 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:40:36.514375    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0015286ef1d6216db642654fdda71a3183c34cd250db3ec5bb4b79d002ddf8a"} err="failed to get container status \"c0015286ef1d6216db642654fdda71a3183c34cd250db3ec5bb4b79d002ddf8a\": rpc error: code = NotFound desc = could not find container \"c0015286ef1d6216db642654fdda71a3183c34cd250db3ec5bb4b79d002ddf8a\": container with ID starting with c0015286ef1d6216db642654fdda71a3183c34cd250db3ec5bb4b79d002ddf8a not found: ID does not exist"
Sep 18 22:40:36.524104 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:40:36.524080    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-361c0305-kserve-5b5d5fd8cf-wtwz7"]
Sep 18 22:40:36.528087 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:40:36.528067    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-361c0305-kserve-5b5d5fd8cf-wtwz7"]
Sep 18 22:40:36.556548 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:40:36.556523    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8pmzj\" (UniqueName: \"kubernetes.io/projected/0676391a-db97-47b2-b2de-7475d6476fd9-kube-api-access-8pmzj\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:40:36.556641 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:40:36.556553    2577 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0676391a-db97-47b2-b2de-7475d6476fd9-tls-certs\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:40:36.556641 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:40:36.556569    2577 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0676391a-db97-47b2-b2de-7475d6476fd9-dshm\") on node \"ip-10-0-141-99.ec2.internal\" DevicePath \"\""
Sep 18 22:40:37.140190 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:40:37.140158    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0676391a-db97-47b2-b2de-7475d6476fd9" path="/var/lib/kubelet/pods/0676391a-db97-47b2-b2de-7475d6476fd9/volumes"
Sep 18 22:41:07.726817 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:07.726739    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-8d479bf8-8fndb_45756c94-441d-4961-b9b7-5a382730412c/authorino/0.log"
Sep 18 22:41:12.979387 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:12.979356    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-8ghwr_33469be5-3311-4ff5-9057-664d0a8d5a8b/manager/0.log"
Sep 18 22:41:13.094674 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:13.094647    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-gct4p_e2542921-25af-417a-a0b4-f01b9a098c20/manager/0.log"
Sep 18 22:41:13.442380 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:13.442345    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-2wnkk_fd762570-226a-49e7-80d2-2f18e3c16917/manager/0.log"
Sep 18 22:41:13.815835 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:13.815811    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79cf4c6fc4-trjj6_3c45757c-4a4e-49a1-94dd-3a0ba4e0458a/copy-manifests/0.log"
Sep 18 22:41:13.828605 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:13.828575    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79cf4c6fc4-trjj6_3c45757c-4a4e-49a1-94dd-3a0ba4e0458a/manager/0.log"
Sep 18 22:41:14.600673 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:14.600645    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-t28vs_b2a0aec7-3ba9-46ec-b4db-39577851035c/postgres/0.log"
Sep 18 22:41:15.355100 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:15.355073    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-8d479bf8-8fndb_45756c94-441d-4961-b9b7-5a382730412c/authorino/0.log"
Sep 18 22:41:15.468633 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:15.468604    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-2shkc_1c9f995a-988a-4242-b75b-9bb9c83c1f3b/manager/0.log"
Sep 18 22:41:15.590097 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:15.590061    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-8r76d_65aa5a5c-2b45-47b3-965a-8e90c4dea733/manager/0.log"
Sep 18 22:41:15.694149 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:15.694074    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-vwdjr_baf93c9a-150e-4a54-bafb-f6f97afaebed/kuadrant-console-plugin/0.log"
Sep 18 22:41:15.811091 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:15.811063    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-4bsw8_9b594b73-9e8e-47e5-9e43-8de72ffa8ee0/manager/0.log"
Sep 18 22:41:16.063809 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:16.063779    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-74rm8_989cf005-4244-4113-a129-d003828298b7/manager/0.log"
Sep 18 22:41:16.417328 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:16.417250    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-wn6lc_b6a37e6c-ee5e-4c66-ac57-f1a4893a6d5c/istio-proxy/0.log"
Sep 18 22:41:16.640976 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:16.640932    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-666584dbdf-c64gg_9ff79945-92fa-408c-a29a-2fc8108000fd/kube-auth-proxy/0.log"
Sep 18 22:41:16.851280 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:16.851254    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-jzpjr_141b0cdb-5a28-40ae-88f4-17e9ab7e97e1/istio-proxy/1.log"
Sep 18 22:41:16.956895 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:16.956870    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-7229m_e64b8957-d4a9-40e0-a010-a875bbae1e96/payload-pre-processing/0.log"
Sep 18 22:41:21.927549 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:21.927515    2577 scope.go:117] "RemoveContainer" containerID="c01a51322ffcf5e08b63dc0835d9b480185342a0b968fca6170e9eb0dd4286f0"
Sep 18 22:41:24.057624 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:24.057587    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-s5gh8/must-gather-kn5kv"]
Sep 18 22:41:24.058043 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:24.057957    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0676391a-db97-47b2-b2de-7475d6476fd9" containerName="main"
Sep 18 22:41:24.058043 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:24.057968    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="0676391a-db97-47b2-b2de-7475d6476fd9" containerName="main"
Sep 18 22:41:24.058043 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:24.058044    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="0676391a-db97-47b2-b2de-7475d6476fd9" containerName="main"
Sep 18 22:41:24.062764 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:24.062742    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-s5gh8/must-gather-kn5kv"
Sep 18 22:41:24.068717 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:24.068690    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-s5gh8\"/\"default-dockercfg-mb95d\""
Sep 18 22:41:24.069448 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:24.069103    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-s5gh8\"/\"kube-root-ca.crt\""
Sep 18 22:41:24.069448 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:24.069146    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-s5gh8\"/\"openshift-service-ca.crt\""
Sep 18 22:41:24.083698 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:24.083668    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-s5gh8/must-gather-kn5kv"]
Sep 18 22:41:24.095350 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:24.095326    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/1f2278a5-4316-4137-89e2-531cc5fc87ad-must-gather-output\") pod \"must-gather-kn5kv\" (UID: \"1f2278a5-4316-4137-89e2-531cc5fc87ad\") " pod="openshift-must-gather-s5gh8/must-gather-kn5kv"
Sep 18 22:41:24.095495 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:24.095388    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vm56\" (UniqueName: \"kubernetes.io/projected/1f2278a5-4316-4137-89e2-531cc5fc87ad-kube-api-access-4vm56\") pod \"must-gather-kn5kv\" (UID: \"1f2278a5-4316-4137-89e2-531cc5fc87ad\") " pod="openshift-must-gather-s5gh8/must-gather-kn5kv"
Sep 18 22:41:24.195868 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:24.195838    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/1f2278a5-4316-4137-89e2-531cc5fc87ad-must-gather-output\") pod \"must-gather-kn5kv\" (UID: \"1f2278a5-4316-4137-89e2-531cc5fc87ad\") " pod="openshift-must-gather-s5gh8/must-gather-kn5kv"
Sep 18 22:41:24.196013 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:24.195922    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vm56\" (UniqueName: \"kubernetes.io/projected/1f2278a5-4316-4137-89e2-531cc5fc87ad-kube-api-access-4vm56\") pod \"must-gather-kn5kv\" (UID: \"1f2278a5-4316-4137-89e2-531cc5fc87ad\") " pod="openshift-must-gather-s5gh8/must-gather-kn5kv"
Sep 18 22:41:24.196254 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:24.196233    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/1f2278a5-4316-4137-89e2-531cc5fc87ad-must-gather-output\") pod \"must-gather-kn5kv\" (UID: \"1f2278a5-4316-4137-89e2-531cc5fc87ad\") " pod="openshift-must-gather-s5gh8/must-gather-kn5kv"
Sep 18 22:41:24.205207 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:24.205190    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vm56\" (UniqueName: \"kubernetes.io/projected/1f2278a5-4316-4137-89e2-531cc5fc87ad-kube-api-access-4vm56\") pod \"must-gather-kn5kv\" (UID: \"1f2278a5-4316-4137-89e2-531cc5fc87ad\") " pod="openshift-must-gather-s5gh8/must-gather-kn5kv"
Sep 18 22:41:24.371589 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:24.371511    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-s5gh8/must-gather-kn5kv"
Sep 18 22:41:24.650918 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:24.650897    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-s5gh8/must-gather-kn5kv"]
Sep 18 22:41:24.652891 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:41:24.652863    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1f2278a5_4316_4137_89e2_531cc5fc87ad.slice/crio-1179ed15004886857d4fca53ea6f88d2bb055774b1ac5463961d849adffedb04 WatchSource:0}: Error finding container 1179ed15004886857d4fca53ea6f88d2bb055774b1ac5463961d849adffedb04: Status 404 returned error can't find the container with id 1179ed15004886857d4fca53ea6f88d2bb055774b1ac5463961d849adffedb04
Sep 18 22:41:24.654781 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:24.654764    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 18 22:41:24.773916 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:24.773879    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-s5gh8/must-gather-kn5kv" event={"ID":"1f2278a5-4316-4137-89e2-531cc5fc87ad","Type":"ContainerStarted","Data":"1179ed15004886857d4fca53ea6f88d2bb055774b1ac5463961d849adffedb04"}
Sep 18 22:41:25.784113 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:25.784074    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-s5gh8/must-gather-kn5kv" event={"ID":"1f2278a5-4316-4137-89e2-531cc5fc87ad","Type":"ContainerStarted","Data":"770f72ac0bbb928367debe731ed63d7d092b59bbb7c1e3f3f6385acaa03cc0bf"}
Sep 18 22:41:25.785046 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:25.785017    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-s5gh8/must-gather-kn5kv" event={"ID":"1f2278a5-4316-4137-89e2-531cc5fc87ad","Type":"ContainerStarted","Data":"4553e48c1de8d993fa49e61301ac1e1341af61e6b89e3b16bd957885d807a5b3"}
Sep 18 22:41:25.802184 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:25.802139    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-s5gh8/must-gather-kn5kv" podStartSLOduration=1.152557879 podStartE2EDuration="1.802120999s" totalImagesPullingTime="649.56312ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:41:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:41:25.799715625 +0000 UTC m=+2465.119387679" watchObservedRunningTime="2026-09-18 22:41:25.802120999 +0000 UTC m=+2465.121793059"
Sep 18 22:41:26.979077 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:26.979044    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-gb9sf_57c8eb94-06ca-4a20-a2d1-acc62a27e816/global-pull-secret-syncer/0.log"
Sep 18 22:41:27.106080 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:27.106024    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-gwrfw_d27d4416-7b1a-4723-8d04-9c07231b5061/konnectivity-agent/0.log"
Sep 18 22:41:27.212833 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:27.212794    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-99.ec2.internal_1bff01dc6642f13a258c3e4f92ce231e/haproxy/0.log"
Sep 18 22:41:32.029434 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:32.028729    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-8d479bf8-8fndb_45756c94-441d-4961-b9b7-5a382730412c/authorino/0.log"
Sep 18 22:41:32.062436 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:32.060909    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-2shkc_1c9f995a-988a-4242-b75b-9bb9c83c1f3b/manager/0.log"
Sep 18 22:41:32.093467 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:32.093429    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-8r76d_65aa5a5c-2b45-47b3-965a-8e90c4dea733/manager/0.log"
Sep 18 22:41:32.118660 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:32.118615    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-vwdjr_baf93c9a-150e-4a54-bafb-f6f97afaebed/kuadrant-console-plugin/0.log"
Sep 18 22:41:32.162719 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:32.162682    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-4bsw8_9b594b73-9e8e-47e5-9e43-8de72ffa8ee0/manager/0.log"
Sep 18 22:41:32.249988 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:32.249951    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-74rm8_989cf005-4244-4113-a129-d003828298b7/manager/0.log"
Sep 18 22:41:33.721328 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:33.721291    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-b48bp_9a2a6552-13e7-4318-9777-19dbfabb09f5/kube-state-metrics/0.log"
Sep 18 22:41:33.749069 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:33.749027    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-b48bp_9a2a6552-13e7-4318-9777-19dbfabb09f5/kube-rbac-proxy-main/0.log"
Sep 18 22:41:33.776824 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:33.776781    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-b48bp_9a2a6552-13e7-4318-9777-19dbfabb09f5/kube-rbac-proxy-self/0.log"
Sep 18 22:41:34.093535 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:34.093501    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xthcf_e5139388-724b-423b-9dff-2a25de46a9bd/node-exporter/0.log"
Sep 18 22:41:34.118245 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:34.118212    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xthcf_e5139388-724b-423b-9dff-2a25de46a9bd/kube-rbac-proxy/0.log"
Sep 18 22:41:34.144460 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:34.144430    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xthcf_e5139388-724b-423b-9dff-2a25de46a9bd/init-textfile/0.log"
Sep 18 22:41:34.548857 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:34.548770    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5d79948b-vnmxt_9a8c65d2-19fd-4545-bf89-39641a5ea60c/telemeter-client/0.log"
Sep 18 22:41:34.572822 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:34.572790    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5d79948b-vnmxt_9a8c65d2-19fd-4545-bf89-39641a5ea60c/reload/0.log"
Sep 18 22:41:34.599170 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:34.599120    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5d79948b-vnmxt_9a8c65d2-19fd-4545-bf89-39641a5ea60c/kube-rbac-proxy/0.log"
Sep 18 22:41:37.079525 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:37.079495    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-h2847_125d5bb0-54b7-4dff-aa80-e737f2791533/console-operator/1.log"
Sep 18 22:41:37.087504 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:37.087476    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-h2847_125d5bb0-54b7-4dff-aa80-e737f2791533/console-operator/2.log"
Sep 18 22:41:37.100368 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:37.100332    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-s5gh8/perf-node-gather-daemonset-nbsmt"]
Sep 18 22:41:37.109092 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:37.109065    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-s5gh8/perf-node-gather-daemonset-nbsmt"
Sep 18 22:41:37.111043 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:37.111022    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-s5gh8/perf-node-gather-daemonset-nbsmt"]
Sep 18 22:41:37.234450 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:37.234397    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6f58a022-9fa9-4817-ae2b-c012f82398c3-sys\") pod \"perf-node-gather-daemonset-nbsmt\" (UID: \"6f58a022-9fa9-4817-ae2b-c012f82398c3\") " pod="openshift-must-gather-s5gh8/perf-node-gather-daemonset-nbsmt"
Sep 18 22:41:37.234732 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:37.234712    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6f58a022-9fa9-4817-ae2b-c012f82398c3-proc\") pod \"perf-node-gather-daemonset-nbsmt\" (UID: \"6f58a022-9fa9-4817-ae2b-c012f82398c3\") " pod="openshift-must-gather-s5gh8/perf-node-gather-daemonset-nbsmt"
Sep 18 22:41:37.234885 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:37.234870    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6f58a022-9fa9-4817-ae2b-c012f82398c3-podres\") pod \"perf-node-gather-daemonset-nbsmt\" (UID: \"6f58a022-9fa9-4817-ae2b-c012f82398c3\") " pod="openshift-must-gather-s5gh8/perf-node-gather-daemonset-nbsmt"
Sep 18 22:41:37.235049 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:37.235034    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6f58a022-9fa9-4817-ae2b-c012f82398c3-lib-modules\") pod \"perf-node-gather-daemonset-nbsmt\" (UID: \"6f58a022-9fa9-4817-ae2b-c012f82398c3\") " pod="openshift-must-gather-s5gh8/perf-node-gather-daemonset-nbsmt"
Sep 18 22:41:37.235663 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:37.235638    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qwm2\" (UniqueName: \"kubernetes.io/projected/6f58a022-9fa9-4817-ae2b-c012f82398c3-kube-api-access-6qwm2\") pod \"perf-node-gather-daemonset-nbsmt\" (UID: \"6f58a022-9fa9-4817-ae2b-c012f82398c3\") " pod="openshift-must-gather-s5gh8/perf-node-gather-daemonset-nbsmt"
Sep 18 22:41:37.336978 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:37.336888    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qwm2\" (UniqueName: \"kubernetes.io/projected/6f58a022-9fa9-4817-ae2b-c012f82398c3-kube-api-access-6qwm2\") pod \"perf-node-gather-daemonset-nbsmt\" (UID: \"6f58a022-9fa9-4817-ae2b-c012f82398c3\") " pod="openshift-must-gather-s5gh8/perf-node-gather-daemonset-nbsmt"
Sep 18 22:41:37.337239 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:37.337221    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6f58a022-9fa9-4817-ae2b-c012f82398c3-sys\") pod \"perf-node-gather-daemonset-nbsmt\" (UID: \"6f58a022-9fa9-4817-ae2b-c012f82398c3\") " pod="openshift-must-gather-s5gh8/perf-node-gather-daemonset-nbsmt"
Sep 18 22:41:37.337394 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:37.337377    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6f58a022-9fa9-4817-ae2b-c012f82398c3-proc\") pod \"perf-node-gather-daemonset-nbsmt\" (UID: \"6f58a022-9fa9-4817-ae2b-c012f82398c3\") " pod="openshift-must-gather-s5gh8/perf-node-gather-daemonset-nbsmt"
Sep 18 22:41:37.337515 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:37.337503    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6f58a022-9fa9-4817-ae2b-c012f82398c3-podres\") pod \"perf-node-gather-daemonset-nbsmt\" (UID: \"6f58a022-9fa9-4817-ae2b-c012f82398c3\") " pod="openshift-must-gather-s5gh8/perf-node-gather-daemonset-nbsmt"
Sep 18 22:41:37.337638 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:37.337626    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6f58a022-9fa9-4817-ae2b-c012f82398c3-lib-modules\") pod \"perf-node-gather-daemonset-nbsmt\" (UID: \"6f58a022-9fa9-4817-ae2b-c012f82398c3\") " pod="openshift-must-gather-s5gh8/perf-node-gather-daemonset-nbsmt"
Sep 18 22:41:37.337813 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:37.337382    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6f58a022-9fa9-4817-ae2b-c012f82398c3-sys\") pod \"perf-node-gather-daemonset-nbsmt\" (UID: \"6f58a022-9fa9-4817-ae2b-c012f82398c3\") " pod="openshift-must-gather-s5gh8/perf-node-gather-daemonset-nbsmt"
Sep 18 22:41:37.337813 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:37.337797    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6f58a022-9fa9-4817-ae2b-c012f82398c3-lib-modules\") pod \"perf-node-gather-daemonset-nbsmt\" (UID: \"6f58a022-9fa9-4817-ae2b-c012f82398c3\") " pod="openshift-must-gather-s5gh8/perf-node-gather-daemonset-nbsmt"
Sep 18 22:41:37.337927 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:37.337680    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6f58a022-9fa9-4817-ae2b-c012f82398c3-podres\") pod \"perf-node-gather-daemonset-nbsmt\" (UID: \"6f58a022-9fa9-4817-ae2b-c012f82398c3\") " pod="openshift-must-gather-s5gh8/perf-node-gather-daemonset-nbsmt"
Sep 18 22:41:37.337927 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:37.337451    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6f58a022-9fa9-4817-ae2b-c012f82398c3-proc\") pod \"perf-node-gather-daemonset-nbsmt\" (UID: \"6f58a022-9fa9-4817-ae2b-c012f82398c3\") " pod="openshift-must-gather-s5gh8/perf-node-gather-daemonset-nbsmt"
Sep 18 22:41:37.345737 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:37.345713    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qwm2\" (UniqueName: \"kubernetes.io/projected/6f58a022-9fa9-4817-ae2b-c012f82398c3-kube-api-access-6qwm2\") pod \"perf-node-gather-daemonset-nbsmt\" (UID: \"6f58a022-9fa9-4817-ae2b-c012f82398c3\") " pod="openshift-must-gather-s5gh8/perf-node-gather-daemonset-nbsmt"
Sep 18 22:41:37.429040 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:37.428844    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-s5gh8/perf-node-gather-daemonset-nbsmt"
Sep 18 22:41:37.659957 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:37.659861    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-59977c9f9d-89dwm_4d95f81d-d3a8-48dc-a63d-7e171c697ab5/console/0.log"
Sep 18 22:41:37.724879 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:37.724834    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-s5gh8/perf-node-gather-daemonset-nbsmt"]
Sep 18 22:41:37.727686 ip-10-0-141-99 kubenswrapper[2577]: W0918 22:41:37.727652    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod6f58a022_9fa9_4817_ae2b_c012f82398c3.slice/crio-6a7df3c25df15583a4e9bb3841c670a3f866b88a8e1f5e37a0767fd6b597cd49 WatchSource:0}: Error finding container 6a7df3c25df15583a4e9bb3841c670a3f866b88a8e1f5e37a0767fd6b597cd49: Status 404 returned error can't find the container with id 6a7df3c25df15583a4e9bb3841c670a3f866b88a8e1f5e37a0767fd6b597cd49
Sep 18 22:41:37.892679 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:37.892649    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-s5gh8/perf-node-gather-daemonset-nbsmt" event={"ID":"6f58a022-9fa9-4817-ae2b-c012f82398c3","Type":"ContainerStarted","Data":"77f076f1901fc5cff148ed14e5b4edb7529894828d877e84abb1e61cc8efdc7b"}
Sep 18 22:41:37.892850 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:37.892703    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-s5gh8/perf-node-gather-daemonset-nbsmt" event={"ID":"6f58a022-9fa9-4817-ae2b-c012f82398c3","Type":"ContainerStarted","Data":"6a7df3c25df15583a4e9bb3841c670a3f866b88a8e1f5e37a0767fd6b597cd49"}
Sep 18 22:41:37.892850 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:37.892759    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-s5gh8/perf-node-gather-daemonset-nbsmt"
Sep 18 22:41:37.909450 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:37.909379    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-s5gh8/perf-node-gather-daemonset-nbsmt" podStartSLOduration=0.909363859 podStartE2EDuration="909.363859ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 22:41:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:41:37.907124676 +0000 UTC m=+2477.226796735" watchObservedRunningTime="2026-09-18 22:41:37.909363859 +0000 UTC m=+2477.229035914"
Sep 18 22:41:39.391582 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:39.391551    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-w9b7s_c8d12c54-c055-450f-b119-48b4667b3537/dns/0.log"
Sep 18 22:41:39.413499 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:39.413469    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-w9b7s_c8d12c54-c055-450f-b119-48b4667b3537/kube-rbac-proxy/0.log"
Sep 18 22:41:39.436492 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:39.436459    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qnflp_d322c364-182a-4826-af75-bc5dcab8bf38/dns-node-resolver/0.log"
Sep 18 22:41:40.191926 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:40.191897    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-w5xfs_9aea2f1a-d418-4d91-b512-3839fa148822/node-ca/0.log"
Sep 18 22:41:41.113146 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:41.113117    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-wn6lc_b6a37e6c-ee5e-4c66-ac57-f1a4893a6d5c/istio-proxy/0.log"
Sep 18 22:41:41.525499 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:41.525427    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-666584dbdf-c64gg_9ff79945-92fa-408c-a29a-2fc8108000fd/kube-auth-proxy/0.log"
Sep 18 22:41:41.624357 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:41.624331    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-jzpjr_141b0cdb-5a28-40ae-88f4-17e9ab7e97e1/istio-proxy/0.log"
Sep 18 22:41:41.626888 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:41.626865    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-jzpjr_141b0cdb-5a28-40ae-88f4-17e9ab7e97e1/istio-proxy/1.log"
Sep 18 22:41:41.680181 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:41.680150    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-7229m_e64b8957-d4a9-40e0-a010-a875bbae1e96/payload-pre-processing/0.log"
Sep 18 22:41:42.663329 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:42.663296    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7vzrh_099e9fb3-fc81-4c88-abd5-ff4cb99cf78b/serve-healthcheck-canary/0.log"
Sep 18 22:41:43.173649 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:43.173615    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-6f9c644dd9-r282c_180df824-c4c4-4de0-b270-597272b6f759/insights-operator/0.log"
Sep 18 22:41:43.174845 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:43.174824    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-6f9c644dd9-r282c_180df824-c4c4-4de0-b270-597272b6f759/insights-operator/1.log"
Sep 18 22:41:43.326741 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:43.326715    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ldnhp_d89bc690-49bd-4c8e-8f91-9dcefe8f7cf2/kube-rbac-proxy/0.log"
Sep 18 22:41:43.347296 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:43.347273    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ldnhp_d89bc690-49bd-4c8e-8f91-9dcefe8f7cf2/exporter/0.log"
Sep 18 22:41:43.370489 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:43.370459    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ldnhp_d89bc690-49bd-4c8e-8f91-9dcefe8f7cf2/extractor/0.log"
Sep 18 22:41:43.921407 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:43.921369    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-s5gh8/perf-node-gather-daemonset-nbsmt"
Sep 18 22:41:45.527864 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:45.527835    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-8ghwr_33469be5-3311-4ff5-9057-664d0a8d5a8b/manager/0.log"
Sep 18 22:41:45.821361 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:45.819486    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-gct4p_e2542921-25af-417a-a0b4-f01b9a098c20/manager/0.log"
Sep 18 22:41:46.005934 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:46.005896    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-2wnkk_fd762570-226a-49e7-80d2-2f18e3c16917/manager/0.log"
Sep 18 22:41:46.213314 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:46.213285    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79cf4c6fc4-trjj6_3c45757c-4a4e-49a1-94dd-3a0ba4e0458a/manager/0.log"
Sep 18 22:41:46.231984 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:46.231951    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79cf4c6fc4-trjj6_3c45757c-4a4e-49a1-94dd-3a0ba4e0458a/copy-manifests/0.log"
Sep 18 22:41:47.797424 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:47.797385    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-wn6lc_b6a37e6c-ee5e-4c66-ac57-f1a4893a6d5c/istio-proxy/0.log"
Sep 18 22:41:48.213376 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:48.213307    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-666584dbdf-c64gg_9ff79945-92fa-408c-a29a-2fc8108000fd/kube-auth-proxy/0.log"
Sep 18 22:41:48.251965 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:48.251928    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-jzpjr_141b0cdb-5a28-40ae-88f4-17e9ab7e97e1/istio-proxy/0.log"
Sep 18 22:41:48.256137 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:48.256099    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-jzpjr_141b0cdb-5a28-40ae-88f4-17e9ab7e97e1/istio-proxy/1.log"
Sep 18 22:41:48.281908 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:48.281877    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-7229m_e64b8957-d4a9-40e0-a010-a875bbae1e96/payload-pre-processing/0.log"
Sep 18 22:41:49.767346 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:49.767311    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-wn6lc_b6a37e6c-ee5e-4c66-ac57-f1a4893a6d5c/istio-proxy/0.log"
Sep 18 22:41:50.173065 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:50.173040    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-666584dbdf-c64gg_9ff79945-92fa-408c-a29a-2fc8108000fd/kube-auth-proxy/0.log"
Sep 18 22:41:50.209091 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:50.209064    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-jzpjr_141b0cdb-5a28-40ae-88f4-17e9ab7e97e1/istio-proxy/0.log"
Sep 18 22:41:50.212641 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:50.212609    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-jzpjr_141b0cdb-5a28-40ae-88f4-17e9ab7e97e1/istio-proxy/1.log"
Sep 18 22:41:50.241172 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:50.241142    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-7229m_e64b8957-d4a9-40e0-a010-a875bbae1e96/payload-pre-processing/0.log"
Sep 18 22:41:53.092695 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:53.092660    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55889f7b47-d7zbx_be6728b1-ba42-42b6-8eb7-8c0399e18907/kube-storage-version-migrator-operator/1.log"
Sep 18 22:41:53.093606 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:53.093584    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55889f7b47-d7zbx_be6728b1-ba42-42b6-8eb7-8c0399e18907/kube-storage-version-migrator-operator/0.log"
Sep 18 22:41:54.171449 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:54.171405    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-9hq94_7a1c1140-3ecb-4c8b-9a06-cf3f32ce21d1/kube-multus/0.log"
Sep 18 22:41:54.197405 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:54.197378    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5rhzl_293a6c1f-7be4-4cd7-a29a-14f22e5a4aac/kube-multus-additional-cni-plugins/0.log"
Sep 18 22:41:54.219487 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:54.219462    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5rhzl_293a6c1f-7be4-4cd7-a29a-14f22e5a4aac/egress-router-binary-copy/0.log"
Sep 18 22:41:54.240812 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:54.240792    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5rhzl_293a6c1f-7be4-4cd7-a29a-14f22e5a4aac/cni-plugins/0.log"
Sep 18 22:41:54.264080 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:54.264046    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5rhzl_293a6c1f-7be4-4cd7-a29a-14f22e5a4aac/bond-cni-plugin/0.log"
Sep 18 22:41:54.288173 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:54.288142    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5rhzl_293a6c1f-7be4-4cd7-a29a-14f22e5a4aac/routeoverride-cni/0.log"
Sep 18 22:41:54.311198 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:54.311169    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5rhzl_293a6c1f-7be4-4cd7-a29a-14f22e5a4aac/whereabouts-cni-bincopy/0.log"
Sep 18 22:41:54.333063 ip-10-0-141-99 kubenswrapper[2577]: I0918 22:41:54.333039    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5rhzl_293a6c1f-7be4-4cd7-a29a-14f22e5a4aac/whereabouts-cni/0.log"