Sep 10 17:39:04.056648 ip-10-0-136-161 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 10 17:39:04.056665 ip-10-0-136-161 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 10 17:39:04.056676 ip-10-0-136-161 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 10 17:39:04.057124 ip-10-0-136-161 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 10 17:39:15.145397 ip-10-0-136-161 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 10 17:39:15.145419 ip-10-0-136-161 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 1505907b45ec44aab277cb2340ab849a --
Sep 10 17:41:04.130667 ip-10-0-136-161 systemd[1]: Starting Kubernetes Kubelet...
Sep 10 17:41:04.554860 ip-10-0-136-161 kubenswrapper[2568]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 10 17:41:04.554860 ip-10-0-136-161 kubenswrapper[2568]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 10 17:41:04.554860 ip-10-0-136-161 kubenswrapper[2568]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 10 17:41:04.554860 ip-10-0-136-161 kubenswrapper[2568]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 10 17:41:04.554860 ip-10-0-136-161 kubenswrapper[2568]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 10 17:41:04.555882 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.555787    2568 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 10 17:41:04.562949 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.562911    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 17:41:04.562949 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.562941    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 17:41:04.562949 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.562945    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 17:41:04.562949 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.562951    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 17:41:04.562949 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.562954    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 17:41:04.562949 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.562957    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 17:41:04.562949 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.562960    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 17:41:04.562949 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.562963    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 17:41:04.563274 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.562967    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 17:41:04.563274 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.562970    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 17:41:04.563274 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.562972    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 17:41:04.563274 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.562975    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 17:41:04.563274 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.562978    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 17:41:04.563274 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.562980    2568 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 17:41:04.563274 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.562983    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 17:41:04.563274 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.562987    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 17:41:04.563274 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.562989    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 17:41:04.563274 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.562992    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 17:41:04.563274 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.562995    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 17:41:04.563274 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.562998    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 17:41:04.563274 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.563001    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 17:41:04.563274 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.563003    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 17:41:04.563274 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.563006    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 17:41:04.563274 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.563009    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 17:41:04.563274 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.563012    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 17:41:04.563274 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.563015    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 17:41:04.563274 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.563017    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 17:41:04.563274 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.563019    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 17:41:04.563784 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.563024    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 17:41:04.563784 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.563027    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 17:41:04.563784 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.563030    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 17:41:04.563784 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.563033    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 17:41:04.563784 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.563040    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 17:41:04.563784 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.563043    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 17:41:04.563784 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.563046    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 17:41:04.563784 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.563048    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 17:41:04.563784 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.563051    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 17:41:04.563784 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.563054    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 17:41:04.563784 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.563056    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 17:41:04.563784 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.563059    2568 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 17:41:04.563784 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.563061    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 17:41:04.563784 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.563065    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 17:41:04.563784 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.563068    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 17:41:04.563784 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.563071    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 17:41:04.563784 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.563073    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 17:41:04.563784 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.563077    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 17:41:04.563784 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.563079    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 17:41:04.563784 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.563082    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 17:41:04.564297 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.563085    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 17:41:04.564297 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.563087    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 17:41:04.564297 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.563090    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 17:41:04.564297 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.563093    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 17:41:04.564297 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.563096    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 17:41:04.564297 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.563098    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 17:41:04.564297 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.563101    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 17:41:04.564297 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.563104    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 17:41:04.564297 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.563107    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 17:41:04.564297 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.563110    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 17:41:04.564297 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.563112    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 17:41:04.564297 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.563114    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 17:41:04.564297 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.563118    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 17:41:04.564297 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.563120    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 17:41:04.564297 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.563123    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 17:41:04.564297 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.563125    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 17:41:04.564297 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.563129    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 17:41:04.564297 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.563133    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 17:41:04.564297 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.563136    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 17:41:04.564880 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.563139    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 17:41:04.564880 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.563142    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 17:41:04.564880 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.563145    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 17:41:04.564880 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.563147    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 17:41:04.564880 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.563150    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 17:41:04.564880 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.563152    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 17:41:04.564880 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.563157    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 17:41:04.564880 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.563160    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 17:41:04.564880 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.563162    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 17:41:04.564880 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.563165    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 17:41:04.564880 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.563168    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 17:41:04.564880 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.563170    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 17:41:04.564880 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.563174    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 17:41:04.564880 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.563176    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 17:41:04.564880 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.563180    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 17:41:04.564880 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.563184    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 17:41:04.564880 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.563188    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 17:41:04.564880 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.563191    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 17:41:04.564880 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.563194    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 17:41:04.564880 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.563197    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 17:41:04.565429 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.563199    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 17:41:04.565429 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.563202    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 17:41:04.565429 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.563206    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 17:41:04.565429 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.563208    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 17:41:04.565429 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.563211    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 17:41:04.565429 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.563214    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 17:41:04.565429 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.563216    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 17:41:04.565429 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.563219    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 17:41:04.565429 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.563221    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 17:41:04.565429 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.563224    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 17:41:04.565429 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.563227    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 17:41:04.565429 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.563230    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 17:41:04.565429 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564033    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 17:41:04.565429 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564041    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 17:41:04.565429 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564044    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 17:41:04.565429 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564047    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 17:41:04.565429 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564050    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 17:41:04.565429 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564052    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 17:41:04.565429 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564056    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 17:41:04.565429 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564059    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 17:41:04.565923 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564062    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 17:41:04.565923 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564064    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 17:41:04.565923 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564067    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 17:41:04.565923 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564070    2568 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 17:41:04.565923 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564073    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 17:41:04.565923 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564076    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 17:41:04.565923 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564078    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 17:41:04.565923 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564081    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 17:41:04.565923 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564083    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 17:41:04.565923 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564087    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 17:41:04.565923 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564090    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 17:41:04.565923 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564093    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 17:41:04.565923 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564095    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 17:41:04.565923 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564098    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 17:41:04.565923 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564100    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 17:41:04.565923 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564103    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 17:41:04.565923 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564106    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 17:41:04.565923 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564109    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 17:41:04.565923 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564111    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 17:41:04.566436 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564114    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 17:41:04.566436 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564145    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 17:41:04.566436 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564149    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 17:41:04.566436 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564152    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 17:41:04.566436 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564156    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 17:41:04.566436 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564159    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 17:41:04.566436 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564162    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 17:41:04.566436 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564165    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 17:41:04.566436 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564168    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 17:41:04.566436 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564171    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 17:41:04.566436 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564173    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 17:41:04.566436 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564178    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 17:41:04.566436 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564181    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 17:41:04.566436 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564184    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 17:41:04.566436 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564187    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 17:41:04.566436 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564190    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 17:41:04.566436 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564192    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 17:41:04.566436 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564195    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 17:41:04.566436 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564199    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 17:41:04.566915 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564203    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 17:41:04.566915 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564206    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 17:41:04.566915 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564208    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 17:41:04.566915 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564211    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 17:41:04.566915 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564215    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 17:41:04.566915 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564218    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 17:41:04.566915 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564222    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 17:41:04.566915 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564225    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 17:41:04.566915 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564228    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 17:41:04.566915 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564231    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 17:41:04.566915 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564233    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 17:41:04.566915 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564236    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 17:41:04.566915 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564238    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 17:41:04.566915 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564241    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 17:41:04.566915 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564244    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 17:41:04.566915 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564246    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 17:41:04.566915 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564249    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 17:41:04.566915 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564253    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 17:41:04.566915 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564256    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 17:41:04.566915 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564259    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 17:41:04.567419 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564261    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 17:41:04.567419 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564264    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 17:41:04.567419 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564267    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 17:41:04.567419 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564269    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 17:41:04.567419 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564273    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 17:41:04.567419 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564275    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 17:41:04.567419 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564279    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 17:41:04.567419 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564281    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 17:41:04.567419 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564284    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 17:41:04.567419 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564287    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 17:41:04.567419 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564290    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 17:41:04.567419 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564292    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 17:41:04.567419 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564295    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 17:41:04.567419 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564297    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 17:41:04.567419 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564300    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 17:41:04.567419 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564303    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 17:41:04.567419 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564306    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 17:41:04.567419 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564310    2568 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 17:41:04.567419 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564313    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 17:41:04.567419 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564315    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 17:41:04.567934 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564332    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 17:41:04.567934 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564334    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 17:41:04.567934 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564338    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 17:41:04.567934 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564340    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 17:41:04.567934 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564344    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 17:41:04.567934 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564348    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 17:41:04.567934 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564351    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 17:41:04.567934 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564355    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 17:41:04.567934 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564359    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 17:41:04.567934 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564362    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 17:41:04.567934 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564365    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 17:41:04.567934 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564368    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 17:41:04.567934 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564371    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 17:41:04.567934 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564814    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 17:41:04.567934 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564820    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 17:41:04.567934 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564824    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 17:41:04.567934 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564827    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 17:41:04.567934 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564830    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 17:41:04.567934 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564834    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 17:41:04.567934 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564837    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 17:41:04.568447 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564840    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 17:41:04.568447 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564843    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 17:41:04.568447 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564847    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 17:41:04.568447 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564850    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 17:41:04.568447 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564852    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 17:41:04.568447 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564855    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 17:41:04.568447 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564857    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 17:41:04.568447 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564861    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 17:41:04.568447 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564863    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 17:41:04.568447 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564872    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 17:41:04.568447 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564875    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 17:41:04.568447 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564877    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 17:41:04.568447 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564880    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 17:41:04.568447 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564883    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 17:41:04.568447 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564886    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 17:41:04.568447 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564889    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 17:41:04.568447 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564892    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 17:41:04.568447 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564895    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 17:41:04.568447 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564897    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 17:41:04.568926 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564901    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 17:41:04.568926 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564905    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 17:41:04.568926 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564909    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 17:41:04.568926 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564912    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 17:41:04.568926 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564916    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 17:41:04.568926 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564919    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 17:41:04.568926 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564922    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 17:41:04.568926 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564924    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 17:41:04.568926 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564928    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 17:41:04.568926 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564931    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 17:41:04.568926 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564934    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 17:41:04.568926 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564937    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 17:41:04.568926 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564940    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 17:41:04.568926 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564944    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 17:41:04.568926 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564946    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 17:41:04.568926 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564950    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 17:41:04.568926 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564953    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 17:41:04.568926 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564956    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 17:41:04.568926 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564959    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 17:41:04.569410 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564962    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 17:41:04.569410 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564964    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 17:41:04.569410 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564967    2568 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 17:41:04.569410 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564970    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 17:41:04.569410 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564973    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 17:41:04.569410 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564976    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 17:41:04.569410 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564979    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 17:41:04.569410 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564981    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 17:41:04.569410 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564984    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 17:41:04.569410 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564987    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 17:41:04.569410 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564990    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 17:41:04.569410 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564992    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 17:41:04.569410 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564995    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 17:41:04.569410 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.564997    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 17:41:04.569410 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.565000    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 17:41:04.569410 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.565003    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 17:41:04.569410 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.565005    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 17:41:04.569410 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.565008    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 17:41:04.569410 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.565010    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 17:41:04.569410 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.565013    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 17:41:04.569921 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.565015    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 17:41:04.569921 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.565018    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 17:41:04.569921 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.565024    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 17:41:04.569921 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.565027    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 17:41:04.569921 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.565029    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 17:41:04.569921 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.565032    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 17:41:04.569921 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.565035    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 17:41:04.569921 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.565037    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 17:41:04.569921 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.565040    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 17:41:04.569921 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.565042    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 17:41:04.569921 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.565045    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 17:41:04.569921 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.565047    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 17:41:04.569921 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.565050    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 17:41:04.569921 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.565053    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 17:41:04.569921 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.565055    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 17:41:04.569921 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.565058    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 17:41:04.569921 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.565060    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 17:41:04.569921 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.565064    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 17:41:04.569921 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.565066    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 17:41:04.569921 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.565069    2568 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 17:41:04.569921 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.565072    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 17:41:04.570530 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.565074    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 17:41:04.570530 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.565078    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 17:41:04.570530 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.565082    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 17:41:04.570530 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.565085    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 17:41:04.570530 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.565088    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 17:41:04.570530 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.565091    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 17:41:04.570530 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.565094    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 17:41:04.570530 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.565097    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 17:41:04.570530 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.565099    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 17:41:04.570530 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.565102    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 17:41:04.570530 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.565105    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 17:41:04.570530 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.565107    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 17:41:04.570530 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.565110    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 17:41:04.570530 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565186    2568 flags.go:64] FLAG: --address="0.0.0.0"
Sep 10 17:41:04.570530 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565229    2568 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 10 17:41:04.570530 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565255    2568 flags.go:64] FLAG: --anonymous-auth="true"
Sep 10 17:41:04.570530 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565261    2568 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 10 17:41:04.570530 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565265    2568 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 10 17:41:04.570530 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565269    2568 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 10 17:41:04.570530 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565274    2568 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 10 17:41:04.570530 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565279    2568 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 10 17:41:04.571051 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565282    2568 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 10 17:41:04.571051 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565285    2568 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 10 17:41:04.571051 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565289    2568 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 10 17:41:04.571051 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565293    2568 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 10 17:41:04.571051 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565296    2568 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 10 17:41:04.571051 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565299    2568 flags.go:64] FLAG: --cgroup-root=""
Sep 10 17:41:04.571051 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565302    2568 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 10 17:41:04.571051 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565305    2568 flags.go:64] FLAG: --client-ca-file=""
Sep 10 17:41:04.571051 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565309    2568 flags.go:64] FLAG: --cloud-provider="external"
Sep 10 17:41:04.571051 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565312    2568 flags.go:64] FLAG: --cluster-dns="[]"
Sep 10 17:41:04.571051 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565317    2568 flags.go:64] FLAG: --cluster-domain=""
Sep 10 17:41:04.571051 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565338    2568 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 10 17:41:04.571051 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565341    2568 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 10 17:41:04.571051 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565345    2568 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 10 17:41:04.571051 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565348    2568 flags.go:64] FLAG: --container-log-max-files="5"
Sep 10 17:41:04.571051 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565352    2568 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 10 17:41:04.571051 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565355    2568 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 10 17:41:04.571051 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565359    2568 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 10 17:41:04.571051 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565362    2568 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 10 17:41:04.571051 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565366    2568 flags.go:64] FLAG: --contention-profiling="false"
Sep 10 17:41:04.571051 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565370    2568 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 10 17:41:04.571051 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565373    2568 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 10 17:41:04.571051 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565376    2568 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 10 17:41:04.571051 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565379    2568 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 10 17:41:04.571657 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565383    2568 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 10 17:41:04.571657 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565387    2568 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 10 17:41:04.571657 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565390    2568 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 10 17:41:04.571657 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565393    2568 flags.go:64] FLAG: --enable-load-reader="false"
Sep 10 17:41:04.571657 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565396    2568 flags.go:64] FLAG: --enable-server="true"
Sep 10 17:41:04.571657 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565399    2568 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 10 17:41:04.571657 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565404    2568 flags.go:64] FLAG: --event-burst="100"
Sep 10 17:41:04.571657 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565407    2568 flags.go:64] FLAG: --event-qps="50"
Sep 10 17:41:04.571657 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565410    2568 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 10 17:41:04.571657 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565414    2568 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 10 17:41:04.571657 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565416    2568 flags.go:64] FLAG: --eviction-hard=""
Sep 10 17:41:04.571657 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565420    2568 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 10 17:41:04.571657 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565423    2568 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 10 17:41:04.571657 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565426    2568 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 10 17:41:04.571657 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565429    2568 flags.go:64] FLAG: --eviction-soft=""
Sep 10 17:41:04.571657 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565435    2568 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 10 17:41:04.571657 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565439    2568 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 10 17:41:04.571657 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565442    2568 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 10 17:41:04.571657 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565446    2568 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 10 17:41:04.571657 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565448    2568 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 10 17:41:04.571657 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565451    2568 flags.go:64] FLAG: --fail-swap-on="true"
Sep 10 17:41:04.571657 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565455    2568 flags.go:64] FLAG: --feature-gates=""
Sep 10 17:41:04.571657 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565459    2568 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 10 17:41:04.571657 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565462    2568 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 10 17:41:04.571657 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565466    2568 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 10 17:41:04.572309 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565469    2568 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 10 17:41:04.572309 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565472    2568 flags.go:64] FLAG: --healthz-port="10248"
Sep 10 17:41:04.572309 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565476    2568 flags.go:64] FLAG: --help="false"
Sep 10 17:41:04.572309 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565479    2568 flags.go:64] FLAG: --hostname-override="ip-10-0-136-161.ec2.internal"
Sep 10 17:41:04.572309 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565482    2568 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 10 17:41:04.572309 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565485    2568 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 10 17:41:04.572309 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565488    2568 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 10 17:41:04.572309 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565491    2568 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 10 17:41:04.572309 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565494    2568 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 10 17:41:04.572309 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565497    2568 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 10 17:41:04.572309 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565500    2568 flags.go:64] FLAG: --image-service-endpoint=""
Sep 10 17:41:04.572309 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565503    2568 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 10 17:41:04.572309 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565506    2568 flags.go:64] FLAG: --kube-api-burst="100"
Sep 10 17:41:04.572309 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565509    2568 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 10 17:41:04.572309 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565512    2568 flags.go:64] FLAG: --kube-api-qps="50"
Sep 10 17:41:04.572309 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565515    2568 flags.go:64] FLAG: --kube-reserved=""
Sep 10 17:41:04.572309 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565518    2568 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 10 17:41:04.572309 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565520    2568 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 10 17:41:04.572309 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565523    2568 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 10 17:41:04.572309 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565526    2568 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 10 17:41:04.572309 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565529    2568 flags.go:64] FLAG: --lock-file=""
Sep 10 17:41:04.572309 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565531    2568 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 10 17:41:04.572309 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565536    2568 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 10 17:41:04.572309 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565539    2568 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 10 17:41:04.572919 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565545    2568 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 10 17:41:04.572919 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565549    2568 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 10 17:41:04.572919 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565552    2568 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 10 17:41:04.572919 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565555    2568 flags.go:64] FLAG: --logging-format="text"
Sep 10 17:41:04.572919 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565558    2568 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 10 17:41:04.572919 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565561    2568 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 10 17:41:04.572919 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565564    2568 flags.go:64] FLAG: --manifest-url=""
Sep 10 17:41:04.572919 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565567    2568 flags.go:64] FLAG: --manifest-url-header=""
Sep 10 17:41:04.572919 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565572    2568 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 10 17:41:04.572919 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565575    2568 flags.go:64] FLAG: --max-open-files="1000000"
Sep 10 17:41:04.572919 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565579    2568 flags.go:64] FLAG: --max-pods="110"
Sep 10 17:41:04.572919 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565582    2568 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 10 17:41:04.572919 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565585    2568 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 10 17:41:04.572919 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565588    2568 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 10 17:41:04.572919 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565591    2568 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 10 17:41:04.572919 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565594    2568 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 10 17:41:04.572919 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565597    2568 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 10 17:41:04.572919 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565600    2568 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 10 17:41:04.572919 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565609    2568 flags.go:64] FLAG: --node-status-max-images="50"
Sep 10 17:41:04.572919 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565612    2568 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 10 17:41:04.572919 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565615    2568 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 10 17:41:04.572919 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565618    2568 flags.go:64] FLAG: --pod-cidr=""
Sep 10 17:41:04.572919 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565621    2568 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1"
Sep 10 17:41:04.573501 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565628    2568 flags.go:64] FLAG: --pod-manifest-path=""
Sep 10 17:41:04.573501 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565631    2568 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 10 17:41:04.573501 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565634    2568 flags.go:64] FLAG: --pods-per-core="0"
Sep 10 17:41:04.573501 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565637    2568 flags.go:64] FLAG: --port="10250"
Sep 10 17:41:04.573501 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565640    2568 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 10 17:41:04.573501 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565643    2568 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0aa54891df2b04609"
Sep 10 17:41:04.573501 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565647    2568 flags.go:64] FLAG: --qos-reserved=""
Sep 10 17:41:04.573501 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565650    2568 flags.go:64] FLAG: --read-only-port="10255"
Sep 10 17:41:04.573501 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565654    2568 flags.go:64] FLAG: --register-node="true"
Sep 10 17:41:04.573501 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565657    2568 flags.go:64] FLAG: --register-with-taints=""
Sep 10 17:41:04.573501 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565661    2568 flags.go:64] FLAG: --registry-burst="10"
Sep 10 17:41:04.573501 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565668    2568 flags.go:64] FLAG: --registry-qps="5"
Sep 10 17:41:04.573501 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565671    2568 flags.go:64] FLAG: --reserved-cpus=""
Sep 10 17:41:04.573501 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565676    2568 flags.go:64] FLAG: --reserved-memory=""
Sep 10 17:41:04.573501 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565680    2568 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 10 17:41:04.573501 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565684    2568 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 10 17:41:04.573501 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565687    2568 flags.go:64] FLAG: --rotate-certificates="false"
Sep 10 17:41:04.573501 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565690    2568 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 10 17:41:04.573501 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565693    2568 flags.go:64] FLAG: --runonce="false"
Sep 10 17:41:04.573501 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565696    2568 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 10 17:41:04.573501 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565699    2568 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 10 17:41:04.573501 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565702    2568 flags.go:64] FLAG: --seccomp-default="false"
Sep 10 17:41:04.573501 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565705    2568 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 10 17:41:04.573501 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565708    2568 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 10 17:41:04.573501 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565711    2568 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 10 17:41:04.573501 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565714    2568 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 10 17:41:04.574190 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565717    2568 flags.go:64] FLAG: --storage-driver-password="root"
Sep 10 17:41:04.574190 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565720    2568 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 10 17:41:04.574190 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565723    2568 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 10 17:41:04.574190 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565726    2568 flags.go:64] FLAG: --storage-driver-user="root"
Sep 10 17:41:04.574190 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565729    2568 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 10 17:41:04.574190 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565732    2568 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 10 17:41:04.574190 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565735    2568 flags.go:64] FLAG: --system-cgroups=""
Sep 10 17:41:04.574190 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565738    2568 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 10 17:41:04.574190 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565743    2568 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 10 17:41:04.574190 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565746    2568 flags.go:64] FLAG: --tls-cert-file=""
Sep 10 17:41:04.574190 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565749    2568 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 10 17:41:04.574190 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565754    2568 flags.go:64] FLAG: --tls-min-version=""
Sep 10 17:41:04.574190 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565757    2568 flags.go:64] FLAG: --tls-private-key-file=""
Sep 10 17:41:04.574190 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565760    2568 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 10 17:41:04.574190 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565764    2568 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 10 17:41:04.574190 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565767    2568 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 10 17:41:04.574190 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565770    2568 flags.go:64] FLAG: --v="2"
Sep 10 17:41:04.574190 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565774    2568 flags.go:64] FLAG: --version="false"
Sep 10 17:41:04.574190 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565779    2568 flags.go:64] FLAG: --vmodule=""
Sep 10 17:41:04.574190 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565785    2568 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 10 17:41:04.574190 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.565788    2568 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 10 17:41:04.574190 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.565917    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 17:41:04.574190 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.565920    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 17:41:04.574190 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.565924    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 17:41:04.574801 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.565928    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 17:41:04.574801 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.565931    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 17:41:04.574801 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.565934    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 17:41:04.574801 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.565938    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 17:41:04.574801 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.565941    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 17:41:04.574801 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.565944    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 17:41:04.574801 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.565947    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 17:41:04.574801 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.565950    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 17:41:04.574801 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.565952    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 17:41:04.574801 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.565955    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 17:41:04.574801 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.565958    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 17:41:04.574801 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.565961    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 17:41:04.574801 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.565963    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 17:41:04.574801 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.565966    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 17:41:04.574801 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.565969    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 17:41:04.574801 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.565971    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 17:41:04.574801 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.565974    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 17:41:04.574801 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.565977    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 17:41:04.574801 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.565980    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 17:41:04.574801 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.565983    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 17:41:04.575299 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.565985    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 17:41:04.575299 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.565988    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 17:41:04.575299 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.565992    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 17:41:04.575299 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.565995    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 17:41:04.575299 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.565998    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 17:41:04.575299 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.566000    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 17:41:04.575299 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.566003    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 17:41:04.575299 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.566008    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 17:41:04.575299 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.566011    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 17:41:04.575299 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.566013    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 17:41:04.575299 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.566017    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 17:41:04.575299 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.566021    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 17:41:04.575299 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.566023    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 17:41:04.575299 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.566028    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 17:41:04.575299 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.566031    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 17:41:04.575299 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.566034    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 17:41:04.575299 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.566037    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 17:41:04.575299 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.566041    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 17:41:04.575299 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.566045    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 17:41:04.575850 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.566048    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 17:41:04.575850 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.566051    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 17:41:04.575850 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.566054    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 17:41:04.575850 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.566057    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 17:41:04.575850 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.566060    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 17:41:04.575850 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.566063    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 17:41:04.575850 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.566066    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 17:41:04.575850 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.566069    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 17:41:04.575850 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.566072    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 17:41:04.575850 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.566075    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 17:41:04.575850 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.566078    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 17:41:04.575850 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.566081    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 17:41:04.575850 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.566083    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 17:41:04.575850 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.566086    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 17:41:04.575850 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.566089    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 17:41:04.575850 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.566093    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 17:41:04.575850 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.566095    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 17:41:04.575850 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.566098    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 17:41:04.575850 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.566101    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 17:41:04.575850 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.566104    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 17:41:04.576356 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.566108    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 17:41:04.576356 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.566116    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 17:41:04.576356 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.566119    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 17:41:04.576356 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.566122    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 17:41:04.576356 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.566125    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 17:41:04.576356 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.566127    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 17:41:04.576356 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.566130    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 17:41:04.576356 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.566133    2568 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 17:41:04.576356 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.566136    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 17:41:04.576356 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.566138    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 17:41:04.576356 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.566141    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 17:41:04.576356 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.566144    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 17:41:04.576356 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.566147    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 17:41:04.576356 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.566150    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 17:41:04.576356 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.566153    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 17:41:04.576356 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.566155    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 17:41:04.576356 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.566158    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 17:41:04.576356 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.566161    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 17:41:04.576356 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.566164    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 17:41:04.576356 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.566167    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 17:41:04.576843 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.566170    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 17:41:04.576843 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.566172    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 17:41:04.576843 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.566175    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 17:41:04.576843 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.566178    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 17:41:04.576843 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.566180    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 17:41:04.576843 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.566183    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 17:41:04.576843 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.566186    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 17:41:04.576843 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.566191    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 17:41:04.576843 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.566194    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 17:41:04.576843 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.566196    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 17:41:04.576843 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.566199    2568 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 17:41:04.576843 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.566202    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 17:41:04.576843 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.566206    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 17:41:04.576843 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.566209    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 17:41:04.576843 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.566213    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 17:41:04.576843 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.566216    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 17:41:04.576843 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.566218    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 17:41:04.577302 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.567312    2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 10 17:41:04.578102 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.577932    2568 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 10 17:41:04.578142 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.578102    2568 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 10 17:41:04.578142 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.578120    2568 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 10 17:41:04.578142 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.578126    2568 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 10 17:41:04.578218 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578199    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 17:41:04.578218 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578204    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 17:41:04.578218 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578207    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 17:41:04.578218 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578210    2568 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 17:41:04.578218 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578213    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 17:41:04.578218 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578216    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 17:41:04.578218 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578220    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 17:41:04.578409 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578223    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 17:41:04.578409 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578226    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 17:41:04.578409 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578228    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 17:41:04.578409 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578232    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 17:41:04.578409 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578234    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 17:41:04.578409 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578237    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 17:41:04.578409 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578241    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 17:41:04.578409 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578246    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 17:41:04.578409 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578249    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 17:41:04.578409 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578252    2568 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 17:41:04.578409 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578255    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 17:41:04.578409 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578257    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 17:41:04.578409 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578260    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 17:41:04.578409 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578263    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 17:41:04.578409 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578266    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 17:41:04.578409 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578268    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 17:41:04.578409 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578271    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 17:41:04.578409 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578273    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 17:41:04.578409 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578276    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 17:41:04.578409 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578278    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 17:41:04.578907 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578281    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 17:41:04.578907 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578284    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 17:41:04.578907 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578293    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 17:41:04.578907 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578296    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 17:41:04.578907 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578298    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 17:41:04.578907 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578301    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 17:41:04.578907 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578303    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 17:41:04.578907 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578306    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 17:41:04.578907 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578308    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 17:41:04.578907 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578311    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 17:41:04.578907 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578314    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 17:41:04.578907 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578336    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 17:41:04.578907 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578341    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 17:41:04.578907 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578344    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 17:41:04.578907 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578347    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 17:41:04.578907 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578350    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 17:41:04.578907 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578353    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 17:41:04.578907 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578356    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 17:41:04.578907 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578359    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 17:41:04.578907 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578361    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 17:41:04.579417 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578364    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 17:41:04.579417 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578366    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 17:41:04.579417 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578369    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 17:41:04.579417 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578371    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 17:41:04.579417 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578374    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 17:41:04.579417 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578377    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 17:41:04.579417 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578380    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 17:41:04.579417 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578382    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 17:41:04.579417 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578385    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 17:41:04.579417 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578387    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 17:41:04.579417 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578391    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 17:41:04.579417 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578395    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 17:41:04.579417 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578398    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 17:41:04.579417 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578401    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 17:41:04.579417 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578403    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 17:41:04.579417 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578413    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 17:41:04.579417 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578416    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 17:41:04.579417 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578418    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 17:41:04.579417 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578422    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 17:41:04.579417 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578424    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 17:41:04.579915 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578427    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 17:41:04.579915 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578430    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 17:41:04.579915 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578432    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 17:41:04.579915 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578435    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 17:41:04.579915 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578438    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 17:41:04.579915 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578441    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 17:41:04.579915 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578444    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 17:41:04.579915 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578446    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 17:41:04.579915 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578449    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 17:41:04.579915 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578452    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 17:41:04.579915 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578454    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 17:41:04.579915 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578457    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 17:41:04.579915 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578459    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 17:41:04.579915 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578462    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 17:41:04.579915 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578464    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 17:41:04.579915 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578467    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 17:41:04.579915 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578471    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 17:41:04.579915 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578475    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 17:41:04.579915 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578478    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 17:41:04.580478 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578481    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 17:41:04.580478 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578483    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 17:41:04.580478 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578486    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 17:41:04.580478 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578489    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 17:41:04.580478 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578492    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 17:41:04.580478 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578494    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 17:41:04.580478 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578497    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 17:41:04.580478 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578499    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 17:41:04.580478 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578502    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 17:41:04.580478 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578510    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 17:41:04.580478 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578513    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 17:41:04.580478 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578516    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 17:41:04.580478 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578518    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 17:41:04.580478 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.578524    2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 10 17:41:04.580478 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578679    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 17:41:04.580838 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578686    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 17:41:04.580838 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578690    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 17:41:04.580838 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578693    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 17:41:04.580838 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578696    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 17:41:04.580838 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578698    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 17:41:04.580838 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578701    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 17:41:04.580838 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578704    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 17:41:04.580838 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578706    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 17:41:04.580838 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578709    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 17:41:04.580838 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578712    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 17:41:04.580838 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578715    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 17:41:04.580838 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578717    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 17:41:04.580838 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578720    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 17:41:04.580838 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578723    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 17:41:04.580838 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578725    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 17:41:04.580838 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578728    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 17:41:04.580838 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578730    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 17:41:04.580838 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578733    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 17:41:04.580838 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578736    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 17:41:04.581305 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578739    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 17:41:04.581305 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578741    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 17:41:04.581305 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578744    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 17:41:04.581305 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578746    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 17:41:04.581305 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578749    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 17:41:04.581305 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578751    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 17:41:04.581305 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578754    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 17:41:04.581305 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578756    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 17:41:04.581305 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578772    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 17:41:04.581305 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578777    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 17:41:04.581305 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578780    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 17:41:04.581305 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578784    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 17:41:04.581305 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578788    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 17:41:04.581305 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578791    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 17:41:04.581305 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578794    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 17:41:04.581305 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578797    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 17:41:04.581305 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578800    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 17:41:04.581305 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578802    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 17:41:04.581305 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578805    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 17:41:04.581305 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578808    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 17:41:04.581810 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578810    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 17:41:04.581810 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578813    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 17:41:04.581810 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578816    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 17:41:04.581810 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578818    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 17:41:04.581810 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578821    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 17:41:04.581810 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578823    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 17:41:04.581810 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578826    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 17:41:04.581810 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578829    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 17:41:04.581810 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578831    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 17:41:04.581810 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578834    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 17:41:04.581810 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578836    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 17:41:04.581810 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578840    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 17:41:04.581810 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578843    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 17:41:04.581810 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578845    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 17:41:04.581810 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578848    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 17:41:04.581810 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578850    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 17:41:04.581810 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578853    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 17:41:04.581810 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578855    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 17:41:04.582257 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578859    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 17:41:04.582257 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578863    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 17:41:04.582257 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578866    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 17:41:04.582257 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578875    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 17:41:04.582257 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578879    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 17:41:04.582257 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578882    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 17:41:04.582257 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578884    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 17:41:04.582257 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578887    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 17:41:04.582257 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578891    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 17:41:04.582257 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578895    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 17:41:04.582257 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578897    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 17:41:04.582257 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578900    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 17:41:04.582257 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578902    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 17:41:04.582257 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578905    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 17:41:04.582257 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578908    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 17:41:04.582257 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578910    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 17:41:04.582257 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578913    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 17:41:04.582257 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578916    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 17:41:04.582257 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578918    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 17:41:04.582733 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578921    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 17:41:04.582733 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578924    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 17:41:04.582733 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578926    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 17:41:04.582733 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578929    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 17:41:04.582733 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578931    2568 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 17:41:04.582733 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578934    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 17:41:04.582733 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578936    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 17:41:04.582733 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578939    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 17:41:04.582733 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578941    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 17:41:04.582733 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578944    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 17:41:04.582733 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578946    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 17:41:04.582733 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578949    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 17:41:04.582733 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578951    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 17:41:04.582733 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578954    2568 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 17:41:04.582733 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578956    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 17:41:04.582733 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578960    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 17:41:04.582733 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578962    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 17:41:04.582733 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578974    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 17:41:04.582733 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578977    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 17:41:04.582733 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578979    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 17:41:04.582733 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578982    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 17:41:04.583277 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:04.578986    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 17:41:04.583277 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.578992    2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 10 17:41:04.583277 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.579152    2568 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 10 17:41:04.583277 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.581662    2568 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 10 17:41:04.583277 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.582803    2568 server.go:1019] "Starting client certificate rotation"
Sep 10 17:41:04.583277 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.582905    2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 10 17:41:04.583277 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.582961    2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 10 17:41:04.585808 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.585784    2568 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 10 17:41:04.590617 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.587630    2568 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 10 17:41:04.607709 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.607675    2568 log.go:25] "Validated CRI v1 runtime API"
Sep 10 17:41:04.611309 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.611279    2568 log.go:25] "Validated CRI v1 image API"
Sep 10 17:41:04.612314 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.612295    2568 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 10 17:41:04.615979 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.615954    2568 fs.go:135] Filesystem UUIDs: map[2864263c-391d-4a96-b58d-3f520026076a:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 d87fb4ce-f78f-4e73-b336-5e4765101eae:/dev/nvme0n1p3]
Sep 10 17:41:04.616058 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.615978    2568 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 10 17:41:04.620730 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.620528    2568 manager.go:216] Machine: {Timestamp:2026-09-10 17:41:04.619961412 +0000 UTC m=+0.381269446 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099904 MemoryCapacity:33164484608 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec273f6085e9094b29d2b85641dd12e2 SystemUUID:ec273f60-85e9-094b-29d2-b85641dd12e2 BootID:1505907b-45ec-44aa-b277-cb2340ab849a Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:27:ed:a2:82:15 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:27:ed:a2:82:15 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:4e:7a:c0:93:f3:1d Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164484608 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 10 17:41:04.620730 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.620726    2568 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 10 17:41:04.620957 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.620939    2568 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 10 17:41:04.624598 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.624560    2568 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 10 17:41:04.624771 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.624602    2568 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-161.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 10 17:41:04.625767 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.625746    2568 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 10 17:41:04.626201 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.626187    2568 topology_manager.go:138] "Creating topology manager with none policy"
Sep 10 17:41:04.626232 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.626204    2568 container_manager_linux.go:309] "Creating device plugin manager"
Sep 10 17:41:04.626232 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.626213    2568 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 10 17:41:04.627093 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.627078    2568 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 10 17:41:04.629003 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.628986    2568 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 10 17:41:04.633815 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.633796    2568 state_mem.go:36] "Initialized new in-memory state store"
Sep 10 17:41:04.633976 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.633966    2568 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 10 17:41:04.634006 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.633998    2568 kubelet.go:486] "Attempting to sync node with API server"
Sep 10 17:41:04.634036 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.634008    2568 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 10 17:41:04.634036 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.634024    2568 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 10 17:41:04.634036 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.634034    2568 kubelet.go:398] "Adding apiserver pod source"
Sep 10 17:41:04.634110 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.634048    2568 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 10 17:41:04.634527 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.634512    2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 10 17:41:04.634605 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.634532    2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 10 17:41:04.637450 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.637423    2568 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 10 17:41:04.642247 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.642194    2568 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 10 17:41:04.642389 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.642275    2568 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 10 17:41:04.642574 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.642558    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 10 17:41:04.642652 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.642585    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 10 17:41:04.642652 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.642596    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 10 17:41:04.642652 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.642614    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 10 17:41:04.642652 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.642626    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 10 17:41:04.642652 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.642638    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 10 17:41:04.643200 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.643184    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 10 17:41:04.643265 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.643204    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 10 17:41:04.643265 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.643231    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 10 17:41:04.643265 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.643242    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 10 17:41:04.643265 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.643262    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 10 17:41:04.643466 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.643286    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 10 17:41:04.643466 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.643316    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 10 17:41:04.643466 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.643341    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 10 17:41:04.646315 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:04.646286    2568 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 10 17:41:04.646315 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:04.646288    2568 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-161.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 10 17:41:04.646509 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.646339    2568 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-161.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 10 17:41:04.648030 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.648010    2568 server.go:1268] "Started kubelet"
Sep 10 17:41:04.648119 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.648081    2568 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 10 17:41:04.648182 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.648107    2568 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 10 17:41:04.648235 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.648193    2568 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 10 17:41:04.649092 ip-10-0-136-161 systemd[1]: Started Kubernetes Kubelet.
Sep 10 17:41:04.649660 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.649642    2568 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 10 17:41:04.650271 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.650255    2568 server.go:310] "Adding debug handlers to kubelet server"
Sep 10 17:41:04.653539 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:04.653521    2568 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 10 17:41:04.658315 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.658287    2568 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 10 17:41:04.658315 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.658308    2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 10 17:41:04.658551 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:04.658528    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-161.ec2.internal\" not found"
Sep 10 17:41:04.659073 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.659051    2568 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 10 17:41:04.659151 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.659079    2568 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 10 17:41:04.659151 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.659105    2568 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 10 17:41:04.659236 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.659187    2568 reconstruct.go:97] "Volume reconstruction finished"
Sep 10 17:41:04.659236 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.659197    2568 reconciler.go:29] "Reconciler: start to sync state"
Sep 10 17:41:04.660230 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.660211    2568 factory.go:55] Registering systemd factory
Sep 10 17:41:04.660354 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.660244    2568 factory.go:223] Registration of the systemd container factory successfully
Sep 10 17:41:04.660530 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.660512    2568 factory.go:153] Registering CRI-O factory
Sep 10 17:41:04.660530 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.660531    2568 factory.go:223] Registration of the crio container factory successfully
Sep 10 17:41:04.660661 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.660602    2568 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 10 17:41:04.660661 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.660631    2568 factory.go:103] Registering Raw factory
Sep 10 17:41:04.660661 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.660647    2568 manager.go:1196] Started watching for new ooms in manager
Sep 10 17:41:04.661222 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.661205    2568 manager.go:349] Starting recovery of all containers
Sep 10 17:41:04.663132 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:04.663105    2568 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 10 17:41:04.663255 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:04.663219    2568 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-161.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 10 17:41:04.664312 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:04.663105    2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-161.ec2.internal.18d406780c7824b5  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-161.ec2.internal,UID:ip-10-0-136-161.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-161.ec2.internal,},FirstTimestamp:2026-09-10 17:41:04.647972021 +0000 UTC m=+0.409280057,LastTimestamp:2026-09-10 17:41:04.647972021 +0000 UTC m=+0.409280057,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-161.ec2.internal,}"
Sep 10 17:41:04.672611 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.672500    2568 manager.go:354] Recovery completed
Sep 10 17:41:04.675118 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:04.675078    2568 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Sep 10 17:41:04.678506 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.678489    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 17:41:04.678506 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.678493    2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8srpq"
Sep 10 17:41:04.680539 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.680518    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-161.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 17:41:04.680625 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.680557    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-161.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 17:41:04.680625 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.680573    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-161.ec2.internal" event="NodeHasSufficientPID"
Sep 10 17:41:04.681195 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.681179    2568 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 10 17:41:04.681195 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.681193    2568 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 10 17:41:04.681334 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.681212    2568 state_mem.go:36] "Initialized new in-memory state store"
Sep 10 17:41:04.681334 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.681252    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 17:41:04.682296 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.682274    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-161.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 17:41:04.682363 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.682316    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-161.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 17:41:04.682363 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.682348    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-161.ec2.internal" event="NodeHasSufficientPID"
Sep 10 17:41:04.682431 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:04.682347    2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-161.ec2.internal.18d406780e6911b4  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-161.ec2.internal,UID:ip-10-0-136-161.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-136-161.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-136-161.ec2.internal,},FirstTimestamp:2026-09-10 17:41:04.680538548 +0000 UTC m=+0.441846589,LastTimestamp:2026-09-10 17:41:04.680538548 +0000 UTC m=+0.441846589,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-161.ec2.internal,}"
Sep 10 17:41:04.683596 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.683581    2568 policy_none.go:49] "None policy: Start"
Sep 10 17:41:04.683669 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.683601    2568 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 10 17:41:04.683669 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.683615    2568 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 10 17:41:04.685687 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.685671    2568 policy_none.go:47] "Start"
Sep 10 17:41:04.686006 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.685985    2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8srpq"
Sep 10 17:41:04.759620 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:04.759583    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-161.ec2.internal\" not found"
Sep 10 17:41:04.761730 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.761702    2568 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 10 17:41:04.763096 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.763068    2568 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 10 17:41:04.763212 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.763143    2568 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 10 17:41:04.763212 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.763174    2568 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 10 17:41:04.763306 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:04.763287    2568 kubelet.go:2472] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
Sep 10 17:41:04.765744 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.765720    2568 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 17:41:04.840280 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.840264    2568 manager.go:337] "Starting Device Plugin manager"
Sep 10 17:41:04.840376 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:04.840306    2568 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 10 17:41:04.840376 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.840337    2568 server.go:87] "Starting device plugin registration server"
Sep 10 17:41:04.840688 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.840671    2568 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 10 17:41:04.840745 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.840691    2568 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 10 17:41:04.840845 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.840759    2568 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 10 17:41:04.840887 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.840853    2568 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 10 17:41:04.840887 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.840862    2568 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 10 17:41:04.841457 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:04.841436    2568 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 10 17:41:04.841570 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:04.841483    2568 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-161.ec2.internal\" not found"
Sep 10 17:41:04.863723 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.863655    2568 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-161.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-161.ec2.internal"]
Sep 10 17:41:04.863890 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.863786    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 17:41:04.864817 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.864799    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-161.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 17:41:04.864875 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.864830    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-161.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 17:41:04.864875 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.864842    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-161.ec2.internal" event="NodeHasSufficientPID"
Sep 10 17:41:04.867210 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.867194    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 17:41:04.867311 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.867295    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-161.ec2.internal"
Sep 10 17:41:04.867379 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.867356    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 17:41:04.868077 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.868047    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-161.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 17:41:04.868077 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.868047    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-161.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 17:41:04.868220 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.868083    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-161.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 17:41:04.868220 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.868097    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-161.ec2.internal" event="NodeHasSufficientPID"
Sep 10 17:41:04.868220 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.868100    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-161.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 17:41:04.868220 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.868114    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-161.ec2.internal" event="NodeHasSufficientPID"
Sep 10 17:41:04.870525 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.870509    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-161.ec2.internal"
Sep 10 17:41:04.870594 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.870540    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 17:41:04.870667 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:04.870646    2568 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-136-161.ec2.internal\" not found" node="ip-10-0-136-161.ec2.internal"
Sep 10 17:41:04.871438 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.871420    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-161.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 17:41:04.871544 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.871444    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-161.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 17:41:04.871544 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.871454    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-161.ec2.internal" event="NodeHasSufficientPID"
Sep 10 17:41:04.905299 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:04.905268    2568 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-161.ec2.internal\" not found" node="ip-10-0-136-161.ec2.internal"
Sep 10 17:41:04.910160 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:04.910132    2568 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-161.ec2.internal\" not found" node="ip-10-0-136-161.ec2.internal"
Sep 10 17:41:04.941602 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.941573    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 17:41:04.942634 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.942614    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-161.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 17:41:04.942770 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.942647    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-161.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 17:41:04.942770 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.942660    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-161.ec2.internal" event="NodeHasSufficientPID"
Sep 10 17:41:04.942770 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.942696    2568 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-161.ec2.internal"
Sep 10 17:41:04.951591 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.951566    2568 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-161.ec2.internal"
Sep 10 17:41:04.951591 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:04.951595    2568 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-161.ec2.internal\": node \"ip-10-0-136-161.ec2.internal\" not found"
Sep 10 17:41:04.960776 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.960743    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/14fa913fd221d63bd218ae72b03b88e8-config\") pod \"kube-apiserver-proxy-ip-10-0-136-161.ec2.internal\" (UID: \"14fa913fd221d63bd218ae72b03b88e8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-161.ec2.internal"
Sep 10 17:41:04.960776 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.960773    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/67b1785819731aadf4d3323928534cad-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-161.ec2.internal\" (UID: \"67b1785819731aadf4d3323928534cad\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-161.ec2.internal"
Sep 10 17:41:04.960958 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:04.960792    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/67b1785819731aadf4d3323928534cad-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-161.ec2.internal\" (UID: \"67b1785819731aadf4d3323928534cad\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-161.ec2.internal"
Sep 10 17:41:04.996340 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:04.996295    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-161.ec2.internal\" not found"
Sep 10 17:41:05.061709 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:05.061623    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/14fa913fd221d63bd218ae72b03b88e8-config\") pod \"kube-apiserver-proxy-ip-10-0-136-161.ec2.internal\" (UID: \"14fa913fd221d63bd218ae72b03b88e8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-161.ec2.internal"
Sep 10 17:41:05.061709 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:05.061569    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/14fa913fd221d63bd218ae72b03b88e8-config\") pod \"kube-apiserver-proxy-ip-10-0-136-161.ec2.internal\" (UID: \"14fa913fd221d63bd218ae72b03b88e8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-161.ec2.internal"
Sep 10 17:41:05.061709 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:05.061690    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/67b1785819731aadf4d3323928534cad-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-161.ec2.internal\" (UID: \"67b1785819731aadf4d3323928534cad\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-161.ec2.internal"
Sep 10 17:41:05.061709 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:05.061706    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/67b1785819731aadf4d3323928534cad-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-161.ec2.internal\" (UID: \"67b1785819731aadf4d3323928534cad\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-161.ec2.internal"
Sep 10 17:41:05.061947 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:05.061730    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/67b1785819731aadf4d3323928534cad-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-161.ec2.internal\" (UID: \"67b1785819731aadf4d3323928534cad\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-161.ec2.internal"
Sep 10 17:41:05.061947 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:05.061773    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/67b1785819731aadf4d3323928534cad-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-161.ec2.internal\" (UID: \"67b1785819731aadf4d3323928534cad\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-161.ec2.internal"
Sep 10 17:41:05.096913 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:05.096879    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-161.ec2.internal\" not found"
Sep 10 17:41:05.197595 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:05.197556    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-161.ec2.internal\" not found"
Sep 10 17:41:05.207736 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:05.207712    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-161.ec2.internal"
Sep 10 17:41:05.213601 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:05.212828    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-161.ec2.internal"
Sep 10 17:41:05.300176 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:05.300131    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-161.ec2.internal\" not found"
Sep 10 17:41:05.400378 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:05.400260    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-161.ec2.internal\" not found"
Sep 10 17:41:05.502417 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:05.502371    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-161.ec2.internal\" not found"
Sep 10 17:41:05.582337 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:05.582252    2568 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 10 17:41:05.583138 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:05.582476    2568 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 10 17:41:05.603151 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:05.603110    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-161.ec2.internal\" not found"
Sep 10 17:41:05.689452 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:05.689300    2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-09 17:36:05 +0000 UTC" deadline="2028-05-17 04:24:30.968409657 +0000 UTC"
Sep 10 17:41:05.689452 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:05.689378    2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14746h43m25.279035335s"
Sep 10 17:41:05.695230 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:05.695208    2568 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 17:41:05.759762 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:05.759546    2568 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-161.ec2.internal"
Sep 10 17:41:05.770866 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:05.770834    2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 10 17:41:05.772443 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:05.772419    2568 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-161.ec2.internal"
Sep 10 17:41:05.792701 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:05.792665    2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 10 17:41:05.944002 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:05.943906    2568 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 17:41:05.951392 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:05.951354    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14fa913fd221d63bd218ae72b03b88e8.slice/crio-4d07e04bfa873a9960309994ed0575dd19177ac35e6353c9696b23841ee591a5 WatchSource:0}: Error finding container 4d07e04bfa873a9960309994ed0575dd19177ac35e6353c9696b23841ee591a5: Status 404 returned error can't find the container with id 4d07e04bfa873a9960309994ed0575dd19177ac35e6353c9696b23841ee591a5
Sep 10 17:41:05.954008 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:05.953978    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67b1785819731aadf4d3323928534cad.slice/crio-4499f4af111afa8d78f6b236e8c71406ea206d77cdfbbf2311ecf32880d1b38e WatchSource:0}: Error finding container 4499f4af111afa8d78f6b236e8c71406ea206d77cdfbbf2311ecf32880d1b38e: Status 404 returned error can't find the container with id 4499f4af111afa8d78f6b236e8c71406ea206d77cdfbbf2311ecf32880d1b38e
Sep 10 17:41:05.957296 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:05.957272    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 17:41:05.970310 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:05.970271    2568 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 17:41:06.635010 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.634970    2568 apiserver.go:52] "Watching apiserver"
Sep 10 17:41:06.646380 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.646328    2568 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 10 17:41:06.646841 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.646805    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-161.ec2.internal","openshift-multus/multus-additional-cni-plugins-8xsvx","openshift-multus/multus-cz2hn","openshift-multus/network-metrics-daemon-76dl2","openshift-network-operator/iptables-alerter-p658s","openshift-ovn-kubernetes/ovnkube-node-f9cn7","kube-system/global-pull-secret-syncer-gqqkd","kube-system/konnectivity-agent-t9bvv","kube-system/kube-apiserver-proxy-ip-10-0-136-161.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hzw7d","openshift-cluster-node-tuning-operator/tuned-ckm2c","openshift-dns/node-resolver-dwtws","openshift-image-registry/node-ca-7jrjh","openshift-network-diagnostics/network-check-target-w5htf"]
Sep 10 17:41:06.649773 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.649741    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ckm2c"
Sep 10 17:41:06.652329 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.652289    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7jrjh"
Sep 10 17:41:06.652825 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.652796    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 10 17:41:06.652938 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.652919    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 10 17:41:06.653216 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.653198    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-ptr64\""
Sep 10 17:41:06.654832 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.654787    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gqqkd"
Sep 10 17:41:06.654832 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.654822    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-8gbqd\""
Sep 10 17:41:06.654996 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:06.654872    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gqqkd" podUID="1df8c233-a191-43e9-9d86-4a191bd54b1e"
Sep 10 17:41:06.655160 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.655135    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 10 17:41:06.655283 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.655135    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 10 17:41:06.655454 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.655427    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 10 17:41:06.657370 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.657300    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-76dl2"
Sep 10 17:41:06.657509 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:06.657413    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-76dl2" podUID="4f8b428e-98e7-4306-b485-d39e9b22eb05"
Sep 10 17:41:06.658946 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.658924    2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 10 17:41:06.659739 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.659713    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-p658s"
Sep 10 17:41:06.663369 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.663318    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-f9cn7"
Sep 10 17:41:06.665119 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.665094    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 10 17:41:06.665271 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.665193    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-qlqs7\""
Sep 10 17:41:06.665818 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.665795    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 10 17:41:06.666138 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.666083    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-t9bvv"
Sep 10 17:41:06.666138 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.666119    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 10 17:41:06.667189 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.667166    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 10 17:41:06.667315 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.667220    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 10 17:41:06.667582 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.667438    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-7pdqt\""
Sep 10 17:41:06.667945 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.667925    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 10 17:41:06.668063 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.668040    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 10 17:41:06.668359 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.668142    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 10 17:41:06.668359 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.668197    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 10 17:41:06.668760 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.668570    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 10 17:41:06.668850 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.668837    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hzw7d"
Sep 10 17:41:06.668913 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.668905    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-ksw5r\""
Sep 10 17:41:06.669039 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.668839    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 10 17:41:06.670126 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.670100    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/34c68fc5-ab82-428a-8c3b-be0d2850e064-host-slash\") pod \"iptables-alerter-p658s\" (UID: \"34c68fc5-ab82-428a-8c3b-be0d2850e064\") " pod="openshift-network-operator/iptables-alerter-p658s"
Sep 10 17:41:06.670244 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.670134    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcssz\" (UniqueName: \"kubernetes.io/projected/34c68fc5-ab82-428a-8c3b-be0d2850e064-kube-api-access-qcssz\") pod \"iptables-alerter-p658s\" (UID: \"34c68fc5-ab82-428a-8c3b-be0d2850e064\") " pod="openshift-network-operator/iptables-alerter-p658s"
Sep 10 17:41:06.670244 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.670175    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0b3f49f1-5b65-4f06-8421-d06019ee50ad-etc-sysconfig\") pod \"tuned-ckm2c\" (UID: \"0b3f49f1-5b65-4f06-8421-d06019ee50ad\") " pod="openshift-cluster-node-tuning-operator/tuned-ckm2c"
Sep 10 17:41:06.670244 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.670197    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0b3f49f1-5b65-4f06-8421-d06019ee50ad-run\") pod \"tuned-ckm2c\" (UID: \"0b3f49f1-5b65-4f06-8421-d06019ee50ad\") " pod="openshift-cluster-node-tuning-operator/tuned-ckm2c"
Sep 10 17:41:06.670244 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.670223    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrw75\" (UniqueName: \"kubernetes.io/projected/0b3f49f1-5b65-4f06-8421-d06019ee50ad-kube-api-access-xrw75\") pod \"tuned-ckm2c\" (UID: \"0b3f49f1-5b65-4f06-8421-d06019ee50ad\") " pod="openshift-cluster-node-tuning-operator/tuned-ckm2c"
Sep 10 17:41:06.670488 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.670282    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqv6v\" (UniqueName: \"kubernetes.io/projected/4f8b428e-98e7-4306-b485-d39e9b22eb05-kube-api-access-lqv6v\") pod \"network-metrics-daemon-76dl2\" (UID: \"4f8b428e-98e7-4306-b485-d39e9b22eb05\") " pod="openshift-multus/network-metrics-daemon-76dl2"
Sep 10 17:41:06.670488 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.670299    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0b3f49f1-5b65-4f06-8421-d06019ee50ad-host\") pod \"tuned-ckm2c\" (UID: \"0b3f49f1-5b65-4f06-8421-d06019ee50ad\") " pod="openshift-cluster-node-tuning-operator/tuned-ckm2c"
Sep 10 17:41:06.670488 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.670324    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0b3f49f1-5b65-4f06-8421-d06019ee50ad-etc-modprobe-d\") pod \"tuned-ckm2c\" (UID: \"0b3f49f1-5b65-4f06-8421-d06019ee50ad\") " pod="openshift-cluster-node-tuning-operator/tuned-ckm2c"
Sep 10 17:41:06.670488 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.670344    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0b3f49f1-5b65-4f06-8421-d06019ee50ad-etc-sysctl-d\") pod \"tuned-ckm2c\" (UID: \"0b3f49f1-5b65-4f06-8421-d06019ee50ad\") " pod="openshift-cluster-node-tuning-operator/tuned-ckm2c"
Sep 10 17:41:06.670488 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.670362    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0b3f49f1-5b65-4f06-8421-d06019ee50ad-lib-modules\") pod \"tuned-ckm2c\" (UID: \"0b3f49f1-5b65-4f06-8421-d06019ee50ad\") " pod="openshift-cluster-node-tuning-operator/tuned-ckm2c"
Sep 10 17:41:06.670488 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.670384    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0b3f49f1-5b65-4f06-8421-d06019ee50ad-var-lib-kubelet\") pod \"tuned-ckm2c\" (UID: \"0b3f49f1-5b65-4f06-8421-d06019ee50ad\") " pod="openshift-cluster-node-tuning-operator/tuned-ckm2c"
Sep 10 17:41:06.670793 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.670551    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clszt\" (UniqueName: \"kubernetes.io/projected/f45056e2-bd13-4829-a897-7cd4a829af0e-kube-api-access-clszt\") pod \"node-ca-7jrjh\" (UID: \"f45056e2-bd13-4829-a897-7cd4a829af0e\") " pod="openshift-image-registry/node-ca-7jrjh"
Sep 10 17:41:06.670793 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.670595    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0b3f49f1-5b65-4f06-8421-d06019ee50ad-etc-kubernetes\") pod \"tuned-ckm2c\" (UID: \"0b3f49f1-5b65-4f06-8421-d06019ee50ad\") " pod="openshift-cluster-node-tuning-operator/tuned-ckm2c"
Sep 10 17:41:06.670793 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.670610    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0b3f49f1-5b65-4f06-8421-d06019ee50ad-etc-sysctl-conf\") pod \"tuned-ckm2c\" (UID: \"0b3f49f1-5b65-4f06-8421-d06019ee50ad\") " pod="openshift-cluster-node-tuning-operator/tuned-ckm2c"
Sep 10 17:41:06.670793 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.670630    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0b3f49f1-5b65-4f06-8421-d06019ee50ad-etc-tuned\") pod \"tuned-ckm2c\" (UID: \"0b3f49f1-5b65-4f06-8421-d06019ee50ad\") " pod="openshift-cluster-node-tuning-operator/tuned-ckm2c"
Sep 10 17:41:06.670793 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.670658    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0b3f49f1-5b65-4f06-8421-d06019ee50ad-tmp\") pod \"tuned-ckm2c\" (UID: \"0b3f49f1-5b65-4f06-8421-d06019ee50ad\") " pod="openshift-cluster-node-tuning-operator/tuned-ckm2c"
Sep 10 17:41:06.670793 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.670676    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f45056e2-bd13-4829-a897-7cd4a829af0e-host\") pod \"node-ca-7jrjh\" (UID: \"f45056e2-bd13-4829-a897-7cd4a829af0e\") " pod="openshift-image-registry/node-ca-7jrjh"
Sep 10 17:41:06.670793 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.670717    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1df8c233-a191-43e9-9d86-4a191bd54b1e-dbus\") pod \"global-pull-secret-syncer-gqqkd\" (UID: \"1df8c233-a191-43e9-9d86-4a191bd54b1e\") " pod="kube-system/global-pull-secret-syncer-gqqkd"
Sep 10 17:41:06.670793 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.670741    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1df8c233-a191-43e9-9d86-4a191bd54b1e-original-pull-secret\") pod \"global-pull-secret-syncer-gqqkd\" (UID: \"1df8c233-a191-43e9-9d86-4a191bd54b1e\") " pod="kube-system/global-pull-secret-syncer-gqqkd"
Sep 10 17:41:06.671209 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.670761    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4f8b428e-98e7-4306-b485-d39e9b22eb05-metrics-certs\") pod \"network-metrics-daemon-76dl2\" (UID: \"4f8b428e-98e7-4306-b485-d39e9b22eb05\") " pod="openshift-multus/network-metrics-daemon-76dl2"
Sep 10 17:41:06.671209 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.671126    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0b3f49f1-5b65-4f06-8421-d06019ee50ad-etc-systemd\") pod \"tuned-ckm2c\" (UID: \"0b3f49f1-5b65-4f06-8421-d06019ee50ad\") " pod="openshift-cluster-node-tuning-operator/tuned-ckm2c"
Sep 10 17:41:06.671209 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.671176    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0b3f49f1-5b65-4f06-8421-d06019ee50ad-sys\") pod \"tuned-ckm2c\" (UID: \"0b3f49f1-5b65-4f06-8421-d06019ee50ad\") " pod="openshift-cluster-node-tuning-operator/tuned-ckm2c"
Sep 10 17:41:06.671209 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.671205    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f45056e2-bd13-4829-a897-7cd4a829af0e-serviceca\") pod \"node-ca-7jrjh\" (UID: \"f45056e2-bd13-4829-a897-7cd4a829af0e\") " pod="openshift-image-registry/node-ca-7jrjh"
Sep 10 17:41:06.671436 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.671243    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1df8c233-a191-43e9-9d86-4a191bd54b1e-kubelet-config\") pod \"global-pull-secret-syncer-gqqkd\" (UID: \"1df8c233-a191-43e9-9d86-4a191bd54b1e\") " pod="kube-system/global-pull-secret-syncer-gqqkd"
Sep 10 17:41:06.671436 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.671280    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/34c68fc5-ab82-428a-8c3b-be0d2850e064-iptables-alerter-script\") pod \"iptables-alerter-p658s\" (UID: \"34c68fc5-ab82-428a-8c3b-be0d2850e064\") " pod="openshift-network-operator/iptables-alerter-p658s"
Sep 10 17:41:06.671741 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.671713    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-kchp5\""
Sep 10 17:41:06.672148 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.672121    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 10 17:41:06.672294 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.672269    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 10 17:41:06.672356 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.672306    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 10 17:41:06.674429 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.674398    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cz2hn"
Sep 10 17:41:06.674655 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.674635    2568 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 10 17:41:06.677585 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.677559    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 10 17:41:06.677925 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.677899    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-4tpvn\""
Sep 10 17:41:06.678033 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.677937    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 10 17:41:06.678203 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.678099    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 10 17:41:06.678258 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.678241    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 10 17:41:06.678831 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.678804    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dwtws"
Sep 10 17:41:06.681568 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.681544    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-47zt4\""
Sep 10 17:41:06.681793 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.681770    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 10 17:41:06.681881 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.681770    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 10 17:41:06.682124 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.682095    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8xsvx"
Sep 10 17:41:06.684447 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.684425    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w5htf"
Sep 10 17:41:06.684573 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:06.684514    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w5htf" podUID="fc857d7e-aafa-4018-aeb4-84f423bb5337"
Sep 10 17:41:06.684866 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.684834    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-cnfmh\""
Sep 10 17:41:06.684990 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.684905    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 10 17:41:06.684990 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.684969    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 10 17:41:06.706452 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.706418    2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-hxngq"
Sep 10 17:41:06.714850 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.714813    2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-hxngq"
Sep 10 17:41:06.761108 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.761076    2568 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 10 17:41:06.770132 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.770070    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-161.ec2.internal" event={"ID":"67b1785819731aadf4d3323928534cad","Type":"ContainerStarted","Data":"4499f4af111afa8d78f6b236e8c71406ea206d77cdfbbf2311ecf32880d1b38e"}
Sep 10 17:41:06.771558 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.771529    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/64722621-3413-45b1-be7b-7a9a5a075215-cnibin\") pod \"multus-cz2hn\" (UID: \"64722621-3413-45b1-be7b-7a9a5a075215\") " pod="openshift-multus/multus-cz2hn"
Sep 10 17:41:06.771710 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.771572    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/64722621-3413-45b1-be7b-7a9a5a075215-host-var-lib-cni-bin\") pod \"multus-cz2hn\" (UID: \"64722621-3413-45b1-be7b-7a9a5a075215\") " pod="openshift-multus/multus-cz2hn"
Sep 10 17:41:06.771710 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.771606    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0b3f49f1-5b65-4f06-8421-d06019ee50ad-etc-sysctl-d\") pod \"tuned-ckm2c\" (UID: \"0b3f49f1-5b65-4f06-8421-d06019ee50ad\") " pod="openshift-cluster-node-tuning-operator/tuned-ckm2c"
Sep 10 17:41:06.771710 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.771634    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/17c92bd6-66da-44c1-aa62-b095d15cdc12-etc-selinux\") pod \"aws-ebs-csi-driver-node-hzw7d\" (UID: \"17c92bd6-66da-44c1-aa62-b095d15cdc12\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hzw7d"
Sep 10 17:41:06.771710 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.771659    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/64722621-3413-45b1-be7b-7a9a5a075215-etc-kubernetes\") pod \"multus-cz2hn\" (UID: \"64722621-3413-45b1-be7b-7a9a5a075215\") " pod="openshift-multus/multus-cz2hn"
Sep 10 17:41:06.771710 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.771690    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/915faba9-e43b-4bdf-ab08-6063e393da6e-node-log\") pod \"ovnkube-node-f9cn7\" (UID: \"915faba9-e43b-4bdf-ab08-6063e393da6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9cn7"
Sep 10 17:41:06.771883 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.771728    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/915faba9-e43b-4bdf-ab08-6063e393da6e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-f9cn7\" (UID: \"915faba9-e43b-4bdf-ab08-6063e393da6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9cn7"
Sep 10 17:41:06.771883 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.771758    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/915faba9-e43b-4bdf-ab08-6063e393da6e-ovnkube-config\") pod \"ovnkube-node-f9cn7\" (UID: \"915faba9-e43b-4bdf-ab08-6063e393da6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9cn7"
Sep 10 17:41:06.771883 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.771781    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/915faba9-e43b-4bdf-ab08-6063e393da6e-ovn-node-metrics-cert\") pod \"ovnkube-node-f9cn7\" (UID: \"915faba9-e43b-4bdf-ab08-6063e393da6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9cn7"
Sep 10 17:41:06.771883 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.771807    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b76cw\" (UniqueName: \"kubernetes.io/projected/915faba9-e43b-4bdf-ab08-6063e393da6e-kube-api-access-b76cw\") pod \"ovnkube-node-f9cn7\" (UID: \"915faba9-e43b-4bdf-ab08-6063e393da6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9cn7"
Sep 10 17:41:06.771883 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.771841    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0b3f49f1-5b65-4f06-8421-d06019ee50ad-etc-tuned\") pod \"tuned-ckm2c\" (UID: \"0b3f49f1-5b65-4f06-8421-d06019ee50ad\") " pod="openshift-cluster-node-tuning-operator/tuned-ckm2c"
Sep 10 17:41:06.771883 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.771866    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/64722621-3413-45b1-be7b-7a9a5a075215-hostroot\") pod \"multus-cz2hn\" (UID: \"64722621-3413-45b1-be7b-7a9a5a075215\") " pod="openshift-multus/multus-cz2hn"
Sep 10 17:41:06.772056 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.771891    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/01467fcf-2ddb-42da-812a-964dc8a1504f-tmp-dir\") pod \"node-resolver-dwtws\" (UID: \"01467fcf-2ddb-42da-812a-964dc8a1504f\") " pod="openshift-dns/node-resolver-dwtws"
Sep 10 17:41:06.772056 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.771923    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/64722621-3413-45b1-be7b-7a9a5a075215-multus-socket-dir-parent\") pod \"multus-cz2hn\" (UID: \"64722621-3413-45b1-be7b-7a9a5a075215\") " pod="openshift-multus/multus-cz2hn"
Sep 10 17:41:06.772056 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.771949    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/64722621-3413-45b1-be7b-7a9a5a075215-host-run-k8s-cni-cncf-io\") pod \"multus-cz2hn\" (UID: \"64722621-3413-45b1-be7b-7a9a5a075215\") " pod="openshift-multus/multus-cz2hn"
Sep 10 17:41:06.772056 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.771974    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/915faba9-e43b-4bdf-ab08-6063e393da6e-host-run-ovn-kubernetes\") pod \"ovnkube-node-f9cn7\" (UID: \"915faba9-e43b-4bdf-ab08-6063e393da6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9cn7"
Sep 10 17:41:06.772056 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.771999    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/915faba9-e43b-4bdf-ab08-6063e393da6e-host-cni-bin\") pod \"ovnkube-node-f9cn7\" (UID: \"915faba9-e43b-4bdf-ab08-6063e393da6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9cn7"
Sep 10 17:41:06.772056 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.772026    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/915faba9-e43b-4bdf-ab08-6063e393da6e-host-cni-netd\") pod \"ovnkube-node-f9cn7\" (UID: \"915faba9-e43b-4bdf-ab08-6063e393da6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9cn7"
Sep 10 17:41:06.772233 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.772057    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/774f7882-94da-4a71-a091-32054dc8d27c-cni-binary-copy\") pod \"multus-additional-cni-plugins-8xsvx\" (UID: \"774f7882-94da-4a71-a091-32054dc8d27c\") " pod="openshift-multus/multus-additional-cni-plugins-8xsvx"
Sep 10 17:41:06.772233 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.772091    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/64722621-3413-45b1-be7b-7a9a5a075215-host-var-lib-cni-multus\") pod \"multus-cz2hn\" (UID: \"64722621-3413-45b1-be7b-7a9a5a075215\") " pod="openshift-multus/multus-cz2hn"
Sep 10 17:41:06.772233 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.772118    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/915faba9-e43b-4bdf-ab08-6063e393da6e-run-openvswitch\") pod \"ovnkube-node-f9cn7\" (UID: \"915faba9-e43b-4bdf-ab08-6063e393da6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9cn7"
Sep 10 17:41:06.772233 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.772146    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0b3f49f1-5b65-4f06-8421-d06019ee50ad-etc-modprobe-d\") pod \"tuned-ckm2c\" (UID: \"0b3f49f1-5b65-4f06-8421-d06019ee50ad\") " pod="openshift-cluster-node-tuning-operator/tuned-ckm2c"
Sep 10 17:41:06.772233 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.772174    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1df8c233-a191-43e9-9d86-4a191bd54b1e-dbus\") pod \"global-pull-secret-syncer-gqqkd\" (UID: \"1df8c233-a191-43e9-9d86-4a191bd54b1e\") " pod="kube-system/global-pull-secret-syncer-gqqkd"
Sep 10 17:41:06.772233 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.772201    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4f8b428e-98e7-4306-b485-d39e9b22eb05-metrics-certs\") pod \"network-metrics-daemon-76dl2\" (UID: \"4f8b428e-98e7-4306-b485-d39e9b22eb05\") " pod="openshift-multus/network-metrics-daemon-76dl2"
Sep 10 17:41:06.772233 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.772227    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0b3f49f1-5b65-4f06-8421-d06019ee50ad-etc-sysctl-conf\") pod \"tuned-ckm2c\" (UID: \"0b3f49f1-5b65-4f06-8421-d06019ee50ad\") " pod="openshift-cluster-node-tuning-operator/tuned-ckm2c"
Sep 10 17:41:06.772463 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.772252    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/17c92bd6-66da-44c1-aa62-b095d15cdc12-socket-dir\") pod \"aws-ebs-csi-driver-node-hzw7d\" (UID: \"17c92bd6-66da-44c1-aa62-b095d15cdc12\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hzw7d"
Sep 10 17:41:06.772463 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.772288    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/64722621-3413-45b1-be7b-7a9a5a075215-host-var-lib-kubelet\") pod \"multus-cz2hn\" (UID: \"64722621-3413-45b1-be7b-7a9a5a075215\") " pod="openshift-multus/multus-cz2hn"
Sep 10 17:41:06.772463 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.772314    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/64722621-3413-45b1-be7b-7a9a5a075215-multus-conf-dir\") pod \"multus-cz2hn\" (UID: \"64722621-3413-45b1-be7b-7a9a5a075215\") " pod="openshift-multus/multus-cz2hn"
Sep 10 17:41:06.772463 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.772339    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/915faba9-e43b-4bdf-ab08-6063e393da6e-host-run-netns\") pod \"ovnkube-node-f9cn7\" (UID: \"915faba9-e43b-4bdf-ab08-6063e393da6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9cn7"
Sep 10 17:41:06.772463 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.772364    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vgdr\" (UniqueName: \"kubernetes.io/projected/fc857d7e-aafa-4018-aeb4-84f423bb5337-kube-api-access-7vgdr\") pod \"network-check-target-w5htf\" (UID: \"fc857d7e-aafa-4018-aeb4-84f423bb5337\") " pod="openshift-network-diagnostics/network-check-target-w5htf"
Sep 10 17:41:06.772463 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.772410    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f45056e2-bd13-4829-a897-7cd4a829af0e-serviceca\") pod \"node-ca-7jrjh\" (UID: \"f45056e2-bd13-4829-a897-7cd4a829af0e\") " pod="openshift-image-registry/node-ca-7jrjh"
Sep 10 17:41:06.772463 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.772437    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1df8c233-a191-43e9-9d86-4a191bd54b1e-kubelet-config\") pod \"global-pull-secret-syncer-gqqkd\" (UID: \"1df8c233-a191-43e9-9d86-4a191bd54b1e\") " pod="kube-system/global-pull-secret-syncer-gqqkd"
Sep 10 17:41:06.772671 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.772465    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/34c68fc5-ab82-428a-8c3b-be0d2850e064-host-slash\") pod \"iptables-alerter-p658s\" (UID: \"34c68fc5-ab82-428a-8c3b-be0d2850e064\") " pod="openshift-network-operator/iptables-alerter-p658s"
Sep 10 17:41:06.772671 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.772497    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w26gp\" (UniqueName: \"kubernetes.io/projected/64722621-3413-45b1-be7b-7a9a5a075215-kube-api-access-w26gp\") pod \"multus-cz2hn\" (UID: \"64722621-3413-45b1-be7b-7a9a5a075215\") " pod="openshift-multus/multus-cz2hn"
Sep 10 17:41:06.772671 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.772527    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/774f7882-94da-4a71-a091-32054dc8d27c-cnibin\") pod \"multus-additional-cni-plugins-8xsvx\" (UID: \"774f7882-94da-4a71-a091-32054dc8d27c\") " pod="openshift-multus/multus-additional-cni-plugins-8xsvx"
Sep 10 17:41:06.772671 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.772564    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrw75\" (UniqueName: \"kubernetes.io/projected/0b3f49f1-5b65-4f06-8421-d06019ee50ad-kube-api-access-xrw75\") pod \"tuned-ckm2c\" (UID: \"0b3f49f1-5b65-4f06-8421-d06019ee50ad\") " pod="openshift-cluster-node-tuning-operator/tuned-ckm2c"
Sep 10 17:41:06.772671 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.772572    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-161.ec2.internal" event={"ID":"14fa913fd221d63bd218ae72b03b88e8","Type":"ContainerStarted","Data":"4d07e04bfa873a9960309994ed0575dd19177ac35e6353c9696b23841ee591a5"}
Sep 10 17:41:06.772671 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.772593    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/64722621-3413-45b1-be7b-7a9a5a075215-multus-daemon-config\") pod \"multus-cz2hn\" (UID: \"64722621-3413-45b1-be7b-7a9a5a075215\") " pod="openshift-multus/multus-cz2hn"
Sep 10 17:41:06.772671 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.772633    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/915faba9-e43b-4bdf-ab08-6063e393da6e-systemd-units\") pod \"ovnkube-node-f9cn7\" (UID: \"915faba9-e43b-4bdf-ab08-6063e393da6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9cn7"
Sep 10 17:41:06.773015 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.772661    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/774f7882-94da-4a71-a091-32054dc8d27c-system-cni-dir\") pod \"multus-additional-cni-plugins-8xsvx\" (UID: \"774f7882-94da-4a71-a091-32054dc8d27c\") " pod="openshift-multus/multus-additional-cni-plugins-8xsvx"
Sep 10 17:41:06.773015 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.772703    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/774f7882-94da-4a71-a091-32054dc8d27c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8xsvx\" (UID: \"774f7882-94da-4a71-a091-32054dc8d27c\") " pod="openshift-multus/multus-additional-cni-plugins-8xsvx"
Sep 10 17:41:06.773015 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.772755    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0b3f49f1-5b65-4f06-8421-d06019ee50ad-host\") pod \"tuned-ckm2c\" (UID: \"0b3f49f1-5b65-4f06-8421-d06019ee50ad\") " pod="openshift-cluster-node-tuning-operator/tuned-ckm2c"
Sep 10 17:41:06.773015 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.772966    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1df8c233-a191-43e9-9d86-4a191bd54b1e-kubelet-config\") pod \"global-pull-secret-syncer-gqqkd\" (UID: \"1df8c233-a191-43e9-9d86-4a191bd54b1e\") " pod="kube-system/global-pull-secret-syncer-gqqkd"
Sep 10 17:41:06.773213 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.773010    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/34c68fc5-ab82-428a-8c3b-be0d2850e064-host-slash\") pod \"iptables-alerter-p658s\" (UID: \"34c68fc5-ab82-428a-8c3b-be0d2850e064\") " pod="openshift-network-operator/iptables-alerter-p658s"
Sep 10 17:41:06.773213 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.773036    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0b3f49f1-5b65-4f06-8421-d06019ee50ad-etc-modprobe-d\") pod \"tuned-ckm2c\" (UID: \"0b3f49f1-5b65-4f06-8421-d06019ee50ad\") " pod="openshift-cluster-node-tuning-operator/tuned-ckm2c"
Sep 10 17:41:06.773213 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.773104    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1df8c233-a191-43e9-9d86-4a191bd54b1e-dbus\") pod \"global-pull-secret-syncer-gqqkd\" (UID: \"1df8c233-a191-43e9-9d86-4a191bd54b1e\") " pod="kube-system/global-pull-secret-syncer-gqqkd"
Sep 10 17:41:06.773213 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.773146    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0b3f49f1-5b65-4f06-8421-d06019ee50ad-lib-modules\") pod \"tuned-ckm2c\" (UID: \"0b3f49f1-5b65-4f06-8421-d06019ee50ad\") " pod="openshift-cluster-node-tuning-operator/tuned-ckm2c"
Sep 10 17:41:06.773213 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.773181    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0b3f49f1-5b65-4f06-8421-d06019ee50ad-var-lib-kubelet\") pod \"tuned-ckm2c\" (UID: \"0b3f49f1-5b65-4f06-8421-d06019ee50ad\") " pod="openshift-cluster-node-tuning-operator/tuned-ckm2c"
Sep 10 17:41:06.773213 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.773210    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/64722621-3413-45b1-be7b-7a9a5a075215-cni-binary-copy\") pod \"multus-cz2hn\" (UID: \"64722621-3413-45b1-be7b-7a9a5a075215\") " pod="openshift-multus/multus-cz2hn"
Sep 10 17:41:06.773542 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.773256    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0b3f49f1-5b65-4f06-8421-d06019ee50ad-etc-kubernetes\") pod \"tuned-ckm2c\" (UID: \"0b3f49f1-5b65-4f06-8421-d06019ee50ad\") " pod="openshift-cluster-node-tuning-operator/tuned-ckm2c"
Sep 10 17:41:06.773542 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.773281    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f45056e2-bd13-4829-a897-7cd4a829af0e-host\") pod \"node-ca-7jrjh\" (UID: \"f45056e2-bd13-4829-a897-7cd4a829af0e\") " pod="openshift-image-registry/node-ca-7jrjh"
Sep 10 17:41:06.773542 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.773310    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcssz\" (UniqueName: \"kubernetes.io/projected/34c68fc5-ab82-428a-8c3b-be0d2850e064-kube-api-access-qcssz\") pod \"iptables-alerter-p658s\" (UID: \"34c68fc5-ab82-428a-8c3b-be0d2850e064\") " pod="openshift-network-operator/iptables-alerter-p658s"
Sep 10 17:41:06.773542 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.773340    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/17c92bd6-66da-44c1-aa62-b095d15cdc12-registration-dir\") pod \"aws-ebs-csi-driver-node-hzw7d\" (UID: \"17c92bd6-66da-44c1-aa62-b095d15cdc12\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hzw7d"
Sep 10 17:41:06.773542 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.773368    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/915faba9-e43b-4bdf-ab08-6063e393da6e-host-kubelet\") pod \"ovnkube-node-f9cn7\" (UID: \"915faba9-e43b-4bdf-ab08-6063e393da6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9cn7"
Sep 10 17:41:06.773542 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.773415    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0b3f49f1-5b65-4f06-8421-d06019ee50ad-sys\") pod \"tuned-ckm2c\" (UID: \"0b3f49f1-5b65-4f06-8421-d06019ee50ad\") " pod="openshift-cluster-node-tuning-operator/tuned-ckm2c"
Sep 10 17:41:06.773542 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.773445    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/34c68fc5-ab82-428a-8c3b-be0d2850e064-iptables-alerter-script\") pod \"iptables-alerter-p658s\" (UID: \"34c68fc5-ab82-428a-8c3b-be0d2850e064\") " pod="openshift-network-operator/iptables-alerter-p658s"
Sep 10 17:41:06.773542 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.773473    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/17c92bd6-66da-44c1-aa62-b095d15cdc12-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hzw7d\" (UID: \"17c92bd6-66da-44c1-aa62-b095d15cdc12\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hzw7d"
Sep 10 17:41:06.773542 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.773500    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/17c92bd6-66da-44c1-aa62-b095d15cdc12-device-dir\") pod \"aws-ebs-csi-driver-node-hzw7d\" (UID: \"17c92bd6-66da-44c1-aa62-b095d15cdc12\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hzw7d"
Sep 10 17:41:06.773542 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.773532    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/915faba9-e43b-4bdf-ab08-6063e393da6e-log-socket\") pod \"ovnkube-node-f9cn7\" (UID: \"915faba9-e43b-4bdf-ab08-6063e393da6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9cn7"
Sep 10 17:41:06.774035 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.773561    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-md9zc\" (UniqueName: \"kubernetes.io/projected/774f7882-94da-4a71-a091-32054dc8d27c-kube-api-access-md9zc\") pod \"multus-additional-cni-plugins-8xsvx\" (UID: \"774f7882-94da-4a71-a091-32054dc8d27c\") " pod="openshift-multus/multus-additional-cni-plugins-8xsvx"
Sep 10 17:41:06.774035 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.773590    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0b3f49f1-5b65-4f06-8421-d06019ee50ad-run\") pod \"tuned-ckm2c\" (UID: \"0b3f49f1-5b65-4f06-8421-d06019ee50ad\") " pod="openshift-cluster-node-tuning-operator/tuned-ckm2c"
Sep 10 17:41:06.774035 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.773618    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqv6v\" (UniqueName: \"kubernetes.io/projected/4f8b428e-98e7-4306-b485-d39e9b22eb05-kube-api-access-lqv6v\") pod \"network-metrics-daemon-76dl2\" (UID: \"4f8b428e-98e7-4306-b485-d39e9b22eb05\") " pod="openshift-multus/network-metrics-daemon-76dl2"
Sep 10 17:41:06.774035 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.773647    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bdb7b7f1-3f2e-4c52-917e-c428b50fcbcf-konnectivity-ca\") pod \"konnectivity-agent-t9bvv\" (UID: \"bdb7b7f1-3f2e-4c52-917e-c428b50fcbcf\") " pod="kube-system/konnectivity-agent-t9bvv"
Sep 10 17:41:06.774035 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.773806    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/64722621-3413-45b1-be7b-7a9a5a075215-multus-cni-dir\") pod \"multus-cz2hn\" (UID: \"64722621-3413-45b1-be7b-7a9a5a075215\") " pod="openshift-multus/multus-cz2hn"
Sep 10 17:41:06.774035 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.773837    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/64722621-3413-45b1-be7b-7a9a5a075215-host-run-multus-certs\") pod \"multus-cz2hn\" (UID: \"64722621-3413-45b1-be7b-7a9a5a075215\") " pod="openshift-multus/multus-cz2hn"
Sep 10 17:41:06.774035 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.773868    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qq6j4\" (UniqueName: \"kubernetes.io/projected/01467fcf-2ddb-42da-812a-964dc8a1504f-kube-api-access-qq6j4\") pod \"node-resolver-dwtws\" (UID: \"01467fcf-2ddb-42da-812a-964dc8a1504f\") " pod="openshift-dns/node-resolver-dwtws"
Sep 10 17:41:06.774035 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.773907    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/774f7882-94da-4a71-a091-32054dc8d27c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8xsvx\" (UID: \"774f7882-94da-4a71-a091-32054dc8d27c\") " pod="openshift-multus/multus-additional-cni-plugins-8xsvx"
Sep 10 17:41:06.774035 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.773942    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clszt\" (UniqueName: \"kubernetes.io/projected/f45056e2-bd13-4829-a897-7cd4a829af0e-kube-api-access-clszt\") pod \"node-ca-7jrjh\" (UID: \"f45056e2-bd13-4829-a897-7cd4a829af0e\") " pod="openshift-image-registry/node-ca-7jrjh"
Sep 10 17:41:06.774035 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.773971    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/17c92bd6-66da-44c1-aa62-b095d15cdc12-sys-fs\") pod \"aws-ebs-csi-driver-node-hzw7d\" (UID: \"17c92bd6-66da-44c1-aa62-b095d15cdc12\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hzw7d"
Sep 10 17:41:06.774035 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.773999    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xsmmv\" (UniqueName: \"kubernetes.io/projected/17c92bd6-66da-44c1-aa62-b095d15cdc12-kube-api-access-xsmmv\") pod \"aws-ebs-csi-driver-node-hzw7d\" (UID: \"17c92bd6-66da-44c1-aa62-b095d15cdc12\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hzw7d"
Sep 10 17:41:06.774035 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.774030    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/915faba9-e43b-4bdf-ab08-6063e393da6e-run-systemd\") pod \"ovnkube-node-f9cn7\" (UID: \"915faba9-e43b-4bdf-ab08-6063e393da6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9cn7"
Sep 10 17:41:06.774663 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.774060    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/915faba9-e43b-4bdf-ab08-6063e393da6e-var-lib-openvswitch\") pod \"ovnkube-node-f9cn7\" (UID: \"915faba9-e43b-4bdf-ab08-6063e393da6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9cn7"
Sep 10 17:41:06.774663 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.774090    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/915faba9-e43b-4bdf-ab08-6063e393da6e-env-overrides\") pod \"ovnkube-node-f9cn7\" (UID: \"915faba9-e43b-4bdf-ab08-6063e393da6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9cn7"
Sep 10 17:41:06.774663 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.774118    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/01467fcf-2ddb-42da-812a-964dc8a1504f-hosts-file\") pod \"node-resolver-dwtws\" (UID: \"01467fcf-2ddb-42da-812a-964dc8a1504f\") " pod="openshift-dns/node-resolver-dwtws"
Sep 10 17:41:06.774663 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.774183    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0b3f49f1-5b65-4f06-8421-d06019ee50ad-tmp\") pod \"tuned-ckm2c\" (UID: \"0b3f49f1-5b65-4f06-8421-d06019ee50ad\") " pod="openshift-cluster-node-tuning-operator/tuned-ckm2c"
Sep 10 17:41:06.774663 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.774227    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1df8c233-a191-43e9-9d86-4a191bd54b1e-original-pull-secret\") pod \"global-pull-secret-syncer-gqqkd\" (UID: \"1df8c233-a191-43e9-9d86-4a191bd54b1e\") " pod="kube-system/global-pull-secret-syncer-gqqkd"
Sep 10 17:41:06.774663 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.774264    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/64722621-3413-45b1-be7b-7a9a5a075215-host-run-netns\") pod \"multus-cz2hn\" (UID: \"64722621-3413-45b1-be7b-7a9a5a075215\") " pod="openshift-multus/multus-cz2hn"
Sep 10 17:41:06.774663 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.774302    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/915faba9-e43b-4bdf-ab08-6063e393da6e-ovnkube-script-lib\") pod \"ovnkube-node-f9cn7\" (UID: \"915faba9-e43b-4bdf-ab08-6063e393da6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9cn7"
Sep 10 17:41:06.774663 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.774333    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0b3f49f1-5b65-4f06-8421-d06019ee50ad-etc-systemd\") pod \"tuned-ckm2c\" (UID: \"0b3f49f1-5b65-4f06-8421-d06019ee50ad\") " pod="openshift-cluster-node-tuning-operator/tuned-ckm2c"
Sep 10 17:41:06.774663 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.774360    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/915faba9-e43b-4bdf-ab08-6063e393da6e-host-slash\") pod \"ovnkube-node-f9cn7\" (UID: \"915faba9-e43b-4bdf-ab08-6063e393da6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9cn7"
Sep 10 17:41:06.774663 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.774390    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/915faba9-e43b-4bdf-ab08-6063e393da6e-etc-openvswitch\") pod \"ovnkube-node-f9cn7\" (UID: \"915faba9-e43b-4bdf-ab08-6063e393da6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9cn7"
Sep 10 17:41:06.774663 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.774435    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/915faba9-e43b-4bdf-ab08-6063e393da6e-run-ovn\") pod \"ovnkube-node-f9cn7\" (UID: \"915faba9-e43b-4bdf-ab08-6063e393da6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9cn7"
Sep 10 17:41:06.774663 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.774463    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/774f7882-94da-4a71-a091-32054dc8d27c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8xsvx\" (UID: \"774f7882-94da-4a71-a091-32054dc8d27c\") " pod="openshift-multus/multus-additional-cni-plugins-8xsvx"
Sep 10 17:41:06.774663 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.774492    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0b3f49f1-5b65-4f06-8421-d06019ee50ad-etc-sysconfig\") pod \"tuned-ckm2c\" (UID: \"0b3f49f1-5b65-4f06-8421-d06019ee50ad\") " pod="openshift-cluster-node-tuning-operator/tuned-ckm2c"
Sep 10 17:41:06.774663 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.774521    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bdb7b7f1-3f2e-4c52-917e-c428b50fcbcf-agent-certs\") pod \"konnectivity-agent-t9bvv\" (UID: \"bdb7b7f1-3f2e-4c52-917e-c428b50fcbcf\") " pod="kube-system/konnectivity-agent-t9bvv"
Sep 10 17:41:06.774663 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.774550    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/64722621-3413-45b1-be7b-7a9a5a075215-system-cni-dir\") pod \"multus-cz2hn\" (UID: \"64722621-3413-45b1-be7b-7a9a5a075215\") " pod="openshift-multus/multus-cz2hn"
Sep 10 17:41:06.775534 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.774660    2568 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 10 17:41:06.775534 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.774682    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0b3f49f1-5b65-4f06-8421-d06019ee50ad-host\") pod \"tuned-ckm2c\" (UID: \"0b3f49f1-5b65-4f06-8421-d06019ee50ad\") " pod="openshift-cluster-node-tuning-operator/tuned-ckm2c"
Sep 10 17:41:06.775534 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:06.774786    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 17:41:06.775534 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:06.774875    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f8b428e-98e7-4306-b485-d39e9b22eb05-metrics-certs podName:4f8b428e-98e7-4306-b485-d39e9b22eb05 nodeName:}" failed. No retries permitted until 2026-09-10 17:41:07.274835573 +0000 UTC m=+3.036143601 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4f8b428e-98e7-4306-b485-d39e9b22eb05-metrics-certs") pod "network-metrics-daemon-76dl2" (UID: "4f8b428e-98e7-4306-b485-d39e9b22eb05") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 17:41:06.775534 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.775200    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0b3f49f1-5b65-4f06-8421-d06019ee50ad-etc-sysctl-conf\") pod \"tuned-ckm2c\" (UID: \"0b3f49f1-5b65-4f06-8421-d06019ee50ad\") " pod="openshift-cluster-node-tuning-operator/tuned-ckm2c"
Sep 10 17:41:06.775534 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.775329    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0b3f49f1-5b65-4f06-8421-d06019ee50ad-etc-sysctl-d\") pod \"tuned-ckm2c\" (UID: \"0b3f49f1-5b65-4f06-8421-d06019ee50ad\") " pod="openshift-cluster-node-tuning-operator/tuned-ckm2c"
Sep 10 17:41:06.775534 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.775464    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0b3f49f1-5b65-4f06-8421-d06019ee50ad-lib-modules\") pod \"tuned-ckm2c\" (UID: \"0b3f49f1-5b65-4f06-8421-d06019ee50ad\") " pod="openshift-cluster-node-tuning-operator/tuned-ckm2c"
Sep 10 17:41:06.775534 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.775517    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0b3f49f1-5b65-4f06-8421-d06019ee50ad-var-lib-kubelet\") pod \"tuned-ckm2c\" (UID: \"0b3f49f1-5b65-4f06-8421-d06019ee50ad\") " pod="openshift-cluster-node-tuning-operator/tuned-ckm2c"
Sep 10 17:41:06.775967 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.775565    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0b3f49f1-5b65-4f06-8421-d06019ee50ad-etc-kubernetes\") pod \"tuned-ckm2c\" (UID: \"0b3f49f1-5b65-4f06-8421-d06019ee50ad\") " pod="openshift-cluster-node-tuning-operator/tuned-ckm2c"
Sep 10 17:41:06.775967 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.775604    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f45056e2-bd13-4829-a897-7cd4a829af0e-host\") pod \"node-ca-7jrjh\" (UID: \"f45056e2-bd13-4829-a897-7cd4a829af0e\") " pod="openshift-image-registry/node-ca-7jrjh"
Sep 10 17:41:06.775967 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.775894    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0b3f49f1-5b65-4f06-8421-d06019ee50ad-sys\") pod \"tuned-ckm2c\" (UID: \"0b3f49f1-5b65-4f06-8421-d06019ee50ad\") " pod="openshift-cluster-node-tuning-operator/tuned-ckm2c"
Sep 10 17:41:06.776568 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.776541    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/34c68fc5-ab82-428a-8c3b-be0d2850e064-iptables-alerter-script\") pod \"iptables-alerter-p658s\" (UID: \"34c68fc5-ab82-428a-8c3b-be0d2850e064\") " pod="openshift-network-operator/iptables-alerter-p658s"
Sep 10 17:41:06.776673 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.776648    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0b3f49f1-5b65-4f06-8421-d06019ee50ad-run\") pod \"tuned-ckm2c\" (UID: \"0b3f49f1-5b65-4f06-8421-d06019ee50ad\") " pod="openshift-cluster-node-tuning-operator/tuned-ckm2c"
Sep 10 17:41:06.777650 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:06.777609    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 17:41:06.777756 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.777737    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0b3f49f1-5b65-4f06-8421-d06019ee50ad-etc-systemd\") pod \"tuned-ckm2c\" (UID: \"0b3f49f1-5b65-4f06-8421-d06019ee50ad\") " pod="openshift-cluster-node-tuning-operator/tuned-ckm2c"
Sep 10 17:41:06.777864 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:06.777838    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1df8c233-a191-43e9-9d86-4a191bd54b1e-original-pull-secret podName:1df8c233-a191-43e9-9d86-4a191bd54b1e nodeName:}" failed. No retries permitted until 2026-09-10 17:41:07.277816978 +0000 UTC m=+3.039125009 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1df8c233-a191-43e9-9d86-4a191bd54b1e-original-pull-secret") pod "global-pull-secret-syncer-gqqkd" (UID: "1df8c233-a191-43e9-9d86-4a191bd54b1e") : object "kube-system"/"original-pull-secret" not registered
Sep 10 17:41:06.778603 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.778579    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0b3f49f1-5b65-4f06-8421-d06019ee50ad-etc-sysconfig\") pod \"tuned-ckm2c\" (UID: \"0b3f49f1-5b65-4f06-8421-d06019ee50ad\") " pod="openshift-cluster-node-tuning-operator/tuned-ckm2c"
Sep 10 17:41:06.778926 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.778906    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f45056e2-bd13-4829-a897-7cd4a829af0e-serviceca\") pod \"node-ca-7jrjh\" (UID: \"f45056e2-bd13-4829-a897-7cd4a829af0e\") " pod="openshift-image-registry/node-ca-7jrjh"
Sep 10 17:41:06.779296 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.779273    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0b3f49f1-5b65-4f06-8421-d06019ee50ad-etc-tuned\") pod \"tuned-ckm2c\" (UID: \"0b3f49f1-5b65-4f06-8421-d06019ee50ad\") " pod="openshift-cluster-node-tuning-operator/tuned-ckm2c"
Sep 10 17:41:06.782736 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.782560    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0b3f49f1-5b65-4f06-8421-d06019ee50ad-tmp\") pod \"tuned-ckm2c\" (UID: \"0b3f49f1-5b65-4f06-8421-d06019ee50ad\") " pod="openshift-cluster-node-tuning-operator/tuned-ckm2c"
Sep 10 17:41:06.783698 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.783675    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrw75\" (UniqueName: \"kubernetes.io/projected/0b3f49f1-5b65-4f06-8421-d06019ee50ad-kube-api-access-xrw75\") pod \"tuned-ckm2c\" (UID: \"0b3f49f1-5b65-4f06-8421-d06019ee50ad\") " pod="openshift-cluster-node-tuning-operator/tuned-ckm2c"
Sep 10 17:41:06.801292 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.801253    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcssz\" (UniqueName: \"kubernetes.io/projected/34c68fc5-ab82-428a-8c3b-be0d2850e064-kube-api-access-qcssz\") pod \"iptables-alerter-p658s\" (UID: \"34c68fc5-ab82-428a-8c3b-be0d2850e064\") " pod="openshift-network-operator/iptables-alerter-p658s"
Sep 10 17:41:06.802531 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.802499    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqv6v\" (UniqueName: \"kubernetes.io/projected/4f8b428e-98e7-4306-b485-d39e9b22eb05-kube-api-access-lqv6v\") pod \"network-metrics-daemon-76dl2\" (UID: \"4f8b428e-98e7-4306-b485-d39e9b22eb05\") " pod="openshift-multus/network-metrics-daemon-76dl2"
Sep 10 17:41:06.803850 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.803818    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-clszt\" (UniqueName: \"kubernetes.io/projected/f45056e2-bd13-4829-a897-7cd4a829af0e-kube-api-access-clszt\") pod \"node-ca-7jrjh\" (UID: \"f45056e2-bd13-4829-a897-7cd4a829af0e\") " pod="openshift-image-registry/node-ca-7jrjh"
Sep 10 17:41:06.875510 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.875466    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/64722621-3413-45b1-be7b-7a9a5a075215-host-run-netns\") pod \"multus-cz2hn\" (UID: \"64722621-3413-45b1-be7b-7a9a5a075215\") " pod="openshift-multus/multus-cz2hn"
Sep 10 17:41:06.875722 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.875525    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/915faba9-e43b-4bdf-ab08-6063e393da6e-ovnkube-script-lib\") pod \"ovnkube-node-f9cn7\" (UID: \"915faba9-e43b-4bdf-ab08-6063e393da6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9cn7"
Sep 10 17:41:06.875722 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.875554    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/915faba9-e43b-4bdf-ab08-6063e393da6e-host-slash\") pod \"ovnkube-node-f9cn7\" (UID: \"915faba9-e43b-4bdf-ab08-6063e393da6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9cn7"
Sep 10 17:41:06.875722 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.875582    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/915faba9-e43b-4bdf-ab08-6063e393da6e-etc-openvswitch\") pod \"ovnkube-node-f9cn7\" (UID: \"915faba9-e43b-4bdf-ab08-6063e393da6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9cn7"
Sep 10 17:41:06.875722 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.875607    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/915faba9-e43b-4bdf-ab08-6063e393da6e-run-ovn\") pod \"ovnkube-node-f9cn7\" (UID: \"915faba9-e43b-4bdf-ab08-6063e393da6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9cn7"
Sep 10 17:41:06.875722 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.875633    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/774f7882-94da-4a71-a091-32054dc8d27c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8xsvx\" (UID: \"774f7882-94da-4a71-a091-32054dc8d27c\") " pod="openshift-multus/multus-additional-cni-plugins-8xsvx"
Sep 10 17:41:06.875722 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.875659    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bdb7b7f1-3f2e-4c52-917e-c428b50fcbcf-agent-certs\") pod \"konnectivity-agent-t9bvv\" (UID: \"bdb7b7f1-3f2e-4c52-917e-c428b50fcbcf\") " pod="kube-system/konnectivity-agent-t9bvv"
Sep 10 17:41:06.875722 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.875704    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/64722621-3413-45b1-be7b-7a9a5a075215-system-cni-dir\") pod \"multus-cz2hn\" (UID: \"64722621-3413-45b1-be7b-7a9a5a075215\") " pod="openshift-multus/multus-cz2hn"
Sep 10 17:41:06.876125 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.875727    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/64722621-3413-45b1-be7b-7a9a5a075215-cnibin\") pod \"multus-cz2hn\" (UID: \"64722621-3413-45b1-be7b-7a9a5a075215\") " pod="openshift-multus/multus-cz2hn"
Sep 10 17:41:06.876125 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.875754    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/64722621-3413-45b1-be7b-7a9a5a075215-host-var-lib-cni-bin\") pod \"multus-cz2hn\" (UID: \"64722621-3413-45b1-be7b-7a9a5a075215\") " pod="openshift-multus/multus-cz2hn"
Sep 10 17:41:06.876125 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.875780    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/17c92bd6-66da-44c1-aa62-b095d15cdc12-etc-selinux\") pod \"aws-ebs-csi-driver-node-hzw7d\" (UID: \"17c92bd6-66da-44c1-aa62-b095d15cdc12\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hzw7d"
Sep 10 17:41:06.876125 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.875804    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/64722621-3413-45b1-be7b-7a9a5a075215-etc-kubernetes\") pod \"multus-cz2hn\" (UID: \"64722621-3413-45b1-be7b-7a9a5a075215\") " pod="openshift-multus/multus-cz2hn"
Sep 10 17:41:06.876125 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.875828    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/915faba9-e43b-4bdf-ab08-6063e393da6e-node-log\") pod \"ovnkube-node-f9cn7\" (UID: \"915faba9-e43b-4bdf-ab08-6063e393da6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9cn7"
Sep 10 17:41:06.876125 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.875854    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/915faba9-e43b-4bdf-ab08-6063e393da6e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-f9cn7\" (UID: \"915faba9-e43b-4bdf-ab08-6063e393da6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9cn7"
Sep 10 17:41:06.876125 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.875882    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/915faba9-e43b-4bdf-ab08-6063e393da6e-ovnkube-config\") pod \"ovnkube-node-f9cn7\" (UID: \"915faba9-e43b-4bdf-ab08-6063e393da6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9cn7"
Sep 10 17:41:06.876125 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.875906    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/915faba9-e43b-4bdf-ab08-6063e393da6e-ovn-node-metrics-cert\") pod \"ovnkube-node-f9cn7\" (UID: \"915faba9-e43b-4bdf-ab08-6063e393da6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9cn7"
Sep 10 17:41:06.876125 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.875934    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b76cw\" (UniqueName: \"kubernetes.io/projected/915faba9-e43b-4bdf-ab08-6063e393da6e-kube-api-access-b76cw\") pod \"ovnkube-node-f9cn7\" (UID: \"915faba9-e43b-4bdf-ab08-6063e393da6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9cn7"
Sep 10 17:41:06.876125 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.875963    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/64722621-3413-45b1-be7b-7a9a5a075215-hostroot\") pod \"multus-cz2hn\" (UID: \"64722621-3413-45b1-be7b-7a9a5a075215\") " pod="openshift-multus/multus-cz2hn"
Sep 10 17:41:06.876125 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.875987    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/01467fcf-2ddb-42da-812a-964dc8a1504f-tmp-dir\") pod \"node-resolver-dwtws\" (UID: \"01467fcf-2ddb-42da-812a-964dc8a1504f\") " pod="openshift-dns/node-resolver-dwtws"
Sep 10 17:41:06.876125 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.876015    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/64722621-3413-45b1-be7b-7a9a5a075215-multus-socket-dir-parent\") pod \"multus-cz2hn\" (UID: \"64722621-3413-45b1-be7b-7a9a5a075215\") " pod="openshift-multus/multus-cz2hn"
Sep 10 17:41:06.876125 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.876041    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/64722621-3413-45b1-be7b-7a9a5a075215-host-run-k8s-cni-cncf-io\") pod \"multus-cz2hn\" (UID: \"64722621-3413-45b1-be7b-7a9a5a075215\") " pod="openshift-multus/multus-cz2hn"
Sep 10 17:41:06.876125 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.876068    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/915faba9-e43b-4bdf-ab08-6063e393da6e-host-run-ovn-kubernetes\") pod \"ovnkube-node-f9cn7\" (UID: \"915faba9-e43b-4bdf-ab08-6063e393da6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9cn7"
Sep 10 17:41:06.876125 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.876094    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/915faba9-e43b-4bdf-ab08-6063e393da6e-host-cni-bin\") pod \"ovnkube-node-f9cn7\" (UID: \"915faba9-e43b-4bdf-ab08-6063e393da6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9cn7"
Sep 10 17:41:06.876125 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.876120    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/915faba9-e43b-4bdf-ab08-6063e393da6e-host-cni-netd\") pod \"ovnkube-node-f9cn7\" (UID: \"915faba9-e43b-4bdf-ab08-6063e393da6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9cn7"
Sep 10 17:41:06.877008 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.876146    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/774f7882-94da-4a71-a091-32054dc8d27c-cni-binary-copy\") pod \"multus-additional-cni-plugins-8xsvx\" (UID: \"774f7882-94da-4a71-a091-32054dc8d27c\") " pod="openshift-multus/multus-additional-cni-plugins-8xsvx"
Sep 10 17:41:06.877008 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.876172    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/64722621-3413-45b1-be7b-7a9a5a075215-host-var-lib-cni-multus\") pod \"multus-cz2hn\" (UID: \"64722621-3413-45b1-be7b-7a9a5a075215\") " pod="openshift-multus/multus-cz2hn"
Sep 10 17:41:06.877008 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.876198    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/915faba9-e43b-4bdf-ab08-6063e393da6e-run-openvswitch\") pod \"ovnkube-node-f9cn7\" (UID: \"915faba9-e43b-4bdf-ab08-6063e393da6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9cn7"
Sep 10 17:41:06.877008 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.876242    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/17c92bd6-66da-44c1-aa62-b095d15cdc12-socket-dir\") pod \"aws-ebs-csi-driver-node-hzw7d\" (UID: \"17c92bd6-66da-44c1-aa62-b095d15cdc12\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hzw7d"
Sep 10 17:41:06.877008 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.876275    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/64722621-3413-45b1-be7b-7a9a5a075215-host-var-lib-kubelet\") pod \"multus-cz2hn\" (UID: \"64722621-3413-45b1-be7b-7a9a5a075215\") " pod="openshift-multus/multus-cz2hn"
Sep 10 17:41:06.877008 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.876302    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/64722621-3413-45b1-be7b-7a9a5a075215-multus-conf-dir\") pod \"multus-cz2hn\" (UID: \"64722621-3413-45b1-be7b-7a9a5a075215\") " pod="openshift-multus/multus-cz2hn"
Sep 10 17:41:06.877008 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.876328    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/915faba9-e43b-4bdf-ab08-6063e393da6e-host-run-netns\") pod \"ovnkube-node-f9cn7\" (UID: \"915faba9-e43b-4bdf-ab08-6063e393da6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9cn7"
Sep 10 17:41:06.877008 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.876356    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vgdr\" (UniqueName: \"kubernetes.io/projected/fc857d7e-aafa-4018-aeb4-84f423bb5337-kube-api-access-7vgdr\") pod \"network-check-target-w5htf\" (UID: \"fc857d7e-aafa-4018-aeb4-84f423bb5337\") " pod="openshift-network-diagnostics/network-check-target-w5htf"
Sep 10 17:41:06.877008 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.876387    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w26gp\" (UniqueName: \"kubernetes.io/projected/64722621-3413-45b1-be7b-7a9a5a075215-kube-api-access-w26gp\") pod \"multus-cz2hn\" (UID: \"64722621-3413-45b1-be7b-7a9a5a075215\") " pod="openshift-multus/multus-cz2hn"
Sep 10 17:41:06.877008 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.876427    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/774f7882-94da-4a71-a091-32054dc8d27c-cnibin\") pod \"multus-additional-cni-plugins-8xsvx\" (UID: \"774f7882-94da-4a71-a091-32054dc8d27c\") " pod="openshift-multus/multus-additional-cni-plugins-8xsvx"
Sep 10 17:41:06.877008 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.876459    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/64722621-3413-45b1-be7b-7a9a5a075215-multus-daemon-config\") pod \"multus-cz2hn\" (UID: \"64722621-3413-45b1-be7b-7a9a5a075215\") " pod="openshift-multus/multus-cz2hn"
Sep 10 17:41:06.877008 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.876487    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/915faba9-e43b-4bdf-ab08-6063e393da6e-systemd-units\") pod \"ovnkube-node-f9cn7\" (UID: \"915faba9-e43b-4bdf-ab08-6063e393da6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9cn7"
Sep 10 17:41:06.877008 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.876511    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/774f7882-94da-4a71-a091-32054dc8d27c-system-cni-dir\") pod \"multus-additional-cni-plugins-8xsvx\" (UID: \"774f7882-94da-4a71-a091-32054dc8d27c\") " pod="openshift-multus/multus-additional-cni-plugins-8xsvx"
Sep 10 17:41:06.877008 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.876538    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/774f7882-94da-4a71-a091-32054dc8d27c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8xsvx\" (UID: \"774f7882-94da-4a71-a091-32054dc8d27c\") " pod="openshift-multus/multus-additional-cni-plugins-8xsvx"
Sep 10 17:41:06.877008 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.876573    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/64722621-3413-45b1-be7b-7a9a5a075215-cni-binary-copy\") pod \"multus-cz2hn\" (UID: \"64722621-3413-45b1-be7b-7a9a5a075215\") " pod="openshift-multus/multus-cz2hn"
Sep 10 17:41:06.877008 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.876603    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/17c92bd6-66da-44c1-aa62-b095d15cdc12-registration-dir\") pod \"aws-ebs-csi-driver-node-hzw7d\" (UID: \"17c92bd6-66da-44c1-aa62-b095d15cdc12\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hzw7d"
Sep 10 17:41:06.877008 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.876629    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/915faba9-e43b-4bdf-ab08-6063e393da6e-host-kubelet\") pod \"ovnkube-node-f9cn7\" (UID: \"915faba9-e43b-4bdf-ab08-6063e393da6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9cn7"
Sep 10 17:41:06.877885 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.876660    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/17c92bd6-66da-44c1-aa62-b095d15cdc12-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hzw7d\" (UID: \"17c92bd6-66da-44c1-aa62-b095d15cdc12\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hzw7d"
Sep 10 17:41:06.877885 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.876688    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/17c92bd6-66da-44c1-aa62-b095d15cdc12-device-dir\") pod \"aws-ebs-csi-driver-node-hzw7d\" (UID: \"17c92bd6-66da-44c1-aa62-b095d15cdc12\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hzw7d"
Sep 10 17:41:06.877885 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.876716    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/915faba9-e43b-4bdf-ab08-6063e393da6e-log-socket\") pod \"ovnkube-node-f9cn7\" (UID: \"915faba9-e43b-4bdf-ab08-6063e393da6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9cn7"
Sep 10 17:41:06.877885 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.876742    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-md9zc\" (UniqueName: \"kubernetes.io/projected/774f7882-94da-4a71-a091-32054dc8d27c-kube-api-access-md9zc\") pod \"multus-additional-cni-plugins-8xsvx\" (UID: \"774f7882-94da-4a71-a091-32054dc8d27c\") " pod="openshift-multus/multus-additional-cni-plugins-8xsvx"
Sep 10 17:41:06.877885 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.876774    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bdb7b7f1-3f2e-4c52-917e-c428b50fcbcf-konnectivity-ca\") pod \"konnectivity-agent-t9bvv\" (UID: \"bdb7b7f1-3f2e-4c52-917e-c428b50fcbcf\") " pod="kube-system/konnectivity-agent-t9bvv"
Sep 10 17:41:06.877885 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.876807    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/64722621-3413-45b1-be7b-7a9a5a075215-multus-cni-dir\") pod \"multus-cz2hn\" (UID: \"64722621-3413-45b1-be7b-7a9a5a075215\") " pod="openshift-multus/multus-cz2hn"
Sep 10 17:41:06.877885 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.876837    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/64722621-3413-45b1-be7b-7a9a5a075215-host-run-multus-certs\") pod \"multus-cz2hn\" (UID: \"64722621-3413-45b1-be7b-7a9a5a075215\") " pod="openshift-multus/multus-cz2hn"
Sep 10 17:41:06.877885 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.876865    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qq6j4\" (UniqueName: \"kubernetes.io/projected/01467fcf-2ddb-42da-812a-964dc8a1504f-kube-api-access-qq6j4\") pod \"node-resolver-dwtws\" (UID: \"01467fcf-2ddb-42da-812a-964dc8a1504f\") " pod="openshift-dns/node-resolver-dwtws"
Sep 10 17:41:06.877885 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.876893    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/774f7882-94da-4a71-a091-32054dc8d27c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8xsvx\" (UID: \"774f7882-94da-4a71-a091-32054dc8d27c\") " pod="openshift-multus/multus-additional-cni-plugins-8xsvx"
Sep 10 17:41:06.877885 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.876922    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/17c92bd6-66da-44c1-aa62-b095d15cdc12-sys-fs\") pod \"aws-ebs-csi-driver-node-hzw7d\" (UID: \"17c92bd6-66da-44c1-aa62-b095d15cdc12\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hzw7d"
Sep 10 17:41:06.877885 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.876951    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xsmmv\" (UniqueName: \"kubernetes.io/projected/17c92bd6-66da-44c1-aa62-b095d15cdc12-kube-api-access-xsmmv\") pod \"aws-ebs-csi-driver-node-hzw7d\" (UID: \"17c92bd6-66da-44c1-aa62-b095d15cdc12\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hzw7d"
Sep 10 17:41:06.877885 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.876978    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/915faba9-e43b-4bdf-ab08-6063e393da6e-run-systemd\") pod \"ovnkube-node-f9cn7\" (UID: \"915faba9-e43b-4bdf-ab08-6063e393da6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9cn7"
Sep 10 17:41:06.877885 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.877003    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/915faba9-e43b-4bdf-ab08-6063e393da6e-var-lib-openvswitch\") pod \"ovnkube-node-f9cn7\" (UID: \"915faba9-e43b-4bdf-ab08-6063e393da6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9cn7"
Sep 10 17:41:06.877885 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.877030    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/915faba9-e43b-4bdf-ab08-6063e393da6e-env-overrides\") pod \"ovnkube-node-f9cn7\" (UID: \"915faba9-e43b-4bdf-ab08-6063e393da6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9cn7"
Sep 10 17:41:06.877885 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.877055    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/01467fcf-2ddb-42da-812a-964dc8a1504f-hosts-file\") pod \"node-resolver-dwtws\" (UID: \"01467fcf-2ddb-42da-812a-964dc8a1504f\") " pod="openshift-dns/node-resolver-dwtws"
Sep 10 17:41:06.877885 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.877113    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/915faba9-e43b-4bdf-ab08-6063e393da6e-run-openvswitch\") pod \"ovnkube-node-f9cn7\" (UID: \"915faba9-e43b-4bdf-ab08-6063e393da6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9cn7"
Sep 10 17:41:06.877885 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.877195    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/01467fcf-2ddb-42da-812a-964dc8a1504f-hosts-file\") pod \"node-resolver-dwtws\" (UID: \"01467fcf-2ddb-42da-812a-964dc8a1504f\") " pod="openshift-dns/node-resolver-dwtws"
Sep 10 17:41:06.878796 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.877232    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/64722621-3413-45b1-be7b-7a9a5a075215-host-run-netns\") pod \"multus-cz2hn\" (UID: \"64722621-3413-45b1-be7b-7a9a5a075215\") " pod="openshift-multus/multus-cz2hn"
Sep 10 17:41:06.878796 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.877285    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/17c92bd6-66da-44c1-aa62-b095d15cdc12-socket-dir\") pod \"aws-ebs-csi-driver-node-hzw7d\" (UID: \"17c92bd6-66da-44c1-aa62-b095d15cdc12\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hzw7d"
Sep 10 17:41:06.878796 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.877295    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/17c92bd6-66da-44c1-aa62-b095d15cdc12-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hzw7d\" (UID: \"17c92bd6-66da-44c1-aa62-b095d15cdc12\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hzw7d"
Sep 10 17:41:06.878796 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.877374    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/17c92bd6-66da-44c1-aa62-b095d15cdc12-device-dir\") pod \"aws-ebs-csi-driver-node-hzw7d\" (UID: \"17c92bd6-66da-44c1-aa62-b095d15cdc12\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hzw7d"
Sep 10 17:41:06.878796 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.877416    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/64722621-3413-45b1-be7b-7a9a5a075215-host-var-lib-kubelet\") pod \"multus-cz2hn\" (UID: \"64722621-3413-45b1-be7b-7a9a5a075215\") " pod="openshift-multus/multus-cz2hn"
Sep 10 17:41:06.878796 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.877439    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/915faba9-e43b-4bdf-ab08-6063e393da6e-log-socket\") pod \"ovnkube-node-f9cn7\" (UID: \"915faba9-e43b-4bdf-ab08-6063e393da6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9cn7"
Sep 10 17:41:06.878796 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.877458    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/64722621-3413-45b1-be7b-7a9a5a075215-multus-conf-dir\") pod \"multus-cz2hn\" (UID: \"64722621-3413-45b1-be7b-7a9a5a075215\") " pod="openshift-multus/multus-cz2hn"
Sep 10 17:41:06.878796 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.877492    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/915faba9-e43b-4bdf-ab08-6063e393da6e-host-run-netns\") pod \"ovnkube-node-f9cn7\" (UID: \"915faba9-e43b-4bdf-ab08-6063e393da6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9cn7"
Sep 10 17:41:06.878796 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.877770    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/774f7882-94da-4a71-a091-32054dc8d27c-cnibin\") pod \"multus-additional-cni-plugins-8xsvx\" (UID: \"774f7882-94da-4a71-a091-32054dc8d27c\") " pod="openshift-multus/multus-additional-cni-plugins-8xsvx"
Sep 10 17:41:06.878796 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.877896    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/915faba9-e43b-4bdf-ab08-6063e393da6e-ovnkube-script-lib\") pod \"ovnkube-node-f9cn7\" (UID: \"915faba9-e43b-4bdf-ab08-6063e393da6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9cn7"
Sep 10 17:41:06.878796 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.877958    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/915faba9-e43b-4bdf-ab08-6063e393da6e-host-slash\") pod \"ovnkube-node-f9cn7\" (UID: \"915faba9-e43b-4bdf-ab08-6063e393da6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9cn7"
Sep 10 17:41:06.878796 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.878000    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/915faba9-e43b-4bdf-ab08-6063e393da6e-etc-openvswitch\") pod \"ovnkube-node-f9cn7\" (UID: \"915faba9-e43b-4bdf-ab08-6063e393da6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9cn7"
Sep 10 17:41:06.878796 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.878039    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/915faba9-e43b-4bdf-ab08-6063e393da6e-run-ovn\") pod \"ovnkube-node-f9cn7\" (UID: \"915faba9-e43b-4bdf-ab08-6063e393da6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9cn7"
Sep 10 17:41:06.878796 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.878176    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/774f7882-94da-4a71-a091-32054dc8d27c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8xsvx\" (UID: \"774f7882-94da-4a71-a091-32054dc8d27c\") " pod="openshift-multus/multus-additional-cni-plugins-8xsvx"
Sep 10 17:41:06.878796 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.878391    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/64722621-3413-45b1-be7b-7a9a5a075215-multus-daemon-config\") pod \"multus-cz2hn\" (UID: \"64722621-3413-45b1-be7b-7a9a5a075215\") " pod="openshift-multus/multus-cz2hn"
Sep 10 17:41:06.878796 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.878417    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bdb7b7f1-3f2e-4c52-917e-c428b50fcbcf-konnectivity-ca\") pod \"konnectivity-agent-t9bvv\" (UID: \"bdb7b7f1-3f2e-4c52-917e-c428b50fcbcf\") " pod="kube-system/konnectivity-agent-t9bvv"
Sep 10 17:41:06.878796 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.878477    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/915faba9-e43b-4bdf-ab08-6063e393da6e-systemd-units\") pod \"ovnkube-node-f9cn7\" (UID: \"915faba9-e43b-4bdf-ab08-6063e393da6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9cn7"
Sep 10 17:41:06.878796 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.878503    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/64722621-3413-45b1-be7b-7a9a5a075215-multus-cni-dir\") pod \"multus-cz2hn\" (UID: \"64722621-3413-45b1-be7b-7a9a5a075215\") " pod="openshift-multus/multus-cz2hn"
Sep 10 17:41:06.879739 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.878537    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/774f7882-94da-4a71-a091-32054dc8d27c-system-cni-dir\") pod \"multus-additional-cni-plugins-8xsvx\" (UID: \"774f7882-94da-4a71-a091-32054dc8d27c\") " pod="openshift-multus/multus-additional-cni-plugins-8xsvx"
Sep 10 17:41:06.879739 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.878573    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/64722621-3413-45b1-be7b-7a9a5a075215-host-run-multus-certs\") pod \"multus-cz2hn\" (UID: \"64722621-3413-45b1-be7b-7a9a5a075215\") " pod="openshift-multus/multus-cz2hn"
Sep 10 17:41:06.879739 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.878677    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/17c92bd6-66da-44c1-aa62-b095d15cdc12-registration-dir\") pod \"aws-ebs-csi-driver-node-hzw7d\" (UID: \"17c92bd6-66da-44c1-aa62-b095d15cdc12\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hzw7d"
Sep 10 17:41:06.879739 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.878833    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/915faba9-e43b-4bdf-ab08-6063e393da6e-host-kubelet\") pod \"ovnkube-node-f9cn7\" (UID: \"915faba9-e43b-4bdf-ab08-6063e393da6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9cn7"
Sep 10 17:41:06.879739 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.878959    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/915faba9-e43b-4bdf-ab08-6063e393da6e-run-systemd\") pod \"ovnkube-node-f9cn7\" (UID: \"915faba9-e43b-4bdf-ab08-6063e393da6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9cn7"
Sep 10 17:41:06.879739 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.879033    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/17c92bd6-66da-44c1-aa62-b095d15cdc12-sys-fs\") pod \"aws-ebs-csi-driver-node-hzw7d\" (UID: \"17c92bd6-66da-44c1-aa62-b095d15cdc12\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hzw7d"
Sep 10 17:41:06.879739 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.879139    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/774f7882-94da-4a71-a091-32054dc8d27c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8xsvx\" (UID: \"774f7882-94da-4a71-a091-32054dc8d27c\") " pod="openshift-multus/multus-additional-cni-plugins-8xsvx"
Sep 10 17:41:06.879739 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.879142    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/774f7882-94da-4a71-a091-32054dc8d27c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8xsvx\" (UID: \"774f7882-94da-4a71-a091-32054dc8d27c\") " pod="openshift-multus/multus-additional-cni-plugins-8xsvx"
Sep 10 17:41:06.879739 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.879194    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/915faba9-e43b-4bdf-ab08-6063e393da6e-var-lib-openvswitch\") pod \"ovnkube-node-f9cn7\" (UID: \"915faba9-e43b-4bdf-ab08-6063e393da6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9cn7"
Sep 10 17:41:06.879739 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.879433    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/64722621-3413-45b1-be7b-7a9a5a075215-cni-binary-copy\") pod \"multus-cz2hn\" (UID: \"64722621-3413-45b1-be7b-7a9a5a075215\") " pod="openshift-multus/multus-cz2hn"
Sep 10 17:41:06.879739 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.879507    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/915faba9-e43b-4bdf-ab08-6063e393da6e-host-run-ovn-kubernetes\") pod \"ovnkube-node-f9cn7\" (UID: \"915faba9-e43b-4bdf-ab08-6063e393da6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9cn7"
Sep 10 17:41:06.879739 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.879537    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/64722621-3413-45b1-be7b-7a9a5a075215-etc-kubernetes\") pod \"multus-cz2hn\" (UID: \"64722621-3413-45b1-be7b-7a9a5a075215\") " pod="openshift-multus/multus-cz2hn"
Sep 10 17:41:06.879739 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.879560    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/64722621-3413-45b1-be7b-7a9a5a075215-hostroot\") pod \"multus-cz2hn\" (UID: \"64722621-3413-45b1-be7b-7a9a5a075215\") " pod="openshift-multus/multus-cz2hn"
Sep 10 17:41:06.879739 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.879588    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/915faba9-e43b-4bdf-ab08-6063e393da6e-env-overrides\") pod \"ovnkube-node-f9cn7\" (UID: \"915faba9-e43b-4bdf-ab08-6063e393da6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9cn7"
Sep 10 17:41:06.879739 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.879602    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/64722621-3413-45b1-be7b-7a9a5a075215-system-cni-dir\") pod \"multus-cz2hn\" (UID: \"64722621-3413-45b1-be7b-7a9a5a075215\") " pod="openshift-multus/multus-cz2hn"
Sep 10 17:41:06.879739 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.879611    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/915faba9-e43b-4bdf-ab08-6063e393da6e-node-log\") pod \"ovnkube-node-f9cn7\" (UID: \"915faba9-e43b-4bdf-ab08-6063e393da6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9cn7"
Sep 10 17:41:06.879739 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.879661    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/64722621-3413-45b1-be7b-7a9a5a075215-host-var-lib-cni-bin\") pod \"multus-cz2hn\" (UID: \"64722621-3413-45b1-be7b-7a9a5a075215\") " pod="openshift-multus/multus-cz2hn"
Sep 10 17:41:06.879739 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.879663    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/64722621-3413-45b1-be7b-7a9a5a075215-cnibin\") pod \"multus-cz2hn\" (UID: \"64722621-3413-45b1-be7b-7a9a5a075215\") " pod="openshift-multus/multus-cz2hn"
Sep 10 17:41:06.880670 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.879665    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/915faba9-e43b-4bdf-ab08-6063e393da6e-host-cni-bin\") pod \"ovnkube-node-f9cn7\" (UID: \"915faba9-e43b-4bdf-ab08-6063e393da6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9cn7"
Sep 10 17:41:06.880670 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.879926    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/01467fcf-2ddb-42da-812a-964dc8a1504f-tmp-dir\") pod \"node-resolver-dwtws\" (UID: \"01467fcf-2ddb-42da-812a-964dc8a1504f\") " pod="openshift-dns/node-resolver-dwtws"
Sep 10 17:41:06.880670 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.880024    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/915faba9-e43b-4bdf-ab08-6063e393da6e-host-cni-netd\") pod \"ovnkube-node-f9cn7\" (UID: \"915faba9-e43b-4bdf-ab08-6063e393da6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9cn7"
Sep 10 17:41:06.880670 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.880104    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/64722621-3413-45b1-be7b-7a9a5a075215-multus-socket-dir-parent\") pod \"multus-cz2hn\" (UID: \"64722621-3413-45b1-be7b-7a9a5a075215\") " pod="openshift-multus/multus-cz2hn"
Sep 10 17:41:06.880670 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.880141    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/64722621-3413-45b1-be7b-7a9a5a075215-host-run-k8s-cni-cncf-io\") pod \"multus-cz2hn\" (UID: \"64722621-3413-45b1-be7b-7a9a5a075215\") " pod="openshift-multus/multus-cz2hn"
Sep 10 17:41:06.880670 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.880179    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/774f7882-94da-4a71-a091-32054dc8d27c-cni-binary-copy\") pod \"multus-additional-cni-plugins-8xsvx\" (UID: \"774f7882-94da-4a71-a091-32054dc8d27c\") " pod="openshift-multus/multus-additional-cni-plugins-8xsvx"
Sep 10 17:41:06.880670 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.880189    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/17c92bd6-66da-44c1-aa62-b095d15cdc12-etc-selinux\") pod \"aws-ebs-csi-driver-node-hzw7d\" (UID: \"17c92bd6-66da-44c1-aa62-b095d15cdc12\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hzw7d"
Sep 10 17:41:06.880670 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.880192    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/915faba9-e43b-4bdf-ab08-6063e393da6e-ovnkube-config\") pod \"ovnkube-node-f9cn7\" (UID: \"915faba9-e43b-4bdf-ab08-6063e393da6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9cn7"
Sep 10 17:41:06.880670 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.880228    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/915faba9-e43b-4bdf-ab08-6063e393da6e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-f9cn7\" (UID: \"915faba9-e43b-4bdf-ab08-6063e393da6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9cn7"
Sep 10 17:41:06.880670 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.880250    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/64722621-3413-45b1-be7b-7a9a5a075215-host-var-lib-cni-multus\") pod \"multus-cz2hn\" (UID: \"64722621-3413-45b1-be7b-7a9a5a075215\") " pod="openshift-multus/multus-cz2hn"
Sep 10 17:41:06.883305 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.883279    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bdb7b7f1-3f2e-4c52-917e-c428b50fcbcf-agent-certs\") pod \"konnectivity-agent-t9bvv\" (UID: \"bdb7b7f1-3f2e-4c52-917e-c428b50fcbcf\") " pod="kube-system/konnectivity-agent-t9bvv"
Sep 10 17:41:06.884660 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.884635    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/915faba9-e43b-4bdf-ab08-6063e393da6e-ovn-node-metrics-cert\") pod \"ovnkube-node-f9cn7\" (UID: \"915faba9-e43b-4bdf-ab08-6063e393da6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9cn7"
Sep 10 17:41:06.886310 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:06.886231    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 17:41:06.886310 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:06.886265    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 17:41:06.886310 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:06.886282    2568 projected.go:196] Error preparing data for projected volume kube-api-access-7vgdr for pod openshift-network-diagnostics/network-check-target-w5htf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 17:41:06.886549 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:06.886366    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fc857d7e-aafa-4018-aeb4-84f423bb5337-kube-api-access-7vgdr podName:fc857d7e-aafa-4018-aeb4-84f423bb5337 nodeName:}" failed. No retries permitted until 2026-09-10 17:41:07.386345535 +0000 UTC m=+3.147653577 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-7vgdr" (UniqueName: "kubernetes.io/projected/fc857d7e-aafa-4018-aeb4-84f423bb5337-kube-api-access-7vgdr") pod "network-check-target-w5htf" (UID: "fc857d7e-aafa-4018-aeb4-84f423bb5337") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 17:41:06.887917 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.887827    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qq6j4\" (UniqueName: \"kubernetes.io/projected/01467fcf-2ddb-42da-812a-964dc8a1504f-kube-api-access-qq6j4\") pod \"node-resolver-dwtws\" (UID: \"01467fcf-2ddb-42da-812a-964dc8a1504f\") " pod="openshift-dns/node-resolver-dwtws"
Sep 10 17:41:06.888500 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.888349    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w26gp\" (UniqueName: \"kubernetes.io/projected/64722621-3413-45b1-be7b-7a9a5a075215-kube-api-access-w26gp\") pod \"multus-cz2hn\" (UID: \"64722621-3413-45b1-be7b-7a9a5a075215\") " pod="openshift-multus/multus-cz2hn"
Sep 10 17:41:06.888770 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.888743    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-md9zc\" (UniqueName: \"kubernetes.io/projected/774f7882-94da-4a71-a091-32054dc8d27c-kube-api-access-md9zc\") pod \"multus-additional-cni-plugins-8xsvx\" (UID: \"774f7882-94da-4a71-a091-32054dc8d27c\") " pod="openshift-multus/multus-additional-cni-plugins-8xsvx"
Sep 10 17:41:06.889751 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.889699    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xsmmv\" (UniqueName: \"kubernetes.io/projected/17c92bd6-66da-44c1-aa62-b095d15cdc12-kube-api-access-xsmmv\") pod \"aws-ebs-csi-driver-node-hzw7d\" (UID: \"17c92bd6-66da-44c1-aa62-b095d15cdc12\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hzw7d"
Sep 10 17:41:06.892092 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.891967    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b76cw\" (UniqueName: \"kubernetes.io/projected/915faba9-e43b-4bdf-ab08-6063e393da6e-kube-api-access-b76cw\") pod \"ovnkube-node-f9cn7\" (UID: \"915faba9-e43b-4bdf-ab08-6063e393da6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9cn7"
Sep 10 17:41:06.907006 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.906968    2568 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 17:41:06.963548 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.963233    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ckm2c"
Sep 10 17:41:06.972463 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.972433    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7jrjh"
Sep 10 17:41:06.982920 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:06.982880    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b3f49f1_5b65_4f06_8421_d06019ee50ad.slice/crio-ad68d53b240605bb1f3f407be028a036721a1fff971e6718d08dad17585b5167 WatchSource:0}: Error finding container ad68d53b240605bb1f3f407be028a036721a1fff971e6718d08dad17585b5167: Status 404 returned error can't find the container with id ad68d53b240605bb1f3f407be028a036721a1fff971e6718d08dad17585b5167
Sep 10 17:41:06.986517 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.986487    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-p658s"
Sep 10 17:41:06.990606 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:06.990562    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf45056e2_bd13_4829_a897_7cd4a829af0e.slice/crio-3564e01daf2221d06901e4d1f162794106c2a75306e6d0af3155eef059293d7d WatchSource:0}: Error finding container 3564e01daf2221d06901e4d1f162794106c2a75306e6d0af3155eef059293d7d: Status 404 returned error can't find the container with id 3564e01daf2221d06901e4d1f162794106c2a75306e6d0af3155eef059293d7d
Sep 10 17:41:06.993676 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:06.993470    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-f9cn7"
Sep 10 17:41:07.000217 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:07.000178    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34c68fc5_ab82_428a_8c3b_be0d2850e064.slice/crio-93de3fd934afe1bf0579e4382524a8c1068febbfdf8e87fa137e4d183cf6d0c1 WatchSource:0}: Error finding container 93de3fd934afe1bf0579e4382524a8c1068febbfdf8e87fa137e4d183cf6d0c1: Status 404 returned error can't find the container with id 93de3fd934afe1bf0579e4382524a8c1068febbfdf8e87fa137e4d183cf6d0c1
Sep 10 17:41:07.001881 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:07.001847    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-t9bvv"
Sep 10 17:41:07.007718 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:07.007685    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod915faba9_e43b_4bdf_ab08_6063e393da6e.slice/crio-a7e92ba1d436c3b98c02861cd6dc6d5208bc0a93a32537a72ff16ded5c0366b6 WatchSource:0}: Error finding container a7e92ba1d436c3b98c02861cd6dc6d5208bc0a93a32537a72ff16ded5c0366b6: Status 404 returned error can't find the container with id a7e92ba1d436c3b98c02861cd6dc6d5208bc0a93a32537a72ff16ded5c0366b6
Sep 10 17:41:07.011631 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:07.011569    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hzw7d"
Sep 10 17:41:07.018206 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:07.018164    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdb7b7f1_3f2e_4c52_917e_c428b50fcbcf.slice/crio-0fa752f7c70a7720a4bfaa97a5e9e08bde32c214daf57a12a5f25ded35179b91 WatchSource:0}: Error finding container 0fa752f7c70a7720a4bfaa97a5e9e08bde32c214daf57a12a5f25ded35179b91: Status 404 returned error can't find the container with id 0fa752f7c70a7720a4bfaa97a5e9e08bde32c214daf57a12a5f25ded35179b91
Sep 10 17:41:07.021510 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:07.021201    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cz2hn"
Sep 10 17:41:07.027640 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:07.027597    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17c92bd6_66da_44c1_aa62_b095d15cdc12.slice/crio-f9203d6e7eae4ff81c098e0d0f198b77adaeceab6b768dfef38ea7f07139d165 WatchSource:0}: Error finding container f9203d6e7eae4ff81c098e0d0f198b77adaeceab6b768dfef38ea7f07139d165: Status 404 returned error can't find the container with id f9203d6e7eae4ff81c098e0d0f198b77adaeceab6b768dfef38ea7f07139d165
Sep 10 17:41:07.031647 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:07.031625    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dwtws"
Sep 10 17:41:07.035362 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:07.035324    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64722621_3413_45b1_be7b_7a9a5a075215.slice/crio-18dd427271fc3761f71c1e0ce34cd73d7223ef1c5e99c6c5d03725f9c7409706 WatchSource:0}: Error finding container 18dd427271fc3761f71c1e0ce34cd73d7223ef1c5e99c6c5d03725f9c7409706: Status 404 returned error can't find the container with id 18dd427271fc3761f71c1e0ce34cd73d7223ef1c5e99c6c5d03725f9c7409706
Sep 10 17:41:07.040583 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:07.040335    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8xsvx"
Sep 10 17:41:07.046591 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:07.046554    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01467fcf_2ddb_42da_812a_964dc8a1504f.slice/crio-56e349855be8cfeacde7d894286da6cb719e8ff8055be141e837198a6adaf59e WatchSource:0}: Error finding container 56e349855be8cfeacde7d894286da6cb719e8ff8055be141e837198a6adaf59e: Status 404 returned error can't find the container with id 56e349855be8cfeacde7d894286da6cb719e8ff8055be141e837198a6adaf59e
Sep 10 17:41:07.056274 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:07.056222    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod774f7882_94da_4a71_a091_32054dc8d27c.slice/crio-4dc2b0a988841a03f31998672a44c3af4342af6c6179c6cc17f38b161b24d4bc WatchSource:0}: Error finding container 4dc2b0a988841a03f31998672a44c3af4342af6c6179c6cc17f38b161b24d4bc: Status 404 returned error can't find the container with id 4dc2b0a988841a03f31998672a44c3af4342af6c6179c6cc17f38b161b24d4bc
Sep 10 17:41:07.280291 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:07.280255    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4f8b428e-98e7-4306-b485-d39e9b22eb05-metrics-certs\") pod \"network-metrics-daemon-76dl2\" (UID: \"4f8b428e-98e7-4306-b485-d39e9b22eb05\") " pod="openshift-multus/network-metrics-daemon-76dl2"
Sep 10 17:41:07.280497 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:07.280335    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1df8c233-a191-43e9-9d86-4a191bd54b1e-original-pull-secret\") pod \"global-pull-secret-syncer-gqqkd\" (UID: \"1df8c233-a191-43e9-9d86-4a191bd54b1e\") " pod="kube-system/global-pull-secret-syncer-gqqkd"
Sep 10 17:41:07.280497 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:07.280448    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 17:41:07.280588 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:07.280509    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1df8c233-a191-43e9-9d86-4a191bd54b1e-original-pull-secret podName:1df8c233-a191-43e9-9d86-4a191bd54b1e nodeName:}" failed. No retries permitted until 2026-09-10 17:41:08.280494717 +0000 UTC m=+4.041802753 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1df8c233-a191-43e9-9d86-4a191bd54b1e-original-pull-secret") pod "global-pull-secret-syncer-gqqkd" (UID: "1df8c233-a191-43e9-9d86-4a191bd54b1e") : object "kube-system"/"original-pull-secret" not registered
Sep 10 17:41:07.280588 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:07.280450    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 17:41:07.280588 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:07.280554    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f8b428e-98e7-4306-b485-d39e9b22eb05-metrics-certs podName:4f8b428e-98e7-4306-b485-d39e9b22eb05 nodeName:}" failed. No retries permitted until 2026-09-10 17:41:08.280545825 +0000 UTC m=+4.041853862 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4f8b428e-98e7-4306-b485-d39e9b22eb05-metrics-certs") pod "network-metrics-daemon-76dl2" (UID: "4f8b428e-98e7-4306-b485-d39e9b22eb05") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 17:41:07.482551 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:07.482488    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vgdr\" (UniqueName: \"kubernetes.io/projected/fc857d7e-aafa-4018-aeb4-84f423bb5337-kube-api-access-7vgdr\") pod \"network-check-target-w5htf\" (UID: \"fc857d7e-aafa-4018-aeb4-84f423bb5337\") " pod="openshift-network-diagnostics/network-check-target-w5htf"
Sep 10 17:41:07.482757 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:07.482711    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 17:41:07.482757 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:07.482744    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 17:41:07.482852 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:07.482761    2568 projected.go:196] Error preparing data for projected volume kube-api-access-7vgdr for pod openshift-network-diagnostics/network-check-target-w5htf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 17:41:07.482852 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:07.482836    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fc857d7e-aafa-4018-aeb4-84f423bb5337-kube-api-access-7vgdr podName:fc857d7e-aafa-4018-aeb4-84f423bb5337 nodeName:}" failed. No retries permitted until 2026-09-10 17:41:08.482819603 +0000 UTC m=+4.244127642 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-7vgdr" (UniqueName: "kubernetes.io/projected/fc857d7e-aafa-4018-aeb4-84f423bb5337-kube-api-access-7vgdr") pod "network-check-target-w5htf" (UID: "fc857d7e-aafa-4018-aeb4-84f423bb5337") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 17:41:07.719858 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:07.719700    2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 17:36:07 +0000 UTC" deadline="2028-02-21 02:46:11.330165083 +0000 UTC"
Sep 10 17:41:07.719858 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:07.719804    2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12681h5m3.610371616s"
Sep 10 17:41:07.776909 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:07.776859    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dwtws" event={"ID":"01467fcf-2ddb-42da-812a-964dc8a1504f","Type":"ContainerStarted","Data":"56e349855be8cfeacde7d894286da6cb719e8ff8055be141e837198a6adaf59e"}
Sep 10 17:41:07.779526 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:07.779459    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cz2hn" event={"ID":"64722621-3413-45b1-be7b-7a9a5a075215","Type":"ContainerStarted","Data":"18dd427271fc3761f71c1e0ce34cd73d7223ef1c5e99c6c5d03725f9c7409706"}
Sep 10 17:41:07.781407 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:07.781355    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hzw7d" event={"ID":"17c92bd6-66da-44c1-aa62-b095d15cdc12","Type":"ContainerStarted","Data":"f9203d6e7eae4ff81c098e0d0f198b77adaeceab6b768dfef38ea7f07139d165"}
Sep 10 17:41:07.783862 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:07.783650    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f9cn7" event={"ID":"915faba9-e43b-4bdf-ab08-6063e393da6e","Type":"ContainerStarted","Data":"a7e92ba1d436c3b98c02861cd6dc6d5208bc0a93a32537a72ff16ded5c0366b6"}
Sep 10 17:41:07.785927 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:07.785895    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-p658s" event={"ID":"34c68fc5-ab82-428a-8c3b-be0d2850e064","Type":"ContainerStarted","Data":"93de3fd934afe1bf0579e4382524a8c1068febbfdf8e87fa137e4d183cf6d0c1"}
Sep 10 17:41:07.787833 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:07.787792    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8xsvx" event={"ID":"774f7882-94da-4a71-a091-32054dc8d27c","Type":"ContainerStarted","Data":"4dc2b0a988841a03f31998672a44c3af4342af6c6179c6cc17f38b161b24d4bc"}
Sep 10 17:41:07.789624 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:07.789595    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-t9bvv" event={"ID":"bdb7b7f1-3f2e-4c52-917e-c428b50fcbcf","Type":"ContainerStarted","Data":"0fa752f7c70a7720a4bfaa97a5e9e08bde32c214daf57a12a5f25ded35179b91"}
Sep 10 17:41:07.791790 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:07.791761    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7jrjh" event={"ID":"f45056e2-bd13-4829-a897-7cd4a829af0e","Type":"ContainerStarted","Data":"3564e01daf2221d06901e4d1f162794106c2a75306e6d0af3155eef059293d7d"}
Sep 10 17:41:07.794070 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:07.794034    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ckm2c" event={"ID":"0b3f49f1-5b65-4f06-8421-d06019ee50ad","Type":"ContainerStarted","Data":"ad68d53b240605bb1f3f407be028a036721a1fff971e6718d08dad17585b5167"}
Sep 10 17:41:08.290565 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:08.290519    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4f8b428e-98e7-4306-b485-d39e9b22eb05-metrics-certs\") pod \"network-metrics-daemon-76dl2\" (UID: \"4f8b428e-98e7-4306-b485-d39e9b22eb05\") " pod="openshift-multus/network-metrics-daemon-76dl2"
Sep 10 17:41:08.290778 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:08.290625    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1df8c233-a191-43e9-9d86-4a191bd54b1e-original-pull-secret\") pod \"global-pull-secret-syncer-gqqkd\" (UID: \"1df8c233-a191-43e9-9d86-4a191bd54b1e\") " pod="kube-system/global-pull-secret-syncer-gqqkd"
Sep 10 17:41:08.290845 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:08.290782    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 17:41:08.290901 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:08.290851    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1df8c233-a191-43e9-9d86-4a191bd54b1e-original-pull-secret podName:1df8c233-a191-43e9-9d86-4a191bd54b1e nodeName:}" failed. No retries permitted until 2026-09-10 17:41:10.290831934 +0000 UTC m=+6.052139960 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1df8c233-a191-43e9-9d86-4a191bd54b1e-original-pull-secret") pod "global-pull-secret-syncer-gqqkd" (UID: "1df8c233-a191-43e9-9d86-4a191bd54b1e") : object "kube-system"/"original-pull-secret" not registered
Sep 10 17:41:08.291214 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:08.291095    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 17:41:08.291214 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:08.291179    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f8b428e-98e7-4306-b485-d39e9b22eb05-metrics-certs podName:4f8b428e-98e7-4306-b485-d39e9b22eb05 nodeName:}" failed. No retries permitted until 2026-09-10 17:41:10.291158818 +0000 UTC m=+6.052466859 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4f8b428e-98e7-4306-b485-d39e9b22eb05-metrics-certs") pod "network-metrics-daemon-76dl2" (UID: "4f8b428e-98e7-4306-b485-d39e9b22eb05") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 17:41:08.492731 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:08.492688    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vgdr\" (UniqueName: \"kubernetes.io/projected/fc857d7e-aafa-4018-aeb4-84f423bb5337-kube-api-access-7vgdr\") pod \"network-check-target-w5htf\" (UID: \"fc857d7e-aafa-4018-aeb4-84f423bb5337\") " pod="openshift-network-diagnostics/network-check-target-w5htf"
Sep 10 17:41:08.493014 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:08.492986    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 17:41:08.493095 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:08.493019    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 17:41:08.493095 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:08.493035    2568 projected.go:196] Error preparing data for projected volume kube-api-access-7vgdr for pod openshift-network-diagnostics/network-check-target-w5htf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 17:41:08.493201 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:08.493105    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fc857d7e-aafa-4018-aeb4-84f423bb5337-kube-api-access-7vgdr podName:fc857d7e-aafa-4018-aeb4-84f423bb5337 nodeName:}" failed. No retries permitted until 2026-09-10 17:41:10.493084684 +0000 UTC m=+6.254392710 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-7vgdr" (UniqueName: "kubernetes.io/projected/fc857d7e-aafa-4018-aeb4-84f423bb5337-kube-api-access-7vgdr") pod "network-check-target-w5htf" (UID: "fc857d7e-aafa-4018-aeb4-84f423bb5337") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 17:41:08.720920 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:08.720820    2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 17:36:07 +0000 UTC" deadline="2028-04-24 17:14:58.823431837 +0000 UTC"
Sep 10 17:41:08.720920 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:08.720866    2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14207h33m50.102570779s"
Sep 10 17:41:08.764450 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:08.764396    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gqqkd"
Sep 10 17:41:08.764656 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:08.764546    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gqqkd" podUID="1df8c233-a191-43e9-9d86-4a191bd54b1e"
Sep 10 17:41:08.765103 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:08.764408    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w5htf"
Sep 10 17:41:08.765103 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:08.764853    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w5htf" podUID="fc857d7e-aafa-4018-aeb4-84f423bb5337"
Sep 10 17:41:08.765103 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:08.764952    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-76dl2"
Sep 10 17:41:08.765103 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:08.765060    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-76dl2" podUID="4f8b428e-98e7-4306-b485-d39e9b22eb05"
Sep 10 17:41:10.309579 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:10.309536    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4f8b428e-98e7-4306-b485-d39e9b22eb05-metrics-certs\") pod \"network-metrics-daemon-76dl2\" (UID: \"4f8b428e-98e7-4306-b485-d39e9b22eb05\") " pod="openshift-multus/network-metrics-daemon-76dl2"
Sep 10 17:41:10.310068 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:10.309638    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1df8c233-a191-43e9-9d86-4a191bd54b1e-original-pull-secret\") pod \"global-pull-secret-syncer-gqqkd\" (UID: \"1df8c233-a191-43e9-9d86-4a191bd54b1e\") " pod="kube-system/global-pull-secret-syncer-gqqkd"
Sep 10 17:41:10.310068 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:10.309730    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 17:41:10.310068 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:10.309791    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 17:41:10.310068 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:10.309818    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f8b428e-98e7-4306-b485-d39e9b22eb05-metrics-certs podName:4f8b428e-98e7-4306-b485-d39e9b22eb05 nodeName:}" failed. No retries permitted until 2026-09-10 17:41:14.309796223 +0000 UTC m=+10.071104246 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4f8b428e-98e7-4306-b485-d39e9b22eb05-metrics-certs") pod "network-metrics-daemon-76dl2" (UID: "4f8b428e-98e7-4306-b485-d39e9b22eb05") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 17:41:10.310068 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:10.309847    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1df8c233-a191-43e9-9d86-4a191bd54b1e-original-pull-secret podName:1df8c233-a191-43e9-9d86-4a191bd54b1e nodeName:}" failed. No retries permitted until 2026-09-10 17:41:14.309830769 +0000 UTC m=+10.071138794 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1df8c233-a191-43e9-9d86-4a191bd54b1e-original-pull-secret") pod "global-pull-secret-syncer-gqqkd" (UID: "1df8c233-a191-43e9-9d86-4a191bd54b1e") : object "kube-system"/"original-pull-secret" not registered
Sep 10 17:41:10.511724 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:10.511679    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vgdr\" (UniqueName: \"kubernetes.io/projected/fc857d7e-aafa-4018-aeb4-84f423bb5337-kube-api-access-7vgdr\") pod \"network-check-target-w5htf\" (UID: \"fc857d7e-aafa-4018-aeb4-84f423bb5337\") " pod="openshift-network-diagnostics/network-check-target-w5htf"
Sep 10 17:41:10.511951 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:10.511930    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 17:41:10.512051 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:10.511962    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 17:41:10.512051 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:10.511977    2568 projected.go:196] Error preparing data for projected volume kube-api-access-7vgdr for pod openshift-network-diagnostics/network-check-target-w5htf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 17:41:10.512051 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:10.512045    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fc857d7e-aafa-4018-aeb4-84f423bb5337-kube-api-access-7vgdr podName:fc857d7e-aafa-4018-aeb4-84f423bb5337 nodeName:}" failed. No retries permitted until 2026-09-10 17:41:14.512023047 +0000 UTC m=+10.273331085 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-7vgdr" (UniqueName: "kubernetes.io/projected/fc857d7e-aafa-4018-aeb4-84f423bb5337-kube-api-access-7vgdr") pod "network-check-target-w5htf" (UID: "fc857d7e-aafa-4018-aeb4-84f423bb5337") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 17:41:10.764993 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:10.764474    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gqqkd"
Sep 10 17:41:10.764993 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:10.764500    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w5htf"
Sep 10 17:41:10.764993 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:10.764624    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gqqkd" podUID="1df8c233-a191-43e9-9d86-4a191bd54b1e"
Sep 10 17:41:10.764993 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:10.764676    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-76dl2"
Sep 10 17:41:10.764993 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:10.764797    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-76dl2" podUID="4f8b428e-98e7-4306-b485-d39e9b22eb05"
Sep 10 17:41:10.764993 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:10.764880    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w5htf" podUID="fc857d7e-aafa-4018-aeb4-84f423bb5337"
Sep 10 17:41:12.763682 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:12.763634    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gqqkd"
Sep 10 17:41:12.764215 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:12.763634    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w5htf"
Sep 10 17:41:12.764215 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:12.763793    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gqqkd" podUID="1df8c233-a191-43e9-9d86-4a191bd54b1e"
Sep 10 17:41:12.764215 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:12.763640    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-76dl2"
Sep 10 17:41:12.764215 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:12.763868    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w5htf" podUID="fc857d7e-aafa-4018-aeb4-84f423bb5337"
Sep 10 17:41:12.764215 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:12.763930    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-76dl2" podUID="4f8b428e-98e7-4306-b485-d39e9b22eb05"
Sep 10 17:41:14.347794 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:14.347748    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1df8c233-a191-43e9-9d86-4a191bd54b1e-original-pull-secret\") pod \"global-pull-secret-syncer-gqqkd\" (UID: \"1df8c233-a191-43e9-9d86-4a191bd54b1e\") " pod="kube-system/global-pull-secret-syncer-gqqkd"
Sep 10 17:41:14.348446 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:14.347832    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4f8b428e-98e7-4306-b485-d39e9b22eb05-metrics-certs\") pod \"network-metrics-daemon-76dl2\" (UID: \"4f8b428e-98e7-4306-b485-d39e9b22eb05\") " pod="openshift-multus/network-metrics-daemon-76dl2"
Sep 10 17:41:14.348446 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:14.347940    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 17:41:14.348446 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:14.348044    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1df8c233-a191-43e9-9d86-4a191bd54b1e-original-pull-secret podName:1df8c233-a191-43e9-9d86-4a191bd54b1e nodeName:}" failed. No retries permitted until 2026-09-10 17:41:22.348004617 +0000 UTC m=+18.109312662 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1df8c233-a191-43e9-9d86-4a191bd54b1e-original-pull-secret") pod "global-pull-secret-syncer-gqqkd" (UID: "1df8c233-a191-43e9-9d86-4a191bd54b1e") : object "kube-system"/"original-pull-secret" not registered
Sep 10 17:41:14.348446 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:14.348072    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 17:41:14.348446 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:14.348118    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f8b428e-98e7-4306-b485-d39e9b22eb05-metrics-certs podName:4f8b428e-98e7-4306-b485-d39e9b22eb05 nodeName:}" failed. No retries permitted until 2026-09-10 17:41:22.34810494 +0000 UTC m=+18.109412970 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4f8b428e-98e7-4306-b485-d39e9b22eb05-metrics-certs") pod "network-metrics-daemon-76dl2" (UID: "4f8b428e-98e7-4306-b485-d39e9b22eb05") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 17:41:14.550235 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:14.550093    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vgdr\" (UniqueName: \"kubernetes.io/projected/fc857d7e-aafa-4018-aeb4-84f423bb5337-kube-api-access-7vgdr\") pod \"network-check-target-w5htf\" (UID: \"fc857d7e-aafa-4018-aeb4-84f423bb5337\") " pod="openshift-network-diagnostics/network-check-target-w5htf"
Sep 10 17:41:14.550508 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:14.550322    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 17:41:14.550508 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:14.550369    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 17:41:14.550508 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:14.550385    2568 projected.go:196] Error preparing data for projected volume kube-api-access-7vgdr for pod openshift-network-diagnostics/network-check-target-w5htf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 17:41:14.550508 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:14.550464    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fc857d7e-aafa-4018-aeb4-84f423bb5337-kube-api-access-7vgdr podName:fc857d7e-aafa-4018-aeb4-84f423bb5337 nodeName:}" failed. No retries permitted until 2026-09-10 17:41:22.550441743 +0000 UTC m=+18.311749771 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-7vgdr" (UniqueName: "kubernetes.io/projected/fc857d7e-aafa-4018-aeb4-84f423bb5337-kube-api-access-7vgdr") pod "network-check-target-w5htf" (UID: "fc857d7e-aafa-4018-aeb4-84f423bb5337") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 17:41:14.764934 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:14.764444    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gqqkd"
Sep 10 17:41:14.764934 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:14.764573    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-76dl2"
Sep 10 17:41:14.764934 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:14.764677    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-76dl2" podUID="4f8b428e-98e7-4306-b485-d39e9b22eb05"
Sep 10 17:41:14.764934 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:14.764727    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gqqkd" podUID="1df8c233-a191-43e9-9d86-4a191bd54b1e"
Sep 10 17:41:14.764934 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:14.764764    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w5htf"
Sep 10 17:41:14.764934 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:14.764827    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w5htf" podUID="fc857d7e-aafa-4018-aeb4-84f423bb5337"
Sep 10 17:41:16.764415 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:16.764372    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w5htf"
Sep 10 17:41:16.764930 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:16.764369    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gqqkd"
Sep 10 17:41:16.764930 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:16.764531    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w5htf" podUID="fc857d7e-aafa-4018-aeb4-84f423bb5337"
Sep 10 17:41:16.764930 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:16.764377    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-76dl2"
Sep 10 17:41:16.764930 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:16.764605    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gqqkd" podUID="1df8c233-a191-43e9-9d86-4a191bd54b1e"
Sep 10 17:41:16.764930 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:16.764740    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-76dl2" podUID="4f8b428e-98e7-4306-b485-d39e9b22eb05"
Sep 10 17:41:18.764229 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:18.764190    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w5htf"
Sep 10 17:41:18.764652 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:18.764244    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-76dl2"
Sep 10 17:41:18.764652 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:18.764191    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gqqkd"
Sep 10 17:41:18.764652 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:18.764310    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w5htf" podUID="fc857d7e-aafa-4018-aeb4-84f423bb5337"
Sep 10 17:41:18.764652 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:18.764411    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gqqkd" podUID="1df8c233-a191-43e9-9d86-4a191bd54b1e"
Sep 10 17:41:18.764652 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:18.764464    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-76dl2" podUID="4f8b428e-98e7-4306-b485-d39e9b22eb05"
Sep 10 17:41:20.764337 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:20.764286    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-76dl2"
Sep 10 17:41:20.764337 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:20.764311    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gqqkd"
Sep 10 17:41:20.764852 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:20.764286    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w5htf"
Sep 10 17:41:20.764852 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:20.764447    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-76dl2" podUID="4f8b428e-98e7-4306-b485-d39e9b22eb05"
Sep 10 17:41:20.764852 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:20.764512    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w5htf" podUID="fc857d7e-aafa-4018-aeb4-84f423bb5337"
Sep 10 17:41:20.764852 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:20.764576    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gqqkd" podUID="1df8c233-a191-43e9-9d86-4a191bd54b1e"
Sep 10 17:41:22.414855 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:22.414820    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4f8b428e-98e7-4306-b485-d39e9b22eb05-metrics-certs\") pod \"network-metrics-daemon-76dl2\" (UID: \"4f8b428e-98e7-4306-b485-d39e9b22eb05\") " pod="openshift-multus/network-metrics-daemon-76dl2"
Sep 10 17:41:22.415373 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:22.414894    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1df8c233-a191-43e9-9d86-4a191bd54b1e-original-pull-secret\") pod \"global-pull-secret-syncer-gqqkd\" (UID: \"1df8c233-a191-43e9-9d86-4a191bd54b1e\") " pod="kube-system/global-pull-secret-syncer-gqqkd"
Sep 10 17:41:22.415373 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:22.414999    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 17:41:22.415373 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:22.415074    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1df8c233-a191-43e9-9d86-4a191bd54b1e-original-pull-secret podName:1df8c233-a191-43e9-9d86-4a191bd54b1e nodeName:}" failed. No retries permitted until 2026-09-10 17:41:38.415052548 +0000 UTC m=+34.176360572 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1df8c233-a191-43e9-9d86-4a191bd54b1e-original-pull-secret") pod "global-pull-secret-syncer-gqqkd" (UID: "1df8c233-a191-43e9-9d86-4a191bd54b1e") : object "kube-system"/"original-pull-secret" not registered
Sep 10 17:41:22.415373 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:22.414999    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 17:41:22.415373 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:22.415197    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f8b428e-98e7-4306-b485-d39e9b22eb05-metrics-certs podName:4f8b428e-98e7-4306-b485-d39e9b22eb05 nodeName:}" failed. No retries permitted until 2026-09-10 17:41:38.415172094 +0000 UTC m=+34.176480129 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4f8b428e-98e7-4306-b485-d39e9b22eb05-metrics-certs") pod "network-metrics-daemon-76dl2" (UID: "4f8b428e-98e7-4306-b485-d39e9b22eb05") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 17:41:22.616962 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:22.616921    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vgdr\" (UniqueName: \"kubernetes.io/projected/fc857d7e-aafa-4018-aeb4-84f423bb5337-kube-api-access-7vgdr\") pod \"network-check-target-w5htf\" (UID: \"fc857d7e-aafa-4018-aeb4-84f423bb5337\") " pod="openshift-network-diagnostics/network-check-target-w5htf"
Sep 10 17:41:22.617148 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:22.617077    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 17:41:22.617148 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:22.617095    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 17:41:22.617148 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:22.617106    2568 projected.go:196] Error preparing data for projected volume kube-api-access-7vgdr for pod openshift-network-diagnostics/network-check-target-w5htf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 17:41:22.617286 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:22.617163    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fc857d7e-aafa-4018-aeb4-84f423bb5337-kube-api-access-7vgdr podName:fc857d7e-aafa-4018-aeb4-84f423bb5337 nodeName:}" failed. No retries permitted until 2026-09-10 17:41:38.617146907 +0000 UTC m=+34.378454949 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-7vgdr" (UniqueName: "kubernetes.io/projected/fc857d7e-aafa-4018-aeb4-84f423bb5337-kube-api-access-7vgdr") pod "network-check-target-w5htf" (UID: "fc857d7e-aafa-4018-aeb4-84f423bb5337") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 17:41:22.763682 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:22.763633    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gqqkd"
Sep 10 17:41:22.763841 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:22.763633    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-76dl2"
Sep 10 17:41:22.763841 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:22.763786    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gqqkd" podUID="1df8c233-a191-43e9-9d86-4a191bd54b1e"
Sep 10 17:41:22.763972 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:22.763877    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-76dl2" podUID="4f8b428e-98e7-4306-b485-d39e9b22eb05"
Sep 10 17:41:22.763972 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:22.763633    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w5htf"
Sep 10 17:41:22.764078 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:22.764011    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w5htf" podUID="fc857d7e-aafa-4018-aeb4-84f423bb5337"
Sep 10 17:41:24.766435 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:24.766398    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-76dl2"
Sep 10 17:41:24.766435 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:24.766408    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w5htf"
Sep 10 17:41:24.766435 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:24.766408    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gqqkd"
Sep 10 17:41:24.766923 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:24.766528    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-76dl2" podUID="4f8b428e-98e7-4306-b485-d39e9b22eb05"
Sep 10 17:41:24.766923 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:24.766584    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w5htf" podUID="fc857d7e-aafa-4018-aeb4-84f423bb5337"
Sep 10 17:41:24.766923 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:24.766669    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gqqkd" podUID="1df8c233-a191-43e9-9d86-4a191bd54b1e"
Sep 10 17:41:26.763985 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:26.763625    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gqqkd"
Sep 10 17:41:26.764786 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:26.763652    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w5htf"
Sep 10 17:41:26.764786 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:26.764077    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gqqkd" podUID="1df8c233-a191-43e9-9d86-4a191bd54b1e"
Sep 10 17:41:26.764786 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:26.764154    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w5htf" podUID="fc857d7e-aafa-4018-aeb4-84f423bb5337"
Sep 10 17:41:26.764786 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:26.763626    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-76dl2"
Sep 10 17:41:26.764786 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:26.764255    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-76dl2" podUID="4f8b428e-98e7-4306-b485-d39e9b22eb05"
Sep 10 17:41:26.846431 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:26.846402    2568 generic.go:356] "Generic (PLEG): container finished" podID="67b1785819731aadf4d3323928534cad" containerID="08f6e80585f957fd1a0a04cd7f0d125729873da70c25149eef974f3f25c958db" exitCode=0
Sep 10 17:41:26.846605 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:26.846482    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-161.ec2.internal" event={"ID":"67b1785819731aadf4d3323928534cad","Type":"ContainerDied","Data":"08f6e80585f957fd1a0a04cd7f0d125729873da70c25149eef974f3f25c958db"}
Sep 10 17:41:26.849691 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:26.848619    2568 generic.go:356] "Generic (PLEG): container finished" podID="774f7882-94da-4a71-a091-32054dc8d27c" containerID="7da99380645ce51339f060e4843a80c22778923fcf63fd1f73937700a7078139" exitCode=0
Sep 10 17:41:26.849691 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:26.848708    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8xsvx" event={"ID":"774f7882-94da-4a71-a091-32054dc8d27c","Type":"ContainerDied","Data":"7da99380645ce51339f060e4843a80c22778923fcf63fd1f73937700a7078139"}
Sep 10 17:41:26.851801 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:26.851776    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-t9bvv" event={"ID":"bdb7b7f1-3f2e-4c52-917e-c428b50fcbcf","Type":"ContainerStarted","Data":"630360fc8e3682e7b0565a2496660f43a8cb3867266c3b4e58893b4bc5d1a9c3"}
Sep 10 17:41:26.853376 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:26.853260    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7jrjh" event={"ID":"f45056e2-bd13-4829-a897-7cd4a829af0e","Type":"ContainerStarted","Data":"41cf4e49aeaa1699c130c96b1a66c733fab6108f7b2621faaeb258d49a64a07c"}
Sep 10 17:41:26.854973 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:26.854951    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ckm2c" event={"ID":"0b3f49f1-5b65-4f06-8421-d06019ee50ad","Type":"ContainerStarted","Data":"65ebbe72211b6c05acf7a1e095b80a67898ad3ce5d550bae4035c1536dc9ee09"}
Sep 10 17:41:26.856529 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:26.856502    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-161.ec2.internal" event={"ID":"14fa913fd221d63bd218ae72b03b88e8","Type":"ContainerStarted","Data":"e13ae845614efa7023da41f2debabb8fe37cc1365d484132b314c431e5567248"}
Sep 10 17:41:26.858403 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:26.858347    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dwtws" event={"ID":"01467fcf-2ddb-42da-812a-964dc8a1504f","Type":"ContainerStarted","Data":"98f2c202c7281ca233f7d41ad32bd82b58162a9d8f7d2c5b06b211d34266fb51"}
Sep 10 17:41:26.859840 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:26.859818    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cz2hn" event={"ID":"64722621-3413-45b1-be7b-7a9a5a075215","Type":"ContainerStarted","Data":"3f46fa700578eee52eea45290bb7ff49f3ca04823c4436c9abef0ff69f265564"}
Sep 10 17:41:26.861732 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:26.861711    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hzw7d" event={"ID":"17c92bd6-66da-44c1-aa62-b095d15cdc12","Type":"ContainerStarted","Data":"bf740868fc8ac9b29e0f56552e3e61bc0641fecf348f32817d24e82ad713fa41"}
Sep 10 17:41:26.863953 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:26.863928    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f9cn7" event={"ID":"915faba9-e43b-4bdf-ab08-6063e393da6e","Type":"ContainerStarted","Data":"5a552ef1d81bac900ba6e38391cbb7a53fc1b25d6d9bff378a93e8d044014b8d"}
Sep 10 17:41:26.864066 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:26.864003    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f9cn7" event={"ID":"915faba9-e43b-4bdf-ab08-6063e393da6e","Type":"ContainerStarted","Data":"ec99e94a04e716208e22409ba5e80d50fab368f3927662f93203ecbf093bc8f5"}
Sep 10 17:41:26.864066 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:26.864033    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f9cn7" event={"ID":"915faba9-e43b-4bdf-ab08-6063e393da6e","Type":"ContainerStarted","Data":"b1f2f85f77696e79064221d45c905e2e44c94a7d2e8888784b482996aed59791"}
Sep 10 17:41:26.864066 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:26.864062    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f9cn7" event={"ID":"915faba9-e43b-4bdf-ab08-6063e393da6e","Type":"ContainerStarted","Data":"516ff10ad09694910cb20c59d9838d4dfff8e2bf8fb61d19d697f80b3ccf4a40"}
Sep 10 17:41:26.889086 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:26.888966    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-161.ec2.internal" podStartSLOduration=20.888943396 podStartE2EDuration="20.888943396s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 17:41:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:41:26.888620999 +0000 UTC m=+22.649929040" watchObservedRunningTime="2026-09-10 17:41:26.888943396 +0000 UTC m=+22.650251440"
Sep 10 17:41:26.907783 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:26.907535    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-ckm2c" podStartSLOduration=2.700410233 podStartE2EDuration="21.907517748s" totalImagesPullingTime="19.207107515s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 17:41:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:41:26.907379865 +0000 UTC m=+22.668687909" watchObservedRunningTime="2026-09-10 17:41:26.907517748 +0000 UTC m=+22.668825790"
Sep 10 17:41:26.922212 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:26.922169    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-7jrjh" podStartSLOduration=6.695873425 podStartE2EDuration="21.92215448s" totalImagesPullingTime="15.226281055s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 17:41:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:41:26.921725584 +0000 UTC m=+22.683033630" watchObservedRunningTime="2026-09-10 17:41:26.92215448 +0000 UTC m=+22.683462523"
Sep 10 17:41:26.948994 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:26.948901    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-t9bvv" podStartSLOduration=5.751856947 podStartE2EDuration="20.948876643s" totalImagesPullingTime="15.197019696s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:41:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:41:26.947608053 +0000 UTC m=+22.708916101" watchObservedRunningTime="2026-09-10 17:41:26.948876643 +0000 UTC m=+22.710184687"
Sep 10 17:41:26.985801 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:26.985741    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-dwtws" podStartSLOduration=1.842285143 podStartE2EDuration="20.985722565s" totalImagesPullingTime="19.143437422s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 17:41:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:41:26.985180233 +0000 UTC m=+22.746488275" watchObservedRunningTime="2026-09-10 17:41:26.985722565 +0000 UTC m=+22.747030609"
Sep 10 17:41:27.001592 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:27.001534    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-cz2hn" podStartSLOduration=1.732190617 podStartE2EDuration="21.001514417s" totalImagesPullingTime="19.2693238s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 17:41:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:41:27.001227888 +0000 UTC m=+22.762535932" watchObservedRunningTime="2026-09-10 17:41:27.001514417 +0000 UTC m=+22.762822463"
Sep 10 17:41:27.871159 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:27.871100    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f9cn7" event={"ID":"915faba9-e43b-4bdf-ab08-6063e393da6e","Type":"ContainerStarted","Data":"638ccb5c9cd31ad0fd256fa2e082519331c689a0071a2f01f3edc23c4c88d05b"}
Sep 10 17:41:27.871927 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:27.871229    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f9cn7" event={"ID":"915faba9-e43b-4bdf-ab08-6063e393da6e","Type":"ContainerStarted","Data":"fa31743421e905f786620d023fad42352fff40055b142a430c99a6b8395b6582"}
Sep 10 17:41:27.873990 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:27.873693    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-161.ec2.internal" event={"ID":"67b1785819731aadf4d3323928534cad","Type":"ContainerStarted","Data":"604e531ac5b7368d18aee7561c0112e040b887430807ef825a73dda3ecddcb55"}
Sep 10 17:41:27.890576 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:27.890499    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-161.ec2.internal" podStartSLOduration=21.890473612 podStartE2EDuration="21.890473612s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 17:41:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:41:27.890216502 +0000 UTC m=+23.651524545" watchObservedRunningTime="2026-09-10 17:41:27.890473612 +0000 UTC m=+23.651781659"
Sep 10 17:41:28.489810 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:28.489775    2568 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 10 17:41:28.763640 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:28.763603    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gqqkd"
Sep 10 17:41:28.763844 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:28.763603    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-76dl2"
Sep 10 17:41:28.763844 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:28.763747    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gqqkd" podUID="1df8c233-a191-43e9-9d86-4a191bd54b1e"
Sep 10 17:41:28.763844 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:28.763603    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w5htf"
Sep 10 17:41:28.763844 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:28.763795    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-76dl2" podUID="4f8b428e-98e7-4306-b485-d39e9b22eb05"
Sep 10 17:41:28.764048 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:28.763865    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w5htf" podUID="fc857d7e-aafa-4018-aeb4-84f423bb5337"
Sep 10 17:41:28.852548 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:28.852417    2568 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-10T17:41:28.489799939Z","UUID":"82178fa7-fbbf-4abf-97da-5f00582d4ad0","Handler":null,"Name":"","Endpoint":""}
Sep 10 17:41:28.854027 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:28.854004    2568 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 10 17:41:28.854171 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:28.854039    2568 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 10 17:41:28.878595 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:28.878556    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hzw7d" event={"ID":"17c92bd6-66da-44c1-aa62-b095d15cdc12","Type":"ContainerStarted","Data":"131b735aba84c35d2519e12f2904a3673630c27c319d62de18109e9017de6c00"}
Sep 10 17:41:28.880423 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:28.880391    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-p658s" event={"ID":"34c68fc5-ab82-428a-8c3b-be0d2850e064","Type":"ContainerStarted","Data":"3decf92d6b55bac106a812956ca169a2f7702092d46d8d74975e80cd6436c18e"}
Sep 10 17:41:28.895567 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:28.895511    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-p658s" podStartSLOduration=3.704459866 podStartE2EDuration="22.89549513s" totalImagesPullingTime="19.191035264s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 17:41:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:41:28.894957104 +0000 UTC m=+24.656265147" watchObservedRunningTime="2026-09-10 17:41:28.89549513 +0000 UTC m=+24.656803172"
Sep 10 17:41:29.482339 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:29.482292    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-t9bvv"
Sep 10 17:41:29.483017 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:29.482997    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-t9bvv"
Sep 10 17:41:29.887850 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:29.887809    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f9cn7" event={"ID":"915faba9-e43b-4bdf-ab08-6063e393da6e","Type":"ContainerStarted","Data":"ceb1ef6c352e5d17f13c72f1c4cb0dc8374eedc772d8b90860afad28ea2399ef"}
Sep 10 17:41:30.763892 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:30.763855    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gqqkd"
Sep 10 17:41:30.763892 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:30.763893    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-76dl2"
Sep 10 17:41:30.764131 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:30.763856    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w5htf"
Sep 10 17:41:30.764131 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:30.763995    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gqqkd" podUID="1df8c233-a191-43e9-9d86-4a191bd54b1e"
Sep 10 17:41:30.764131 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:30.764074    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w5htf" podUID="fc857d7e-aafa-4018-aeb4-84f423bb5337"
Sep 10 17:41:30.764260 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:30.764175    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-76dl2" podUID="4f8b428e-98e7-4306-b485-d39e9b22eb05"
Sep 10 17:41:30.893041 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:30.893001    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hzw7d" event={"ID":"17c92bd6-66da-44c1-aa62-b095d15cdc12","Type":"ContainerStarted","Data":"d6a9a7b3f09e942a7e409a476502d54651524f4b6da0cd708ba959d71083c823"}
Sep 10 17:41:32.764210 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:32.764015    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-76dl2"
Sep 10 17:41:32.764665 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:32.764015    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gqqkd"
Sep 10 17:41:32.764665 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:32.764293    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-76dl2" podUID="4f8b428e-98e7-4306-b485-d39e9b22eb05"
Sep 10 17:41:32.764665 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:32.764015    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w5htf"
Sep 10 17:41:32.764665 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:32.764411    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gqqkd" podUID="1df8c233-a191-43e9-9d86-4a191bd54b1e"
Sep 10 17:41:32.764665 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:32.764529    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w5htf" podUID="fc857d7e-aafa-4018-aeb4-84f423bb5337"
Sep 10 17:41:32.899163 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:32.899127    2568 generic.go:356] "Generic (PLEG): container finished" podID="774f7882-94da-4a71-a091-32054dc8d27c" containerID="a712f1216d9ffb823f909d058b3a3f244841d74e1614bb82c4426d31d0470e9a" exitCode=0
Sep 10 17:41:32.899331 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:32.899175    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8xsvx" event={"ID":"774f7882-94da-4a71-a091-32054dc8d27c","Type":"ContainerDied","Data":"a712f1216d9ffb823f909d058b3a3f244841d74e1614bb82c4426d31d0470e9a"}
Sep 10 17:41:32.903169 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:32.903143    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f9cn7" event={"ID":"915faba9-e43b-4bdf-ab08-6063e393da6e","Type":"ContainerStarted","Data":"f6884992d09b0dfdf0bc6d08021ae627a0d436651ca5d10692f41a8396e1ce1b"}
Sep 10 17:41:32.903418 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:32.903401    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-f9cn7"
Sep 10 17:41:32.903493 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:32.903460    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-f9cn7"
Sep 10 17:41:32.919897 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:32.919861    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-f9cn7"
Sep 10 17:41:32.933581 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:32.933527    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hzw7d" podStartSLOduration=4.801988526 podStartE2EDuration="26.93351141s" totalImagesPullingTime="22.131522884s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 17:41:06 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:41:30.911964632 +0000 UTC m=+26.673272677" watchObservedRunningTime="2026-09-10 17:41:32.93351141 +0000 UTC m=+28.694819444"
Sep 10 17:41:32.981296 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:32.981241    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-f9cn7" podStartSLOduration=7.763133007 podStartE2EDuration="26.981224741s" totalImagesPullingTime="19.218091734s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 17:41:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:41:32.963933257 +0000 UTC m=+28.725241299" watchObservedRunningTime="2026-09-10 17:41:32.981224741 +0000 UTC m=+28.742532784"
Sep 10 17:41:33.905861 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:33.905668    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-f9cn7"
Sep 10 17:41:33.921167 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:33.921140    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-f9cn7"
Sep 10 17:41:34.238770 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:34.238730    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-gqqkd"]
Sep 10 17:41:34.238945 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:34.238889    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gqqkd"
Sep 10 17:41:34.239074 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:34.239048    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gqqkd" podUID="1df8c233-a191-43e9-9d86-4a191bd54b1e"
Sep 10 17:41:34.241780 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:34.241749    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-w5htf"]
Sep 10 17:41:34.241908 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:34.241861    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w5htf"
Sep 10 17:41:34.241968 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:34.241945    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w5htf" podUID="fc857d7e-aafa-4018-aeb4-84f423bb5337"
Sep 10 17:41:34.255089 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:34.255056    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-76dl2"]
Sep 10 17:41:34.255221 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:34.255183    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-76dl2"
Sep 10 17:41:34.255294 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:34.255273    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-76dl2" podUID="4f8b428e-98e7-4306-b485-d39e9b22eb05"
Sep 10 17:41:34.909568 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:34.909532    2568 generic.go:356] "Generic (PLEG): container finished" podID="774f7882-94da-4a71-a091-32054dc8d27c" containerID="ba7a9cf4248dca2e9172ee6e2573b9908f4811561d214de09be5bb630532dd35" exitCode=0
Sep 10 17:41:34.910133 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:34.909621    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8xsvx" event={"ID":"774f7882-94da-4a71-a091-32054dc8d27c","Type":"ContainerDied","Data":"ba7a9cf4248dca2e9172ee6e2573b9908f4811561d214de09be5bb630532dd35"}
Sep 10 17:41:35.024556 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:35.024516    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-t9bvv"
Sep 10 17:41:35.024714 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:35.024658    2568 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 10 17:41:35.025109 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:35.025093    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-t9bvv"
Sep 10 17:41:35.763837 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:35.763801    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-76dl2"
Sep 10 17:41:35.763979 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:35.763801    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gqqkd"
Sep 10 17:41:35.763979 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:35.763801    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w5htf"
Sep 10 17:41:35.763979 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:35.763925    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-76dl2" podUID="4f8b428e-98e7-4306-b485-d39e9b22eb05"
Sep 10 17:41:35.764109 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:35.763970    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gqqkd" podUID="1df8c233-a191-43e9-9d86-4a191bd54b1e"
Sep 10 17:41:35.764109 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:35.764060    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w5htf" podUID="fc857d7e-aafa-4018-aeb4-84f423bb5337"
Sep 10 17:41:36.915892 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:36.915854    2568 generic.go:356] "Generic (PLEG): container finished" podID="774f7882-94da-4a71-a091-32054dc8d27c" containerID="5a5436c8420613fd022c97f6a0d5c1bcfb9783a7d7845c5dd872755e79baf4af" exitCode=0
Sep 10 17:41:36.916476 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:36.915934    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8xsvx" event={"ID":"774f7882-94da-4a71-a091-32054dc8d27c","Type":"ContainerDied","Data":"5a5436c8420613fd022c97f6a0d5c1bcfb9783a7d7845c5dd872755e79baf4af"}
Sep 10 17:41:37.763810 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:37.763575    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gqqkd"
Sep 10 17:41:37.764009 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:37.763575    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w5htf"
Sep 10 17:41:37.764009 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:37.763915    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gqqkd" podUID="1df8c233-a191-43e9-9d86-4a191bd54b1e"
Sep 10 17:41:37.764009 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:37.763607    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-76dl2"
Sep 10 17:41:37.764009 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:37.763976    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w5htf" podUID="fc857d7e-aafa-4018-aeb4-84f423bb5337"
Sep 10 17:41:37.764196 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:37.764151    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-76dl2" podUID="4f8b428e-98e7-4306-b485-d39e9b22eb05"
Sep 10 17:41:38.441195 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:38.439061    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4f8b428e-98e7-4306-b485-d39e9b22eb05-metrics-certs\") pod \"network-metrics-daemon-76dl2\" (UID: \"4f8b428e-98e7-4306-b485-d39e9b22eb05\") " pod="openshift-multus/network-metrics-daemon-76dl2"
Sep 10 17:41:38.441195 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:38.439173    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1df8c233-a191-43e9-9d86-4a191bd54b1e-original-pull-secret\") pod \"global-pull-secret-syncer-gqqkd\" (UID: \"1df8c233-a191-43e9-9d86-4a191bd54b1e\") " pod="kube-system/global-pull-secret-syncer-gqqkd"
Sep 10 17:41:38.441195 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:38.439352    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 17:41:38.441195 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:38.439437    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1df8c233-a191-43e9-9d86-4a191bd54b1e-original-pull-secret podName:1df8c233-a191-43e9-9d86-4a191bd54b1e nodeName:}" failed. No retries permitted until 2026-09-10 17:42:10.4394107 +0000 UTC m=+66.200718735 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1df8c233-a191-43e9-9d86-4a191bd54b1e-original-pull-secret") pod "global-pull-secret-syncer-gqqkd" (UID: "1df8c233-a191-43e9-9d86-4a191bd54b1e") : object "kube-system"/"original-pull-secret" not registered
Sep 10 17:41:38.441195 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:38.439958    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 17:41:38.441195 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:38.440017    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f8b428e-98e7-4306-b485-d39e9b22eb05-metrics-certs podName:4f8b428e-98e7-4306-b485-d39e9b22eb05 nodeName:}" failed. No retries permitted until 2026-09-10 17:42:10.440001994 +0000 UTC m=+66.201310017 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4f8b428e-98e7-4306-b485-d39e9b22eb05-metrics-certs") pod "network-metrics-daemon-76dl2" (UID: "4f8b428e-98e7-4306-b485-d39e9b22eb05") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 17:41:38.641169 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:38.641120    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vgdr\" (UniqueName: \"kubernetes.io/projected/fc857d7e-aafa-4018-aeb4-84f423bb5337-kube-api-access-7vgdr\") pod \"network-check-target-w5htf\" (UID: \"fc857d7e-aafa-4018-aeb4-84f423bb5337\") " pod="openshift-network-diagnostics/network-check-target-w5htf"
Sep 10 17:41:38.641379 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:38.641251    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 17:41:38.641379 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:38.641266    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 17:41:38.641379 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:38.641275    2568 projected.go:196] Error preparing data for projected volume kube-api-access-7vgdr for pod openshift-network-diagnostics/network-check-target-w5htf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 17:41:38.641379 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:38.641353    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fc857d7e-aafa-4018-aeb4-84f423bb5337-kube-api-access-7vgdr podName:fc857d7e-aafa-4018-aeb4-84f423bb5337 nodeName:}" failed. No retries permitted until 2026-09-10 17:42:10.641315418 +0000 UTC m=+66.402623438 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-7vgdr" (UniqueName: "kubernetes.io/projected/fc857d7e-aafa-4018-aeb4-84f423bb5337-kube-api-access-7vgdr") pod "network-check-target-w5htf" (UID: "fc857d7e-aafa-4018-aeb4-84f423bb5337") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 17:41:39.764073 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:39.764032    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w5htf"
Sep 10 17:41:39.764548 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:39.764100    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gqqkd"
Sep 10 17:41:39.764548 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:39.764196    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-76dl2"
Sep 10 17:41:39.764548 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:39.764215    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w5htf" podUID="fc857d7e-aafa-4018-aeb4-84f423bb5337"
Sep 10 17:41:39.764548 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:39.764287    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-76dl2" podUID="4f8b428e-98e7-4306-b485-d39e9b22eb05"
Sep 10 17:41:39.764548 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:39.764387    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gqqkd" podUID="1df8c233-a191-43e9-9d86-4a191bd54b1e"
Sep 10 17:41:40.032299 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:40.032210    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-161.ec2.internal" event="NodeReady"
Sep 10 17:41:40.032474 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:40.032378    2568 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 10 17:41:40.084306 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:40.084259    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-77c4f8844d-b7c4w"]
Sep 10 17:41:40.095536 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:40.095506    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77c4f8844d-b7c4w"
Sep 10 17:41:40.099056 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:40.099031    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 10 17:41:40.099203 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:40.099150    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 10 17:41:40.099707 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:40.099692    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-stkqn\""
Sep 10 17:41:40.099707 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:40.099701    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 10 17:41:40.102352 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:40.102314    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-n64rx"]
Sep 10 17:41:40.107385 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:40.107364    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 10 17:41:40.112712 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:40.112689    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-77c4f8844d-b7c4w"]
Sep 10 17:41:40.112827 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:40.112720    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-n8gr2"]
Sep 10 17:41:40.112827 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:40.112809    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-n64rx"
Sep 10 17:41:40.115791 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:40.115767    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 10 17:41:40.116031 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:40.116011    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 10 17:41:40.116031 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:40.116023    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-d7j7h\""
Sep 10 17:41:40.130668 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:40.130638    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-n64rx"]
Sep 10 17:41:40.131196 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:40.131171    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-n8gr2"
Sep 10 17:41:40.135639 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:40.135578    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 10 17:41:40.135802 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:40.135778    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-p79lb\""
Sep 10 17:41:40.137716 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:40.137695    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 10 17:41:40.137852 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:40.137699    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 10 17:41:40.144404 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:40.144378    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-n8gr2"]
Sep 10 17:41:40.252725 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:40.252684    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/23ba8a7e-2139-4312-bb59-b1adfeb87a10-installation-pull-secrets\") pod \"image-registry-77c4f8844d-b7c4w\" (UID: \"23ba8a7e-2139-4312-bb59-b1adfeb87a10\") " pod="openshift-image-registry/image-registry-77c4f8844d-b7c4w"
Sep 10 17:41:40.252725 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:40.252722    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3a37cb7c-2638-48d0-83c2-d039ac7b6771-config-volume\") pod \"dns-default-n64rx\" (UID: \"3a37cb7c-2638-48d0-83c2-d039ac7b6771\") " pod="openshift-dns/dns-default-n64rx"
Sep 10 17:41:40.252933 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:40.252746    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5k5fn\" (UniqueName: \"kubernetes.io/projected/3a37cb7c-2638-48d0-83c2-d039ac7b6771-kube-api-access-5k5fn\") pod \"dns-default-n64rx\" (UID: \"3a37cb7c-2638-48d0-83c2-d039ac7b6771\") " pod="openshift-dns/dns-default-n64rx"
Sep 10 17:41:40.252933 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:40.252813    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnnbr\" (UniqueName: \"kubernetes.io/projected/77340c83-f0c1-4617-a0df-dc686674f941-kube-api-access-tnnbr\") pod \"ingress-canary-n8gr2\" (UID: \"77340c83-f0c1-4617-a0df-dc686674f941\") " pod="openshift-ingress-canary/ingress-canary-n8gr2"
Sep 10 17:41:40.252933 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:40.252855    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3a37cb7c-2638-48d0-83c2-d039ac7b6771-metrics-tls\") pod \"dns-default-n64rx\" (UID: \"3a37cb7c-2638-48d0-83c2-d039ac7b6771\") " pod="openshift-dns/dns-default-n64rx"
Sep 10 17:41:40.252933 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:40.252873    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a37cb7c-2638-48d0-83c2-d039ac7b6771-tmp-dir\") pod \"dns-default-n64rx\" (UID: \"3a37cb7c-2638-48d0-83c2-d039ac7b6771\") " pod="openshift-dns/dns-default-n64rx"
Sep 10 17:41:40.252933 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:40.252896    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/23ba8a7e-2139-4312-bb59-b1adfeb87a10-ca-trust-extracted\") pod \"image-registry-77c4f8844d-b7c4w\" (UID: \"23ba8a7e-2139-4312-bb59-b1adfeb87a10\") " pod="openshift-image-registry/image-registry-77c4f8844d-b7c4w"
Sep 10 17:41:40.252933 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:40.252925    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvl48\" (UniqueName: \"kubernetes.io/projected/23ba8a7e-2139-4312-bb59-b1adfeb87a10-kube-api-access-vvl48\") pod \"image-registry-77c4f8844d-b7c4w\" (UID: \"23ba8a7e-2139-4312-bb59-b1adfeb87a10\") " pod="openshift-image-registry/image-registry-77c4f8844d-b7c4w"
Sep 10 17:41:40.253111 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:40.252950    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/77340c83-f0c1-4617-a0df-dc686674f941-cert\") pod \"ingress-canary-n8gr2\" (UID: \"77340c83-f0c1-4617-a0df-dc686674f941\") " pod="openshift-ingress-canary/ingress-canary-n8gr2"
Sep 10 17:41:40.253111 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:40.252964    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/23ba8a7e-2139-4312-bb59-b1adfeb87a10-image-registry-private-configuration\") pod \"image-registry-77c4f8844d-b7c4w\" (UID: \"23ba8a7e-2139-4312-bb59-b1adfeb87a10\") " pod="openshift-image-registry/image-registry-77c4f8844d-b7c4w"
Sep 10 17:41:40.253111 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:40.253009    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/23ba8a7e-2139-4312-bb59-b1adfeb87a10-registry-certificates\") pod \"image-registry-77c4f8844d-b7c4w\" (UID: \"23ba8a7e-2139-4312-bb59-b1adfeb87a10\") " pod="openshift-image-registry/image-registry-77c4f8844d-b7c4w"
Sep 10 17:41:40.253111 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:40.253028    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/23ba8a7e-2139-4312-bb59-b1adfeb87a10-trusted-ca\") pod \"image-registry-77c4f8844d-b7c4w\" (UID: \"23ba8a7e-2139-4312-bb59-b1adfeb87a10\") " pod="openshift-image-registry/image-registry-77c4f8844d-b7c4w"
Sep 10 17:41:40.253111 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:40.253045    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/23ba8a7e-2139-4312-bb59-b1adfeb87a10-bound-sa-token\") pod \"image-registry-77c4f8844d-b7c4w\" (UID: \"23ba8a7e-2139-4312-bb59-b1adfeb87a10\") " pod="openshift-image-registry/image-registry-77c4f8844d-b7c4w"
Sep 10 17:41:40.253293 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:40.253115    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/23ba8a7e-2139-4312-bb59-b1adfeb87a10-registry-tls\") pod \"image-registry-77c4f8844d-b7c4w\" (UID: \"23ba8a7e-2139-4312-bb59-b1adfeb87a10\") " pod="openshift-image-registry/image-registry-77c4f8844d-b7c4w"
Sep 10 17:41:40.353585 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:40.353489    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnnbr\" (UniqueName: \"kubernetes.io/projected/77340c83-f0c1-4617-a0df-dc686674f941-kube-api-access-tnnbr\") pod \"ingress-canary-n8gr2\" (UID: \"77340c83-f0c1-4617-a0df-dc686674f941\") " pod="openshift-ingress-canary/ingress-canary-n8gr2"
Sep 10 17:41:40.353585 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:40.353534    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3a37cb7c-2638-48d0-83c2-d039ac7b6771-metrics-tls\") pod \"dns-default-n64rx\" (UID: \"3a37cb7c-2638-48d0-83c2-d039ac7b6771\") " pod="openshift-dns/dns-default-n64rx"
Sep 10 17:41:40.353585 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:40.353554    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a37cb7c-2638-48d0-83c2-d039ac7b6771-tmp-dir\") pod \"dns-default-n64rx\" (UID: \"3a37cb7c-2638-48d0-83c2-d039ac7b6771\") " pod="openshift-dns/dns-default-n64rx"
Sep 10 17:41:40.353820 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:40.353659    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 17:41:40.353820 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:40.353725    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a37cb7c-2638-48d0-83c2-d039ac7b6771-metrics-tls podName:3a37cb7c-2638-48d0-83c2-d039ac7b6771 nodeName:}" failed. No retries permitted until 2026-09-10 17:41:40.853703235 +0000 UTC m=+36.615011256 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3a37cb7c-2638-48d0-83c2-d039ac7b6771-metrics-tls") pod "dns-default-n64rx" (UID: "3a37cb7c-2638-48d0-83c2-d039ac7b6771") : secret "dns-default-metrics-tls" not found
Sep 10 17:41:40.353820 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:40.353761    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/23ba8a7e-2139-4312-bb59-b1adfeb87a10-ca-trust-extracted\") pod \"image-registry-77c4f8844d-b7c4w\" (UID: \"23ba8a7e-2139-4312-bb59-b1adfeb87a10\") " pod="openshift-image-registry/image-registry-77c4f8844d-b7c4w"
Sep 10 17:41:40.353820 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:40.353796    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvl48\" (UniqueName: \"kubernetes.io/projected/23ba8a7e-2139-4312-bb59-b1adfeb87a10-kube-api-access-vvl48\") pod \"image-registry-77c4f8844d-b7c4w\" (UID: \"23ba8a7e-2139-4312-bb59-b1adfeb87a10\") " pod="openshift-image-registry/image-registry-77c4f8844d-b7c4w"
Sep 10 17:41:40.353957 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:40.353835    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/77340c83-f0c1-4617-a0df-dc686674f941-cert\") pod \"ingress-canary-n8gr2\" (UID: \"77340c83-f0c1-4617-a0df-dc686674f941\") " pod="openshift-ingress-canary/ingress-canary-n8gr2"
Sep 10 17:41:40.353957 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:40.353861    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/23ba8a7e-2139-4312-bb59-b1adfeb87a10-image-registry-private-configuration\") pod \"image-registry-77c4f8844d-b7c4w\" (UID: \"23ba8a7e-2139-4312-bb59-b1adfeb87a10\") " pod="openshift-image-registry/image-registry-77c4f8844d-b7c4w"
Sep 10 17:41:40.353957 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:40.353904    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a37cb7c-2638-48d0-83c2-d039ac7b6771-tmp-dir\") pod \"dns-default-n64rx\" (UID: \"3a37cb7c-2638-48d0-83c2-d039ac7b6771\") " pod="openshift-dns/dns-default-n64rx"
Sep 10 17:41:40.353957 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:40.353912    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/23ba8a7e-2139-4312-bb59-b1adfeb87a10-registry-certificates\") pod \"image-registry-77c4f8844d-b7c4w\" (UID: \"23ba8a7e-2139-4312-bb59-b1adfeb87a10\") " pod="openshift-image-registry/image-registry-77c4f8844d-b7c4w"
Sep 10 17:41:40.353957 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:40.353934    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/23ba8a7e-2139-4312-bb59-b1adfeb87a10-trusted-ca\") pod \"image-registry-77c4f8844d-b7c4w\" (UID: \"23ba8a7e-2139-4312-bb59-b1adfeb87a10\") " pod="openshift-image-registry/image-registry-77c4f8844d-b7c4w"
Sep 10 17:41:40.354136 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:40.353959    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/23ba8a7e-2139-4312-bb59-b1adfeb87a10-bound-sa-token\") pod \"image-registry-77c4f8844d-b7c4w\" (UID: \"23ba8a7e-2139-4312-bb59-b1adfeb87a10\") " pod="openshift-image-registry/image-registry-77c4f8844d-b7c4w"
Sep 10 17:41:40.354136 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:40.353989    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/23ba8a7e-2139-4312-bb59-b1adfeb87a10-registry-tls\") pod \"image-registry-77c4f8844d-b7c4w\" (UID: \"23ba8a7e-2139-4312-bb59-b1adfeb87a10\") " pod="openshift-image-registry/image-registry-77c4f8844d-b7c4w"
Sep 10 17:41:40.354136 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:40.354059    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/23ba8a7e-2139-4312-bb59-b1adfeb87a10-installation-pull-secrets\") pod \"image-registry-77c4f8844d-b7c4w\" (UID: \"23ba8a7e-2139-4312-bb59-b1adfeb87a10\") " pod="openshift-image-registry/image-registry-77c4f8844d-b7c4w"
Sep 10 17:41:40.354136 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:40.354085    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3a37cb7c-2638-48d0-83c2-d039ac7b6771-config-volume\") pod \"dns-default-n64rx\" (UID: \"3a37cb7c-2638-48d0-83c2-d039ac7b6771\") " pod="openshift-dns/dns-default-n64rx"
Sep 10 17:41:40.354136 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:40.354112    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5k5fn\" (UniqueName: \"kubernetes.io/projected/3a37cb7c-2638-48d0-83c2-d039ac7b6771-kube-api-access-5k5fn\") pod \"dns-default-n64rx\" (UID: \"3a37cb7c-2638-48d0-83c2-d039ac7b6771\") " pod="openshift-dns/dns-default-n64rx"
Sep 10 17:41:40.354410 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:40.354176    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/23ba8a7e-2139-4312-bb59-b1adfeb87a10-ca-trust-extracted\") pod \"image-registry-77c4f8844d-b7c4w\" (UID: \"23ba8a7e-2139-4312-bb59-b1adfeb87a10\") " pod="openshift-image-registry/image-registry-77c4f8844d-b7c4w"
Sep 10 17:41:40.354551 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:40.354524    2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 17:41:40.354551 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:40.354544    2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77c4f8844d-b7c4w: secret "image-registry-tls" not found
Sep 10 17:41:40.354743 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:40.354593    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/23ba8a7e-2139-4312-bb59-b1adfeb87a10-registry-tls podName:23ba8a7e-2139-4312-bb59-b1adfeb87a10 nodeName:}" failed. No retries permitted until 2026-09-10 17:41:40.854576545 +0000 UTC m=+36.615884569 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/23ba8a7e-2139-4312-bb59-b1adfeb87a10-registry-tls") pod "image-registry-77c4f8844d-b7c4w" (UID: "23ba8a7e-2139-4312-bb59-b1adfeb87a10") : secret "image-registry-tls" not found
Sep 10 17:41:40.354906 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:40.354884    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/23ba8a7e-2139-4312-bb59-b1adfeb87a10-registry-certificates\") pod \"image-registry-77c4f8844d-b7c4w\" (UID: \"23ba8a7e-2139-4312-bb59-b1adfeb87a10\") " pod="openshift-image-registry/image-registry-77c4f8844d-b7c4w"
Sep 10 17:41:40.355219 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:40.355178    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3a37cb7c-2638-48d0-83c2-d039ac7b6771-config-volume\") pod \"dns-default-n64rx\" (UID: \"3a37cb7c-2638-48d0-83c2-d039ac7b6771\") " pod="openshift-dns/dns-default-n64rx"
Sep 10 17:41:40.355641 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:40.355606    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/23ba8a7e-2139-4312-bb59-b1adfeb87a10-trusted-ca\") pod \"image-registry-77c4f8844d-b7c4w\" (UID: \"23ba8a7e-2139-4312-bb59-b1adfeb87a10\") " pod="openshift-image-registry/image-registry-77c4f8844d-b7c4w"
Sep 10 17:41:40.358853 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:40.358827    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/23ba8a7e-2139-4312-bb59-b1adfeb87a10-installation-pull-secrets\") pod \"image-registry-77c4f8844d-b7c4w\" (UID: \"23ba8a7e-2139-4312-bb59-b1adfeb87a10\") " pod="openshift-image-registry/image-registry-77c4f8844d-b7c4w"
Sep 10 17:41:40.358853 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:40.358847    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/77340c83-f0c1-4617-a0df-dc686674f941-cert\") pod \"ingress-canary-n8gr2\" (UID: \"77340c83-f0c1-4617-a0df-dc686674f941\") " pod="openshift-ingress-canary/ingress-canary-n8gr2"
Sep 10 17:41:40.359022 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:40.358847    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/23ba8a7e-2139-4312-bb59-b1adfeb87a10-image-registry-private-configuration\") pod \"image-registry-77c4f8844d-b7c4w\" (UID: \"23ba8a7e-2139-4312-bb59-b1adfeb87a10\") " pod="openshift-image-registry/image-registry-77c4f8844d-b7c4w"
Sep 10 17:41:40.369972 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:40.369859    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/23ba8a7e-2139-4312-bb59-b1adfeb87a10-bound-sa-token\") pod \"image-registry-77c4f8844d-b7c4w\" (UID: \"23ba8a7e-2139-4312-bb59-b1adfeb87a10\") " pod="openshift-image-registry/image-registry-77c4f8844d-b7c4w"
Sep 10 17:41:40.369972 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:40.369877    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5k5fn\" (UniqueName: \"kubernetes.io/projected/3a37cb7c-2638-48d0-83c2-d039ac7b6771-kube-api-access-5k5fn\") pod \"dns-default-n64rx\" (UID: \"3a37cb7c-2638-48d0-83c2-d039ac7b6771\") " pod="openshift-dns/dns-default-n64rx"
Sep 10 17:41:40.369972 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:40.369915    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvl48\" (UniqueName: \"kubernetes.io/projected/23ba8a7e-2139-4312-bb59-b1adfeb87a10-kube-api-access-vvl48\") pod \"image-registry-77c4f8844d-b7c4w\" (UID: \"23ba8a7e-2139-4312-bb59-b1adfeb87a10\") " pod="openshift-image-registry/image-registry-77c4f8844d-b7c4w"
Sep 10 17:41:40.370186 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:40.369987    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnnbr\" (UniqueName: \"kubernetes.io/projected/77340c83-f0c1-4617-a0df-dc686674f941-kube-api-access-tnnbr\") pod \"ingress-canary-n8gr2\" (UID: \"77340c83-f0c1-4617-a0df-dc686674f941\") " pod="openshift-ingress-canary/ingress-canary-n8gr2"
Sep 10 17:41:40.445210 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:40.445168    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-n8gr2"
Sep 10 17:41:40.782158 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:40.782122    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-n8gr2"]
Sep 10 17:41:40.786301 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:40.786269    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77340c83_f0c1_4617_a0df_dc686674f941.slice/crio-113d5d207bc419290daa31b9dcbd9e09801c2014af217fe822eec282235e8fe4 WatchSource:0}: Error finding container 113d5d207bc419290daa31b9dcbd9e09801c2014af217fe822eec282235e8fe4: Status 404 returned error can't find the container with id 113d5d207bc419290daa31b9dcbd9e09801c2014af217fe822eec282235e8fe4
Sep 10 17:41:40.857840 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:40.857805    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3a37cb7c-2638-48d0-83c2-d039ac7b6771-metrics-tls\") pod \"dns-default-n64rx\" (UID: \"3a37cb7c-2638-48d0-83c2-d039ac7b6771\") " pod="openshift-dns/dns-default-n64rx"
Sep 10 17:41:40.858007 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:40.857944    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/23ba8a7e-2139-4312-bb59-b1adfeb87a10-registry-tls\") pod \"image-registry-77c4f8844d-b7c4w\" (UID: \"23ba8a7e-2139-4312-bb59-b1adfeb87a10\") " pod="openshift-image-registry/image-registry-77c4f8844d-b7c4w"
Sep 10 17:41:40.858007 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:40.857960    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 17:41:40.858082 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:40.858027    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a37cb7c-2638-48d0-83c2-d039ac7b6771-metrics-tls podName:3a37cb7c-2638-48d0-83c2-d039ac7b6771 nodeName:}" failed. No retries permitted until 2026-09-10 17:41:41.858008183 +0000 UTC m=+37.619316208 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3a37cb7c-2638-48d0-83c2-d039ac7b6771-metrics-tls") pod "dns-default-n64rx" (UID: "3a37cb7c-2638-48d0-83c2-d039ac7b6771") : secret "dns-default-metrics-tls" not found
Sep 10 17:41:40.858082 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:40.858045    2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 17:41:40.858082 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:40.858055    2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77c4f8844d-b7c4w: secret "image-registry-tls" not found
Sep 10 17:41:40.858194 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:40.858094    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/23ba8a7e-2139-4312-bb59-b1adfeb87a10-registry-tls podName:23ba8a7e-2139-4312-bb59-b1adfeb87a10 nodeName:}" failed. No retries permitted until 2026-09-10 17:41:41.858081333 +0000 UTC m=+37.619389354 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/23ba8a7e-2139-4312-bb59-b1adfeb87a10-registry-tls") pod "image-registry-77c4f8844d-b7c4w" (UID: "23ba8a7e-2139-4312-bb59-b1adfeb87a10") : secret "image-registry-tls" not found
Sep 10 17:41:40.927593 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:40.927562    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-n8gr2" event={"ID":"77340c83-f0c1-4617-a0df-dc686674f941","Type":"ContainerStarted","Data":"113d5d207bc419290daa31b9dcbd9e09801c2014af217fe822eec282235e8fe4"}
Sep 10 17:41:41.764193 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:41.764162    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w5htf"
Sep 10 17:41:41.764380 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:41.764168    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gqqkd"
Sep 10 17:41:41.764380 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:41.764301    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-76dl2"
Sep 10 17:41:41.767373 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:41.767288    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 10 17:41:41.768399 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:41.768359    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 10 17:41:41.768612 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:41.768591    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 10 17:41:41.768708 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:41.768616    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-fbgqn\""
Sep 10 17:41:41.768944 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:41.768926    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hkln9\""
Sep 10 17:41:41.769022 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:41.768973    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 10 17:41:41.868058 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:41.868007    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3a37cb7c-2638-48d0-83c2-d039ac7b6771-metrics-tls\") pod \"dns-default-n64rx\" (UID: \"3a37cb7c-2638-48d0-83c2-d039ac7b6771\") " pod="openshift-dns/dns-default-n64rx"
Sep 10 17:41:41.868510 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:41.868113    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/23ba8a7e-2139-4312-bb59-b1adfeb87a10-registry-tls\") pod \"image-registry-77c4f8844d-b7c4w\" (UID: \"23ba8a7e-2139-4312-bb59-b1adfeb87a10\") " pod="openshift-image-registry/image-registry-77c4f8844d-b7c4w"
Sep 10 17:41:41.868510 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:41.868205    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 17:41:41.868510 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:41.868280    2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 17:41:41.868510 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:41.868291    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a37cb7c-2638-48d0-83c2-d039ac7b6771-metrics-tls podName:3a37cb7c-2638-48d0-83c2-d039ac7b6771 nodeName:}" failed. No retries permitted until 2026-09-10 17:41:43.86826896 +0000 UTC m=+39.629577005 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3a37cb7c-2638-48d0-83c2-d039ac7b6771-metrics-tls") pod "dns-default-n64rx" (UID: "3a37cb7c-2638-48d0-83c2-d039ac7b6771") : secret "dns-default-metrics-tls" not found
Sep 10 17:41:41.868510 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:41.868300    2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77c4f8844d-b7c4w: secret "image-registry-tls" not found
Sep 10 17:41:41.868510 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:41.868370    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/23ba8a7e-2139-4312-bb59-b1adfeb87a10-registry-tls podName:23ba8a7e-2139-4312-bb59-b1adfeb87a10 nodeName:}" failed. No retries permitted until 2026-09-10 17:41:43.868352422 +0000 UTC m=+39.629660446 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/23ba8a7e-2139-4312-bb59-b1adfeb87a10-registry-tls") pod "image-registry-77c4f8844d-b7c4w" (UID: "23ba8a7e-2139-4312-bb59-b1adfeb87a10") : secret "image-registry-tls" not found
Sep 10 17:41:43.884062 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:43.883844    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/23ba8a7e-2139-4312-bb59-b1adfeb87a10-registry-tls\") pod \"image-registry-77c4f8844d-b7c4w\" (UID: \"23ba8a7e-2139-4312-bb59-b1adfeb87a10\") " pod="openshift-image-registry/image-registry-77c4f8844d-b7c4w"
Sep 10 17:41:43.884062 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:43.884050    2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 17:41:43.884062 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:43.884078    2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77c4f8844d-b7c4w: secret "image-registry-tls" not found
Sep 10 17:41:43.884699 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:43.884115    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3a37cb7c-2638-48d0-83c2-d039ac7b6771-metrics-tls\") pod \"dns-default-n64rx\" (UID: \"3a37cb7c-2638-48d0-83c2-d039ac7b6771\") " pod="openshift-dns/dns-default-n64rx"
Sep 10 17:41:43.884699 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:43.884140    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/23ba8a7e-2139-4312-bb59-b1adfeb87a10-registry-tls podName:23ba8a7e-2139-4312-bb59-b1adfeb87a10 nodeName:}" failed. No retries permitted until 2026-09-10 17:41:47.88411968 +0000 UTC m=+43.645427702 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/23ba8a7e-2139-4312-bb59-b1adfeb87a10-registry-tls") pod "image-registry-77c4f8844d-b7c4w" (UID: "23ba8a7e-2139-4312-bb59-b1adfeb87a10") : secret "image-registry-tls" not found
Sep 10 17:41:43.884699 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:43.884242    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 17:41:43.884699 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:43.884292    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a37cb7c-2638-48d0-83c2-d039ac7b6771-metrics-tls podName:3a37cb7c-2638-48d0-83c2-d039ac7b6771 nodeName:}" failed. No retries permitted until 2026-09-10 17:41:47.884280368 +0000 UTC m=+43.645588389 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3a37cb7c-2638-48d0-83c2-d039ac7b6771-metrics-tls") pod "dns-default-n64rx" (UID: "3a37cb7c-2638-48d0-83c2-d039ac7b6771") : secret "dns-default-metrics-tls" not found
Sep 10 17:41:45.943614 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:45.943574    2568 generic.go:356] "Generic (PLEG): container finished" podID="774f7882-94da-4a71-a091-32054dc8d27c" containerID="ff576220e13df00ab98534a192ccdbda4ae5f88b669472315a96fa6f0d43fe05" exitCode=0
Sep 10 17:41:45.944058 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:45.943619    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8xsvx" event={"ID":"774f7882-94da-4a71-a091-32054dc8d27c","Type":"ContainerDied","Data":"ff576220e13df00ab98534a192ccdbda4ae5f88b669472315a96fa6f0d43fe05"}
Sep 10 17:41:45.945383 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:45.945352    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-n8gr2" event={"ID":"77340c83-f0c1-4617-a0df-dc686674f941","Type":"ContainerStarted","Data":"c0c9d8e5287ece7ee8ece7a434de72e4f4ddbe2cde8afe40716b6ee27fd2a094"}
Sep 10 17:41:46.009753 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:46.009698    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-n8gr2" podStartSLOduration=1.208579676 podStartE2EDuration="6.009657959s" totalImagesPullingTime="4.801078283s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:41:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:41:46.009399805 +0000 UTC m=+41.770707849" watchObservedRunningTime="2026-09-10 17:41:46.009657959 +0000 UTC m=+41.770966002"
Sep 10 17:41:46.950815 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:46.950779    2568 generic.go:356] "Generic (PLEG): container finished" podID="774f7882-94da-4a71-a091-32054dc8d27c" containerID="9781497acb319fcf2eddf73f637a363aced413e26e5bb992e774acffe7d500da" exitCode=0
Sep 10 17:41:46.951189 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:46.950857    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8xsvx" event={"ID":"774f7882-94da-4a71-a091-32054dc8d27c","Type":"ContainerDied","Data":"9781497acb319fcf2eddf73f637a363aced413e26e5bb992e774acffe7d500da"}
Sep 10 17:41:47.914922 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:47.914884    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3a37cb7c-2638-48d0-83c2-d039ac7b6771-metrics-tls\") pod \"dns-default-n64rx\" (UID: \"3a37cb7c-2638-48d0-83c2-d039ac7b6771\") " pod="openshift-dns/dns-default-n64rx"
Sep 10 17:41:47.915107 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:47.914948    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/23ba8a7e-2139-4312-bb59-b1adfeb87a10-registry-tls\") pod \"image-registry-77c4f8844d-b7c4w\" (UID: \"23ba8a7e-2139-4312-bb59-b1adfeb87a10\") " pod="openshift-image-registry/image-registry-77c4f8844d-b7c4w"
Sep 10 17:41:47.915107 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:47.915040    2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 17:41:47.915107 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:47.915045    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 17:41:47.915217 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:47.915112    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a37cb7c-2638-48d0-83c2-d039ac7b6771-metrics-tls podName:3a37cb7c-2638-48d0-83c2-d039ac7b6771 nodeName:}" failed. No retries permitted until 2026-09-10 17:41:55.915095412 +0000 UTC m=+51.676403469 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3a37cb7c-2638-48d0-83c2-d039ac7b6771-metrics-tls") pod "dns-default-n64rx" (UID: "3a37cb7c-2638-48d0-83c2-d039ac7b6771") : secret "dns-default-metrics-tls" not found
Sep 10 17:41:47.915217 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:47.915053    2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77c4f8844d-b7c4w: secret "image-registry-tls" not found
Sep 10 17:41:47.915217 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:47.915190    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/23ba8a7e-2139-4312-bb59-b1adfeb87a10-registry-tls podName:23ba8a7e-2139-4312-bb59-b1adfeb87a10 nodeName:}" failed. No retries permitted until 2026-09-10 17:41:55.915179307 +0000 UTC m=+51.676487354 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/23ba8a7e-2139-4312-bb59-b1adfeb87a10-registry-tls") pod "image-registry-77c4f8844d-b7c4w" (UID: "23ba8a7e-2139-4312-bb59-b1adfeb87a10") : secret "image-registry-tls" not found
Sep 10 17:41:47.956142 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:47.956113    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8xsvx" event={"ID":"774f7882-94da-4a71-a091-32054dc8d27c","Type":"ContainerStarted","Data":"0acb337aa896b6a320df3e61ab2cd65812c761fa61c73a86151f7e6b1b529160"}
Sep 10 17:41:47.981865 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:47.981818    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-8xsvx" podStartSLOduration=6.5619211360000005 podStartE2EDuration="41.981803553s" totalImagesPullingTime="35.419882417s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 17:41:06 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:41:47.980980743 +0000 UTC m=+43.742288788" watchObservedRunningTime="2026-09-10 17:41:47.981803553 +0000 UTC m=+43.743111593"
Sep 10 17:41:48.557704 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:48.557664    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-vzfdh"]
Sep 10 17:41:48.587695 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:48.587662    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-8hhtb"]
Sep 10 17:41:48.587881 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:48.587795    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-vzfdh"
Sep 10 17:41:48.590518 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:48.590494    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-gc2qn\""
Sep 10 17:41:48.601858 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:48.601827    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-vzfdh"]
Sep 10 17:41:48.601858 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:48.601860    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-8hhtb"]
Sep 10 17:41:48.602083 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:48.601958    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-8hhtb"
Sep 10 17:41:48.606227 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:48.606204    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Sep 10 17:41:48.606419 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:48.606401    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 10 17:41:48.606642 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:48.606619    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Sep 10 17:41:48.606757 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:48.606643    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-5vtv5\""
Sep 10 17:41:48.606757 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:48.606688    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 10 17:41:48.614198 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:48.614175    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Sep 10 17:41:48.667988 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:48.666034    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-85b454874b-jwfnv"]
Sep 10 17:41:48.685405 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:48.685374    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85b454874b-jwfnv"
Sep 10 17:41:48.687416 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:48.687393    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85b454874b-jwfnv"]
Sep 10 17:41:48.689753 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:48.689732    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Sep 10 17:41:48.690117 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:48.689975    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Sep 10 17:41:48.690117 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:48.690006    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Sep 10 17:41:48.691816 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:48.691684    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Sep 10 17:41:48.691816 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:48.691688    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-hlg6f\""
Sep 10 17:41:48.694511 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:48.694492    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Sep 10 17:41:48.721956 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:48.721924    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50081a35-70d7-41dd-88af-176fb4aca5d6-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-8hhtb\" (UID: \"50081a35-70d7-41dd-88af-176fb4aca5d6\") " pod="openshift-insights/insights-operator-76bcd6ccf5-8hhtb"
Sep 10 17:41:48.722138 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:48.721970    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/50081a35-70d7-41dd-88af-176fb4aca5d6-serving-cert\") pod \"insights-operator-76bcd6ccf5-8hhtb\" (UID: \"50081a35-70d7-41dd-88af-176fb4aca5d6\") " pod="openshift-insights/insights-operator-76bcd6ccf5-8hhtb"
Sep 10 17:41:48.722138 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:48.721991    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qgfh\" (UniqueName: \"kubernetes.io/projected/b1e59696-062b-4275-b1d7-f76f725e0ea0-kube-api-access-9qgfh\") pod \"network-check-source-685456655f-vzfdh\" (UID: \"b1e59696-062b-4275-b1d7-f76f725e0ea0\") " pod="openshift-network-diagnostics/network-check-source-685456655f-vzfdh"
Sep 10 17:41:48.722138 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:48.722080    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50081a35-70d7-41dd-88af-176fb4aca5d6-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-8hhtb\" (UID: \"50081a35-70d7-41dd-88af-176fb4aca5d6\") " pod="openshift-insights/insights-operator-76bcd6ccf5-8hhtb"
Sep 10 17:41:48.722253 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:48.722143    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/50081a35-70d7-41dd-88af-176fb4aca5d6-tmp\") pod \"insights-operator-76bcd6ccf5-8hhtb\" (UID: \"50081a35-70d7-41dd-88af-176fb4aca5d6\") " pod="openshift-insights/insights-operator-76bcd6ccf5-8hhtb"
Sep 10 17:41:48.722253 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:48.722188    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/50081a35-70d7-41dd-88af-176fb4aca5d6-snapshots\") pod \"insights-operator-76bcd6ccf5-8hhtb\" (UID: \"50081a35-70d7-41dd-88af-176fb4aca5d6\") " pod="openshift-insights/insights-operator-76bcd6ccf5-8hhtb"
Sep 10 17:41:48.722253 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:48.722239    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdw4k\" (UniqueName: \"kubernetes.io/projected/50081a35-70d7-41dd-88af-176fb4aca5d6-kube-api-access-pdw4k\") pod \"insights-operator-76bcd6ccf5-8hhtb\" (UID: \"50081a35-70d7-41dd-88af-176fb4aca5d6\") " pod="openshift-insights/insights-operator-76bcd6ccf5-8hhtb"
Sep 10 17:41:48.822889 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:48.822775    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/50081a35-70d7-41dd-88af-176fb4aca5d6-tmp\") pod \"insights-operator-76bcd6ccf5-8hhtb\" (UID: \"50081a35-70d7-41dd-88af-176fb4aca5d6\") " pod="openshift-insights/insights-operator-76bcd6ccf5-8hhtb"
Sep 10 17:41:48.822889 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:48.822816    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/50081a35-70d7-41dd-88af-176fb4aca5d6-snapshots\") pod \"insights-operator-76bcd6ccf5-8hhtb\" (UID: \"50081a35-70d7-41dd-88af-176fb4aca5d6\") " pod="openshift-insights/insights-operator-76bcd6ccf5-8hhtb"
Sep 10 17:41:48.822889 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:48.822836    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdw4k\" (UniqueName: \"kubernetes.io/projected/50081a35-70d7-41dd-88af-176fb4aca5d6-kube-api-access-pdw4k\") pod \"insights-operator-76bcd6ccf5-8hhtb\" (UID: \"50081a35-70d7-41dd-88af-176fb4aca5d6\") " pod="openshift-insights/insights-operator-76bcd6ccf5-8hhtb"
Sep 10 17:41:48.822889 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:48.822863    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e90054ec-91dc-4cda-94a2-fbe7a2a1fff0-trusted-ca\") pod \"console-operator-85b454874b-jwfnv\" (UID: \"e90054ec-91dc-4cda-94a2-fbe7a2a1fff0\") " pod="openshift-console-operator/console-operator-85b454874b-jwfnv"
Sep 10 17:41:48.823201 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:48.822903    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50081a35-70d7-41dd-88af-176fb4aca5d6-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-8hhtb\" (UID: \"50081a35-70d7-41dd-88af-176fb4aca5d6\") " pod="openshift-insights/insights-operator-76bcd6ccf5-8hhtb"
Sep 10 17:41:48.823201 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:48.822941    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/50081a35-70d7-41dd-88af-176fb4aca5d6-serving-cert\") pod \"insights-operator-76bcd6ccf5-8hhtb\" (UID: \"50081a35-70d7-41dd-88af-176fb4aca5d6\") " pod="openshift-insights/insights-operator-76bcd6ccf5-8hhtb"
Sep 10 17:41:48.823201 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:48.822970    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qgfh\" (UniqueName: \"kubernetes.io/projected/b1e59696-062b-4275-b1d7-f76f725e0ea0-kube-api-access-9qgfh\") pod \"network-check-source-685456655f-vzfdh\" (UID: \"b1e59696-062b-4275-b1d7-f76f725e0ea0\") " pod="openshift-network-diagnostics/network-check-source-685456655f-vzfdh"
Sep 10 17:41:48.823201 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:48.822992    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68mg6\" (UniqueName: \"kubernetes.io/projected/e90054ec-91dc-4cda-94a2-fbe7a2a1fff0-kube-api-access-68mg6\") pod \"console-operator-85b454874b-jwfnv\" (UID: \"e90054ec-91dc-4cda-94a2-fbe7a2a1fff0\") " pod="openshift-console-operator/console-operator-85b454874b-jwfnv"
Sep 10 17:41:48.823201 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:48.823040    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e90054ec-91dc-4cda-94a2-fbe7a2a1fff0-config\") pod \"console-operator-85b454874b-jwfnv\" (UID: \"e90054ec-91dc-4cda-94a2-fbe7a2a1fff0\") " pod="openshift-console-operator/console-operator-85b454874b-jwfnv"
Sep 10 17:41:48.823201 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:48.823067    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50081a35-70d7-41dd-88af-176fb4aca5d6-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-8hhtb\" (UID: \"50081a35-70d7-41dd-88af-176fb4aca5d6\") " pod="openshift-insights/insights-operator-76bcd6ccf5-8hhtb"
Sep 10 17:41:48.823201 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:48.823097    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e90054ec-91dc-4cda-94a2-fbe7a2a1fff0-serving-cert\") pod \"console-operator-85b454874b-jwfnv\" (UID: \"e90054ec-91dc-4cda-94a2-fbe7a2a1fff0\") " pod="openshift-console-operator/console-operator-85b454874b-jwfnv"
Sep 10 17:41:48.823647 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:48.823612    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/50081a35-70d7-41dd-88af-176fb4aca5d6-tmp\") pod \"insights-operator-76bcd6ccf5-8hhtb\" (UID: \"50081a35-70d7-41dd-88af-176fb4aca5d6\") " pod="openshift-insights/insights-operator-76bcd6ccf5-8hhtb"
Sep 10 17:41:48.823734 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:48.823693    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/50081a35-70d7-41dd-88af-176fb4aca5d6-snapshots\") pod \"insights-operator-76bcd6ccf5-8hhtb\" (UID: \"50081a35-70d7-41dd-88af-176fb4aca5d6\") " pod="openshift-insights/insights-operator-76bcd6ccf5-8hhtb"
Sep 10 17:41:48.823777 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:48.823753    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50081a35-70d7-41dd-88af-176fb4aca5d6-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-8hhtb\" (UID: \"50081a35-70d7-41dd-88af-176fb4aca5d6\") " pod="openshift-insights/insights-operator-76bcd6ccf5-8hhtb"
Sep 10 17:41:48.823901 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:48.823883    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50081a35-70d7-41dd-88af-176fb4aca5d6-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-8hhtb\" (UID: \"50081a35-70d7-41dd-88af-176fb4aca5d6\") " pod="openshift-insights/insights-operator-76bcd6ccf5-8hhtb"
Sep 10 17:41:48.826446 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:48.826421    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/50081a35-70d7-41dd-88af-176fb4aca5d6-serving-cert\") pod \"insights-operator-76bcd6ccf5-8hhtb\" (UID: \"50081a35-70d7-41dd-88af-176fb4aca5d6\") " pod="openshift-insights/insights-operator-76bcd6ccf5-8hhtb"
Sep 10 17:41:48.836554 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:48.836521    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qgfh\" (UniqueName: \"kubernetes.io/projected/b1e59696-062b-4275-b1d7-f76f725e0ea0-kube-api-access-9qgfh\") pod \"network-check-source-685456655f-vzfdh\" (UID: \"b1e59696-062b-4275-b1d7-f76f725e0ea0\") " pod="openshift-network-diagnostics/network-check-source-685456655f-vzfdh"
Sep 10 17:41:48.836966 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:48.836943    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdw4k\" (UniqueName: \"kubernetes.io/projected/50081a35-70d7-41dd-88af-176fb4aca5d6-kube-api-access-pdw4k\") pod \"insights-operator-76bcd6ccf5-8hhtb\" (UID: \"50081a35-70d7-41dd-88af-176fb4aca5d6\") " pod="openshift-insights/insights-operator-76bcd6ccf5-8hhtb"
Sep 10 17:41:48.896933 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:48.896889    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-vzfdh"
Sep 10 17:41:48.911132 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:48.911097    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-8hhtb"
Sep 10 17:41:48.924468 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:48.924434    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e90054ec-91dc-4cda-94a2-fbe7a2a1fff0-trusted-ca\") pod \"console-operator-85b454874b-jwfnv\" (UID: \"e90054ec-91dc-4cda-94a2-fbe7a2a1fff0\") " pod="openshift-console-operator/console-operator-85b454874b-jwfnv"
Sep 10 17:41:48.924625 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:48.924496    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68mg6\" (UniqueName: \"kubernetes.io/projected/e90054ec-91dc-4cda-94a2-fbe7a2a1fff0-kube-api-access-68mg6\") pod \"console-operator-85b454874b-jwfnv\" (UID: \"e90054ec-91dc-4cda-94a2-fbe7a2a1fff0\") " pod="openshift-console-operator/console-operator-85b454874b-jwfnv"
Sep 10 17:41:48.924625 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:48.924532    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e90054ec-91dc-4cda-94a2-fbe7a2a1fff0-config\") pod \"console-operator-85b454874b-jwfnv\" (UID: \"e90054ec-91dc-4cda-94a2-fbe7a2a1fff0\") " pod="openshift-console-operator/console-operator-85b454874b-jwfnv"
Sep 10 17:41:48.924625 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:48.924551    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e90054ec-91dc-4cda-94a2-fbe7a2a1fff0-serving-cert\") pod \"console-operator-85b454874b-jwfnv\" (UID: \"e90054ec-91dc-4cda-94a2-fbe7a2a1fff0\") " pod="openshift-console-operator/console-operator-85b454874b-jwfnv"
Sep 10 17:41:48.925197 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:48.925165    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e90054ec-91dc-4cda-94a2-fbe7a2a1fff0-config\") pod \"console-operator-85b454874b-jwfnv\" (UID: \"e90054ec-91dc-4cda-94a2-fbe7a2a1fff0\") " pod="openshift-console-operator/console-operator-85b454874b-jwfnv"
Sep 10 17:41:48.925416 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:48.925398    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e90054ec-91dc-4cda-94a2-fbe7a2a1fff0-trusted-ca\") pod \"console-operator-85b454874b-jwfnv\" (UID: \"e90054ec-91dc-4cda-94a2-fbe7a2a1fff0\") " pod="openshift-console-operator/console-operator-85b454874b-jwfnv"
Sep 10 17:41:48.926961 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:48.926938    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e90054ec-91dc-4cda-94a2-fbe7a2a1fff0-serving-cert\") pod \"console-operator-85b454874b-jwfnv\" (UID: \"e90054ec-91dc-4cda-94a2-fbe7a2a1fff0\") " pod="openshift-console-operator/console-operator-85b454874b-jwfnv"
Sep 10 17:41:48.936699 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:48.936663    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-68mg6\" (UniqueName: \"kubernetes.io/projected/e90054ec-91dc-4cda-94a2-fbe7a2a1fff0-kube-api-access-68mg6\") pod \"console-operator-85b454874b-jwfnv\" (UID: \"e90054ec-91dc-4cda-94a2-fbe7a2a1fff0\") " pod="openshift-console-operator/console-operator-85b454874b-jwfnv"
Sep 10 17:41:48.996004 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:48.995927    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85b454874b-jwfnv"
Sep 10 17:41:49.219705 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:49.219640    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-vzfdh"]
Sep 10 17:41:49.222999 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:49.222964    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1e59696_062b_4275_b1d7_f76f725e0ea0.slice/crio-70e92a2bfe991ca30b7a8408c121934d1fe0582dec47a11038ff88441aacba66 WatchSource:0}: Error finding container 70e92a2bfe991ca30b7a8408c121934d1fe0582dec47a11038ff88441aacba66: Status 404 returned error can't find the container with id 70e92a2bfe991ca30b7a8408c121934d1fe0582dec47a11038ff88441aacba66
Sep 10 17:41:49.257702 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:49.257663    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-8hhtb"]
Sep 10 17:41:49.261592 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:49.261563    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50081a35_70d7_41dd_88af_176fb4aca5d6.slice/crio-f3ce9387ef5c1d51fe3e78d5a5fd7242a6949d7b99b538defe4c3bb1510df898 WatchSource:0}: Error finding container f3ce9387ef5c1d51fe3e78d5a5fd7242a6949d7b99b538defe4c3bb1510df898: Status 404 returned error can't find the container with id f3ce9387ef5c1d51fe3e78d5a5fd7242a6949d7b99b538defe4c3bb1510df898
Sep 10 17:41:49.321461 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:49.321423    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85b454874b-jwfnv"]
Sep 10 17:41:49.324045 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:49.324018    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode90054ec_91dc_4cda_94a2_fbe7a2a1fff0.slice/crio-571ce303b604cc14169536748b0d71561edc88011c55a98463e09260d65faded WatchSource:0}: Error finding container 571ce303b604cc14169536748b0d71561edc88011c55a98463e09260d65faded: Status 404 returned error can't find the container with id 571ce303b604cc14169536748b0d71561edc88011c55a98463e09260d65faded
Sep 10 17:41:49.965392 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:49.965299    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-8hhtb" event={"ID":"50081a35-70d7-41dd-88af-176fb4aca5d6","Type":"ContainerStarted","Data":"f3ce9387ef5c1d51fe3e78d5a5fd7242a6949d7b99b538defe4c3bb1510df898"}
Sep 10 17:41:49.967036 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:49.966995    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-vzfdh" event={"ID":"b1e59696-062b-4275-b1d7-f76f725e0ea0","Type":"ContainerStarted","Data":"70e92a2bfe991ca30b7a8408c121934d1fe0582dec47a11038ff88441aacba66"}
Sep 10 17:41:49.968604 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:49.968565    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-jwfnv" event={"ID":"e90054ec-91dc-4cda-94a2-fbe7a2a1fff0","Type":"ContainerStarted","Data":"571ce303b604cc14169536748b0d71561edc88011c55a98463e09260d65faded"}
Sep 10 17:41:53.981601 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:53.981563    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-8hhtb" event={"ID":"50081a35-70d7-41dd-88af-176fb4aca5d6","Type":"ContainerStarted","Data":"d325be6c11f58114bc762e0adfe227d41fd77dc5cf3be13680f4fb42f914031c"}
Sep 10 17:41:53.983206 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:53.983177    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-vzfdh" event={"ID":"b1e59696-062b-4275-b1d7-f76f725e0ea0","Type":"ContainerStarted","Data":"611ce6822e549d56e5448c6c0f1602c9d006bb56a966b66700ccb5006dbb20db"}
Sep 10 17:41:53.984926 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:53.984906    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-jwfnv_e90054ec-91dc-4cda-94a2-fbe7a2a1fff0/console-operator/0.log"
Sep 10 17:41:53.985046 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:53.984940    2568 generic.go:356] "Generic (PLEG): container finished" podID="e90054ec-91dc-4cda-94a2-fbe7a2a1fff0" containerID="487e3d36134cbf33ffad74337f65dab13b693fe5c6ee57b53602e14e1b1c1b99" exitCode=255
Sep 10 17:41:53.985046 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:53.984969    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-jwfnv" event={"ID":"e90054ec-91dc-4cda-94a2-fbe7a2a1fff0","Type":"ContainerDied","Data":"487e3d36134cbf33ffad74337f65dab13b693fe5c6ee57b53602e14e1b1c1b99"}
Sep 10 17:41:53.985167 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:53.985152    2568 scope.go:117] "RemoveContainer" containerID="487e3d36134cbf33ffad74337f65dab13b693fe5c6ee57b53602e14e1b1c1b99"
Sep 10 17:41:54.001557 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:54.001372    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-76bcd6ccf5-8hhtb" podStartSLOduration=1.699801984 podStartE2EDuration="6.001350048s" totalImagesPullingTime="4.301548064s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:41:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:41:54.000235034 +0000 UTC m=+49.761543114" watchObservedRunningTime="2026-09-10 17:41:54.001350048 +0000 UTC m=+49.762658084"
Sep 10 17:41:54.020986 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:54.020930    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-685456655f-vzfdh" podStartSLOduration=1.66509545 podStartE2EDuration="6.020904738s" totalImagesPullingTime="4.355809288s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:41:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:41:54.020507771 +0000 UTC m=+49.781815815" watchObservedRunningTime="2026-09-10 17:41:54.020904738 +0000 UTC m=+49.782212782"
Sep 10 17:41:54.804806 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:54.804762    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-7tjtv"]
Sep 10 17:41:54.807911 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:54.807882    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7tjtv"
Sep 10 17:41:54.810690 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:54.810665    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 10 17:41:54.810874 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:54.810854    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 10 17:41:54.812003 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:54.811982    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-fk6pf\""
Sep 10 17:41:54.833820 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:54.833732    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7tjtv"]
Sep 10 17:41:54.877253 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:54.877200    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a2e1b47d-cb55-4328-bbb6-4bd6d5424abf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7tjtv\" (UID: \"a2e1b47d-cb55-4328-bbb6-4bd6d5424abf\") " pod="openshift-insights/insights-runtime-extractor-7tjtv"
Sep 10 17:41:54.877253 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:54.877257    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5h7wh\" (UniqueName: \"kubernetes.io/projected/a2e1b47d-cb55-4328-bbb6-4bd6d5424abf-kube-api-access-5h7wh\") pod \"insights-runtime-extractor-7tjtv\" (UID: \"a2e1b47d-cb55-4328-bbb6-4bd6d5424abf\") " pod="openshift-insights/insights-runtime-extractor-7tjtv"
Sep 10 17:41:54.877539 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:54.877346    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a2e1b47d-cb55-4328-bbb6-4bd6d5424abf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7tjtv\" (UID: \"a2e1b47d-cb55-4328-bbb6-4bd6d5424abf\") " pod="openshift-insights/insights-runtime-extractor-7tjtv"
Sep 10 17:41:54.877539 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:54.877384    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a2e1b47d-cb55-4328-bbb6-4bd6d5424abf-data-volume\") pod \"insights-runtime-extractor-7tjtv\" (UID: \"a2e1b47d-cb55-4328-bbb6-4bd6d5424abf\") " pod="openshift-insights/insights-runtime-extractor-7tjtv"
Sep 10 17:41:54.877539 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:54.877405    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a2e1b47d-cb55-4328-bbb6-4bd6d5424abf-crio-socket\") pod \"insights-runtime-extractor-7tjtv\" (UID: \"a2e1b47d-cb55-4328-bbb6-4bd6d5424abf\") " pod="openshift-insights/insights-runtime-extractor-7tjtv"
Sep 10 17:41:54.978149 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:54.978086    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a2e1b47d-cb55-4328-bbb6-4bd6d5424abf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7tjtv\" (UID: \"a2e1b47d-cb55-4328-bbb6-4bd6d5424abf\") " pod="openshift-insights/insights-runtime-extractor-7tjtv"
Sep 10 17:41:54.978149 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:54.978146    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5h7wh\" (UniqueName: \"kubernetes.io/projected/a2e1b47d-cb55-4328-bbb6-4bd6d5424abf-kube-api-access-5h7wh\") pod \"insights-runtime-extractor-7tjtv\" (UID: \"a2e1b47d-cb55-4328-bbb6-4bd6d5424abf\") " pod="openshift-insights/insights-runtime-extractor-7tjtv"
Sep 10 17:41:54.978432 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:54.978243    2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 17:41:54.978432 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:54.978300    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a2e1b47d-cb55-4328-bbb6-4bd6d5424abf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7tjtv\" (UID: \"a2e1b47d-cb55-4328-bbb6-4bd6d5424abf\") " pod="openshift-insights/insights-runtime-extractor-7tjtv"
Sep 10 17:41:54.978432 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:54.978341    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a2e1b47d-cb55-4328-bbb6-4bd6d5424abf-kube-rbac-proxy-cm podName:a2e1b47d-cb55-4328-bbb6-4bd6d5424abf nodeName:}" failed. No retries permitted until 2026-09-10 17:41:55.478304375 +0000 UTC m=+51.239612397 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a2e1b47d-cb55-4328-bbb6-4bd6d5424abf-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7tjtv" (UID: "a2e1b47d-cb55-4328-bbb6-4bd6d5424abf") : configmap "kube-rbac-proxy" not found
Sep 10 17:41:54.978432 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:54.978393    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a2e1b47d-cb55-4328-bbb6-4bd6d5424abf-data-volume\") pod \"insights-runtime-extractor-7tjtv\" (UID: \"a2e1b47d-cb55-4328-bbb6-4bd6d5424abf\") " pod="openshift-insights/insights-runtime-extractor-7tjtv"
Sep 10 17:41:54.978432 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:54.978411    2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 17:41:54.978432 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:54.978420    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a2e1b47d-cb55-4328-bbb6-4bd6d5424abf-crio-socket\") pod \"insights-runtime-extractor-7tjtv\" (UID: \"a2e1b47d-cb55-4328-bbb6-4bd6d5424abf\") " pod="openshift-insights/insights-runtime-extractor-7tjtv"
Sep 10 17:41:54.978660 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:54.978460    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2e1b47d-cb55-4328-bbb6-4bd6d5424abf-insights-runtime-extractor-tls podName:a2e1b47d-cb55-4328-bbb6-4bd6d5424abf nodeName:}" failed. No retries permitted until 2026-09-10 17:41:55.478445163 +0000 UTC m=+51.239753193 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a2e1b47d-cb55-4328-bbb6-4bd6d5424abf-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7tjtv" (UID: "a2e1b47d-cb55-4328-bbb6-4bd6d5424abf") : secret "insights-runtime-extractor-tls" not found
Sep 10 17:41:54.978660 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:54.978619    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a2e1b47d-cb55-4328-bbb6-4bd6d5424abf-crio-socket\") pod \"insights-runtime-extractor-7tjtv\" (UID: \"a2e1b47d-cb55-4328-bbb6-4bd6d5424abf\") " pod="openshift-insights/insights-runtime-extractor-7tjtv"
Sep 10 17:41:54.978781 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:54.978763    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a2e1b47d-cb55-4328-bbb6-4bd6d5424abf-data-volume\") pod \"insights-runtime-extractor-7tjtv\" (UID: \"a2e1b47d-cb55-4328-bbb6-4bd6d5424abf\") " pod="openshift-insights/insights-runtime-extractor-7tjtv"
Sep 10 17:41:54.990602 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:54.990567    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-jwfnv_e90054ec-91dc-4cda-94a2-fbe7a2a1fff0/console-operator/1.log"
Sep 10 17:41:54.991131 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:54.991110    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-jwfnv_e90054ec-91dc-4cda-94a2-fbe7a2a1fff0/console-operator/0.log"
Sep 10 17:41:54.991200 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:54.991157    2568 generic.go:356] "Generic (PLEG): container finished" podID="e90054ec-91dc-4cda-94a2-fbe7a2a1fff0" containerID="d9dcdb1e406439e258a909981c366505bd629643af0242fbdee519b9067ac082" exitCode=255
Sep 10 17:41:54.991269 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:54.991234    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-jwfnv" event={"ID":"e90054ec-91dc-4cda-94a2-fbe7a2a1fff0","Type":"ContainerDied","Data":"d9dcdb1e406439e258a909981c366505bd629643af0242fbdee519b9067ac082"}
Sep 10 17:41:54.992100 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:54.992083    2568 scope.go:117] "RemoveContainer" containerID="487e3d36134cbf33ffad74337f65dab13b693fe5c6ee57b53602e14e1b1c1b99"
Sep 10 17:41:54.992198 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:54.992183    2568 scope.go:117] "RemoveContainer" containerID="d9dcdb1e406439e258a909981c366505bd629643af0242fbdee519b9067ac082"
Sep 10 17:41:54.992388 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:54.992364    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-jwfnv_openshift-console-operator(e90054ec-91dc-4cda-94a2-fbe7a2a1fff0)\"" pod="openshift-console-operator/console-operator-85b454874b-jwfnv" podUID="e90054ec-91dc-4cda-94a2-fbe7a2a1fff0"
Sep 10 17:41:54.996223 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:54.996198    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5h7wh\" (UniqueName: \"kubernetes.io/projected/a2e1b47d-cb55-4328-bbb6-4bd6d5424abf-kube-api-access-5h7wh\") pod \"insights-runtime-extractor-7tjtv\" (UID: \"a2e1b47d-cb55-4328-bbb6-4bd6d5424abf\") " pod="openshift-insights/insights-runtime-extractor-7tjtv"
Sep 10 17:41:55.483600 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:55.483550    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a2e1b47d-cb55-4328-bbb6-4bd6d5424abf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7tjtv\" (UID: \"a2e1b47d-cb55-4328-bbb6-4bd6d5424abf\") " pod="openshift-insights/insights-runtime-extractor-7tjtv"
Sep 10 17:41:55.483794 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:55.483616    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a2e1b47d-cb55-4328-bbb6-4bd6d5424abf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7tjtv\" (UID: \"a2e1b47d-cb55-4328-bbb6-4bd6d5424abf\") " pod="openshift-insights/insights-runtime-extractor-7tjtv"
Sep 10 17:41:55.483794 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:55.483720    2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 17:41:55.483794 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:55.483786    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2e1b47d-cb55-4328-bbb6-4bd6d5424abf-insights-runtime-extractor-tls podName:a2e1b47d-cb55-4328-bbb6-4bd6d5424abf nodeName:}" failed. No retries permitted until 2026-09-10 17:41:56.483769365 +0000 UTC m=+52.245077401 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a2e1b47d-cb55-4328-bbb6-4bd6d5424abf-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7tjtv" (UID: "a2e1b47d-cb55-4328-bbb6-4bd6d5424abf") : secret "insights-runtime-extractor-tls" not found
Sep 10 17:41:55.484085 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:55.484064    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a2e1b47d-cb55-4328-bbb6-4bd6d5424abf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7tjtv\" (UID: \"a2e1b47d-cb55-4328-bbb6-4bd6d5424abf\") " pod="openshift-insights/insights-runtime-extractor-7tjtv"
Sep 10 17:41:55.757902 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:55.757799    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-75d99c484-8phlj"]
Sep 10 17:41:55.760830 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:55.760809    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-8phlj"
Sep 10 17:41:55.763895 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:55.763866    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Sep 10 17:41:55.765067 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:55.765040    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Sep 10 17:41:55.765211 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:55.765098    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-r56jg\""
Sep 10 17:41:55.765211 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:55.765124    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Sep 10 17:41:55.765333 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:55.765211    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Sep 10 17:41:55.769709 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:55.769682    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-8phlj"]
Sep 10 17:41:55.785283 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:55.785250    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ff833791-40e2-46a4-b03e-fade43b0c9d7-signing-key\") pod \"service-ca-75d99c484-8phlj\" (UID: \"ff833791-40e2-46a4-b03e-fade43b0c9d7\") " pod="openshift-service-ca/service-ca-75d99c484-8phlj"
Sep 10 17:41:55.785283 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:55.785285    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zvvk\" (UniqueName: \"kubernetes.io/projected/ff833791-40e2-46a4-b03e-fade43b0c9d7-kube-api-access-5zvvk\") pod \"service-ca-75d99c484-8phlj\" (UID: \"ff833791-40e2-46a4-b03e-fade43b0c9d7\") " pod="openshift-service-ca/service-ca-75d99c484-8phlj"
Sep 10 17:41:55.785529 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:55.785353    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ff833791-40e2-46a4-b03e-fade43b0c9d7-signing-cabundle\") pod \"service-ca-75d99c484-8phlj\" (UID: \"ff833791-40e2-46a4-b03e-fade43b0c9d7\") " pod="openshift-service-ca/service-ca-75d99c484-8phlj"
Sep 10 17:41:55.886557 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:55.886515    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ff833791-40e2-46a4-b03e-fade43b0c9d7-signing-cabundle\") pod \"service-ca-75d99c484-8phlj\" (UID: \"ff833791-40e2-46a4-b03e-fade43b0c9d7\") " pod="openshift-service-ca/service-ca-75d99c484-8phlj"
Sep 10 17:41:55.886727 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:55.886604    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ff833791-40e2-46a4-b03e-fade43b0c9d7-signing-key\") pod \"service-ca-75d99c484-8phlj\" (UID: \"ff833791-40e2-46a4-b03e-fade43b0c9d7\") " pod="openshift-service-ca/service-ca-75d99c484-8phlj"
Sep 10 17:41:55.886727 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:55.886627    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zvvk\" (UniqueName: \"kubernetes.io/projected/ff833791-40e2-46a4-b03e-fade43b0c9d7-kube-api-access-5zvvk\") pod \"service-ca-75d99c484-8phlj\" (UID: \"ff833791-40e2-46a4-b03e-fade43b0c9d7\") " pod="openshift-service-ca/service-ca-75d99c484-8phlj"
Sep 10 17:41:55.887183 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:55.887151    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ff833791-40e2-46a4-b03e-fade43b0c9d7-signing-cabundle\") pod \"service-ca-75d99c484-8phlj\" (UID: \"ff833791-40e2-46a4-b03e-fade43b0c9d7\") " pod="openshift-service-ca/service-ca-75d99c484-8phlj"
Sep 10 17:41:55.889010 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:55.888989    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ff833791-40e2-46a4-b03e-fade43b0c9d7-signing-key\") pod \"service-ca-75d99c484-8phlj\" (UID: \"ff833791-40e2-46a4-b03e-fade43b0c9d7\") " pod="openshift-service-ca/service-ca-75d99c484-8phlj"
Sep 10 17:41:55.896763 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:55.896738    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zvvk\" (UniqueName: \"kubernetes.io/projected/ff833791-40e2-46a4-b03e-fade43b0c9d7-kube-api-access-5zvvk\") pod \"service-ca-75d99c484-8phlj\" (UID: \"ff833791-40e2-46a4-b03e-fade43b0c9d7\") " pod="openshift-service-ca/service-ca-75d99c484-8phlj"
Sep 10 17:41:55.987815 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:55.987765    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/23ba8a7e-2139-4312-bb59-b1adfeb87a10-registry-tls\") pod \"image-registry-77c4f8844d-b7c4w\" (UID: \"23ba8a7e-2139-4312-bb59-b1adfeb87a10\") " pod="openshift-image-registry/image-registry-77c4f8844d-b7c4w"
Sep 10 17:41:55.987989 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:55.987843    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3a37cb7c-2638-48d0-83c2-d039ac7b6771-metrics-tls\") pod \"dns-default-n64rx\" (UID: \"3a37cb7c-2638-48d0-83c2-d039ac7b6771\") " pod="openshift-dns/dns-default-n64rx"
Sep 10 17:41:55.987989 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:55.987927    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 17:41:55.987989 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:55.987981    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a37cb7c-2638-48d0-83c2-d039ac7b6771-metrics-tls podName:3a37cb7c-2638-48d0-83c2-d039ac7b6771 nodeName:}" failed. No retries permitted until 2026-09-10 17:42:11.987967978 +0000 UTC m=+67.749275999 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3a37cb7c-2638-48d0-83c2-d039ac7b6771-metrics-tls") pod "dns-default-n64rx" (UID: "3a37cb7c-2638-48d0-83c2-d039ac7b6771") : secret "dns-default-metrics-tls" not found
Sep 10 17:41:55.988115 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:55.987927    2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 17:41:55.988115 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:55.988020    2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77c4f8844d-b7c4w: secret "image-registry-tls" not found
Sep 10 17:41:55.988115 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:55.988064    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/23ba8a7e-2139-4312-bb59-b1adfeb87a10-registry-tls podName:23ba8a7e-2139-4312-bb59-b1adfeb87a10 nodeName:}" failed. No retries permitted until 2026-09-10 17:42:11.988050404 +0000 UTC m=+67.749358445 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/23ba8a7e-2139-4312-bb59-b1adfeb87a10-registry-tls") pod "image-registry-77c4f8844d-b7c4w" (UID: "23ba8a7e-2139-4312-bb59-b1adfeb87a10") : secret "image-registry-tls" not found
Sep 10 17:41:55.995163 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:55.995137    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-jwfnv_e90054ec-91dc-4cda-94a2-fbe7a2a1fff0/console-operator/1.log"
Sep 10 17:41:55.995518 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:55.995481    2568 scope.go:117] "RemoveContainer" containerID="d9dcdb1e406439e258a909981c366505bd629643af0242fbdee519b9067ac082"
Sep 10 17:41:55.995670 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:55.995649    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-jwfnv_openshift-console-operator(e90054ec-91dc-4cda-94a2-fbe7a2a1fff0)\"" pod="openshift-console-operator/console-operator-85b454874b-jwfnv" podUID="e90054ec-91dc-4cda-94a2-fbe7a2a1fff0"
Sep 10 17:41:56.070667 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:56.070573    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-8phlj"
Sep 10 17:41:56.341904 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:56.341814    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-8phlj"]
Sep 10 17:41:56.345809 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:41:56.345778    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff833791_40e2_46a4_b03e_fade43b0c9d7.slice/crio-5c24a76ef2676c576a03a34a3595873116dd1b9ce0a439ee0d48e1a992776c7e WatchSource:0}: Error finding container 5c24a76ef2676c576a03a34a3595873116dd1b9ce0a439ee0d48e1a992776c7e: Status 404 returned error can't find the container with id 5c24a76ef2676c576a03a34a3595873116dd1b9ce0a439ee0d48e1a992776c7e
Sep 10 17:41:56.491506 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:56.491466    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a2e1b47d-cb55-4328-bbb6-4bd6d5424abf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7tjtv\" (UID: \"a2e1b47d-cb55-4328-bbb6-4bd6d5424abf\") " pod="openshift-insights/insights-runtime-extractor-7tjtv"
Sep 10 17:41:56.491702 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:56.491598    2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 17:41:56.491702 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:56.491664    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2e1b47d-cb55-4328-bbb6-4bd6d5424abf-insights-runtime-extractor-tls podName:a2e1b47d-cb55-4328-bbb6-4bd6d5424abf nodeName:}" failed. No retries permitted until 2026-09-10 17:41:58.491650029 +0000 UTC m=+54.252958049 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a2e1b47d-cb55-4328-bbb6-4bd6d5424abf-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7tjtv" (UID: "a2e1b47d-cb55-4328-bbb6-4bd6d5424abf") : secret "insights-runtime-extractor-tls" not found
Sep 10 17:41:56.735778 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:56.735755    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dwtws_01467fcf-2ddb-42da-812a-964dc8a1504f/dns-node-resolver/0.log"
Sep 10 17:41:56.999078 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:56.998988    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-8phlj" event={"ID":"ff833791-40e2-46a4-b03e-fade43b0c9d7","Type":"ContainerStarted","Data":"5c24a76ef2676c576a03a34a3595873116dd1b9ce0a439ee0d48e1a992776c7e"}
Sep 10 17:41:57.535839 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:57.535806    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7jrjh_f45056e2-bd13-4829-a897-7cd4a829af0e/node-ca/0.log"
Sep 10 17:41:58.509191 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:58.509145    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a2e1b47d-cb55-4328-bbb6-4bd6d5424abf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7tjtv\" (UID: \"a2e1b47d-cb55-4328-bbb6-4bd6d5424abf\") " pod="openshift-insights/insights-runtime-extractor-7tjtv"
Sep 10 17:41:58.509684 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:58.509317    2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 17:41:58.509684 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:58.509407    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2e1b47d-cb55-4328-bbb6-4bd6d5424abf-insights-runtime-extractor-tls podName:a2e1b47d-cb55-4328-bbb6-4bd6d5424abf nodeName:}" failed. No retries permitted until 2026-09-10 17:42:02.509391533 +0000 UTC m=+58.270699557 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a2e1b47d-cb55-4328-bbb6-4bd6d5424abf-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7tjtv" (UID: "a2e1b47d-cb55-4328-bbb6-4bd6d5424abf") : secret "insights-runtime-extractor-tls" not found
Sep 10 17:41:58.736234 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:58.736204    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-n8gr2_77340c83-f0c1-4617-a0df-dc686674f941/serve-healthcheck-canary/0.log"
Sep 10 17:41:58.996181 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:58.996135    2568 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-85b454874b-jwfnv"
Sep 10 17:41:58.996385 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:58.996203    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-jwfnv"
Sep 10 17:41:58.996603 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:58.996589    2568 scope.go:117] "RemoveContainer" containerID="d9dcdb1e406439e258a909981c366505bd629643af0242fbdee519b9067ac082"
Sep 10 17:41:58.996760 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:41:58.996741    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-jwfnv_openshift-console-operator(e90054ec-91dc-4cda-94a2-fbe7a2a1fff0)\"" pod="openshift-console-operator/console-operator-85b454874b-jwfnv" podUID="e90054ec-91dc-4cda-94a2-fbe7a2a1fff0"
Sep 10 17:41:59.006813 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:59.006775    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-8phlj" event={"ID":"ff833791-40e2-46a4-b03e-fade43b0c9d7","Type":"ContainerStarted","Data":"b80991c11798d8971cca84a2b39e39008a177c450d51cdfa610c64d4edc0714c"}
Sep 10 17:41:59.025865 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:41:59.025811    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-75d99c484-8phlj" podStartSLOduration=2.281210995 podStartE2EDuration="4.025793336s" totalImagesPullingTime="1.744582341s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:41:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:41:59.025152519 +0000 UTC m=+54.786460562" watchObservedRunningTime="2026-09-10 17:41:59.025793336 +0000 UTC m=+54.787101378"
Sep 10 17:42:02.548056 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:02.548009    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a2e1b47d-cb55-4328-bbb6-4bd6d5424abf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7tjtv\" (UID: \"a2e1b47d-cb55-4328-bbb6-4bd6d5424abf\") " pod="openshift-insights/insights-runtime-extractor-7tjtv"
Sep 10 17:42:02.548483 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:42:02.548170    2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 17:42:02.548483 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:42:02.548252    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2e1b47d-cb55-4328-bbb6-4bd6d5424abf-insights-runtime-extractor-tls podName:a2e1b47d-cb55-4328-bbb6-4bd6d5424abf nodeName:}" failed. No retries permitted until 2026-09-10 17:42:10.5482351 +0000 UTC m=+66.309543124 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a2e1b47d-cb55-4328-bbb6-4bd6d5424abf-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7tjtv" (UID: "a2e1b47d-cb55-4328-bbb6-4bd6d5424abf") : secret "insights-runtime-extractor-tls" not found
Sep 10 17:42:05.922636 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:05.922601    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-f9cn7"
Sep 10 17:42:09.764224 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:09.764191    2568 scope.go:117] "RemoveContainer" containerID="d9dcdb1e406439e258a909981c366505bd629643af0242fbdee519b9067ac082"
Sep 10 17:42:10.043783 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:10.043702    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-jwfnv_e90054ec-91dc-4cda-94a2-fbe7a2a1fff0/console-operator/1.log"
Sep 10 17:42:10.043783 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:10.043766    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-jwfnv" event={"ID":"e90054ec-91dc-4cda-94a2-fbe7a2a1fff0","Type":"ContainerStarted","Data":"d513616b135af5bf142a38a55ce21d0331bbfeb45053972505aeeed57cd4e1cb"}
Sep 10 17:42:10.044084 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:10.044063    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-jwfnv"
Sep 10 17:42:10.066583 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:10.066521    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-85b454874b-jwfnv" podStartSLOduration=17.82496721 podStartE2EDuration="22.066498072s" totalImagesPullingTime="4.241530862s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:41:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:42:10.065701377 +0000 UTC m=+65.827009420" watchObservedRunningTime="2026-09-10 17:42:10.066498072 +0000 UTC m=+65.827806116"
Sep 10 17:42:10.341159 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:10.341057    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-85b454874b-jwfnv"
Sep 10 17:42:10.516859 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:10.516804    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4f8b428e-98e7-4306-b485-d39e9b22eb05-metrics-certs\") pod \"network-metrics-daemon-76dl2\" (UID: \"4f8b428e-98e7-4306-b485-d39e9b22eb05\") " pod="openshift-multus/network-metrics-daemon-76dl2"
Sep 10 17:42:10.517039 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:10.516904    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1df8c233-a191-43e9-9d86-4a191bd54b1e-original-pull-secret\") pod \"global-pull-secret-syncer-gqqkd\" (UID: \"1df8c233-a191-43e9-9d86-4a191bd54b1e\") " pod="kube-system/global-pull-secret-syncer-gqqkd"
Sep 10 17:42:10.519594 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:10.519572    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 10 17:42:10.519647 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:10.519571    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 10 17:42:10.529616 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:10.529586    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1df8c233-a191-43e9-9d86-4a191bd54b1e-original-pull-secret\") pod \"global-pull-secret-syncer-gqqkd\" (UID: \"1df8c233-a191-43e9-9d86-4a191bd54b1e\") " pod="kube-system/global-pull-secret-syncer-gqqkd"
Sep 10 17:42:10.529616 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:10.529602    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4f8b428e-98e7-4306-b485-d39e9b22eb05-metrics-certs\") pod \"network-metrics-daemon-76dl2\" (UID: \"4f8b428e-98e7-4306-b485-d39e9b22eb05\") " pod="openshift-multus/network-metrics-daemon-76dl2"
Sep 10 17:42:10.595571 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:10.595488    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hkln9\""
Sep 10 17:42:10.597850 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:10.597829    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gqqkd"
Sep 10 17:42:10.602831 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:10.602814    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-76dl2"
Sep 10 17:42:10.618126 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:10.618096    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a2e1b47d-cb55-4328-bbb6-4bd6d5424abf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7tjtv\" (UID: \"a2e1b47d-cb55-4328-bbb6-4bd6d5424abf\") " pod="openshift-insights/insights-runtime-extractor-7tjtv"
Sep 10 17:42:10.620639 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:10.620601    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a2e1b47d-cb55-4328-bbb6-4bd6d5424abf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7tjtv\" (UID: \"a2e1b47d-cb55-4328-bbb6-4bd6d5424abf\") " pod="openshift-insights/insights-runtime-extractor-7tjtv"
Sep 10 17:42:10.718446 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:10.718409    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vgdr\" (UniqueName: \"kubernetes.io/projected/fc857d7e-aafa-4018-aeb4-84f423bb5337-kube-api-access-7vgdr\") pod \"network-check-target-w5htf\" (UID: \"fc857d7e-aafa-4018-aeb4-84f423bb5337\") " pod="openshift-network-diagnostics/network-check-target-w5htf"
Sep 10 17:42:10.720969 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:10.720944    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vgdr\" (UniqueName: \"kubernetes.io/projected/fc857d7e-aafa-4018-aeb4-84f423bb5337-kube-api-access-7vgdr\") pod \"network-check-target-w5htf\" (UID: \"fc857d7e-aafa-4018-aeb4-84f423bb5337\") " pod="openshift-network-diagnostics/network-check-target-w5htf"
Sep 10 17:42:10.721107 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:10.721004    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-fk6pf\""
Sep 10 17:42:10.728601 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:10.728574    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7tjtv"
Sep 10 17:42:10.870563 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:10.870473    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-gqqkd"]
Sep 10 17:42:10.873406 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:42:10.873363    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1df8c233_a191_43e9_9d86_4a191bd54b1e.slice/crio-90554c09d296dc6ae9ecf8f7a739b512821a184b7f69f778273ffe5f64ed3a5a WatchSource:0}: Error finding container 90554c09d296dc6ae9ecf8f7a739b512821a184b7f69f778273ffe5f64ed3a5a: Status 404 returned error can't find the container with id 90554c09d296dc6ae9ecf8f7a739b512821a184b7f69f778273ffe5f64ed3a5a
Sep 10 17:42:10.881662 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:10.881633    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-fbgqn\""
Sep 10 17:42:10.884151 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:10.884129    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-76dl2"]
Sep 10 17:42:10.886547 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:42:10.886512    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f8b428e_98e7_4306_b485_d39e9b22eb05.slice/crio-164b91dba50925f07d525c77d9d6092547ac9784c492d8797a71fd6da97b8ca8 WatchSource:0}: Error finding container 164b91dba50925f07d525c77d9d6092547ac9784c492d8797a71fd6da97b8ca8: Status 404 returned error can't find the container with id 164b91dba50925f07d525c77d9d6092547ac9784c492d8797a71fd6da97b8ca8
Sep 10 17:42:10.888076 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:10.888054    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w5htf"
Sep 10 17:42:11.011674 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:11.011641    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7tjtv"]
Sep 10 17:42:11.014855 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:42:11.014828    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2e1b47d_cb55_4328_bbb6_4bd6d5424abf.slice/crio-fb979c88985306d3ab8bc780597f37029dd51d16bec6d0d2da45e9ad02eb1ac7 WatchSource:0}: Error finding container fb979c88985306d3ab8bc780597f37029dd51d16bec6d0d2da45e9ad02eb1ac7: Status 404 returned error can't find the container with id fb979c88985306d3ab8bc780597f37029dd51d16bec6d0d2da45e9ad02eb1ac7
Sep 10 17:42:11.048904 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:11.048868    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7tjtv" event={"ID":"a2e1b47d-cb55-4328-bbb6-4bd6d5424abf","Type":"ContainerStarted","Data":"fb979c88985306d3ab8bc780597f37029dd51d16bec6d0d2da45e9ad02eb1ac7"}
Sep 10 17:42:11.050262 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:11.050237    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-gqqkd" event={"ID":"1df8c233-a191-43e9-9d86-4a191bd54b1e","Type":"ContainerStarted","Data":"90554c09d296dc6ae9ecf8f7a739b512821a184b7f69f778273ffe5f64ed3a5a"}
Sep 10 17:42:11.051651 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:11.051622    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-76dl2" event={"ID":"4f8b428e-98e7-4306-b485-d39e9b22eb05","Type":"ContainerStarted","Data":"164b91dba50925f07d525c77d9d6092547ac9784c492d8797a71fd6da97b8ca8"}
Sep 10 17:42:11.173396 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:11.173297    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-w5htf"]
Sep 10 17:42:11.176351 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:42:11.176302    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc857d7e_aafa_4018_aeb4_84f423bb5337.slice/crio-ef25d197f593ee18fae2bd8fb465c7f7f68abd34580fdf68c932d2b92f2b1a1d WatchSource:0}: Error finding container ef25d197f593ee18fae2bd8fb465c7f7f68abd34580fdf68c932d2b92f2b1a1d: Status 404 returned error can't find the container with id ef25d197f593ee18fae2bd8fb465c7f7f68abd34580fdf68c932d2b92f2b1a1d
Sep 10 17:42:12.031847 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:12.031301    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/23ba8a7e-2139-4312-bb59-b1adfeb87a10-registry-tls\") pod \"image-registry-77c4f8844d-b7c4w\" (UID: \"23ba8a7e-2139-4312-bb59-b1adfeb87a10\") " pod="openshift-image-registry/image-registry-77c4f8844d-b7c4w"
Sep 10 17:42:12.031847 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:12.031384    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3a37cb7c-2638-48d0-83c2-d039ac7b6771-metrics-tls\") pod \"dns-default-n64rx\" (UID: \"3a37cb7c-2638-48d0-83c2-d039ac7b6771\") " pod="openshift-dns/dns-default-n64rx"
Sep 10 17:42:12.034444 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:12.034413    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3a37cb7c-2638-48d0-83c2-d039ac7b6771-metrics-tls\") pod \"dns-default-n64rx\" (UID: \"3a37cb7c-2638-48d0-83c2-d039ac7b6771\") " pod="openshift-dns/dns-default-n64rx"
Sep 10 17:42:12.036181 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:12.035967    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/23ba8a7e-2139-4312-bb59-b1adfeb87a10-registry-tls\") pod \"image-registry-77c4f8844d-b7c4w\" (UID: \"23ba8a7e-2139-4312-bb59-b1adfeb87a10\") " pod="openshift-image-registry/image-registry-77c4f8844d-b7c4w"
Sep 10 17:42:12.060569 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:12.060440    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-w5htf" event={"ID":"fc857d7e-aafa-4018-aeb4-84f423bb5337","Type":"ContainerStarted","Data":"248158c4cefe7848e060bd216b1b58490150c27ec578a6cd7645cef9713408d4"}
Sep 10 17:42:12.060569 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:12.060502    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-w5htf" event={"ID":"fc857d7e-aafa-4018-aeb4-84f423bb5337","Type":"ContainerStarted","Data":"ef25d197f593ee18fae2bd8fb465c7f7f68abd34580fdf68c932d2b92f2b1a1d"}
Sep 10 17:42:12.060569 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:12.060530    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-w5htf"
Sep 10 17:42:12.063064 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:12.063030    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7tjtv" event={"ID":"a2e1b47d-cb55-4328-bbb6-4bd6d5424abf","Type":"ContainerStarted","Data":"5b38fd642e1271fa05434a318c8695b3ad6e34dee510a8084aba853e4c7ec763"}
Sep 10 17:42:12.063230 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:12.063091    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7tjtv" event={"ID":"a2e1b47d-cb55-4328-bbb6-4bd6d5424abf","Type":"ContainerStarted","Data":"5fa8166babe2daa105c400066baa0bbb32e18e68c02757988c73b83f3ec02763"}
Sep 10 17:42:12.066501 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:12.066378    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-76dl2" event={"ID":"4f8b428e-98e7-4306-b485-d39e9b22eb05","Type":"ContainerStarted","Data":"d2fb04d46f35f1204867dcba7415d823a0311d19b63054819b071b05ae001d18"}
Sep 10 17:42:12.078376 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:12.077991    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-w5htf" podStartSLOduration=66.077969083 podStartE2EDuration="1m6.077969083s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:41:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:42:12.077783818 +0000 UTC m=+67.839091861" watchObservedRunningTime="2026-09-10 17:42:12.077969083 +0000 UTC m=+67.839277127"
Sep 10 17:42:12.209027 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:12.208940    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-stkqn\""
Sep 10 17:42:12.216787 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:12.216649    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77c4f8844d-b7c4w"
Sep 10 17:42:12.223909 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:12.223875    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-d7j7h\""
Sep 10 17:42:12.231798 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:12.231672    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-n64rx"
Sep 10 17:42:12.514678 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:12.514633    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-77c4f8844d-b7c4w"]
Sep 10 17:42:12.529009 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:12.528978    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-n64rx"]
Sep 10 17:42:12.537488 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:42:12.537448    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a37cb7c_2638_48d0_83c2_d039ac7b6771.slice/crio-d2a6b95e6f88f7524487323fcc92695462a75ae31e9ddea2541593efea931a3d WatchSource:0}: Error finding container d2a6b95e6f88f7524487323fcc92695462a75ae31e9ddea2541593efea931a3d: Status 404 returned error can't find the container with id d2a6b95e6f88f7524487323fcc92695462a75ae31e9ddea2541593efea931a3d
Sep 10 17:42:13.075121 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:13.074195    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77c4f8844d-b7c4w" event={"ID":"23ba8a7e-2139-4312-bb59-b1adfeb87a10","Type":"ContainerStarted","Data":"5dc9b9cf56051438be47d00823e2efce8f3f12c14825734f4fda9246a71f9aa3"}
Sep 10 17:42:13.075121 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:13.074255    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77c4f8844d-b7c4w" event={"ID":"23ba8a7e-2139-4312-bb59-b1adfeb87a10","Type":"ContainerStarted","Data":"377176aab9f308ad19fc0c779ba70a653bdb6aa7a10b76453815ba0e6be313ea"}
Sep 10 17:42:13.075121 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:13.075046    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-77c4f8844d-b7c4w"
Sep 10 17:42:13.077938 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:13.077870    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-n64rx" event={"ID":"3a37cb7c-2638-48d0-83c2-d039ac7b6771","Type":"ContainerStarted","Data":"d2a6b95e6f88f7524487323fcc92695462a75ae31e9ddea2541593efea931a3d"}
Sep 10 17:42:13.083925 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:13.083884    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-76dl2" event={"ID":"4f8b428e-98e7-4306-b485-d39e9b22eb05","Type":"ContainerStarted","Data":"bdd59decb96e808f6d1461a92c3416c585342617c769fee9551dbf9dedfeb6dc"}
Sep 10 17:42:13.123278 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:13.122619    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-77c4f8844d-b7c4w" podStartSLOduration=46.122597208 podStartE2EDuration="46.122597208s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:41:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:42:13.104586618 +0000 UTC m=+68.865894664" watchObservedRunningTime="2026-09-10 17:42:13.122597208 +0000 UTC m=+68.883905254"
Sep 10 17:42:14.089855 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:14.089808    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7tjtv" event={"ID":"a2e1b47d-cb55-4328-bbb6-4bd6d5424abf","Type":"ContainerStarted","Data":"df1ed0381b8c8d8648e01891a047499ab74c2bd025bbc63f62aa1f923099c317"}
Sep 10 17:42:14.114016 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:14.113951    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-7tjtv" podStartSLOduration=17.844283433 podStartE2EDuration="20.11392753s" totalImagesPullingTime="2.269644097s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 17:41:54 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:42:14.11286791 +0000 UTC m=+69.874175955" watchObservedRunningTime="2026-09-10 17:42:14.11392753 +0000 UTC m=+69.875235573"
Sep 10 17:42:14.114487 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:14.114445    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-76dl2" podStartSLOduration=67.067270382 podStartE2EDuration="1m8.11443344s" totalImagesPullingTime="1.047163058s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:41:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:42:13.12325655 +0000 UTC m=+68.884564594" watchObservedRunningTime="2026-09-10 17:42:14.11443344 +0000 UTC m=+69.875741485"
Sep 10 17:42:16.098909 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:16.098868    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-n64rx" event={"ID":"3a37cb7c-2638-48d0-83c2-d039ac7b6771","Type":"ContainerStarted","Data":"6ce4aadc44afbb64be4a069efc2f0bcf1f2344602bad2865278b9c111c705b34"}
Sep 10 17:42:16.099417 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:16.098986    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-n64rx"
Sep 10 17:42:16.099417 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:16.099010    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-n64rx" event={"ID":"3a37cb7c-2638-48d0-83c2-d039ac7b6771","Type":"ContainerStarted","Data":"f5d718a2f63954607cdb7b9c4078f215733eef0bc1cd0e915b3c2919f40e9f32"}
Sep 10 17:42:16.100492 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:16.100459    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-gqqkd" event={"ID":"1df8c233-a191-43e9-9d86-4a191bd54b1e","Type":"ContainerStarted","Data":"da9cca1693fa98cd32f943a218433381c247d86d96d9920479e08eb403c0f58d"}
Sep 10 17:42:16.117148 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:16.117074    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-n64rx" podStartSLOduration=33.077983347 podStartE2EDuration="36.117055614s" totalImagesPullingTime="3.039072267s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:41:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:42:16.116179405 +0000 UTC m=+71.877487451" watchObservedRunningTime="2026-09-10 17:42:16.117055614 +0000 UTC m=+71.878363700"
Sep 10 17:42:16.131571 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:16.131510    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-gqqkd" podStartSLOduration=65.421915402 podStartE2EDuration="1m10.131486133s" totalImagesPullingTime="4.709570731s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 17:41:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:42:16.13139154 +0000 UTC m=+71.892699581" watchObservedRunningTime="2026-09-10 17:42:16.131486133 +0000 UTC m=+71.892794177"
Sep 10 17:42:17.508517 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:17.508484    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75c6d9694b-6gwx4"]
Sep 10 17:42:17.535116 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:17.535078    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75c6d9694b-6gwx4"]
Sep 10 17:42:17.535283 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:17.535239    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75c6d9694b-6gwx4"
Sep 10 17:42:17.538091 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:17.538067    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Sep 10 17:42:17.538381 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:17.538363    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Sep 10 17:42:17.539173 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:17.539152    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 10 17:42:17.539416 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:17.539401    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 10 17:42:17.539642 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:17.539626    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Sep 10 17:42:17.539728 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:17.539674    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 10 17:42:17.539804 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:17.539783    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Sep 10 17:42:17.679703 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:17.679639    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9k2gt\" (UniqueName: \"kubernetes.io/projected/293c4b9e-1f18-449c-99cf-044d7a9ba996-kube-api-access-9k2gt\") pod \"cluster-proxy-proxy-agent-75c6d9694b-6gwx4\" (UID: \"293c4b9e-1f18-449c-99cf-044d7a9ba996\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75c6d9694b-6gwx4"
Sep 10 17:42:17.679925 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:17.679760    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/293c4b9e-1f18-449c-99cf-044d7a9ba996-hub\") pod \"cluster-proxy-proxy-agent-75c6d9694b-6gwx4\" (UID: \"293c4b9e-1f18-449c-99cf-044d7a9ba996\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75c6d9694b-6gwx4"
Sep 10 17:42:17.679925 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:17.679814    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/293c4b9e-1f18-449c-99cf-044d7a9ba996-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-75c6d9694b-6gwx4\" (UID: \"293c4b9e-1f18-449c-99cf-044d7a9ba996\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75c6d9694b-6gwx4"
Sep 10 17:42:17.679925 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:17.679866    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/293c4b9e-1f18-449c-99cf-044d7a9ba996-additional-service-ca\") pod \"cluster-proxy-proxy-agent-75c6d9694b-6gwx4\" (UID: \"293c4b9e-1f18-449c-99cf-044d7a9ba996\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75c6d9694b-6gwx4"
Sep 10 17:42:17.679925 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:17.679886    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/293c4b9e-1f18-449c-99cf-044d7a9ba996-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-75c6d9694b-6gwx4\" (UID: \"293c4b9e-1f18-449c-99cf-044d7a9ba996\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75c6d9694b-6gwx4"
Sep 10 17:42:17.679925 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:17.679916    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/293c4b9e-1f18-449c-99cf-044d7a9ba996-ca\") pod \"cluster-proxy-proxy-agent-75c6d9694b-6gwx4\" (UID: \"293c4b9e-1f18-449c-99cf-044d7a9ba996\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75c6d9694b-6gwx4"
Sep 10 17:42:17.781410 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:17.781287    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/293c4b9e-1f18-449c-99cf-044d7a9ba996-additional-service-ca\") pod \"cluster-proxy-proxy-agent-75c6d9694b-6gwx4\" (UID: \"293c4b9e-1f18-449c-99cf-044d7a9ba996\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75c6d9694b-6gwx4"
Sep 10 17:42:17.781410 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:17.781365    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/293c4b9e-1f18-449c-99cf-044d7a9ba996-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-75c6d9694b-6gwx4\" (UID: \"293c4b9e-1f18-449c-99cf-044d7a9ba996\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75c6d9694b-6gwx4"
Sep 10 17:42:17.781410 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:17.781398    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/293c4b9e-1f18-449c-99cf-044d7a9ba996-ca\") pod \"cluster-proxy-proxy-agent-75c6d9694b-6gwx4\" (UID: \"293c4b9e-1f18-449c-99cf-044d7a9ba996\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75c6d9694b-6gwx4"
Sep 10 17:42:17.781671 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:17.781423    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9k2gt\" (UniqueName: \"kubernetes.io/projected/293c4b9e-1f18-449c-99cf-044d7a9ba996-kube-api-access-9k2gt\") pod \"cluster-proxy-proxy-agent-75c6d9694b-6gwx4\" (UID: \"293c4b9e-1f18-449c-99cf-044d7a9ba996\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75c6d9694b-6gwx4"
Sep 10 17:42:17.781671 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:17.781465    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/293c4b9e-1f18-449c-99cf-044d7a9ba996-hub\") pod \"cluster-proxy-proxy-agent-75c6d9694b-6gwx4\" (UID: \"293c4b9e-1f18-449c-99cf-044d7a9ba996\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75c6d9694b-6gwx4"
Sep 10 17:42:17.781671 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:17.781501    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/293c4b9e-1f18-449c-99cf-044d7a9ba996-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-75c6d9694b-6gwx4\" (UID: \"293c4b9e-1f18-449c-99cf-044d7a9ba996\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75c6d9694b-6gwx4"
Sep 10 17:42:17.782072 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:17.782046    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/293c4b9e-1f18-449c-99cf-044d7a9ba996-additional-service-ca\") pod \"cluster-proxy-proxy-agent-75c6d9694b-6gwx4\" (UID: \"293c4b9e-1f18-449c-99cf-044d7a9ba996\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75c6d9694b-6gwx4"
Sep 10 17:42:17.784263 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:17.784222    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/293c4b9e-1f18-449c-99cf-044d7a9ba996-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-75c6d9694b-6gwx4\" (UID: \"293c4b9e-1f18-449c-99cf-044d7a9ba996\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75c6d9694b-6gwx4"
Sep 10 17:42:17.784397 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:17.784227    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/293c4b9e-1f18-449c-99cf-044d7a9ba996-ca\") pod \"cluster-proxy-proxy-agent-75c6d9694b-6gwx4\" (UID: \"293c4b9e-1f18-449c-99cf-044d7a9ba996\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75c6d9694b-6gwx4"
Sep 10 17:42:17.784397 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:17.784373    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/293c4b9e-1f18-449c-99cf-044d7a9ba996-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-75c6d9694b-6gwx4\" (UID: \"293c4b9e-1f18-449c-99cf-044d7a9ba996\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75c6d9694b-6gwx4"
Sep 10 17:42:17.784472 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:17.784374    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/293c4b9e-1f18-449c-99cf-044d7a9ba996-hub\") pod \"cluster-proxy-proxy-agent-75c6d9694b-6gwx4\" (UID: \"293c4b9e-1f18-449c-99cf-044d7a9ba996\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75c6d9694b-6gwx4"
Sep 10 17:42:17.800682 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:17.800650    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9k2gt\" (UniqueName: \"kubernetes.io/projected/293c4b9e-1f18-449c-99cf-044d7a9ba996-kube-api-access-9k2gt\") pod \"cluster-proxy-proxy-agent-75c6d9694b-6gwx4\" (UID: \"293c4b9e-1f18-449c-99cf-044d7a9ba996\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75c6d9694b-6gwx4"
Sep 10 17:42:17.855537 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:17.855489    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75c6d9694b-6gwx4"
Sep 10 17:42:18.159103 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:18.158997    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75c6d9694b-6gwx4"]
Sep 10 17:42:18.162484 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:42:18.162450    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod293c4b9e_1f18_449c_99cf_044d7a9ba996.slice/crio-ea72383f97a05338b6b55c67017ef9a634bb598bd8d555c50ddae4db56fdd8ba WatchSource:0}: Error finding container ea72383f97a05338b6b55c67017ef9a634bb598bd8d555c50ddae4db56fdd8ba: Status 404 returned error can't find the container with id ea72383f97a05338b6b55c67017ef9a634bb598bd8d555c50ddae4db56fdd8ba
Sep 10 17:42:19.118623 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:19.118553    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75c6d9694b-6gwx4" event={"ID":"293c4b9e-1f18-449c-99cf-044d7a9ba996","Type":"ContainerStarted","Data":"ea72383f97a05338b6b55c67017ef9a634bb598bd8d555c50ddae4db56fdd8ba"}
Sep 10 17:42:22.133235 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:22.133198    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75c6d9694b-6gwx4" event={"ID":"293c4b9e-1f18-449c-99cf-044d7a9ba996","Type":"ContainerStarted","Data":"a4be8c7764f3bf9298434c237d47908017e24921683b982d40d7e380934bdf4e"}
Sep 10 17:42:22.133235 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:22.133244    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75c6d9694b-6gwx4" event={"ID":"293c4b9e-1f18-449c-99cf-044d7a9ba996","Type":"ContainerStarted","Data":"dc9d4039faf3ee34673797839d8fb78d3d756293ea2f7ee052e865e80b592aff"}
Sep 10 17:42:22.133774 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:22.133256    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75c6d9694b-6gwx4" event={"ID":"293c4b9e-1f18-449c-99cf-044d7a9ba996","Type":"ContainerStarted","Data":"669e912840cae78925fb36799c963f4a9ae4ceb233f24003882dc91d700f9c7c"}
Sep 10 17:42:22.156509 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:22.156459    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75c6d9694b-6gwx4" podStartSLOduration=1.845932102 podStartE2EDuration="5.156440837s" totalImagesPullingTime="3.310508735s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:42:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:42:22.154851557 +0000 UTC m=+77.916159601" watchObservedRunningTime="2026-09-10 17:42:22.156440837 +0000 UTC m=+77.917748879"
Sep 10 17:42:26.106128 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:26.106094    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-n64rx"
Sep 10 17:42:35.098404 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:35.098274    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-77c4f8844d-b7c4w"
Sep 10 17:42:39.474604 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:39.474561    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-77c4f8844d-b7c4w"]
Sep 10 17:42:43.086277 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:43.086238    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-w5htf"
Sep 10 17:42:43.090935 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:43.090896    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-hsfv6"]
Sep 10 17:42:43.096009 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:43.095974    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hsfv6"
Sep 10 17:42:43.099449 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:43.099387    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 10 17:42:43.099624 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:43.099476    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 10 17:42:43.100457 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:43.100431    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 10 17:42:43.100831 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:43.100807    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 10 17:42:43.100922 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:43.100832    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 10 17:42:43.101342 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:43.101297    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-5vtvp\""
Sep 10 17:42:43.101342 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:43.101314    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 10 17:42:43.278533 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:43.278486    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/012c8a9c-a3fd-4e5e-bb99-d116da21f74f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hsfv6\" (UID: \"012c8a9c-a3fd-4e5e-bb99-d116da21f74f\") " pod="openshift-monitoring/node-exporter-hsfv6"
Sep 10 17:42:43.278748 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:43.278544    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/012c8a9c-a3fd-4e5e-bb99-d116da21f74f-metrics-client-ca\") pod \"node-exporter-hsfv6\" (UID: \"012c8a9c-a3fd-4e5e-bb99-d116da21f74f\") " pod="openshift-monitoring/node-exporter-hsfv6"
Sep 10 17:42:43.278748 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:43.278628    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/012c8a9c-a3fd-4e5e-bb99-d116da21f74f-node-exporter-wtmp\") pod \"node-exporter-hsfv6\" (UID: \"012c8a9c-a3fd-4e5e-bb99-d116da21f74f\") " pod="openshift-monitoring/node-exporter-hsfv6"
Sep 10 17:42:43.278748 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:43.278695    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/012c8a9c-a3fd-4e5e-bb99-d116da21f74f-node-exporter-accelerators-collector-config\") pod \"node-exporter-hsfv6\" (UID: \"012c8a9c-a3fd-4e5e-bb99-d116da21f74f\") " pod="openshift-monitoring/node-exporter-hsfv6"
Sep 10 17:42:43.278748 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:43.278747    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/012c8a9c-a3fd-4e5e-bb99-d116da21f74f-sys\") pod \"node-exporter-hsfv6\" (UID: \"012c8a9c-a3fd-4e5e-bb99-d116da21f74f\") " pod="openshift-monitoring/node-exporter-hsfv6"
Sep 10 17:42:43.278949 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:43.278767    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dc9b6\" (UniqueName: \"kubernetes.io/projected/012c8a9c-a3fd-4e5e-bb99-d116da21f74f-kube-api-access-dc9b6\") pod \"node-exporter-hsfv6\" (UID: \"012c8a9c-a3fd-4e5e-bb99-d116da21f74f\") " pod="openshift-monitoring/node-exporter-hsfv6"
Sep 10 17:42:43.278949 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:43.278854    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/012c8a9c-a3fd-4e5e-bb99-d116da21f74f-node-exporter-tls\") pod \"node-exporter-hsfv6\" (UID: \"012c8a9c-a3fd-4e5e-bb99-d116da21f74f\") " pod="openshift-monitoring/node-exporter-hsfv6"
Sep 10 17:42:43.278949 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:43.278946    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/012c8a9c-a3fd-4e5e-bb99-d116da21f74f-root\") pod \"node-exporter-hsfv6\" (UID: \"012c8a9c-a3fd-4e5e-bb99-d116da21f74f\") " pod="openshift-monitoring/node-exporter-hsfv6"
Sep 10 17:42:43.279177 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:43.278983    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/012c8a9c-a3fd-4e5e-bb99-d116da21f74f-node-exporter-textfile\") pod \"node-exporter-hsfv6\" (UID: \"012c8a9c-a3fd-4e5e-bb99-d116da21f74f\") " pod="openshift-monitoring/node-exporter-hsfv6"
Sep 10 17:42:43.380264 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:43.380160    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/012c8a9c-a3fd-4e5e-bb99-d116da21f74f-root\") pod \"node-exporter-hsfv6\" (UID: \"012c8a9c-a3fd-4e5e-bb99-d116da21f74f\") " pod="openshift-monitoring/node-exporter-hsfv6"
Sep 10 17:42:43.380264 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:43.380214    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/012c8a9c-a3fd-4e5e-bb99-d116da21f74f-node-exporter-textfile\") pod \"node-exporter-hsfv6\" (UID: \"012c8a9c-a3fd-4e5e-bb99-d116da21f74f\") " pod="openshift-monitoring/node-exporter-hsfv6"
Sep 10 17:42:43.380264 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:43.380242    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/012c8a9c-a3fd-4e5e-bb99-d116da21f74f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hsfv6\" (UID: \"012c8a9c-a3fd-4e5e-bb99-d116da21f74f\") " pod="openshift-monitoring/node-exporter-hsfv6"
Sep 10 17:42:43.380568 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:43.380275    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/012c8a9c-a3fd-4e5e-bb99-d116da21f74f-metrics-client-ca\") pod \"node-exporter-hsfv6\" (UID: \"012c8a9c-a3fd-4e5e-bb99-d116da21f74f\") " pod="openshift-monitoring/node-exporter-hsfv6"
Sep 10 17:42:43.380568 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:43.380289    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/012c8a9c-a3fd-4e5e-bb99-d116da21f74f-root\") pod \"node-exporter-hsfv6\" (UID: \"012c8a9c-a3fd-4e5e-bb99-d116da21f74f\") " pod="openshift-monitoring/node-exporter-hsfv6"
Sep 10 17:42:43.380568 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:43.380303    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/012c8a9c-a3fd-4e5e-bb99-d116da21f74f-node-exporter-wtmp\") pod \"node-exporter-hsfv6\" (UID: \"012c8a9c-a3fd-4e5e-bb99-d116da21f74f\") " pod="openshift-monitoring/node-exporter-hsfv6"
Sep 10 17:42:43.380568 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:43.380383    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/012c8a9c-a3fd-4e5e-bb99-d116da21f74f-node-exporter-accelerators-collector-config\") pod \"node-exporter-hsfv6\" (UID: \"012c8a9c-a3fd-4e5e-bb99-d116da21f74f\") " pod="openshift-monitoring/node-exporter-hsfv6"
Sep 10 17:42:43.380568 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:43.380429    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/012c8a9c-a3fd-4e5e-bb99-d116da21f74f-sys\") pod \"node-exporter-hsfv6\" (UID: \"012c8a9c-a3fd-4e5e-bb99-d116da21f74f\") " pod="openshift-monitoring/node-exporter-hsfv6"
Sep 10 17:42:43.380568 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:43.380456    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dc9b6\" (UniqueName: \"kubernetes.io/projected/012c8a9c-a3fd-4e5e-bb99-d116da21f74f-kube-api-access-dc9b6\") pod \"node-exporter-hsfv6\" (UID: \"012c8a9c-a3fd-4e5e-bb99-d116da21f74f\") " pod="openshift-monitoring/node-exporter-hsfv6"
Sep 10 17:42:43.380568 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:43.380527    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/012c8a9c-a3fd-4e5e-bb99-d116da21f74f-node-exporter-tls\") pod \"node-exporter-hsfv6\" (UID: \"012c8a9c-a3fd-4e5e-bb99-d116da21f74f\") " pod="openshift-monitoring/node-exporter-hsfv6"
Sep 10 17:42:43.380568 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:43.380546    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/012c8a9c-a3fd-4e5e-bb99-d116da21f74f-node-exporter-wtmp\") pod \"node-exporter-hsfv6\" (UID: \"012c8a9c-a3fd-4e5e-bb99-d116da21f74f\") " pod="openshift-monitoring/node-exporter-hsfv6"
Sep 10 17:42:43.380941 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:43.380599    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/012c8a9c-a3fd-4e5e-bb99-d116da21f74f-sys\") pod \"node-exporter-hsfv6\" (UID: \"012c8a9c-a3fd-4e5e-bb99-d116da21f74f\") " pod="openshift-monitoring/node-exporter-hsfv6"
Sep 10 17:42:43.381000 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:43.380982    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/012c8a9c-a3fd-4e5e-bb99-d116da21f74f-metrics-client-ca\") pod \"node-exporter-hsfv6\" (UID: \"012c8a9c-a3fd-4e5e-bb99-d116da21f74f\") " pod="openshift-monitoring/node-exporter-hsfv6"
Sep 10 17:42:43.381142 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:43.381096    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/012c8a9c-a3fd-4e5e-bb99-d116da21f74f-node-exporter-accelerators-collector-config\") pod \"node-exporter-hsfv6\" (UID: \"012c8a9c-a3fd-4e5e-bb99-d116da21f74f\") " pod="openshift-monitoring/node-exporter-hsfv6"
Sep 10 17:42:43.381264 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:43.381195    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/012c8a9c-a3fd-4e5e-bb99-d116da21f74f-node-exporter-textfile\") pod \"node-exporter-hsfv6\" (UID: \"012c8a9c-a3fd-4e5e-bb99-d116da21f74f\") " pod="openshift-monitoring/node-exporter-hsfv6"
Sep 10 17:42:43.383377 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:43.383353    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/012c8a9c-a3fd-4e5e-bb99-d116da21f74f-node-exporter-tls\") pod \"node-exporter-hsfv6\" (UID: \"012c8a9c-a3fd-4e5e-bb99-d116da21f74f\") " pod="openshift-monitoring/node-exporter-hsfv6"
Sep 10 17:42:43.383881 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:43.383858    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/012c8a9c-a3fd-4e5e-bb99-d116da21f74f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hsfv6\" (UID: \"012c8a9c-a3fd-4e5e-bb99-d116da21f74f\") " pod="openshift-monitoring/node-exporter-hsfv6"
Sep 10 17:42:43.390310 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:43.390275    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dc9b6\" (UniqueName: \"kubernetes.io/projected/012c8a9c-a3fd-4e5e-bb99-d116da21f74f-kube-api-access-dc9b6\") pod \"node-exporter-hsfv6\" (UID: \"012c8a9c-a3fd-4e5e-bb99-d116da21f74f\") " pod="openshift-monitoring/node-exporter-hsfv6"
Sep 10 17:42:43.406767 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:43.406726    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hsfv6"
Sep 10 17:42:43.418198 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:42:43.418164    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod012c8a9c_a3fd_4e5e_bb99_d116da21f74f.slice/crio-a7001e41810343a91e9b6104c9006e9615fd10137b46d707a68fa89098f8d2e5 WatchSource:0}: Error finding container a7001e41810343a91e9b6104c9006e9615fd10137b46d707a68fa89098f8d2e5: Status 404 returned error can't find the container with id a7001e41810343a91e9b6104c9006e9615fd10137b46d707a68fa89098f8d2e5
Sep 10 17:42:44.221005 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:44.220918    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hsfv6" event={"ID":"012c8a9c-a3fd-4e5e-bb99-d116da21f74f","Type":"ContainerStarted","Data":"a7001e41810343a91e9b6104c9006e9615fd10137b46d707a68fa89098f8d2e5"}
Sep 10 17:42:45.227002 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:45.226944    2568 generic.go:356] "Generic (PLEG): container finished" podID="012c8a9c-a3fd-4e5e-bb99-d116da21f74f" containerID="3fccea16685442ec45c7dd67baeebe97be1ef1f2b595b5ac5ab7ea9cb5bc2d07" exitCode=0
Sep 10 17:42:45.227900 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:45.227859    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hsfv6" event={"ID":"012c8a9c-a3fd-4e5e-bb99-d116da21f74f","Type":"ContainerDied","Data":"3fccea16685442ec45c7dd67baeebe97be1ef1f2b595b5ac5ab7ea9cb5bc2d07"}
Sep 10 17:42:46.233725 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:46.233683    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hsfv6" event={"ID":"012c8a9c-a3fd-4e5e-bb99-d116da21f74f","Type":"ContainerStarted","Data":"d2314446eeb0d3677475d412fe8f4deaea2c679796998714f1e9b645378bb345"}
Sep 10 17:42:46.234147 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:46.233796    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hsfv6" event={"ID":"012c8a9c-a3fd-4e5e-bb99-d116da21f74f","Type":"ContainerStarted","Data":"51edbf0dd6dc9d0a0c658ad9ac4d8aa2296db50830ce78ef34f64914a1c5a282"}
Sep 10 17:42:46.256067 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:42:46.256011    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-hsfv6" podStartSLOduration=2.109173241 podStartE2EDuration="3.255994858s" totalImagesPullingTime="1.050027396s" totalInitContainerRuntime="96.794221ms" isStatefulPod=true podCreationTimestamp="2026-09-10 17:42:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:42:46.255205701 +0000 UTC m=+102.016513743" watchObservedRunningTime="2026-09-10 17:42:46.255994858 +0000 UTC m=+102.017302902"
Sep 10 17:43:04.500302 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:43:04.500238    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-77c4f8844d-b7c4w" podUID="23ba8a7e-2139-4312-bb59-b1adfeb87a10" containerName="registry" containerID="cri-o://5dc9b9cf56051438be47d00823e2efce8f3f12c14825734f4fda9246a71f9aa3" gracePeriod=30
Sep 10 17:43:04.746993 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:43:04.746964    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77c4f8844d-b7c4w"
Sep 10 17:43:04.837873 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:43:04.837766    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/23ba8a7e-2139-4312-bb59-b1adfeb87a10-registry-tls\") pod \"23ba8a7e-2139-4312-bb59-b1adfeb87a10\" (UID: \"23ba8a7e-2139-4312-bb59-b1adfeb87a10\") "
Sep 10 17:43:04.837873 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:43:04.837823    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/23ba8a7e-2139-4312-bb59-b1adfeb87a10-trusted-ca\") pod \"23ba8a7e-2139-4312-bb59-b1adfeb87a10\" (UID: \"23ba8a7e-2139-4312-bb59-b1adfeb87a10\") "
Sep 10 17:43:04.838112 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:43:04.837877    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/23ba8a7e-2139-4312-bb59-b1adfeb87a10-image-registry-private-configuration\") pod \"23ba8a7e-2139-4312-bb59-b1adfeb87a10\" (UID: \"23ba8a7e-2139-4312-bb59-b1adfeb87a10\") "
Sep 10 17:43:04.838112 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:43:04.837915    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/23ba8a7e-2139-4312-bb59-b1adfeb87a10-registry-certificates\") pod \"23ba8a7e-2139-4312-bb59-b1adfeb87a10\" (UID: \"23ba8a7e-2139-4312-bb59-b1adfeb87a10\") "
Sep 10 17:43:04.838112 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:43:04.837945    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/23ba8a7e-2139-4312-bb59-b1adfeb87a10-installation-pull-secrets\") pod \"23ba8a7e-2139-4312-bb59-b1adfeb87a10\" (UID: \"23ba8a7e-2139-4312-bb59-b1adfeb87a10\") "
Sep 10 17:43:04.838112 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:43:04.837972    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/23ba8a7e-2139-4312-bb59-b1adfeb87a10-ca-trust-extracted\") pod \"23ba8a7e-2139-4312-bb59-b1adfeb87a10\" (UID: \"23ba8a7e-2139-4312-bb59-b1adfeb87a10\") "
Sep 10 17:43:04.838112 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:43:04.837994    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/23ba8a7e-2139-4312-bb59-b1adfeb87a10-bound-sa-token\") pod \"23ba8a7e-2139-4312-bb59-b1adfeb87a10\" (UID: \"23ba8a7e-2139-4312-bb59-b1adfeb87a10\") "
Sep 10 17:43:04.838112 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:43:04.838020    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vvl48\" (UniqueName: \"kubernetes.io/projected/23ba8a7e-2139-4312-bb59-b1adfeb87a10-kube-api-access-vvl48\") pod \"23ba8a7e-2139-4312-bb59-b1adfeb87a10\" (UID: \"23ba8a7e-2139-4312-bb59-b1adfeb87a10\") "
Sep 10 17:43:04.838808 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:43:04.838765    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/23ba8a7e-2139-4312-bb59-b1adfeb87a10-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "23ba8a7e-2139-4312-bb59-b1adfeb87a10" (UID: "23ba8a7e-2139-4312-bb59-b1adfeb87a10"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 17:43:04.838943 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:43:04.838920    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/23ba8a7e-2139-4312-bb59-b1adfeb87a10-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "23ba8a7e-2139-4312-bb59-b1adfeb87a10" (UID: "23ba8a7e-2139-4312-bb59-b1adfeb87a10"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 17:43:04.841477 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:43:04.841369    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23ba8a7e-2139-4312-bb59-b1adfeb87a10-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "23ba8a7e-2139-4312-bb59-b1adfeb87a10" (UID: "23ba8a7e-2139-4312-bb59-b1adfeb87a10"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:43:04.841658 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:43:04.841613    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23ba8a7e-2139-4312-bb59-b1adfeb87a10-kube-api-access-vvl48" (OuterVolumeSpecName: "kube-api-access-vvl48") pod "23ba8a7e-2139-4312-bb59-b1adfeb87a10" (UID: "23ba8a7e-2139-4312-bb59-b1adfeb87a10"). InnerVolumeSpecName "kube-api-access-vvl48". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:43:04.844367 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:43:04.841845    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23ba8a7e-2139-4312-bb59-b1adfeb87a10-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "23ba8a7e-2139-4312-bb59-b1adfeb87a10" (UID: "23ba8a7e-2139-4312-bb59-b1adfeb87a10"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 17:43:04.844367 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:43:04.841979    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23ba8a7e-2139-4312-bb59-b1adfeb87a10-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "23ba8a7e-2139-4312-bb59-b1adfeb87a10" (UID: "23ba8a7e-2139-4312-bb59-b1adfeb87a10"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 17:43:04.844367 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:43:04.843548    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23ba8a7e-2139-4312-bb59-b1adfeb87a10-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "23ba8a7e-2139-4312-bb59-b1adfeb87a10" (UID: "23ba8a7e-2139-4312-bb59-b1adfeb87a10"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:43:04.849961 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:43:04.849921    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23ba8a7e-2139-4312-bb59-b1adfeb87a10-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "23ba8a7e-2139-4312-bb59-b1adfeb87a10" (UID: "23ba8a7e-2139-4312-bb59-b1adfeb87a10"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:43:04.942490 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:43:04.942452    2568 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/23ba8a7e-2139-4312-bb59-b1adfeb87a10-registry-tls\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:43:04.942490 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:43:04.942484    2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/23ba8a7e-2139-4312-bb59-b1adfeb87a10-trusted-ca\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:43:04.942490 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:43:04.942498    2568 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/23ba8a7e-2139-4312-bb59-b1adfeb87a10-image-registry-private-configuration\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:43:04.942739 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:43:04.942511    2568 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/23ba8a7e-2139-4312-bb59-b1adfeb87a10-registry-certificates\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:43:04.942739 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:43:04.942524    2568 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/23ba8a7e-2139-4312-bb59-b1adfeb87a10-installation-pull-secrets\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:43:04.942739 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:43:04.942536    2568 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/23ba8a7e-2139-4312-bb59-b1adfeb87a10-ca-trust-extracted\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:43:04.942739 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:43:04.942547    2568 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/23ba8a7e-2139-4312-bb59-b1adfeb87a10-bound-sa-token\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:43:04.942739 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:43:04.942558    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vvl48\" (UniqueName: \"kubernetes.io/projected/23ba8a7e-2139-4312-bb59-b1adfeb87a10-kube-api-access-vvl48\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:43:05.300309 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:43:05.300272    2568 generic.go:356] "Generic (PLEG): container finished" podID="23ba8a7e-2139-4312-bb59-b1adfeb87a10" containerID="5dc9b9cf56051438be47d00823e2efce8f3f12c14825734f4fda9246a71f9aa3" exitCode=0
Sep 10 17:43:05.300309 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:43:05.300315    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77c4f8844d-b7c4w" event={"ID":"23ba8a7e-2139-4312-bb59-b1adfeb87a10","Type":"ContainerDied","Data":"5dc9b9cf56051438be47d00823e2efce8f3f12c14825734f4fda9246a71f9aa3"}
Sep 10 17:43:05.300563 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:43:05.300362    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77c4f8844d-b7c4w"
Sep 10 17:43:05.300563 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:43:05.300391    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77c4f8844d-b7c4w" event={"ID":"23ba8a7e-2139-4312-bb59-b1adfeb87a10","Type":"ContainerDied","Data":"377176aab9f308ad19fc0c779ba70a653bdb6aa7a10b76453815ba0e6be313ea"}
Sep 10 17:43:05.300563 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:43:05.300412    2568 scope.go:117] "RemoveContainer" containerID="5dc9b9cf56051438be47d00823e2efce8f3f12c14825734f4fda9246a71f9aa3"
Sep 10 17:43:05.308444 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:43:05.308423    2568 scope.go:117] "RemoveContainer" containerID="5dc9b9cf56051438be47d00823e2efce8f3f12c14825734f4fda9246a71f9aa3"
Sep 10 17:43:05.308797 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:43:05.308772    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5dc9b9cf56051438be47d00823e2efce8f3f12c14825734f4fda9246a71f9aa3\": container with ID starting with 5dc9b9cf56051438be47d00823e2efce8f3f12c14825734f4fda9246a71f9aa3 not found: ID does not exist" containerID="5dc9b9cf56051438be47d00823e2efce8f3f12c14825734f4fda9246a71f9aa3"
Sep 10 17:43:05.308837 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:43:05.308809    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5dc9b9cf56051438be47d00823e2efce8f3f12c14825734f4fda9246a71f9aa3"} err="failed to get container status \"5dc9b9cf56051438be47d00823e2efce8f3f12c14825734f4fda9246a71f9aa3\": rpc error: code = NotFound desc = could not find container \"5dc9b9cf56051438be47d00823e2efce8f3f12c14825734f4fda9246a71f9aa3\": container with ID starting with 5dc9b9cf56051438be47d00823e2efce8f3f12c14825734f4fda9246a71f9aa3 not found: ID does not exist"
Sep 10 17:43:05.322486 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:43:05.322452    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-77c4f8844d-b7c4w"]
Sep 10 17:43:05.328243 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:43:05.328213    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-77c4f8844d-b7c4w"]
Sep 10 17:43:06.768504 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:43:06.768467    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23ba8a7e-2139-4312-bb59-b1adfeb87a10" path="/var/lib/kubelet/pods/23ba8a7e-2139-4312-bb59-b1adfeb87a10/volumes"
Sep 10 17:43:19.356201 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:43:19.356163    2568 generic.go:356] "Generic (PLEG): container finished" podID="50081a35-70d7-41dd-88af-176fb4aca5d6" containerID="d325be6c11f58114bc762e0adfe227d41fd77dc5cf3be13680f4fb42f914031c" exitCode=0
Sep 10 17:43:19.356744 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:43:19.356221    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-8hhtb" event={"ID":"50081a35-70d7-41dd-88af-176fb4aca5d6","Type":"ContainerDied","Data":"d325be6c11f58114bc762e0adfe227d41fd77dc5cf3be13680f4fb42f914031c"}
Sep 10 17:43:19.356744 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:43:19.356665    2568 scope.go:117] "RemoveContainer" containerID="d325be6c11f58114bc762e0adfe227d41fd77dc5cf3be13680f4fb42f914031c"
Sep 10 17:43:20.361217 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:43:20.361179    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-8hhtb" event={"ID":"50081a35-70d7-41dd-88af-176fb4aca5d6","Type":"ContainerStarted","Data":"40b0ac38028803aedccd9b149c4a9fe91b24dd6b64c6438c9cf05f131e4a1d65"}
Sep 10 17:45:06.921224 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:45:06.921186    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404hhqp"]
Sep 10 17:45:06.921700 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:45:06.921441    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23ba8a7e-2139-4312-bb59-b1adfeb87a10" containerName="registry"
Sep 10 17:45:06.921700 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:45:06.921453    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="23ba8a7e-2139-4312-bb59-b1adfeb87a10" containerName="registry"
Sep 10 17:45:06.921700 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:45:06.921500    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="23ba8a7e-2139-4312-bb59-b1adfeb87a10" containerName="registry"
Sep 10 17:45:06.924428 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:45:06.924409    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404hhqp"
Sep 10 17:45:06.927171 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:45:06.927142    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-s2ppn\""
Sep 10 17:45:06.927309 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:45:06.927240    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 10 17:45:06.928476 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:45:06.928456    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 10 17:45:06.932804 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:45:06.932771    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404hhqp"]
Sep 10 17:45:07.039560 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:45:07.039518    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/320e34c1-2b7a-448e-9dd5-1e184137be08-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404hhqp\" (UID: \"320e34c1-2b7a-448e-9dd5-1e184137be08\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404hhqp"
Sep 10 17:45:07.039737 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:45:07.039569    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwpr4\" (UniqueName: \"kubernetes.io/projected/320e34c1-2b7a-448e-9dd5-1e184137be08-kube-api-access-vwpr4\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404hhqp\" (UID: \"320e34c1-2b7a-448e-9dd5-1e184137be08\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404hhqp"
Sep 10 17:45:07.039737 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:45:07.039590    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/320e34c1-2b7a-448e-9dd5-1e184137be08-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404hhqp\" (UID: \"320e34c1-2b7a-448e-9dd5-1e184137be08\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404hhqp"
Sep 10 17:45:07.140286 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:45:07.140254    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/320e34c1-2b7a-448e-9dd5-1e184137be08-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404hhqp\" (UID: \"320e34c1-2b7a-448e-9dd5-1e184137be08\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404hhqp"
Sep 10 17:45:07.140428 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:45:07.140299    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwpr4\" (UniqueName: \"kubernetes.io/projected/320e34c1-2b7a-448e-9dd5-1e184137be08-kube-api-access-vwpr4\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404hhqp\" (UID: \"320e34c1-2b7a-448e-9dd5-1e184137be08\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404hhqp"
Sep 10 17:45:07.140428 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:45:07.140341    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/320e34c1-2b7a-448e-9dd5-1e184137be08-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404hhqp\" (UID: \"320e34c1-2b7a-448e-9dd5-1e184137be08\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404hhqp"
Sep 10 17:45:07.140750 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:45:07.140732    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/320e34c1-2b7a-448e-9dd5-1e184137be08-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404hhqp\" (UID: \"320e34c1-2b7a-448e-9dd5-1e184137be08\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404hhqp"
Sep 10 17:45:07.140794 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:45:07.140737    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/320e34c1-2b7a-448e-9dd5-1e184137be08-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404hhqp\" (UID: \"320e34c1-2b7a-448e-9dd5-1e184137be08\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404hhqp"
Sep 10 17:45:07.149787 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:45:07.149750    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwpr4\" (UniqueName: \"kubernetes.io/projected/320e34c1-2b7a-448e-9dd5-1e184137be08-kube-api-access-vwpr4\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404hhqp\" (UID: \"320e34c1-2b7a-448e-9dd5-1e184137be08\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404hhqp"
Sep 10 17:45:07.234153 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:45:07.234123    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404hhqp"
Sep 10 17:45:07.505305 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:45:07.505226    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404hhqp"]
Sep 10 17:45:07.508501 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:45:07.508471    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod320e34c1_2b7a_448e_9dd5_1e184137be08.slice/crio-966a510ff0477d04c07040f3cf2c860e2c378015bf8da72777a4e5bf020dc3b2 WatchSource:0}: Error finding container 966a510ff0477d04c07040f3cf2c860e2c378015bf8da72777a4e5bf020dc3b2: Status 404 returned error can't find the container with id 966a510ff0477d04c07040f3cf2c860e2c378015bf8da72777a4e5bf020dc3b2
Sep 10 17:45:07.731492 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:45:07.731454    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404hhqp" event={"ID":"320e34c1-2b7a-448e-9dd5-1e184137be08","Type":"ContainerStarted","Data":"966a510ff0477d04c07040f3cf2c860e2c378015bf8da72777a4e5bf020dc3b2"}
Sep 10 17:45:14.759290 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:45:14.759255    2568 generic.go:356] "Generic (PLEG): container finished" podID="320e34c1-2b7a-448e-9dd5-1e184137be08" containerID="a2afc855e0637c503bc4dec99333b4b59953501670f6ecd3b4d580a6e905570d" exitCode=0
Sep 10 17:45:14.759758 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:45:14.759297    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404hhqp" event={"ID":"320e34c1-2b7a-448e-9dd5-1e184137be08","Type":"ContainerDied","Data":"a2afc855e0637c503bc4dec99333b4b59953501670f6ecd3b4d580a6e905570d"}
Sep 10 17:45:17.772446 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:45:17.772408    2568 generic.go:356] "Generic (PLEG): container finished" podID="320e34c1-2b7a-448e-9dd5-1e184137be08" containerID="1a1a631c3478db8eccfc60ad99e632ecfb7b83aad175c22b02a2b1d657b4caa0" exitCode=0
Sep 10 17:45:17.772904 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:45:17.772453    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404hhqp" event={"ID":"320e34c1-2b7a-448e-9dd5-1e184137be08","Type":"ContainerDied","Data":"1a1a631c3478db8eccfc60ad99e632ecfb7b83aad175c22b02a2b1d657b4caa0"}
Sep 10 17:45:25.805762 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:45:25.805726    2568 generic.go:356] "Generic (PLEG): container finished" podID="320e34c1-2b7a-448e-9dd5-1e184137be08" containerID="72e01352b574dddfabf83581d3220d63026a4d524a5efa0e1b08d476de868f81" exitCode=0
Sep 10 17:45:25.806131 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:45:25.805805    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404hhqp" event={"ID":"320e34c1-2b7a-448e-9dd5-1e184137be08","Type":"ContainerDied","Data":"72e01352b574dddfabf83581d3220d63026a4d524a5efa0e1b08d476de868f81"}
Sep 10 17:45:26.930913 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:45:26.930885    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404hhqp"
Sep 10 17:45:27.005123 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:45:27.005085    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/320e34c1-2b7a-448e-9dd5-1e184137be08-util\") pod \"320e34c1-2b7a-448e-9dd5-1e184137be08\" (UID: \"320e34c1-2b7a-448e-9dd5-1e184137be08\") "
Sep 10 17:45:27.005300 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:45:27.005149    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vwpr4\" (UniqueName: \"kubernetes.io/projected/320e34c1-2b7a-448e-9dd5-1e184137be08-kube-api-access-vwpr4\") pod \"320e34c1-2b7a-448e-9dd5-1e184137be08\" (UID: \"320e34c1-2b7a-448e-9dd5-1e184137be08\") "
Sep 10 17:45:27.005300 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:45:27.005200    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/320e34c1-2b7a-448e-9dd5-1e184137be08-bundle\") pod \"320e34c1-2b7a-448e-9dd5-1e184137be08\" (UID: \"320e34c1-2b7a-448e-9dd5-1e184137be08\") "
Sep 10 17:45:27.005911 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:45:27.005883    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/320e34c1-2b7a-448e-9dd5-1e184137be08-bundle" (OuterVolumeSpecName: "bundle") pod "320e34c1-2b7a-448e-9dd5-1e184137be08" (UID: "320e34c1-2b7a-448e-9dd5-1e184137be08"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:45:27.007521 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:45:27.007492    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/320e34c1-2b7a-448e-9dd5-1e184137be08-kube-api-access-vwpr4" (OuterVolumeSpecName: "kube-api-access-vwpr4") pod "320e34c1-2b7a-448e-9dd5-1e184137be08" (UID: "320e34c1-2b7a-448e-9dd5-1e184137be08"). InnerVolumeSpecName "kube-api-access-vwpr4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:45:27.010238 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:45:27.010208    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/320e34c1-2b7a-448e-9dd5-1e184137be08-util" (OuterVolumeSpecName: "util") pod "320e34c1-2b7a-448e-9dd5-1e184137be08" (UID: "320e34c1-2b7a-448e-9dd5-1e184137be08"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:45:27.106386 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:45:27.106258    2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/320e34c1-2b7a-448e-9dd5-1e184137be08-util\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:45:27.106386 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:45:27.106304    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vwpr4\" (UniqueName: \"kubernetes.io/projected/320e34c1-2b7a-448e-9dd5-1e184137be08-kube-api-access-vwpr4\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:45:27.106386 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:45:27.106314    2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/320e34c1-2b7a-448e-9dd5-1e184137be08-bundle\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:45:27.814337 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:45:27.814296    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404hhqp" event={"ID":"320e34c1-2b7a-448e-9dd5-1e184137be08","Type":"ContainerDied","Data":"966a510ff0477d04c07040f3cf2c860e2c378015bf8da72777a4e5bf020dc3b2"}
Sep 10 17:45:27.814510 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:45:27.814364    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404hhqp"
Sep 10 17:45:27.814510 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:45:27.814369    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="966a510ff0477d04c07040f3cf2c860e2c378015bf8da72777a4e5bf020dc3b2"
Sep 10 17:45:34.739222 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:45:34.739177    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pd2xg"]
Sep 10 17:45:34.739724 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:45:34.739524    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="320e34c1-2b7a-448e-9dd5-1e184137be08" containerName="pull"
Sep 10 17:45:34.739724 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:45:34.739544    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="320e34c1-2b7a-448e-9dd5-1e184137be08" containerName="pull"
Sep 10 17:45:34.739724 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:45:34.739560    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="320e34c1-2b7a-448e-9dd5-1e184137be08" containerName="util"
Sep 10 17:45:34.739724 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:45:34.739568    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="320e34c1-2b7a-448e-9dd5-1e184137be08" containerName="util"
Sep 10 17:45:34.739724 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:45:34.739582    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="320e34c1-2b7a-448e-9dd5-1e184137be08" containerName="extract"
Sep 10 17:45:34.739724 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:45:34.739591    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="320e34c1-2b7a-448e-9dd5-1e184137be08" containerName="extract"
Sep 10 17:45:34.739724 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:45:34.739659    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="320e34c1-2b7a-448e-9dd5-1e184137be08" containerName="extract"
Sep 10 17:45:34.743424 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:45:34.743400    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pd2xg"
Sep 10 17:45:34.747714 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:45:34.747689    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Sep 10 17:45:34.748032 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:45:34.748010    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-tw56z\""
Sep 10 17:45:34.749815 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:45:34.749663    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Sep 10 17:45:34.768874 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:45:34.768836    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pd2xg"]
Sep 10 17:45:34.868522 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:45:34.868485    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bc3eb184-768e-4d08-8be0-b41a299452ab-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-pd2xg\" (UID: \"bc3eb184-768e-4d08-8be0-b41a299452ab\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pd2xg"
Sep 10 17:45:34.868522 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:45:34.868524    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-925bf\" (UniqueName: \"kubernetes.io/projected/bc3eb184-768e-4d08-8be0-b41a299452ab-kube-api-access-925bf\") pod \"cert-manager-operator-controller-manager-55c444bf86-pd2xg\" (UID: \"bc3eb184-768e-4d08-8be0-b41a299452ab\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pd2xg"
Sep 10 17:45:34.969030 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:45:34.968968    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bc3eb184-768e-4d08-8be0-b41a299452ab-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-pd2xg\" (UID: \"bc3eb184-768e-4d08-8be0-b41a299452ab\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pd2xg"
Sep 10 17:45:34.969030 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:45:34.969023    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-925bf\" (UniqueName: \"kubernetes.io/projected/bc3eb184-768e-4d08-8be0-b41a299452ab-kube-api-access-925bf\") pod \"cert-manager-operator-controller-manager-55c444bf86-pd2xg\" (UID: \"bc3eb184-768e-4d08-8be0-b41a299452ab\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pd2xg"
Sep 10 17:45:34.969417 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:45:34.969397    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bc3eb184-768e-4d08-8be0-b41a299452ab-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-pd2xg\" (UID: \"bc3eb184-768e-4d08-8be0-b41a299452ab\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pd2xg"
Sep 10 17:45:34.981980 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:45:34.981943    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-925bf\" (UniqueName: \"kubernetes.io/projected/bc3eb184-768e-4d08-8be0-b41a299452ab-kube-api-access-925bf\") pod \"cert-manager-operator-controller-manager-55c444bf86-pd2xg\" (UID: \"bc3eb184-768e-4d08-8be0-b41a299452ab\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pd2xg"
Sep 10 17:45:35.052839 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:45:35.052748    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pd2xg"
Sep 10 17:45:35.333920 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:45:35.333796    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pd2xg"]
Sep 10 17:45:35.338999 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:45:35.338963    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc3eb184_768e_4d08_8be0_b41a299452ab.slice/crio-897757b2d64ef06c175329d637ce002231c9c690f2141d7662bd02c2f6088fd0 WatchSource:0}: Error finding container 897757b2d64ef06c175329d637ce002231c9c690f2141d7662bd02c2f6088fd0: Status 404 returned error can't find the container with id 897757b2d64ef06c175329d637ce002231c9c690f2141d7662bd02c2f6088fd0
Sep 10 17:45:35.843578 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:45:35.843539    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pd2xg" event={"ID":"bc3eb184-768e-4d08-8be0-b41a299452ab","Type":"ContainerStarted","Data":"897757b2d64ef06c175329d637ce002231c9c690f2141d7662bd02c2f6088fd0"}
Sep 10 17:45:37.857820 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:45:37.857732    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pd2xg" event={"ID":"bc3eb184-768e-4d08-8be0-b41a299452ab","Type":"ContainerStarted","Data":"582634b7b62d4f53020c5dddc9de770a52a984c7dbf3cf0efa1c6c894ca4b44c"}
Sep 10 17:45:37.883000 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:45:37.882946    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pd2xg" podStartSLOduration=1.718109165 podStartE2EDuration="3.882928389s" totalImagesPullingTime="2.164819224s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:45:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:45:37.880753865 +0000 UTC m=+273.642061908" watchObservedRunningTime="2026-09-10 17:45:37.882928389 +0000 UTC m=+273.644236436"
Sep 10 17:45:41.058115 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:45:41.058081    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-ss5jt"]
Sep 10 17:45:41.061275 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:45:41.061255    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-ss5jt"
Sep 10 17:45:41.064550 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:45:41.064522    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 10 17:45:41.064550 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:45:41.064544    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-2mq5q\""
Sep 10 17:45:41.065524 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:45:41.065502    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 10 17:45:41.070626 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:45:41.070598    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-ss5jt"]
Sep 10 17:45:41.215269 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:45:41.215224    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgr5z\" (UniqueName: \"kubernetes.io/projected/f2c0591a-1dd6-4741-acad-7ee921f6b292-kube-api-access-xgr5z\") pod \"cert-manager-cainjector-559cdd8c87-ss5jt\" (UID: \"f2c0591a-1dd6-4741-acad-7ee921f6b292\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-ss5jt"
Sep 10 17:45:41.215470 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:45:41.215287    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f2c0591a-1dd6-4741-acad-7ee921f6b292-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-ss5jt\" (UID: \"f2c0591a-1dd6-4741-acad-7ee921f6b292\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-ss5jt"
Sep 10 17:45:41.316597 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:45:41.316512    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgr5z\" (UniqueName: \"kubernetes.io/projected/f2c0591a-1dd6-4741-acad-7ee921f6b292-kube-api-access-xgr5z\") pod \"cert-manager-cainjector-559cdd8c87-ss5jt\" (UID: \"f2c0591a-1dd6-4741-acad-7ee921f6b292\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-ss5jt"
Sep 10 17:45:41.316597 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:45:41.316563    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f2c0591a-1dd6-4741-acad-7ee921f6b292-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-ss5jt\" (UID: \"f2c0591a-1dd6-4741-acad-7ee921f6b292\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-ss5jt"
Sep 10 17:45:41.326620 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:45:41.326583    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f2c0591a-1dd6-4741-acad-7ee921f6b292-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-ss5jt\" (UID: \"f2c0591a-1dd6-4741-acad-7ee921f6b292\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-ss5jt"
Sep 10 17:45:41.327018 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:45:41.326991    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgr5z\" (UniqueName: \"kubernetes.io/projected/f2c0591a-1dd6-4741-acad-7ee921f6b292-kube-api-access-xgr5z\") pod \"cert-manager-cainjector-559cdd8c87-ss5jt\" (UID: \"f2c0591a-1dd6-4741-acad-7ee921f6b292\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-ss5jt"
Sep 10 17:45:41.371112 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:45:41.371071    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-ss5jt"
Sep 10 17:45:41.641945 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:45:41.641919    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-ss5jt"]
Sep 10 17:45:41.644197 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:45:41.644170    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf2c0591a_1dd6_4741_acad_7ee921f6b292.slice/crio-b8016a7cba843b17ef7a7482921a8c23857c11debdde84a1aa9b0920b9997a9e WatchSource:0}: Error finding container b8016a7cba843b17ef7a7482921a8c23857c11debdde84a1aa9b0920b9997a9e: Status 404 returned error can't find the container with id b8016a7cba843b17ef7a7482921a8c23857c11debdde84a1aa9b0920b9997a9e
Sep 10 17:45:41.873263 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:45:41.873227    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-ss5jt" event={"ID":"f2c0591a-1dd6-4741-acad-7ee921f6b292","Type":"ContainerStarted","Data":"b8016a7cba843b17ef7a7482921a8c23857c11debdde84a1aa9b0920b9997a9e"}
Sep 10 17:45:44.887414 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:45:44.887289    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-ss5jt" event={"ID":"f2c0591a-1dd6-4741-acad-7ee921f6b292","Type":"ContainerStarted","Data":"d87c03b7a384cf775304ada48dd1f29da9e25775053eb6429819d7c929bcc182"}
Sep 10 17:45:44.904706 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:45:44.904637    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-ss5jt" podStartSLOduration=1.038842642 podStartE2EDuration="3.904618214s" totalImagesPullingTime="2.865775572s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:45:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:45:44.903594257 +0000 UTC m=+280.664902301" watchObservedRunningTime="2026-09-10 17:45:44.904618214 +0000 UTC m=+280.665926257"
Sep 10 17:46:04.666893 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:04.666851    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-jwfnv_e90054ec-91dc-4cda-94a2-fbe7a2a1fff0/console-operator/1.log"
Sep 10 17:46:04.672228 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:04.672193    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-jwfnv_e90054ec-91dc-4cda-94a2-fbe7a2a1fff0/console-operator/1.log"
Sep 10 17:46:04.677162 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:04.677137    2568 kubelet.go:1648] "Image garbage collection succeeded"
Sep 10 17:46:04.851823 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:04.851674    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tzgsz"]
Sep 10 17:46:04.855545 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:04.855481    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tzgsz"
Sep 10 17:46:04.858292 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:04.858271    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 10 17:46:04.859256 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:04.859237    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 10 17:46:04.859379 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:04.859240    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-6nx59\""
Sep 10 17:46:04.864942 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:04.864916    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tzgsz"]
Sep 10 17:46:04.896622 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:04.896574    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e8e62bff-8348-478c-85de-a31f0ebd0404-tmp\") pod \"openshift-lws-operator-fd8ccff4c-tzgsz\" (UID: \"e8e62bff-8348-478c-85de-a31f0ebd0404\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tzgsz"
Sep 10 17:46:04.896806 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:04.896631    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8sl5\" (UniqueName: \"kubernetes.io/projected/e8e62bff-8348-478c-85de-a31f0ebd0404-kube-api-access-s8sl5\") pod \"openshift-lws-operator-fd8ccff4c-tzgsz\" (UID: \"e8e62bff-8348-478c-85de-a31f0ebd0404\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tzgsz"
Sep 10 17:46:04.997871 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:04.997830    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e8e62bff-8348-478c-85de-a31f0ebd0404-tmp\") pod \"openshift-lws-operator-fd8ccff4c-tzgsz\" (UID: \"e8e62bff-8348-478c-85de-a31f0ebd0404\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tzgsz"
Sep 10 17:46:04.998053 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:04.997888    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8sl5\" (UniqueName: \"kubernetes.io/projected/e8e62bff-8348-478c-85de-a31f0ebd0404-kube-api-access-s8sl5\") pod \"openshift-lws-operator-fd8ccff4c-tzgsz\" (UID: \"e8e62bff-8348-478c-85de-a31f0ebd0404\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tzgsz"
Sep 10 17:46:04.998313 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:04.998289    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e8e62bff-8348-478c-85de-a31f0ebd0404-tmp\") pod \"openshift-lws-operator-fd8ccff4c-tzgsz\" (UID: \"e8e62bff-8348-478c-85de-a31f0ebd0404\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tzgsz"
Sep 10 17:46:05.012757 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:05.012715    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8sl5\" (UniqueName: \"kubernetes.io/projected/e8e62bff-8348-478c-85de-a31f0ebd0404-kube-api-access-s8sl5\") pod \"openshift-lws-operator-fd8ccff4c-tzgsz\" (UID: \"e8e62bff-8348-478c-85de-a31f0ebd0404\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tzgsz"
Sep 10 17:46:05.165021 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:05.164979    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tzgsz"
Sep 10 17:46:05.438144 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:05.438065    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tzgsz"]
Sep 10 17:46:05.441533 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:46:05.441499    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode8e62bff_8348_478c_85de_a31f0ebd0404.slice/crio-a5a260238b83f203c2a541ade52b232d49d3200dca515ec97ada5d53a6411338 WatchSource:0}: Error finding container a5a260238b83f203c2a541ade52b232d49d3200dca515ec97ada5d53a6411338: Status 404 returned error can't find the container with id a5a260238b83f203c2a541ade52b232d49d3200dca515ec97ada5d53a6411338
Sep 10 17:46:05.965165 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:05.965127    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tzgsz" event={"ID":"e8e62bff-8348-478c-85de-a31f0ebd0404","Type":"ContainerStarted","Data":"a5a260238b83f203c2a541ade52b232d49d3200dca515ec97ada5d53a6411338"}
Sep 10 17:46:08.979493 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:08.979456    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tzgsz" event={"ID":"e8e62bff-8348-478c-85de-a31f0ebd0404","Type":"ContainerStarted","Data":"38e176389842b6b60fef8ffd8c8cd67a280b6684d7e68345d29e30c35c1d94a6"}
Sep 10 17:46:08.996130 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:08.996068    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tzgsz" podStartSLOduration=2.5223695470000003 podStartE2EDuration="4.996036607s" totalImagesPullingTime="2.47366706s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:46:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:46:08.995437339 +0000 UTC m=+304.756745386" watchObservedRunningTime="2026-09-10 17:46:08.996036607 +0000 UTC m=+304.757344650"
Sep 10 17:46:11.220683 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:11.220645    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgtrmx"]
Sep 10 17:46:11.225421 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:11.225379    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgtrmx"
Sep 10 17:46:11.228566 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:11.228534    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 10 17:46:11.228731 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:11.228647    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 10 17:46:11.230038 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:11.230011    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-s2ppn\""
Sep 10 17:46:11.236786 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:11.236746    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgtrmx"]
Sep 10 17:46:11.249306 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:11.249271    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/77dcde78-4608-410c-8357-86edf2247ebb-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgtrmx\" (UID: \"77dcde78-4608-410c-8357-86edf2247ebb\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgtrmx"
Sep 10 17:46:11.249306 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:11.249314    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ktlx\" (UniqueName: \"kubernetes.io/projected/77dcde78-4608-410c-8357-86edf2247ebb-kube-api-access-5ktlx\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgtrmx\" (UID: \"77dcde78-4608-410c-8357-86edf2247ebb\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgtrmx"
Sep 10 17:46:11.249553 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:11.249378    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/77dcde78-4608-410c-8357-86edf2247ebb-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgtrmx\" (UID: \"77dcde78-4608-410c-8357-86edf2247ebb\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgtrmx"
Sep 10 17:46:11.350119 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:11.350071    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ktlx\" (UniqueName: \"kubernetes.io/projected/77dcde78-4608-410c-8357-86edf2247ebb-kube-api-access-5ktlx\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgtrmx\" (UID: \"77dcde78-4608-410c-8357-86edf2247ebb\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgtrmx"
Sep 10 17:46:11.350310 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:11.350141    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/77dcde78-4608-410c-8357-86edf2247ebb-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgtrmx\" (UID: \"77dcde78-4608-410c-8357-86edf2247ebb\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgtrmx"
Sep 10 17:46:11.350310 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:11.350179    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/77dcde78-4608-410c-8357-86edf2247ebb-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgtrmx\" (UID: \"77dcde78-4608-410c-8357-86edf2247ebb\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgtrmx"
Sep 10 17:46:11.350560 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:11.350542    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/77dcde78-4608-410c-8357-86edf2247ebb-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgtrmx\" (UID: \"77dcde78-4608-410c-8357-86edf2247ebb\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgtrmx"
Sep 10 17:46:11.350621 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:11.350601    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/77dcde78-4608-410c-8357-86edf2247ebb-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgtrmx\" (UID: \"77dcde78-4608-410c-8357-86edf2247ebb\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgtrmx"
Sep 10 17:46:11.360511 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:11.360468    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ktlx\" (UniqueName: \"kubernetes.io/projected/77dcde78-4608-410c-8357-86edf2247ebb-kube-api-access-5ktlx\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgtrmx\" (UID: \"77dcde78-4608-410c-8357-86edf2247ebb\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgtrmx"
Sep 10 17:46:11.536536 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:11.536491    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgtrmx"
Sep 10 17:46:11.815841 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:11.815736    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgtrmx"]
Sep 10 17:46:11.818766 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:46:11.818737    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77dcde78_4608_410c_8357_86edf2247ebb.slice/crio-050f3d7639e578552345fffbb21e1cfd388c542259da4ca711fc6deb8a0274cf WatchSource:0}: Error finding container 050f3d7639e578552345fffbb21e1cfd388c542259da4ca711fc6deb8a0274cf: Status 404 returned error can't find the container with id 050f3d7639e578552345fffbb21e1cfd388c542259da4ca711fc6deb8a0274cf
Sep 10 17:46:11.992712 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:11.992670    2568 generic.go:356] "Generic (PLEG): container finished" podID="77dcde78-4608-410c-8357-86edf2247ebb" containerID="88457819022b719f599c3f44c9db326d117c470dbb11287142b325bfc6d64928" exitCode=0
Sep 10 17:46:11.992887 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:11.992764    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgtrmx" event={"ID":"77dcde78-4608-410c-8357-86edf2247ebb","Type":"ContainerDied","Data":"88457819022b719f599c3f44c9db326d117c470dbb11287142b325bfc6d64928"}
Sep 10 17:46:11.992887 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:11.992827    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgtrmx" event={"ID":"77dcde78-4608-410c-8357-86edf2247ebb","Type":"ContainerStarted","Data":"050f3d7639e578552345fffbb21e1cfd388c542259da4ca711fc6deb8a0274cf"}
Sep 10 17:46:11.993355 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:11.993310    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 17:46:12.999252 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:12.999205    2568 generic.go:356] "Generic (PLEG): container finished" podID="77dcde78-4608-410c-8357-86edf2247ebb" containerID="5c61097e297b3b370baa6a494d6c102db5b536c1caed2fa7c374edbaa2762565" exitCode=0
Sep 10 17:46:12.999702 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:12.999257    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgtrmx" event={"ID":"77dcde78-4608-410c-8357-86edf2247ebb","Type":"ContainerDied","Data":"5c61097e297b3b370baa6a494d6c102db5b536c1caed2fa7c374edbaa2762565"}
Sep 10 17:46:14.005314 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:14.005272    2568 generic.go:356] "Generic (PLEG): container finished" podID="77dcde78-4608-410c-8357-86edf2247ebb" containerID="a4ce500c11975725c14c297335c72c9c70fe85d25856450c1f7f49c8228623f6" exitCode=0
Sep 10 17:46:14.005716 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:14.005358    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgtrmx" event={"ID":"77dcde78-4608-410c-8357-86edf2247ebb","Type":"ContainerDied","Data":"a4ce500c11975725c14c297335c72c9c70fe85d25856450c1f7f49c8228623f6"}
Sep 10 17:46:15.140778 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:15.140747    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgtrmx"
Sep 10 17:46:15.181479 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:15.181445    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/77dcde78-4608-410c-8357-86edf2247ebb-util\") pod \"77dcde78-4608-410c-8357-86edf2247ebb\" (UID: \"77dcde78-4608-410c-8357-86edf2247ebb\") "
Sep 10 17:46:15.181657 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:15.181536    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5ktlx\" (UniqueName: \"kubernetes.io/projected/77dcde78-4608-410c-8357-86edf2247ebb-kube-api-access-5ktlx\") pod \"77dcde78-4608-410c-8357-86edf2247ebb\" (UID: \"77dcde78-4608-410c-8357-86edf2247ebb\") "
Sep 10 17:46:15.181657 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:15.181555    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/77dcde78-4608-410c-8357-86edf2247ebb-bundle\") pod \"77dcde78-4608-410c-8357-86edf2247ebb\" (UID: \"77dcde78-4608-410c-8357-86edf2247ebb\") "
Sep 10 17:46:15.182307 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:15.182278    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77dcde78-4608-410c-8357-86edf2247ebb-bundle" (OuterVolumeSpecName: "bundle") pod "77dcde78-4608-410c-8357-86edf2247ebb" (UID: "77dcde78-4608-410c-8357-86edf2247ebb"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:46:15.183836 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:15.183792    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77dcde78-4608-410c-8357-86edf2247ebb-kube-api-access-5ktlx" (OuterVolumeSpecName: "kube-api-access-5ktlx") pod "77dcde78-4608-410c-8357-86edf2247ebb" (UID: "77dcde78-4608-410c-8357-86edf2247ebb"). InnerVolumeSpecName "kube-api-access-5ktlx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:46:15.187130 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:15.187098    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77dcde78-4608-410c-8357-86edf2247ebb-util" (OuterVolumeSpecName: "util") pod "77dcde78-4608-410c-8357-86edf2247ebb" (UID: "77dcde78-4608-410c-8357-86edf2247ebb"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:46:15.282929 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:15.282844    2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/77dcde78-4608-410c-8357-86edf2247ebb-util\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:46:15.282929 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:15.282872    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5ktlx\" (UniqueName: \"kubernetes.io/projected/77dcde78-4608-410c-8357-86edf2247ebb-kube-api-access-5ktlx\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:46:15.282929 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:15.282882    2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/77dcde78-4608-410c-8357-86edf2247ebb-bundle\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:46:16.015440 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:16.015410    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgtrmx"
Sep 10 17:46:16.015615 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:16.015408    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgtrmx" event={"ID":"77dcde78-4608-410c-8357-86edf2247ebb","Type":"ContainerDied","Data":"050f3d7639e578552345fffbb21e1cfd388c542259da4ca711fc6deb8a0274cf"}
Sep 10 17:46:16.015615 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:16.015532    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="050f3d7639e578552345fffbb21e1cfd388c542259da4ca711fc6deb8a0274cf"
Sep 10 17:46:25.611093 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:25.611052    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08k5pp"]
Sep 10 17:46:25.611515 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:25.611359    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77dcde78-4608-410c-8357-86edf2247ebb" containerName="util"
Sep 10 17:46:25.611515 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:25.611394    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="77dcde78-4608-410c-8357-86edf2247ebb" containerName="util"
Sep 10 17:46:25.611515 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:25.611421    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77dcde78-4608-410c-8357-86edf2247ebb" containerName="pull"
Sep 10 17:46:25.611515 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:25.611427    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="77dcde78-4608-410c-8357-86edf2247ebb" containerName="pull"
Sep 10 17:46:25.611515 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:25.611433    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77dcde78-4608-410c-8357-86edf2247ebb" containerName="extract"
Sep 10 17:46:25.611515 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:25.611439    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="77dcde78-4608-410c-8357-86edf2247ebb" containerName="extract"
Sep 10 17:46:25.611515 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:25.611485    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="77dcde78-4608-410c-8357-86edf2247ebb" containerName="extract"
Sep 10 17:46:25.615245 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:25.615218    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08k5pp"
Sep 10 17:46:25.618596 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:25.618534    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 10 17:46:25.618596 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:25.618572    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 10 17:46:25.618798 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:25.618698    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-s2ppn\""
Sep 10 17:46:25.627746 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:25.627715    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08k5pp"]
Sep 10 17:46:25.767860 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:25.767818    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gltkh\" (UniqueName: \"kubernetes.io/projected/a9df3867-30dd-41cf-8d5f-950fa2fab631-kube-api-access-gltkh\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08k5pp\" (UID: \"a9df3867-30dd-41cf-8d5f-950fa2fab631\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08k5pp"
Sep 10 17:46:25.768056 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:25.767880    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a9df3867-30dd-41cf-8d5f-950fa2fab631-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08k5pp\" (UID: \"a9df3867-30dd-41cf-8d5f-950fa2fab631\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08k5pp"
Sep 10 17:46:25.768056 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:25.767955    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a9df3867-30dd-41cf-8d5f-950fa2fab631-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08k5pp\" (UID: \"a9df3867-30dd-41cf-8d5f-950fa2fab631\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08k5pp"
Sep 10 17:46:25.822501 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:25.822454    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-556447cf57-6zckr"]
Sep 10 17:46:25.825486 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:25.825456    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-556447cf57-6zckr"
Sep 10 17:46:25.829637 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:25.829603    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-kbvxn\""
Sep 10 17:46:25.831236 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:25.831213    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 10 17:46:25.831376 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:25.831340    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 10 17:46:25.831563 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:25.831546    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 10 17:46:25.832759 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:25.832742    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 10 17:46:25.847594 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:25.847560    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-556447cf57-6zckr"]
Sep 10 17:46:25.869061 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:25.868971    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a9df3867-30dd-41cf-8d5f-950fa2fab631-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08k5pp\" (UID: \"a9df3867-30dd-41cf-8d5f-950fa2fab631\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08k5pp"
Sep 10 17:46:25.869061 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:25.869033    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gltkh\" (UniqueName: \"kubernetes.io/projected/a9df3867-30dd-41cf-8d5f-950fa2fab631-kube-api-access-gltkh\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08k5pp\" (UID: \"a9df3867-30dd-41cf-8d5f-950fa2fab631\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08k5pp"
Sep 10 17:46:25.869250 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:25.869070    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a9df3867-30dd-41cf-8d5f-950fa2fab631-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08k5pp\" (UID: \"a9df3867-30dd-41cf-8d5f-950fa2fab631\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08k5pp"
Sep 10 17:46:25.869374 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:25.869357    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a9df3867-30dd-41cf-8d5f-950fa2fab631-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08k5pp\" (UID: \"a9df3867-30dd-41cf-8d5f-950fa2fab631\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08k5pp"
Sep 10 17:46:25.869424 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:25.869410    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a9df3867-30dd-41cf-8d5f-950fa2fab631-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08k5pp\" (UID: \"a9df3867-30dd-41cf-8d5f-950fa2fab631\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08k5pp"
Sep 10 17:46:25.890151 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:25.890118    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gltkh\" (UniqueName: \"kubernetes.io/projected/a9df3867-30dd-41cf-8d5f-950fa2fab631-kube-api-access-gltkh\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08k5pp\" (UID: \"a9df3867-30dd-41cf-8d5f-950fa2fab631\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08k5pp"
Sep 10 17:46:25.925253 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:25.925221    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08k5pp"
Sep 10 17:46:25.970258 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:25.970224    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2w25\" (UniqueName: \"kubernetes.io/projected/46182237-0b16-4545-be26-ea43a91fd9ee-kube-api-access-t2w25\") pod \"opendatahub-operator-controller-manager-556447cf57-6zckr\" (UID: \"46182237-0b16-4545-be26-ea43a91fd9ee\") " pod="opendatahub/opendatahub-operator-controller-manager-556447cf57-6zckr"
Sep 10 17:46:25.970444 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:25.970269    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/46182237-0b16-4545-be26-ea43a91fd9ee-tmp\") pod \"opendatahub-operator-controller-manager-556447cf57-6zckr\" (UID: \"46182237-0b16-4545-be26-ea43a91fd9ee\") " pod="opendatahub/opendatahub-operator-controller-manager-556447cf57-6zckr"
Sep 10 17:46:25.970444 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:25.970298    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/46182237-0b16-4545-be26-ea43a91fd9ee-webhook-cert\") pod \"opendatahub-operator-controller-manager-556447cf57-6zckr\" (UID: \"46182237-0b16-4545-be26-ea43a91fd9ee\") " pod="opendatahub/opendatahub-operator-controller-manager-556447cf57-6zckr"
Sep 10 17:46:25.970444 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:25.970384    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/46182237-0b16-4545-be26-ea43a91fd9ee-manifests\") pod \"opendatahub-operator-controller-manager-556447cf57-6zckr\" (UID: \"46182237-0b16-4545-be26-ea43a91fd9ee\") " pod="opendatahub/opendatahub-operator-controller-manager-556447cf57-6zckr"
Sep 10 17:46:25.970444 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:25.970439    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/46182237-0b16-4545-be26-ea43a91fd9ee-apiservice-cert\") pod \"opendatahub-operator-controller-manager-556447cf57-6zckr\" (UID: \"46182237-0b16-4545-be26-ea43a91fd9ee\") " pod="opendatahub/opendatahub-operator-controller-manager-556447cf57-6zckr"
Sep 10 17:46:26.071795 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:26.071757    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/46182237-0b16-4545-be26-ea43a91fd9ee-webhook-cert\") pod \"opendatahub-operator-controller-manager-556447cf57-6zckr\" (UID: \"46182237-0b16-4545-be26-ea43a91fd9ee\") " pod="opendatahub/opendatahub-operator-controller-manager-556447cf57-6zckr"
Sep 10 17:46:26.071795 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:26.071805    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/46182237-0b16-4545-be26-ea43a91fd9ee-manifests\") pod \"opendatahub-operator-controller-manager-556447cf57-6zckr\" (UID: \"46182237-0b16-4545-be26-ea43a91fd9ee\") " pod="opendatahub/opendatahub-operator-controller-manager-556447cf57-6zckr"
Sep 10 17:46:26.072073 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:26.071828    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/46182237-0b16-4545-be26-ea43a91fd9ee-apiservice-cert\") pod \"opendatahub-operator-controller-manager-556447cf57-6zckr\" (UID: \"46182237-0b16-4545-be26-ea43a91fd9ee\") " pod="opendatahub/opendatahub-operator-controller-manager-556447cf57-6zckr"
Sep 10 17:46:26.072073 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:26.071870    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2w25\" (UniqueName: \"kubernetes.io/projected/46182237-0b16-4545-be26-ea43a91fd9ee-kube-api-access-t2w25\") pod \"opendatahub-operator-controller-manager-556447cf57-6zckr\" (UID: \"46182237-0b16-4545-be26-ea43a91fd9ee\") " pod="opendatahub/opendatahub-operator-controller-manager-556447cf57-6zckr"
Sep 10 17:46:26.072073 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:26.071896    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/46182237-0b16-4545-be26-ea43a91fd9ee-tmp\") pod \"opendatahub-operator-controller-manager-556447cf57-6zckr\" (UID: \"46182237-0b16-4545-be26-ea43a91fd9ee\") " pod="opendatahub/opendatahub-operator-controller-manager-556447cf57-6zckr"
Sep 10 17:46:26.072263 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:26.072236    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/46182237-0b16-4545-be26-ea43a91fd9ee-manifests\") pod \"opendatahub-operator-controller-manager-556447cf57-6zckr\" (UID: \"46182237-0b16-4545-be26-ea43a91fd9ee\") " pod="opendatahub/opendatahub-operator-controller-manager-556447cf57-6zckr"
Sep 10 17:46:26.074403 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:26.074342    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/46182237-0b16-4545-be26-ea43a91fd9ee-tmp\") pod \"opendatahub-operator-controller-manager-556447cf57-6zckr\" (UID: \"46182237-0b16-4545-be26-ea43a91fd9ee\") " pod="opendatahub/opendatahub-operator-controller-manager-556447cf57-6zckr"
Sep 10 17:46:26.074597 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:26.074571    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/46182237-0b16-4545-be26-ea43a91fd9ee-webhook-cert\") pod \"opendatahub-operator-controller-manager-556447cf57-6zckr\" (UID: \"46182237-0b16-4545-be26-ea43a91fd9ee\") " pod="opendatahub/opendatahub-operator-controller-manager-556447cf57-6zckr"
Sep 10 17:46:26.074666 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:26.074600    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/46182237-0b16-4545-be26-ea43a91fd9ee-apiservice-cert\") pod \"opendatahub-operator-controller-manager-556447cf57-6zckr\" (UID: \"46182237-0b16-4545-be26-ea43a91fd9ee\") " pod="opendatahub/opendatahub-operator-controller-manager-556447cf57-6zckr"
Sep 10 17:46:26.103612 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:26.103579    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2w25\" (UniqueName: \"kubernetes.io/projected/46182237-0b16-4545-be26-ea43a91fd9ee-kube-api-access-t2w25\") pod \"opendatahub-operator-controller-manager-556447cf57-6zckr\" (UID: \"46182237-0b16-4545-be26-ea43a91fd9ee\") " pod="opendatahub/opendatahub-operator-controller-manager-556447cf57-6zckr"
Sep 10 17:46:26.135850 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:26.135746    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-556447cf57-6zckr"
Sep 10 17:46:26.224856 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:26.224830    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08k5pp"]
Sep 10 17:46:26.227020 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:46:26.226990    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9df3867_30dd_41cf_8d5f_950fa2fab631.slice/crio-6be5d1ccd5b32ca741239e9520cc8c46d742bd85f32c866a6647917ef54a2a83 WatchSource:0}: Error finding container 6be5d1ccd5b32ca741239e9520cc8c46d742bd85f32c866a6647917ef54a2a83: Status 404 returned error can't find the container with id 6be5d1ccd5b32ca741239e9520cc8c46d742bd85f32c866a6647917ef54a2a83
Sep 10 17:46:26.418143 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:26.418111    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-556447cf57-6zckr"]
Sep 10 17:46:26.420469 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:46:26.420439    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46182237_0b16_4545_be26_ea43a91fd9ee.slice/crio-a0b5c6015734d32ebe0cf8e122e50c3f14ebc8097de27cbd91004da3f6aa5546 WatchSource:0}: Error finding container a0b5c6015734d32ebe0cf8e122e50c3f14ebc8097de27cbd91004da3f6aa5546: Status 404 returned error can't find the container with id a0b5c6015734d32ebe0cf8e122e50c3f14ebc8097de27cbd91004da3f6aa5546
Sep 10 17:46:27.065337 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:27.065279    2568 generic.go:356] "Generic (PLEG): container finished" podID="a9df3867-30dd-41cf-8d5f-950fa2fab631" containerID="ec32e177f1f55b8dd113bfbd88e3a6b481dd2f02e77213a13e6beebd5d4d85d6" exitCode=0
Sep 10 17:46:27.065815 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:27.065436    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08k5pp" event={"ID":"a9df3867-30dd-41cf-8d5f-950fa2fab631","Type":"ContainerDied","Data":"ec32e177f1f55b8dd113bfbd88e3a6b481dd2f02e77213a13e6beebd5d4d85d6"}
Sep 10 17:46:27.065815 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:27.065486    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08k5pp" event={"ID":"a9df3867-30dd-41cf-8d5f-950fa2fab631","Type":"ContainerStarted","Data":"6be5d1ccd5b32ca741239e9520cc8c46d742bd85f32c866a6647917ef54a2a83"}
Sep 10 17:46:27.068697 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:27.068660    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-556447cf57-6zckr" event={"ID":"46182237-0b16-4545-be26-ea43a91fd9ee","Type":"ContainerStarted","Data":"a0b5c6015734d32ebe0cf8e122e50c3f14ebc8097de27cbd91004da3f6aa5546"}
Sep 10 17:46:28.076487 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:28.076447    2568 generic.go:356] "Generic (PLEG): container finished" podID="a9df3867-30dd-41cf-8d5f-950fa2fab631" containerID="d615ccbde90feb0be7a66266c99ab862049d4ba47cfb64e8b171969286540fc8" exitCode=0
Sep 10 17:46:28.076966 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:28.076578    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08k5pp" event={"ID":"a9df3867-30dd-41cf-8d5f-950fa2fab631","Type":"ContainerDied","Data":"d615ccbde90feb0be7a66266c99ab862049d4ba47cfb64e8b171969286540fc8"}
Sep 10 17:46:30.087134 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:30.087089    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-556447cf57-6zckr" event={"ID":"46182237-0b16-4545-be26-ea43a91fd9ee","Type":"ContainerStarted","Data":"bd98274832088aef8ea0db0033fe21c132617381b8162eb1180eb604b775c07e"}
Sep 10 17:46:30.089200 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:30.089171    2568 generic.go:356] "Generic (PLEG): container finished" podID="a9df3867-30dd-41cf-8d5f-950fa2fab631" containerID="6298d966acd76182685c76853fa091617cdea9d1abd678ad1aea8a4431c510d6" exitCode=0
Sep 10 17:46:30.089343 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:30.089211    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08k5pp" event={"ID":"a9df3867-30dd-41cf-8d5f-950fa2fab631","Type":"ContainerDied","Data":"6298d966acd76182685c76853fa091617cdea9d1abd678ad1aea8a4431c510d6"}
Sep 10 17:46:31.094995 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:31.094957    2568 generic.go:356] "Generic (PLEG): container finished" podID="46182237-0b16-4545-be26-ea43a91fd9ee" containerID="bd98274832088aef8ea0db0033fe21c132617381b8162eb1180eb604b775c07e" exitCode=0
Sep 10 17:46:31.095422 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:31.095039    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-556447cf57-6zckr" event={"ID":"46182237-0b16-4545-be26-ea43a91fd9ee","Type":"ContainerDied","Data":"bd98274832088aef8ea0db0033fe21c132617381b8162eb1180eb604b775c07e"}
Sep 10 17:46:31.233915 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:31.233883    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08k5pp"
Sep 10 17:46:31.317225 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:31.317192    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a9df3867-30dd-41cf-8d5f-950fa2fab631-bundle\") pod \"a9df3867-30dd-41cf-8d5f-950fa2fab631\" (UID: \"a9df3867-30dd-41cf-8d5f-950fa2fab631\") "
Sep 10 17:46:31.317459 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:31.317274    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a9df3867-30dd-41cf-8d5f-950fa2fab631-util\") pod \"a9df3867-30dd-41cf-8d5f-950fa2fab631\" (UID: \"a9df3867-30dd-41cf-8d5f-950fa2fab631\") "
Sep 10 17:46:31.317459 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:31.317348    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gltkh\" (UniqueName: \"kubernetes.io/projected/a9df3867-30dd-41cf-8d5f-950fa2fab631-kube-api-access-gltkh\") pod \"a9df3867-30dd-41cf-8d5f-950fa2fab631\" (UID: \"a9df3867-30dd-41cf-8d5f-950fa2fab631\") "
Sep 10 17:46:31.317954 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:31.317925    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a9df3867-30dd-41cf-8d5f-950fa2fab631-bundle" (OuterVolumeSpecName: "bundle") pod "a9df3867-30dd-41cf-8d5f-950fa2fab631" (UID: "a9df3867-30dd-41cf-8d5f-950fa2fab631"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:46:31.319571 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:31.319537    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9df3867-30dd-41cf-8d5f-950fa2fab631-kube-api-access-gltkh" (OuterVolumeSpecName: "kube-api-access-gltkh") pod "a9df3867-30dd-41cf-8d5f-950fa2fab631" (UID: "a9df3867-30dd-41cf-8d5f-950fa2fab631"). InnerVolumeSpecName "kube-api-access-gltkh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:46:31.323193 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:31.323147    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a9df3867-30dd-41cf-8d5f-950fa2fab631-util" (OuterVolumeSpecName: "util") pod "a9df3867-30dd-41cf-8d5f-950fa2fab631" (UID: "a9df3867-30dd-41cf-8d5f-950fa2fab631"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:46:31.418227 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:31.418201    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gltkh\" (UniqueName: \"kubernetes.io/projected/a9df3867-30dd-41cf-8d5f-950fa2fab631-kube-api-access-gltkh\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:46:31.418281 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:31.418232    2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a9df3867-30dd-41cf-8d5f-950fa2fab631-bundle\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:46:31.418281 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:31.418245    2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a9df3867-30dd-41cf-8d5f-950fa2fab631-util\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:46:32.101736 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:32.101698    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08k5pp"
Sep 10 17:46:32.101736 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:32.101719    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08k5pp" event={"ID":"a9df3867-30dd-41cf-8d5f-950fa2fab631","Type":"ContainerDied","Data":"6be5d1ccd5b32ca741239e9520cc8c46d742bd85f32c866a6647917ef54a2a83"}
Sep 10 17:46:32.102193 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:32.101770    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6be5d1ccd5b32ca741239e9520cc8c46d742bd85f32c866a6647917ef54a2a83"
Sep 10 17:46:32.103761 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:32.103733    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-556447cf57-6zckr" event={"ID":"46182237-0b16-4545-be26-ea43a91fd9ee","Type":"ContainerStarted","Data":"66f4d157bdeef1ae66a49c99807dba8f057a04d1d91baf134facf185190c6aae"}
Sep 10 17:46:32.103896 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:32.103861    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-556447cf57-6zckr"
Sep 10 17:46:32.130170 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:32.130093    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-556447cf57-6zckr" podStartSLOduration=2.682456244 podStartE2EDuration="7.130069362s" totalImagesPullingTime="3.358379901s" totalInitContainerRuntime="1.089233217s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:46:25 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:46:32.127498281 +0000 UTC m=+327.888806327" watchObservedRunningTime="2026-09-10 17:46:32.130069362 +0000 UTC m=+327.891377407"
Sep 10 17:46:43.110566 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:43.110531    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-556447cf57-6zckr"
Sep 10 17:46:45.845374 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:45.845313    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5c775fbbf-sbr8v"]
Sep 10 17:46:45.845873 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:45.845694    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9df3867-30dd-41cf-8d5f-950fa2fab631" containerName="util"
Sep 10 17:46:45.845873 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:45.845709    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9df3867-30dd-41cf-8d5f-950fa2fab631" containerName="util"
Sep 10 17:46:45.845873 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:45.845729    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9df3867-30dd-41cf-8d5f-950fa2fab631" containerName="pull"
Sep 10 17:46:45.845873 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:45.845738    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9df3867-30dd-41cf-8d5f-950fa2fab631" containerName="pull"
Sep 10 17:46:45.845873 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:45.845758    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9df3867-30dd-41cf-8d5f-950fa2fab631" containerName="extract"
Sep 10 17:46:45.845873 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:45.845766    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9df3867-30dd-41cf-8d5f-950fa2fab631" containerName="extract"
Sep 10 17:46:45.845873 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:45.845833    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="a9df3867-30dd-41cf-8d5f-950fa2fab631" containerName="extract"
Sep 10 17:46:45.856094 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:45.856052    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5c775fbbf-sbr8v"
Sep 10 17:46:45.860289 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:45.860255    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 10 17:46:45.861020 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:45.860996    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 10 17:46:45.861155 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:45.861028    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 10 17:46:45.861155 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:45.861143    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 10 17:46:45.861505 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:45.861486    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-wnt8s\""
Sep 10 17:46:45.862059 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:45.862032    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5c775fbbf-sbr8v"]
Sep 10 17:46:46.043201 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:46.043159    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/87b9586a-ebc1-451b-829b-896d50a75b34-tmp\") pod \"kube-auth-proxy-5c775fbbf-sbr8v\" (UID: \"87b9586a-ebc1-451b-829b-896d50a75b34\") " pod="openshift-ingress/kube-auth-proxy-5c775fbbf-sbr8v"
Sep 10 17:46:46.043201 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:46.043204    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/87b9586a-ebc1-451b-829b-896d50a75b34-tls-certs\") pod \"kube-auth-proxy-5c775fbbf-sbr8v\" (UID: \"87b9586a-ebc1-451b-829b-896d50a75b34\") " pod="openshift-ingress/kube-auth-proxy-5c775fbbf-sbr8v"
Sep 10 17:46:46.043462 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:46.043225    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-slg95\" (UniqueName: \"kubernetes.io/projected/87b9586a-ebc1-451b-829b-896d50a75b34-kube-api-access-slg95\") pod \"kube-auth-proxy-5c775fbbf-sbr8v\" (UID: \"87b9586a-ebc1-451b-829b-896d50a75b34\") " pod="openshift-ingress/kube-auth-proxy-5c775fbbf-sbr8v"
Sep 10 17:46:46.144648 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:46.144543    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slg95\" (UniqueName: \"kubernetes.io/projected/87b9586a-ebc1-451b-829b-896d50a75b34-kube-api-access-slg95\") pod \"kube-auth-proxy-5c775fbbf-sbr8v\" (UID: \"87b9586a-ebc1-451b-829b-896d50a75b34\") " pod="openshift-ingress/kube-auth-proxy-5c775fbbf-sbr8v"
Sep 10 17:46:46.144648 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:46.144635    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/87b9586a-ebc1-451b-829b-896d50a75b34-tmp\") pod \"kube-auth-proxy-5c775fbbf-sbr8v\" (UID: \"87b9586a-ebc1-451b-829b-896d50a75b34\") " pod="openshift-ingress/kube-auth-proxy-5c775fbbf-sbr8v"
Sep 10 17:46:46.144842 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:46.144667    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/87b9586a-ebc1-451b-829b-896d50a75b34-tls-certs\") pod \"kube-auth-proxy-5c775fbbf-sbr8v\" (UID: \"87b9586a-ebc1-451b-829b-896d50a75b34\") " pod="openshift-ingress/kube-auth-proxy-5c775fbbf-sbr8v"
Sep 10 17:46:46.147010 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:46.146985    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/87b9586a-ebc1-451b-829b-896d50a75b34-tmp\") pod \"kube-auth-proxy-5c775fbbf-sbr8v\" (UID: \"87b9586a-ebc1-451b-829b-896d50a75b34\") " pod="openshift-ingress/kube-auth-proxy-5c775fbbf-sbr8v"
Sep 10 17:46:46.147267 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:46.147247    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/87b9586a-ebc1-451b-829b-896d50a75b34-tls-certs\") pod \"kube-auth-proxy-5c775fbbf-sbr8v\" (UID: \"87b9586a-ebc1-451b-829b-896d50a75b34\") " pod="openshift-ingress/kube-auth-proxy-5c775fbbf-sbr8v"
Sep 10 17:46:46.166551 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:46.166514    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-slg95\" (UniqueName: \"kubernetes.io/projected/87b9586a-ebc1-451b-829b-896d50a75b34-kube-api-access-slg95\") pod \"kube-auth-proxy-5c775fbbf-sbr8v\" (UID: \"87b9586a-ebc1-451b-829b-896d50a75b34\") " pod="openshift-ingress/kube-auth-proxy-5c775fbbf-sbr8v"
Sep 10 17:46:46.168257 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:46.168229    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5c775fbbf-sbr8v"
Sep 10 17:46:46.446394 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:46.446366    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5c775fbbf-sbr8v"]
Sep 10 17:46:46.449289 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:46:46.449255    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87b9586a_ebc1_451b_829b_896d50a75b34.slice/crio-5f1c50dd3248f3829838f0c84b9dd9f0492d88c7d58e6c9e4b37b97b4c567a1d WatchSource:0}: Error finding container 5f1c50dd3248f3829838f0c84b9dd9f0492d88c7d58e6c9e4b37b97b4c567a1d: Status 404 returned error can't find the container with id 5f1c50dd3248f3829838f0c84b9dd9f0492d88c7d58e6c9e4b37b97b4c567a1d
Sep 10 17:46:47.173948 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:47.173903    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5c775fbbf-sbr8v" event={"ID":"87b9586a-ebc1-451b-829b-896d50a75b34","Type":"ContainerStarted","Data":"5f1c50dd3248f3829838f0c84b9dd9f0492d88c7d58e6c9e4b37b97b4c567a1d"}
Sep 10 17:46:47.358502 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:47.358462    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5l7f9"]
Sep 10 17:46:47.361837 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:47.361800    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5l7f9"
Sep 10 17:46:47.366141 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:47.366093    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 10 17:46:47.366564 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:47.366532    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 10 17:46:47.367071 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:47.367042    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 10 17:46:47.367180 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:47.367067    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-lgfjq\""
Sep 10 17:46:47.367390 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:47.367263    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 10 17:46:47.384522 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:47.384487    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5l7f9"]
Sep 10 17:46:47.455589 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:47.455489    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/04879750-bf8d-4f3a-9176-0e0b3cb54709-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-5l7f9\" (UID: \"04879750-bf8d-4f3a-9176-0e0b3cb54709\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5l7f9"
Sep 10 17:46:47.455589 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:47.455543    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62nxw\" (UniqueName: \"kubernetes.io/projected/04879750-bf8d-4f3a-9176-0e0b3cb54709-kube-api-access-62nxw\") pod \"istiod-openshift-gateway-7b7995d5cd-5l7f9\" (UID: \"04879750-bf8d-4f3a-9176-0e0b3cb54709\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5l7f9"
Sep 10 17:46:47.455832 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:47.455649    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/04879750-bf8d-4f3a-9176-0e0b3cb54709-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-5l7f9\" (UID: \"04879750-bf8d-4f3a-9176-0e0b3cb54709\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5l7f9"
Sep 10 17:46:47.455832 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:47.455700    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04879750-bf8d-4f3a-9176-0e0b3cb54709-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-5l7f9\" (UID: \"04879750-bf8d-4f3a-9176-0e0b3cb54709\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5l7f9"
Sep 10 17:46:47.455832 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:47.455722    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/04879750-bf8d-4f3a-9176-0e0b3cb54709-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-5l7f9\" (UID: \"04879750-bf8d-4f3a-9176-0e0b3cb54709\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5l7f9"
Sep 10 17:46:47.455832 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:47.455761    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/04879750-bf8d-4f3a-9176-0e0b3cb54709-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-5l7f9\" (UID: \"04879750-bf8d-4f3a-9176-0e0b3cb54709\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5l7f9"
Sep 10 17:46:47.455832 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:47.455792    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/04879750-bf8d-4f3a-9176-0e0b3cb54709-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-5l7f9\" (UID: \"04879750-bf8d-4f3a-9176-0e0b3cb54709\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5l7f9"
Sep 10 17:46:47.556805 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:47.556759    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/04879750-bf8d-4f3a-9176-0e0b3cb54709-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-5l7f9\" (UID: \"04879750-bf8d-4f3a-9176-0e0b3cb54709\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5l7f9"
Sep 10 17:46:47.556805 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:47.556818    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62nxw\" (UniqueName: \"kubernetes.io/projected/04879750-bf8d-4f3a-9176-0e0b3cb54709-kube-api-access-62nxw\") pod \"istiod-openshift-gateway-7b7995d5cd-5l7f9\" (UID: \"04879750-bf8d-4f3a-9176-0e0b3cb54709\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5l7f9"
Sep 10 17:46:47.557075 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:47.556855    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/04879750-bf8d-4f3a-9176-0e0b3cb54709-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-5l7f9\" (UID: \"04879750-bf8d-4f3a-9176-0e0b3cb54709\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5l7f9"
Sep 10 17:46:47.557075 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:47.556890    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04879750-bf8d-4f3a-9176-0e0b3cb54709-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-5l7f9\" (UID: \"04879750-bf8d-4f3a-9176-0e0b3cb54709\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5l7f9"
Sep 10 17:46:47.557075 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:47.556917    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/04879750-bf8d-4f3a-9176-0e0b3cb54709-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-5l7f9\" (UID: \"04879750-bf8d-4f3a-9176-0e0b3cb54709\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5l7f9"
Sep 10 17:46:47.557075 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:47.556954    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/04879750-bf8d-4f3a-9176-0e0b3cb54709-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-5l7f9\" (UID: \"04879750-bf8d-4f3a-9176-0e0b3cb54709\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5l7f9"
Sep 10 17:46:47.557075 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:47.556984    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/04879750-bf8d-4f3a-9176-0e0b3cb54709-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-5l7f9\" (UID: \"04879750-bf8d-4f3a-9176-0e0b3cb54709\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5l7f9"
Sep 10 17:46:47.558249 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:47.557735    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/04879750-bf8d-4f3a-9176-0e0b3cb54709-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-5l7f9\" (UID: \"04879750-bf8d-4f3a-9176-0e0b3cb54709\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5l7f9"
Sep 10 17:46:47.560503 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:47.560445    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/04879750-bf8d-4f3a-9176-0e0b3cb54709-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-5l7f9\" (UID: \"04879750-bf8d-4f3a-9176-0e0b3cb54709\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5l7f9"
Sep 10 17:46:47.560653 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:47.560630    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/04879750-bf8d-4f3a-9176-0e0b3cb54709-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-5l7f9\" (UID: \"04879750-bf8d-4f3a-9176-0e0b3cb54709\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5l7f9"
Sep 10 17:46:47.560806 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:47.560781    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/04879750-bf8d-4f3a-9176-0e0b3cb54709-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-5l7f9\" (UID: \"04879750-bf8d-4f3a-9176-0e0b3cb54709\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5l7f9"
Sep 10 17:46:47.561035 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:47.561013    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/04879750-bf8d-4f3a-9176-0e0b3cb54709-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-5l7f9\" (UID: \"04879750-bf8d-4f3a-9176-0e0b3cb54709\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5l7f9"
Sep 10 17:46:47.575808 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:47.575767    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04879750-bf8d-4f3a-9176-0e0b3cb54709-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-5l7f9\" (UID: \"04879750-bf8d-4f3a-9176-0e0b3cb54709\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5l7f9"
Sep 10 17:46:47.575970 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:47.575837    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-62nxw\" (UniqueName: \"kubernetes.io/projected/04879750-bf8d-4f3a-9176-0e0b3cb54709-kube-api-access-62nxw\") pod \"istiod-openshift-gateway-7b7995d5cd-5l7f9\" (UID: \"04879750-bf8d-4f3a-9176-0e0b3cb54709\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5l7f9"
Sep 10 17:46:47.676690 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:47.676646    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5l7f9"
Sep 10 17:46:47.982543 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:47.982337    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5l7f9"]
Sep 10 17:46:49.317965 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:46:49.317922    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04879750_bf8d_4f3a_9176_0e0b3cb54709.slice/crio-2c9fdc5d54eb88c30b982db94138acfab7829c3ca342eded5a708f9c765bf696 WatchSource:0}: Error finding container 2c9fdc5d54eb88c30b982db94138acfab7829c3ca342eded5a708f9c765bf696: Status 404 returned error can't find the container with id 2c9fdc5d54eb88c30b982db94138acfab7829c3ca342eded5a708f9c765bf696
Sep 10 17:46:50.197368 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:50.197294    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5c775fbbf-sbr8v" event={"ID":"87b9586a-ebc1-451b-829b-896d50a75b34","Type":"ContainerStarted","Data":"737e52f7d0cb2754dbb311decbfa5a136a3c7defdd7c91ea0a2fda0610910b31"}
Sep 10 17:46:50.199210 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:50.199172    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5l7f9" event={"ID":"04879750-bf8d-4f3a-9176-0e0b3cb54709","Type":"ContainerStarted","Data":"2c9fdc5d54eb88c30b982db94138acfab7829c3ca342eded5a708f9c765bf696"}
Sep 10 17:46:50.218144 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:50.217995    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5c775fbbf-sbr8v" podStartSLOduration=2.30126862 podStartE2EDuration="5.217971412s" totalImagesPullingTime="2.916702792s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:46:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:46:50.215973194 +0000 UTC m=+345.977281234" watchObservedRunningTime="2026-09-10 17:46:50.217971412 +0000 UTC m=+345.979279454"
Sep 10 17:46:51.885090 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:51.885040    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 17:46:51.885440 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:51.885108    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 17:46:52.212246 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:52.212161    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5l7f9" event={"ID":"04879750-bf8d-4f3a-9176-0e0b3cb54709","Type":"ContainerStarted","Data":"42cff5256f955b98225721b5a0f16158df592a0b3d060d68e78b81effda2a005"}
Sep 10 17:46:52.212415 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:52.212367    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5l7f9"
Sep 10 17:46:52.214282 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:52.214248    2568 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-5l7f9 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 17:46:52.214426 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:52.214305    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5l7f9" podUID="04879750-bf8d-4f3a-9176-0e0b3cb54709" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 17:46:52.237800 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:52.237743    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5l7f9" podStartSLOduration=2.673093582 podStartE2EDuration="5.237724528s" totalImagesPullingTime="2.564630946s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:46:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:46:52.235360947 +0000 UTC m=+347.996668991" watchObservedRunningTime="2026-09-10 17:46:52.237724528 +0000 UTC m=+347.999032570"
Sep 10 17:46:53.217240 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:53.217207    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5l7f9"
Sep 10 17:46:56.941535 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:56.941454    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-92bvc"]
Sep 10 17:46:56.945962 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:56.945943    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-92bvc"
Sep 10 17:46:56.948867 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:56.948841    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Sep 10 17:46:56.949093 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:56.948937    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-j7ftv\""
Sep 10 17:46:56.960251 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:56.960225    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-92bvc"]
Sep 10 17:46:57.033484 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:57.033450    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdjfw\" (UniqueName: \"kubernetes.io/projected/aaf8f3ee-7c51-4d32-9920-0cd5b198f4e9-kube-api-access-xdjfw\") pod \"model-serving-api-54d89bd5fc-92bvc\" (UID: \"aaf8f3ee-7c51-4d32-9920-0cd5b198f4e9\") " pod="opendatahub/model-serving-api-54d89bd5fc-92bvc"
Sep 10 17:46:57.033665 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:57.033490    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aaf8f3ee-7c51-4d32-9920-0cd5b198f4e9-tls-certs\") pod \"model-serving-api-54d89bd5fc-92bvc\" (UID: \"aaf8f3ee-7c51-4d32-9920-0cd5b198f4e9\") " pod="opendatahub/model-serving-api-54d89bd5fc-92bvc"
Sep 10 17:46:57.134836 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:57.134796    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdjfw\" (UniqueName: \"kubernetes.io/projected/aaf8f3ee-7c51-4d32-9920-0cd5b198f4e9-kube-api-access-xdjfw\") pod \"model-serving-api-54d89bd5fc-92bvc\" (UID: \"aaf8f3ee-7c51-4d32-9920-0cd5b198f4e9\") " pod="opendatahub/model-serving-api-54d89bd5fc-92bvc"
Sep 10 17:46:57.134836 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:57.134839    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aaf8f3ee-7c51-4d32-9920-0cd5b198f4e9-tls-certs\") pod \"model-serving-api-54d89bd5fc-92bvc\" (UID: \"aaf8f3ee-7c51-4d32-9920-0cd5b198f4e9\") " pod="opendatahub/model-serving-api-54d89bd5fc-92bvc"
Sep 10 17:46:57.137249 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:57.137223    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aaf8f3ee-7c51-4d32-9920-0cd5b198f4e9-tls-certs\") pod \"model-serving-api-54d89bd5fc-92bvc\" (UID: \"aaf8f3ee-7c51-4d32-9920-0cd5b198f4e9\") " pod="opendatahub/model-serving-api-54d89bd5fc-92bvc"
Sep 10 17:46:57.143861 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:57.143828    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdjfw\" (UniqueName: \"kubernetes.io/projected/aaf8f3ee-7c51-4d32-9920-0cd5b198f4e9-kube-api-access-xdjfw\") pod \"model-serving-api-54d89bd5fc-92bvc\" (UID: \"aaf8f3ee-7c51-4d32-9920-0cd5b198f4e9\") " pod="opendatahub/model-serving-api-54d89bd5fc-92bvc"
Sep 10 17:46:57.257164 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:57.257130    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-92bvc"
Sep 10 17:46:57.540508 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:57.540482    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-92bvc"]
Sep 10 17:46:57.543185 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:46:57.543149    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaaf8f3ee_7c51_4d32_9920_0cd5b198f4e9.slice/crio-e92569a2ce744fe5f88fcdf721f33acad721a2b779875113375015d15d5f0a4c WatchSource:0}: Error finding container e92569a2ce744fe5f88fcdf721f33acad721a2b779875113375015d15d5f0a4c: Status 404 returned error can't find the container with id e92569a2ce744fe5f88fcdf721f33acad721a2b779875113375015d15d5f0a4c
Sep 10 17:46:58.240281 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:58.240242    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-92bvc" event={"ID":"aaf8f3ee-7c51-4d32-9920-0cd5b198f4e9","Type":"ContainerStarted","Data":"e92569a2ce744fe5f88fcdf721f33acad721a2b779875113375015d15d5f0a4c"}
Sep 10 17:46:59.248851 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:59.248805    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-92bvc" event={"ID":"aaf8f3ee-7c51-4d32-9920-0cd5b198f4e9","Type":"ContainerStarted","Data":"fa1d5204b0454e762ddc953f3c0431ca0e386595b826b964a12755d4b49c0fc1"}
Sep 10 17:46:59.249288 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:59.249003    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-92bvc"
Sep 10 17:46:59.278299 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:46:59.278238    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-92bvc" podStartSLOduration=1.747640655 podStartE2EDuration="3.278222179s" totalImagesPullingTime="1.530581524s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:46:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:46:59.277574519 +0000 UTC m=+355.038882561" watchObservedRunningTime="2026-09-10 17:46:59.278222179 +0000 UTC m=+355.039530222"
Sep 10 17:47:07.561532 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:47:07.561488    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-x2fbn"]
Sep 10 17:47:07.571900 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:47:07.571864    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-x2fbn"
Sep 10 17:47:07.577698 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:47:07.577649    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Sep 10 17:47:07.577891 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:47:07.577670    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-h2gg8\""
Sep 10 17:47:07.582888 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:47:07.582852    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-d7nb8"]
Sep 10 17:47:07.586397 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:47:07.586368    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-d7nb8"
Sep 10 17:47:07.595518 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:47:07.595486    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-x2fbn"]
Sep 10 17:47:07.597026 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:47:07.596997    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-xg5d2\""
Sep 10 17:47:07.597429 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:47:07.597398    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Sep 10 17:47:07.622462 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:47:07.622423    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-d7nb8"]
Sep 10 17:47:07.626923 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:47:07.626879    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7cxh\" (UniqueName: \"kubernetes.io/projected/c732730f-9840-4992-b47d-54405558d7fc-kube-api-access-z7cxh\") pod \"llmisvc-controller-manager-777c6bd7d5-d7nb8\" (UID: \"c732730f-9840-4992-b47d-54405558d7fc\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-d7nb8"
Sep 10 17:47:07.627111 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:47:07.626951    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0b1d6d50-f875-46b9-b2fc-9343c7c5d49d-cert\") pod \"kserve-controller-manager-d6f4b65b8-x2fbn\" (UID: \"0b1d6d50-f875-46b9-b2fc-9343c7c5d49d\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-x2fbn"
Sep 10 17:47:07.627111 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:47:07.626991    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c732730f-9840-4992-b47d-54405558d7fc-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-d7nb8\" (UID: \"c732730f-9840-4992-b47d-54405558d7fc\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-d7nb8"
Sep 10 17:47:07.627111 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:47:07.627018    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6cw7c\" (UniqueName: \"kubernetes.io/projected/0b1d6d50-f875-46b9-b2fc-9343c7c5d49d-kube-api-access-6cw7c\") pod \"kserve-controller-manager-d6f4b65b8-x2fbn\" (UID: \"0b1d6d50-f875-46b9-b2fc-9343c7c5d49d\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-x2fbn"
Sep 10 17:47:07.728111 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:47:07.728069    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0b1d6d50-f875-46b9-b2fc-9343c7c5d49d-cert\") pod \"kserve-controller-manager-d6f4b65b8-x2fbn\" (UID: \"0b1d6d50-f875-46b9-b2fc-9343c7c5d49d\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-x2fbn"
Sep 10 17:47:07.728111 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:47:07.728117    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c732730f-9840-4992-b47d-54405558d7fc-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-d7nb8\" (UID: \"c732730f-9840-4992-b47d-54405558d7fc\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-d7nb8"
Sep 10 17:47:07.728406 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:47:07.728137    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6cw7c\" (UniqueName: \"kubernetes.io/projected/0b1d6d50-f875-46b9-b2fc-9343c7c5d49d-kube-api-access-6cw7c\") pod \"kserve-controller-manager-d6f4b65b8-x2fbn\" (UID: \"0b1d6d50-f875-46b9-b2fc-9343c7c5d49d\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-x2fbn"
Sep 10 17:47:07.728406 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:47:07.728197    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7cxh\" (UniqueName: \"kubernetes.io/projected/c732730f-9840-4992-b47d-54405558d7fc-kube-api-access-z7cxh\") pod \"llmisvc-controller-manager-777c6bd7d5-d7nb8\" (UID: \"c732730f-9840-4992-b47d-54405558d7fc\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-d7nb8"
Sep 10 17:47:07.728406 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:47:07.728307    2568 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Sep 10 17:47:07.728406 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:47:07.728401    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b1d6d50-f875-46b9-b2fc-9343c7c5d49d-cert podName:0b1d6d50-f875-46b9-b2fc-9343c7c5d49d nodeName:}" failed. No retries permitted until 2026-09-10 17:47:08.228379898 +0000 UTC m=+363.989687938 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0b1d6d50-f875-46b9-b2fc-9343c7c5d49d-cert") pod "kserve-controller-manager-d6f4b65b8-x2fbn" (UID: "0b1d6d50-f875-46b9-b2fc-9343c7c5d49d") : secret "kserve-webhook-server-cert" not found
Sep 10 17:47:07.730643 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:47:07.730609    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c732730f-9840-4992-b47d-54405558d7fc-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-d7nb8\" (UID: \"c732730f-9840-4992-b47d-54405558d7fc\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-d7nb8"
Sep 10 17:47:07.749197 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:47:07.749165    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7cxh\" (UniqueName: \"kubernetes.io/projected/c732730f-9840-4992-b47d-54405558d7fc-kube-api-access-z7cxh\") pod \"llmisvc-controller-manager-777c6bd7d5-d7nb8\" (UID: \"c732730f-9840-4992-b47d-54405558d7fc\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-d7nb8"
Sep 10 17:47:07.755241 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:47:07.755205    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6cw7c\" (UniqueName: \"kubernetes.io/projected/0b1d6d50-f875-46b9-b2fc-9343c7c5d49d-kube-api-access-6cw7c\") pod \"kserve-controller-manager-d6f4b65b8-x2fbn\" (UID: \"0b1d6d50-f875-46b9-b2fc-9343c7c5d49d\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-x2fbn"
Sep 10 17:47:07.899209 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:47:07.899122    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-d7nb8"
Sep 10 17:47:08.186477 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:47:08.186387    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-d7nb8"]
Sep 10 17:47:08.193914 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:47:08.193887    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc732730f_9840_4992_b47d_54405558d7fc.slice/crio-b24c06db6829fa2c24bdc4e7bb390125a2b19412e8970b0edbaacd034e95000b WatchSource:0}: Error finding container b24c06db6829fa2c24bdc4e7bb390125a2b19412e8970b0edbaacd034e95000b: Status 404 returned error can't find the container with id b24c06db6829fa2c24bdc4e7bb390125a2b19412e8970b0edbaacd034e95000b
Sep 10 17:47:08.232783 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:47:08.232740    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0b1d6d50-f875-46b9-b2fc-9343c7c5d49d-cert\") pod \"kserve-controller-manager-d6f4b65b8-x2fbn\" (UID: \"0b1d6d50-f875-46b9-b2fc-9343c7c5d49d\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-x2fbn"
Sep 10 17:47:08.235251 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:47:08.235226    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0b1d6d50-f875-46b9-b2fc-9343c7c5d49d-cert\") pod \"kserve-controller-manager-d6f4b65b8-x2fbn\" (UID: \"0b1d6d50-f875-46b9-b2fc-9343c7c5d49d\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-x2fbn"
Sep 10 17:47:08.293381 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:47:08.293316    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-d7nb8" event={"ID":"c732730f-9840-4992-b47d-54405558d7fc","Type":"ContainerStarted","Data":"b24c06db6829fa2c24bdc4e7bb390125a2b19412e8970b0edbaacd034e95000b"}
Sep 10 17:47:08.444956 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:47:08.444861    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5l7f9"]
Sep 10 17:47:08.445121 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:47:08.445065    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5l7f9" podUID="04879750-bf8d-4f3a-9176-0e0b3cb54709" containerName="discovery" containerID="cri-o://42cff5256f955b98225721b5a0f16158df592a0b3d060d68e78b81effda2a005" gracePeriod=30
Sep 10 17:47:08.485896 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:47:08.485864    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-x2fbn"
Sep 10 17:47:08.682572 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:47:08.682526    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5l7f9"
Sep 10 17:47:08.736741 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:47:08.736706    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-62nxw\" (UniqueName: \"kubernetes.io/projected/04879750-bf8d-4f3a-9176-0e0b3cb54709-kube-api-access-62nxw\") pod \"04879750-bf8d-4f3a-9176-0e0b3cb54709\" (UID: \"04879750-bf8d-4f3a-9176-0e0b3cb54709\") "
Sep 10 17:47:08.736924 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:47:08.736752    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/04879750-bf8d-4f3a-9176-0e0b3cb54709-istio-kubeconfig\") pod \"04879750-bf8d-4f3a-9176-0e0b3cb54709\" (UID: \"04879750-bf8d-4f3a-9176-0e0b3cb54709\") "
Sep 10 17:47:08.736924 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:47:08.736770    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04879750-bf8d-4f3a-9176-0e0b3cb54709-istio-token\") pod \"04879750-bf8d-4f3a-9176-0e0b3cb54709\" (UID: \"04879750-bf8d-4f3a-9176-0e0b3cb54709\") "
Sep 10 17:47:08.736924 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:47:08.736818    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/04879750-bf8d-4f3a-9176-0e0b3cb54709-istio-csr-ca-configmap\") pod \"04879750-bf8d-4f3a-9176-0e0b3cb54709\" (UID: \"04879750-bf8d-4f3a-9176-0e0b3cb54709\") "
Sep 10 17:47:08.736924 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:47:08.736853    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/04879750-bf8d-4f3a-9176-0e0b3cb54709-local-certs\") pod \"04879750-bf8d-4f3a-9176-0e0b3cb54709\" (UID: \"04879750-bf8d-4f3a-9176-0e0b3cb54709\") "
Sep 10 17:47:08.736924 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:47:08.736885    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/04879750-bf8d-4f3a-9176-0e0b3cb54709-cacerts\") pod \"04879750-bf8d-4f3a-9176-0e0b3cb54709\" (UID: \"04879750-bf8d-4f3a-9176-0e0b3cb54709\") "
Sep 10 17:47:08.736924 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:47:08.736909    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/04879750-bf8d-4f3a-9176-0e0b3cb54709-istio-csr-dns-cert\") pod \"04879750-bf8d-4f3a-9176-0e0b3cb54709\" (UID: \"04879750-bf8d-4f3a-9176-0e0b3cb54709\") "
Sep 10 17:47:08.737716 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:47:08.737270    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/04879750-bf8d-4f3a-9176-0e0b3cb54709-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "04879750-bf8d-4f3a-9176-0e0b3cb54709" (UID: "04879750-bf8d-4f3a-9176-0e0b3cb54709"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 17:47:08.739886 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:47:08.739810    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04879750-bf8d-4f3a-9176-0e0b3cb54709-istio-token" (OuterVolumeSpecName: "istio-token") pod "04879750-bf8d-4f3a-9176-0e0b3cb54709" (UID: "04879750-bf8d-4f3a-9176-0e0b3cb54709"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:47:08.740111 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:47:08.740083    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04879750-bf8d-4f3a-9176-0e0b3cb54709-cacerts" (OuterVolumeSpecName: "cacerts") pod "04879750-bf8d-4f3a-9176-0e0b3cb54709" (UID: "04879750-bf8d-4f3a-9176-0e0b3cb54709"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 17:47:08.740235 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:47:08.740202    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04879750-bf8d-4f3a-9176-0e0b3cb54709-kube-api-access-62nxw" (OuterVolumeSpecName: "kube-api-access-62nxw") pod "04879750-bf8d-4f3a-9176-0e0b3cb54709" (UID: "04879750-bf8d-4f3a-9176-0e0b3cb54709"). InnerVolumeSpecName "kube-api-access-62nxw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:47:08.740463 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:47:08.740438    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04879750-bf8d-4f3a-9176-0e0b3cb54709-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "04879750-bf8d-4f3a-9176-0e0b3cb54709" (UID: "04879750-bf8d-4f3a-9176-0e0b3cb54709"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 17:47:08.740842 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:47:08.740820    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04879750-bf8d-4f3a-9176-0e0b3cb54709-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "04879750-bf8d-4f3a-9176-0e0b3cb54709" (UID: "04879750-bf8d-4f3a-9176-0e0b3cb54709"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 17:47:08.741021 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:47:08.740997    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04879750-bf8d-4f3a-9176-0e0b3cb54709-local-certs" (OuterVolumeSpecName: "local-certs") pod "04879750-bf8d-4f3a-9176-0e0b3cb54709" (UID: "04879750-bf8d-4f3a-9176-0e0b3cb54709"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:47:08.799444 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:47:08.799409    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-x2fbn"]
Sep 10 17:47:08.801973 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:47:08.801943    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b1d6d50_f875_46b9_b2fc_9343c7c5d49d.slice/crio-319b274f87075935ba19a705925ccc07464b700bc72eb24bc3ab0e9a11b7cf3a WatchSource:0}: Error finding container 319b274f87075935ba19a705925ccc07464b700bc72eb24bc3ab0e9a11b7cf3a: Status 404 returned error can't find the container with id 319b274f87075935ba19a705925ccc07464b700bc72eb24bc3ab0e9a11b7cf3a
Sep 10 17:47:08.838175 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:47:08.838141    2568 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/04879750-bf8d-4f3a-9176-0e0b3cb54709-local-certs\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:47:08.838175 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:47:08.838177    2568 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/04879750-bf8d-4f3a-9176-0e0b3cb54709-cacerts\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:47:08.838435 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:47:08.838190    2568 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/04879750-bf8d-4f3a-9176-0e0b3cb54709-istio-csr-dns-cert\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:47:08.838435 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:47:08.838203    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-62nxw\" (UniqueName: \"kubernetes.io/projected/04879750-bf8d-4f3a-9176-0e0b3cb54709-kube-api-access-62nxw\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:47:08.838435 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:47:08.838217    2568 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/04879750-bf8d-4f3a-9176-0e0b3cb54709-istio-kubeconfig\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:47:08.838435 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:47:08.838228    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04879750-bf8d-4f3a-9176-0e0b3cb54709-istio-token\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:47:08.838435 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:47:08.838240    2568 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/04879750-bf8d-4f3a-9176-0e0b3cb54709-istio-csr-ca-configmap\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:47:09.301229 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:47:09.301187    2568 generic.go:356] "Generic (PLEG): container finished" podID="04879750-bf8d-4f3a-9176-0e0b3cb54709" containerID="42cff5256f955b98225721b5a0f16158df592a0b3d060d68e78b81effda2a005" exitCode=0
Sep 10 17:47:09.301450 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:47:09.301251    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5l7f9"
Sep 10 17:47:09.301450 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:47:09.301291    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5l7f9" event={"ID":"04879750-bf8d-4f3a-9176-0e0b3cb54709","Type":"ContainerDied","Data":"42cff5256f955b98225721b5a0f16158df592a0b3d060d68e78b81effda2a005"}
Sep 10 17:47:09.301450 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:47:09.301371    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5l7f9" event={"ID":"04879750-bf8d-4f3a-9176-0e0b3cb54709","Type":"ContainerDied","Data":"2c9fdc5d54eb88c30b982db94138acfab7829c3ca342eded5a708f9c765bf696"}
Sep 10 17:47:09.301450 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:47:09.301401    2568 scope.go:117] "RemoveContainer" containerID="42cff5256f955b98225721b5a0f16158df592a0b3d060d68e78b81effda2a005"
Sep 10 17:47:09.303628 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:47:09.303484    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-x2fbn" event={"ID":"0b1d6d50-f875-46b9-b2fc-9343c7c5d49d","Type":"ContainerStarted","Data":"319b274f87075935ba19a705925ccc07464b700bc72eb24bc3ab0e9a11b7cf3a"}
Sep 10 17:47:09.335337 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:47:09.335284    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5l7f9"]
Sep 10 17:47:09.342967 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:47:09.342927    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5l7f9"]
Sep 10 17:47:09.430416 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:47:09.430379    2568 scope.go:117] "RemoveContainer" containerID="42cff5256f955b98225721b5a0f16158df592a0b3d060d68e78b81effda2a005"
Sep 10 17:47:09.430832 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:47:09.430800    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42cff5256f955b98225721b5a0f16158df592a0b3d060d68e78b81effda2a005\": container with ID starting with 42cff5256f955b98225721b5a0f16158df592a0b3d060d68e78b81effda2a005 not found: ID does not exist" containerID="42cff5256f955b98225721b5a0f16158df592a0b3d060d68e78b81effda2a005"
Sep 10 17:47:09.430925 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:47:09.430846    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42cff5256f955b98225721b5a0f16158df592a0b3d060d68e78b81effda2a005"} err="failed to get container status \"42cff5256f955b98225721b5a0f16158df592a0b3d060d68e78b81effda2a005\": rpc error: code = NotFound desc = could not find container \"42cff5256f955b98225721b5a0f16158df592a0b3d060d68e78b81effda2a005\": container with ID starting with 42cff5256f955b98225721b5a0f16158df592a0b3d060d68e78b81effda2a005 not found: ID does not exist"
Sep 10 17:47:10.258409 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:47:10.258379    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-92bvc"
Sep 10 17:47:10.771612 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:47:10.771448    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="04879750-bf8d-4f3a-9176-0e0b3cb54709" path="/var/lib/kubelet/pods/04879750-bf8d-4f3a-9176-0e0b3cb54709/volumes"
Sep 10 17:47:12.327726 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:47:12.327691    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-d7nb8" event={"ID":"c732730f-9840-4992-b47d-54405558d7fc","Type":"ContainerStarted","Data":"ace004df4584d02470b129328e35f38d2ed16f0da7f05dfdfb4c3daf612c0226"}
Sep 10 17:47:12.328254 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:47:12.327842    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-d7nb8"
Sep 10 17:47:12.329507 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:47:12.329479    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-x2fbn" event={"ID":"0b1d6d50-f875-46b9-b2fc-9343c7c5d49d","Type":"ContainerStarted","Data":"4738b8b0cb8e780a6961720a5dbe31dc0fa66d38ac5633ab48830af55954aeed"}
Sep 10 17:47:12.329677 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:47:12.329549    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-x2fbn"
Sep 10 17:47:12.347256 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:47:12.347199    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-d7nb8" podStartSLOduration=2.038327328 podStartE2EDuration="5.347181333s" totalImagesPullingTime="3.308854005s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:47:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:47:12.34621759 +0000 UTC m=+368.107525635" watchObservedRunningTime="2026-09-10 17:47:12.347181333 +0000 UTC m=+368.108489375"
Sep 10 17:47:12.368808 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:47:12.368745    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-x2fbn" podStartSLOduration=2.663384925 podStartE2EDuration="5.368723667s" totalImagesPullingTime="2.705338742s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:47:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:47:12.367145717 +0000 UTC m=+368.128453761" watchObservedRunningTime="2026-09-10 17:47:12.368723667 +0000 UTC m=+368.130031712"
Sep 10 17:47:43.336607 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:47:43.336572    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-d7nb8"
Sep 10 17:47:43.339717 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:47:43.339693    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-x2fbn"
Sep 10 17:48:00.954309 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:00.954267    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a46f7j"]
Sep 10 17:48:00.954786 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:00.954586    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04879750-bf8d-4f3a-9176-0e0b3cb54709" containerName="discovery"
Sep 10 17:48:00.954786 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:00.954599    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="04879750-bf8d-4f3a-9176-0e0b3cb54709" containerName="discovery"
Sep 10 17:48:00.954786 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:00.954659    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="04879750-bf8d-4f3a-9176-0e0b3cb54709" containerName="discovery"
Sep 10 17:48:00.957735 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:00.957712    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a46f7j"
Sep 10 17:48:00.960519 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:00.960485    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 10 17:48:00.960743 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:00.960715    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5fv8\" (UniqueName: \"kubernetes.io/projected/789f0b5f-41c7-4def-88ad-a5bd94e823bb-kube-api-access-c5fv8\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a46f7j\" (UID: \"789f0b5f-41c7-4def-88ad-a5bd94e823bb\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a46f7j"
Sep 10 17:48:00.960816 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:00.960762    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/789f0b5f-41c7-4def-88ad-a5bd94e823bb-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a46f7j\" (UID: \"789f0b5f-41c7-4def-88ad-a5bd94e823bb\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a46f7j"
Sep 10 17:48:00.960888 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:00.960872    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/789f0b5f-41c7-4def-88ad-a5bd94e823bb-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a46f7j\" (UID: \"789f0b5f-41c7-4def-88ad-a5bd94e823bb\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a46f7j"
Sep 10 17:48:00.961534 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:00.961513    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-s2ppn\""
Sep 10 17:48:00.961618 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:00.961514    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 10 17:48:00.966278 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:00.966250    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a46f7j"]
Sep 10 17:48:01.051061 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:01.051028    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg6kq7"]
Sep 10 17:48:01.054558 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:01.054528    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg6kq7"
Sep 10 17:48:01.061490 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:01.061457    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/789f0b5f-41c7-4def-88ad-a5bd94e823bb-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a46f7j\" (UID: \"789f0b5f-41c7-4def-88ad-a5bd94e823bb\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a46f7j"
Sep 10 17:48:01.061620 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:01.061530    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2c88a39c-e756-4cf5-baba-7830b2ae2791-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg6kq7\" (UID: \"2c88a39c-e756-4cf5-baba-7830b2ae2791\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg6kq7"
Sep 10 17:48:01.061620 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:01.061590    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2c88a39c-e756-4cf5-baba-7830b2ae2791-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg6kq7\" (UID: \"2c88a39c-e756-4cf5-baba-7830b2ae2791\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg6kq7"
Sep 10 17:48:01.061741 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:01.061634    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5fv8\" (UniqueName: \"kubernetes.io/projected/789f0b5f-41c7-4def-88ad-a5bd94e823bb-kube-api-access-c5fv8\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a46f7j\" (UID: \"789f0b5f-41c7-4def-88ad-a5bd94e823bb\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a46f7j"
Sep 10 17:48:01.061741 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:01.061698    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/789f0b5f-41c7-4def-88ad-a5bd94e823bb-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a46f7j\" (UID: \"789f0b5f-41c7-4def-88ad-a5bd94e823bb\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a46f7j"
Sep 10 17:48:01.061842 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:01.061751    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4w5vg\" (UniqueName: \"kubernetes.io/projected/2c88a39c-e756-4cf5-baba-7830b2ae2791-kube-api-access-4w5vg\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg6kq7\" (UID: \"2c88a39c-e756-4cf5-baba-7830b2ae2791\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg6kq7"
Sep 10 17:48:01.062263 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:01.062242    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/789f0b5f-41c7-4def-88ad-a5bd94e823bb-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a46f7j\" (UID: \"789f0b5f-41c7-4def-88ad-a5bd94e823bb\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a46f7j"
Sep 10 17:48:01.062833 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:01.062805    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/789f0b5f-41c7-4def-88ad-a5bd94e823bb-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a46f7j\" (UID: \"789f0b5f-41c7-4def-88ad-a5bd94e823bb\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a46f7j"
Sep 10 17:48:01.068077 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:01.068039    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg6kq7"]
Sep 10 17:48:01.071109 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:01.071080    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5fv8\" (UniqueName: \"kubernetes.io/projected/789f0b5f-41c7-4def-88ad-a5bd94e823bb-kube-api-access-c5fv8\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a46f7j\" (UID: \"789f0b5f-41c7-4def-88ad-a5bd94e823bb\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a46f7j"
Sep 10 17:48:01.150275 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:01.150235    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6p4846"]
Sep 10 17:48:01.153757 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:01.153730    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6p4846"
Sep 10 17:48:01.161932 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:01.161902    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6p4846"]
Sep 10 17:48:01.162147 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:01.162122    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2c88a39c-e756-4cf5-baba-7830b2ae2791-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg6kq7\" (UID: \"2c88a39c-e756-4cf5-baba-7830b2ae2791\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg6kq7"
Sep 10 17:48:01.162240 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:01.162166    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/87d73d59-875d-4c30-826c-652f4e8f8459-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6p4846\" (UID: \"87d73d59-875d-4c30-826c-652f4e8f8459\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6p4846"
Sep 10 17:48:01.162240 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:01.162193    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8hql\" (UniqueName: \"kubernetes.io/projected/87d73d59-875d-4c30-826c-652f4e8f8459-kube-api-access-x8hql\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6p4846\" (UID: \"87d73d59-875d-4c30-826c-652f4e8f8459\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6p4846"
Sep 10 17:48:01.162240 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:01.162229    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2c88a39c-e756-4cf5-baba-7830b2ae2791-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg6kq7\" (UID: \"2c88a39c-e756-4cf5-baba-7830b2ae2791\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg6kq7"
Sep 10 17:48:01.162433 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:01.162260    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/87d73d59-875d-4c30-826c-652f4e8f8459-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6p4846\" (UID: \"87d73d59-875d-4c30-826c-652f4e8f8459\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6p4846"
Sep 10 17:48:01.162433 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:01.162377    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4w5vg\" (UniqueName: \"kubernetes.io/projected/2c88a39c-e756-4cf5-baba-7830b2ae2791-kube-api-access-4w5vg\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg6kq7\" (UID: \"2c88a39c-e756-4cf5-baba-7830b2ae2791\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg6kq7"
Sep 10 17:48:01.162595 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:01.162574    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2c88a39c-e756-4cf5-baba-7830b2ae2791-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg6kq7\" (UID: \"2c88a39c-e756-4cf5-baba-7830b2ae2791\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg6kq7"
Sep 10 17:48:01.162595 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:01.162588    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2c88a39c-e756-4cf5-baba-7830b2ae2791-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg6kq7\" (UID: \"2c88a39c-e756-4cf5-baba-7830b2ae2791\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg6kq7"
Sep 10 17:48:01.170754 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:01.170716    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4w5vg\" (UniqueName: \"kubernetes.io/projected/2c88a39c-e756-4cf5-baba-7830b2ae2791-kube-api-access-4w5vg\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg6kq7\" (UID: \"2c88a39c-e756-4cf5-baba-7830b2ae2791\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg6kq7"
Sep 10 17:48:01.253018 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:01.252981    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fmwtr"]
Sep 10 17:48:01.256558 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:01.256538    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fmwtr"
Sep 10 17:48:01.264084 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:01.263576    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/87d73d59-875d-4c30-826c-652f4e8f8459-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6p4846\" (UID: \"87d73d59-875d-4c30-826c-652f4e8f8459\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6p4846"
Sep 10 17:48:01.264084 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:01.263618    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8hql\" (UniqueName: \"kubernetes.io/projected/87d73d59-875d-4c30-826c-652f4e8f8459-kube-api-access-x8hql\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6p4846\" (UID: \"87d73d59-875d-4c30-826c-652f4e8f8459\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6p4846"
Sep 10 17:48:01.264084 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:01.263648    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vvp2\" (UniqueName: \"kubernetes.io/projected/87f64f2b-06ea-4102-80b6-c997f675c04f-kube-api-access-2vvp2\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fmwtr\" (UID: \"87f64f2b-06ea-4102-80b6-c997f675c04f\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fmwtr"
Sep 10 17:48:01.264084 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:01.263689    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/87d73d59-875d-4c30-826c-652f4e8f8459-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6p4846\" (UID: \"87d73d59-875d-4c30-826c-652f4e8f8459\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6p4846"
Sep 10 17:48:01.264084 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:01.263737    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/87f64f2b-06ea-4102-80b6-c997f675c04f-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fmwtr\" (UID: \"87f64f2b-06ea-4102-80b6-c997f675c04f\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fmwtr"
Sep 10 17:48:01.264084 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:01.263770    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/87f64f2b-06ea-4102-80b6-c997f675c04f-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fmwtr\" (UID: \"87f64f2b-06ea-4102-80b6-c997f675c04f\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fmwtr"
Sep 10 17:48:01.264428 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:01.264159    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/87d73d59-875d-4c30-826c-652f4e8f8459-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6p4846\" (UID: \"87d73d59-875d-4c30-826c-652f4e8f8459\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6p4846"
Sep 10 17:48:01.264680 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:01.264653    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/87d73d59-875d-4c30-826c-652f4e8f8459-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6p4846\" (UID: \"87d73d59-875d-4c30-826c-652f4e8f8459\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6p4846"
Sep 10 17:48:01.265469 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:01.265445    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fmwtr"]
Sep 10 17:48:01.268404 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:01.268383    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a46f7j"
Sep 10 17:48:01.273627 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:01.273541    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8hql\" (UniqueName: \"kubernetes.io/projected/87d73d59-875d-4c30-826c-652f4e8f8459-kube-api-access-x8hql\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6p4846\" (UID: \"87d73d59-875d-4c30-826c-652f4e8f8459\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6p4846"
Sep 10 17:48:01.364895 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:01.364837    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/87f64f2b-06ea-4102-80b6-c997f675c04f-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fmwtr\" (UID: \"87f64f2b-06ea-4102-80b6-c997f675c04f\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fmwtr"
Sep 10 17:48:01.365093 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:01.364904    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/87f64f2b-06ea-4102-80b6-c997f675c04f-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fmwtr\" (UID: \"87f64f2b-06ea-4102-80b6-c997f675c04f\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fmwtr"
Sep 10 17:48:01.365093 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:01.364966    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vvp2\" (UniqueName: \"kubernetes.io/projected/87f64f2b-06ea-4102-80b6-c997f675c04f-kube-api-access-2vvp2\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fmwtr\" (UID: \"87f64f2b-06ea-4102-80b6-c997f675c04f\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fmwtr"
Sep 10 17:48:01.365301 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:01.365264    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg6kq7"
Sep 10 17:48:01.365301 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:01.365289    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/87f64f2b-06ea-4102-80b6-c997f675c04f-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fmwtr\" (UID: \"87f64f2b-06ea-4102-80b6-c997f675c04f\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fmwtr"
Sep 10 17:48:01.365550 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:01.365274    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/87f64f2b-06ea-4102-80b6-c997f675c04f-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fmwtr\" (UID: \"87f64f2b-06ea-4102-80b6-c997f675c04f\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fmwtr"
Sep 10 17:48:01.374237 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:01.374199    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vvp2\" (UniqueName: \"kubernetes.io/projected/87f64f2b-06ea-4102-80b6-c997f675c04f-kube-api-access-2vvp2\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fmwtr\" (UID: \"87f64f2b-06ea-4102-80b6-c997f675c04f\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fmwtr"
Sep 10 17:48:01.464806 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:01.464756    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6p4846"
Sep 10 17:48:01.545500 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:01.545457    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a46f7j"]
Sep 10 17:48:01.548765 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:48:01.548731    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod789f0b5f_41c7_4def_88ad_a5bd94e823bb.slice/crio-0a24852533dcfd8f4af46d7da3afcbe5dd8fa02aeed80f815a61b981a6e86e81 WatchSource:0}: Error finding container 0a24852533dcfd8f4af46d7da3afcbe5dd8fa02aeed80f815a61b981a6e86e81: Status 404 returned error can't find the container with id 0a24852533dcfd8f4af46d7da3afcbe5dd8fa02aeed80f815a61b981a6e86e81
Sep 10 17:48:01.564580 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:01.564535    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a46f7j" event={"ID":"789f0b5f-41c7-4def-88ad-a5bd94e823bb","Type":"ContainerStarted","Data":"0a24852533dcfd8f4af46d7da3afcbe5dd8fa02aeed80f815a61b981a6e86e81"}
Sep 10 17:48:01.566803 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:01.566775    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fmwtr"
Sep 10 17:48:01.645814 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:01.645778    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg6kq7"]
Sep 10 17:48:01.649158 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:48:01.649093    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c88a39c_e756_4cf5_baba_7830b2ae2791.slice/crio-abc30f3525d3ce82363870c8e460e5570ea13223e3e3784597284949311c6bf3 WatchSource:0}: Error finding container abc30f3525d3ce82363870c8e460e5570ea13223e3e3784597284949311c6bf3: Status 404 returned error can't find the container with id abc30f3525d3ce82363870c8e460e5570ea13223e3e3784597284949311c6bf3
Sep 10 17:48:01.743282 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:01.743254    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6p4846"]
Sep 10 17:48:01.745694 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:48:01.745659    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87d73d59_875d_4c30_826c_652f4e8f8459.slice/crio-0e541880dbd8001ee2dd971a39469d177914ac2680dc945adba3fd811d3a130e WatchSource:0}: Error finding container 0e541880dbd8001ee2dd971a39469d177914ac2680dc945adba3fd811d3a130e: Status 404 returned error can't find the container with id 0e541880dbd8001ee2dd971a39469d177914ac2680dc945adba3fd811d3a130e
Sep 10 17:48:01.851892 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:01.851853    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fmwtr"]
Sep 10 17:48:01.857633 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:48:01.857587    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87f64f2b_06ea_4102_80b6_c997f675c04f.slice/crio-b8cc677b1cb1d75826920c1e1647b0b49db77c723e8889fda4fddc72f8f54e7d WatchSource:0}: Error finding container b8cc677b1cb1d75826920c1e1647b0b49db77c723e8889fda4fddc72f8f54e7d: Status 404 returned error can't find the container with id b8cc677b1cb1d75826920c1e1647b0b49db77c723e8889fda4fddc72f8f54e7d
Sep 10 17:48:02.571302 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:02.571263    2568 generic.go:356] "Generic (PLEG): container finished" podID="87f64f2b-06ea-4102-80b6-c997f675c04f" containerID="9e541e616798dad8ac54552ab338816c5cc083240fee0983228208e3b79d5d16" exitCode=0
Sep 10 17:48:02.571779 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:02.571351    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fmwtr" event={"ID":"87f64f2b-06ea-4102-80b6-c997f675c04f","Type":"ContainerDied","Data":"9e541e616798dad8ac54552ab338816c5cc083240fee0983228208e3b79d5d16"}
Sep 10 17:48:02.571779 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:02.571409    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fmwtr" event={"ID":"87f64f2b-06ea-4102-80b6-c997f675c04f","Type":"ContainerStarted","Data":"b8cc677b1cb1d75826920c1e1647b0b49db77c723e8889fda4fddc72f8f54e7d"}
Sep 10 17:48:02.573046 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:02.573023    2568 generic.go:356] "Generic (PLEG): container finished" podID="87d73d59-875d-4c30-826c-652f4e8f8459" containerID="a227151a963000699a8b7017c1e5cdc64378bc19604caa462f6b0332adcb2d39" exitCode=0
Sep 10 17:48:02.573129 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:02.573103    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6p4846" event={"ID":"87d73d59-875d-4c30-826c-652f4e8f8459","Type":"ContainerDied","Data":"a227151a963000699a8b7017c1e5cdc64378bc19604caa462f6b0332adcb2d39"}
Sep 10 17:48:02.573188 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:02.573157    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6p4846" event={"ID":"87d73d59-875d-4c30-826c-652f4e8f8459","Type":"ContainerStarted","Data":"0e541880dbd8001ee2dd971a39469d177914ac2680dc945adba3fd811d3a130e"}
Sep 10 17:48:02.574748 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:02.574729    2568 generic.go:356] "Generic (PLEG): container finished" podID="2c88a39c-e756-4cf5-baba-7830b2ae2791" containerID="22656b7624dffae340d4317a27843b342a4e2024e394d99a5d8bcf0c181f88cf" exitCode=0
Sep 10 17:48:02.574825 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:02.574794    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg6kq7" event={"ID":"2c88a39c-e756-4cf5-baba-7830b2ae2791","Type":"ContainerDied","Data":"22656b7624dffae340d4317a27843b342a4e2024e394d99a5d8bcf0c181f88cf"}
Sep 10 17:48:02.574945 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:02.574850    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg6kq7" event={"ID":"2c88a39c-e756-4cf5-baba-7830b2ae2791","Type":"ContainerStarted","Data":"abc30f3525d3ce82363870c8e460e5570ea13223e3e3784597284949311c6bf3"}
Sep 10 17:48:02.576637 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:02.576618    2568 generic.go:356] "Generic (PLEG): container finished" podID="789f0b5f-41c7-4def-88ad-a5bd94e823bb" containerID="65290a300af6743f2fa776ca549b14a96f08a320d382a0d47b1733cd9779f156" exitCode=0
Sep 10 17:48:02.576738 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:02.576693    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a46f7j" event={"ID":"789f0b5f-41c7-4def-88ad-a5bd94e823bb","Type":"ContainerDied","Data":"65290a300af6743f2fa776ca549b14a96f08a320d382a0d47b1733cd9779f156"}
Sep 10 17:48:04.596200 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:04.596159    2568 generic.go:356] "Generic (PLEG): container finished" podID="789f0b5f-41c7-4def-88ad-a5bd94e823bb" containerID="4be38d5e216c3b4cebf12f135ef9146ad2e864ac03cea31bc1f30c5159c7e59d" exitCode=0
Sep 10 17:48:04.596624 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:04.596253    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a46f7j" event={"ID":"789f0b5f-41c7-4def-88ad-a5bd94e823bb","Type":"ContainerDied","Data":"4be38d5e216c3b4cebf12f135ef9146ad2e864ac03cea31bc1f30c5159c7e59d"}
Sep 10 17:48:04.598364 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:04.598317    2568 generic.go:356] "Generic (PLEG): container finished" podID="87f64f2b-06ea-4102-80b6-c997f675c04f" containerID="fe4b0a76b9a408f1a0afbf405df31556f0f8c6f9993de772ae2581d6f634b66e" exitCode=0
Sep 10 17:48:04.598458 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:04.598429    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fmwtr" event={"ID":"87f64f2b-06ea-4102-80b6-c997f675c04f","Type":"ContainerDied","Data":"fe4b0a76b9a408f1a0afbf405df31556f0f8c6f9993de772ae2581d6f634b66e"}
Sep 10 17:48:04.600518 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:04.600486    2568 generic.go:356] "Generic (PLEG): container finished" podID="87d73d59-875d-4c30-826c-652f4e8f8459" containerID="e6f7ec3f822ca5a6bc4a1458d0e45c321b6a5afbbc989cb2f80f3c628492e45e" exitCode=0
Sep 10 17:48:04.600639 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:04.600563    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6p4846" event={"ID":"87d73d59-875d-4c30-826c-652f4e8f8459","Type":"ContainerDied","Data":"e6f7ec3f822ca5a6bc4a1458d0e45c321b6a5afbbc989cb2f80f3c628492e45e"}
Sep 10 17:48:04.602582 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:04.602555    2568 generic.go:356] "Generic (PLEG): container finished" podID="2c88a39c-e756-4cf5-baba-7830b2ae2791" containerID="c4f871bebb3ea5d0751a79f33cc2d16e55d93405fc52d0a9c801dd24264cb522" exitCode=0
Sep 10 17:48:04.602686 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:04.602593    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg6kq7" event={"ID":"2c88a39c-e756-4cf5-baba-7830b2ae2791","Type":"ContainerDied","Data":"c4f871bebb3ea5d0751a79f33cc2d16e55d93405fc52d0a9c801dd24264cb522"}
Sep 10 17:48:05.609803 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:05.609763    2568 generic.go:356] "Generic (PLEG): container finished" podID="87f64f2b-06ea-4102-80b6-c997f675c04f" containerID="23de022682b44c8df38656bd5ddcb6a92563e4ea379ac562b243bafb08de974a" exitCode=0
Sep 10 17:48:05.610360 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:05.609855    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fmwtr" event={"ID":"87f64f2b-06ea-4102-80b6-c997f675c04f","Type":"ContainerDied","Data":"23de022682b44c8df38656bd5ddcb6a92563e4ea379ac562b243bafb08de974a"}
Sep 10 17:48:05.612061 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:05.612032    2568 generic.go:356] "Generic (PLEG): container finished" podID="87d73d59-875d-4c30-826c-652f4e8f8459" containerID="4d0b64ed52d43e1ce7ee4b3ac40302fb839238476a8e869d012d419fd69d6ba7" exitCode=0
Sep 10 17:48:05.612200 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:05.612110    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6p4846" event={"ID":"87d73d59-875d-4c30-826c-652f4e8f8459","Type":"ContainerDied","Data":"4d0b64ed52d43e1ce7ee4b3ac40302fb839238476a8e869d012d419fd69d6ba7"}
Sep 10 17:48:05.614470 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:05.614443    2568 generic.go:356] "Generic (PLEG): container finished" podID="2c88a39c-e756-4cf5-baba-7830b2ae2791" containerID="c98ac135144a6ea3bad9a043c54a28c083c1dbaa59c4d60824a0082ea546e486" exitCode=0
Sep 10 17:48:05.614577 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:05.614513    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg6kq7" event={"ID":"2c88a39c-e756-4cf5-baba-7830b2ae2791","Type":"ContainerDied","Data":"c98ac135144a6ea3bad9a043c54a28c083c1dbaa59c4d60824a0082ea546e486"}
Sep 10 17:48:05.616679 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:05.616652    2568 generic.go:356] "Generic (PLEG): container finished" podID="789f0b5f-41c7-4def-88ad-a5bd94e823bb" containerID="b54c6bf66e35502b6785379d2d6af8d73eb89c5995e236402e1183f8af798f89" exitCode=0
Sep 10 17:48:05.616803 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:05.616719    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a46f7j" event={"ID":"789f0b5f-41c7-4def-88ad-a5bd94e823bb","Type":"ContainerDied","Data":"b54c6bf66e35502b6785379d2d6af8d73eb89c5995e236402e1183f8af798f89"}
Sep 10 17:48:06.806747 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:06.806719    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg6kq7"
Sep 10 17:48:06.810135 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:06.810112    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6p4846"
Sep 10 17:48:06.849588 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:06.849548    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fmwtr"
Sep 10 17:48:06.853804 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:06.853769    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a46f7j"
Sep 10 17:48:06.910399 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:06.910282    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/87f64f2b-06ea-4102-80b6-c997f675c04f-util\") pod \"87f64f2b-06ea-4102-80b6-c997f675c04f\" (UID: \"87f64f2b-06ea-4102-80b6-c997f675c04f\") "
Sep 10 17:48:06.910399 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:06.910385    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/87d73d59-875d-4c30-826c-652f4e8f8459-bundle\") pod \"87d73d59-875d-4c30-826c-652f4e8f8459\" (UID: \"87d73d59-875d-4c30-826c-652f4e8f8459\") "
Sep 10 17:48:06.910640 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:06.910416    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/87d73d59-875d-4c30-826c-652f4e8f8459-util\") pod \"87d73d59-875d-4c30-826c-652f4e8f8459\" (UID: \"87d73d59-875d-4c30-826c-652f4e8f8459\") "
Sep 10 17:48:06.910640 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:06.910436    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2c88a39c-e756-4cf5-baba-7830b2ae2791-util\") pod \"2c88a39c-e756-4cf5-baba-7830b2ae2791\" (UID: \"2c88a39c-e756-4cf5-baba-7830b2ae2791\") "
Sep 10 17:48:06.910640 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:06.910457    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/789f0b5f-41c7-4def-88ad-a5bd94e823bb-util\") pod \"789f0b5f-41c7-4def-88ad-a5bd94e823bb\" (UID: \"789f0b5f-41c7-4def-88ad-a5bd94e823bb\") "
Sep 10 17:48:06.910640 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:06.910480    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/789f0b5f-41c7-4def-88ad-a5bd94e823bb-bundle\") pod \"789f0b5f-41c7-4def-88ad-a5bd94e823bb\" (UID: \"789f0b5f-41c7-4def-88ad-a5bd94e823bb\") "
Sep 10 17:48:06.910640 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:06.910530    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c5fv8\" (UniqueName: \"kubernetes.io/projected/789f0b5f-41c7-4def-88ad-a5bd94e823bb-kube-api-access-c5fv8\") pod \"789f0b5f-41c7-4def-88ad-a5bd94e823bb\" (UID: \"789f0b5f-41c7-4def-88ad-a5bd94e823bb\") "
Sep 10 17:48:06.910640 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:06.910558    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2c88a39c-e756-4cf5-baba-7830b2ae2791-bundle\") pod \"2c88a39c-e756-4cf5-baba-7830b2ae2791\" (UID: \"2c88a39c-e756-4cf5-baba-7830b2ae2791\") "
Sep 10 17:48:06.910640 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:06.910581    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4w5vg\" (UniqueName: \"kubernetes.io/projected/2c88a39c-e756-4cf5-baba-7830b2ae2791-kube-api-access-4w5vg\") pod \"2c88a39c-e756-4cf5-baba-7830b2ae2791\" (UID: \"2c88a39c-e756-4cf5-baba-7830b2ae2791\") "
Sep 10 17:48:06.910640 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:06.910622    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/87f64f2b-06ea-4102-80b6-c997f675c04f-bundle\") pod \"87f64f2b-06ea-4102-80b6-c997f675c04f\" (UID: \"87f64f2b-06ea-4102-80b6-c997f675c04f\") "
Sep 10 17:48:06.910997 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:06.910649    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2vvp2\" (UniqueName: \"kubernetes.io/projected/87f64f2b-06ea-4102-80b6-c997f675c04f-kube-api-access-2vvp2\") pod \"87f64f2b-06ea-4102-80b6-c997f675c04f\" (UID: \"87f64f2b-06ea-4102-80b6-c997f675c04f\") "
Sep 10 17:48:06.910997 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:06.910702    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x8hql\" (UniqueName: \"kubernetes.io/projected/87d73d59-875d-4c30-826c-652f4e8f8459-kube-api-access-x8hql\") pod \"87d73d59-875d-4c30-826c-652f4e8f8459\" (UID: \"87d73d59-875d-4c30-826c-652f4e8f8459\") "
Sep 10 17:48:06.912272 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:06.911219    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87d73d59-875d-4c30-826c-652f4e8f8459-bundle" (OuterVolumeSpecName: "bundle") pod "87d73d59-875d-4c30-826c-652f4e8f8459" (UID: "87d73d59-875d-4c30-826c-652f4e8f8459"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:48:06.912272 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:06.911730    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87f64f2b-06ea-4102-80b6-c997f675c04f-bundle" (OuterVolumeSpecName: "bundle") pod "87f64f2b-06ea-4102-80b6-c997f675c04f" (UID: "87f64f2b-06ea-4102-80b6-c997f675c04f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:48:06.912272 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:06.911824    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/789f0b5f-41c7-4def-88ad-a5bd94e823bb-bundle" (OuterVolumeSpecName: "bundle") pod "789f0b5f-41c7-4def-88ad-a5bd94e823bb" (UID: "789f0b5f-41c7-4def-88ad-a5bd94e823bb"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:48:06.912673 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:06.912479    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c88a39c-e756-4cf5-baba-7830b2ae2791-bundle" (OuterVolumeSpecName: "bundle") pod "2c88a39c-e756-4cf5-baba-7830b2ae2791" (UID: "2c88a39c-e756-4cf5-baba-7830b2ae2791"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:48:06.914044 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:06.914010    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87f64f2b-06ea-4102-80b6-c997f675c04f-kube-api-access-2vvp2" (OuterVolumeSpecName: "kube-api-access-2vvp2") pod "87f64f2b-06ea-4102-80b6-c997f675c04f" (UID: "87f64f2b-06ea-4102-80b6-c997f675c04f"). InnerVolumeSpecName "kube-api-access-2vvp2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:48:06.914253 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:06.914236    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87d73d59-875d-4c30-826c-652f4e8f8459-kube-api-access-x8hql" (OuterVolumeSpecName: "kube-api-access-x8hql") pod "87d73d59-875d-4c30-826c-652f4e8f8459" (UID: "87d73d59-875d-4c30-826c-652f4e8f8459"). InnerVolumeSpecName "kube-api-access-x8hql". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:48:06.914810 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:06.914771    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c88a39c-e756-4cf5-baba-7830b2ae2791-kube-api-access-4w5vg" (OuterVolumeSpecName: "kube-api-access-4w5vg") pod "2c88a39c-e756-4cf5-baba-7830b2ae2791" (UID: "2c88a39c-e756-4cf5-baba-7830b2ae2791"). InnerVolumeSpecName "kube-api-access-4w5vg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:48:06.915519 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:06.915481    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/789f0b5f-41c7-4def-88ad-a5bd94e823bb-kube-api-access-c5fv8" (OuterVolumeSpecName: "kube-api-access-c5fv8") pod "789f0b5f-41c7-4def-88ad-a5bd94e823bb" (UID: "789f0b5f-41c7-4def-88ad-a5bd94e823bb"). InnerVolumeSpecName "kube-api-access-c5fv8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:48:06.917894 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:06.917858    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87d73d59-875d-4c30-826c-652f4e8f8459-util" (OuterVolumeSpecName: "util") pod "87d73d59-875d-4c30-826c-652f4e8f8459" (UID: "87d73d59-875d-4c30-826c-652f4e8f8459"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:48:06.918027 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:06.917907    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/789f0b5f-41c7-4def-88ad-a5bd94e823bb-util" (OuterVolumeSpecName: "util") pod "789f0b5f-41c7-4def-88ad-a5bd94e823bb" (UID: "789f0b5f-41c7-4def-88ad-a5bd94e823bb"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:48:06.918306 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:06.918284    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c88a39c-e756-4cf5-baba-7830b2ae2791-util" (OuterVolumeSpecName: "util") pod "2c88a39c-e756-4cf5-baba-7830b2ae2791" (UID: "2c88a39c-e756-4cf5-baba-7830b2ae2791"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:48:06.918404 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:06.918382    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87f64f2b-06ea-4102-80b6-c997f675c04f-util" (OuterVolumeSpecName: "util") pod "87f64f2b-06ea-4102-80b6-c997f675c04f" (UID: "87f64f2b-06ea-4102-80b6-c997f675c04f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:48:07.011974 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:07.011927    2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/87f64f2b-06ea-4102-80b6-c997f675c04f-util\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:48:07.011974 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:07.011964    2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/87d73d59-875d-4c30-826c-652f4e8f8459-bundle\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:48:07.011974 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:07.011973    2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/87d73d59-875d-4c30-826c-652f4e8f8459-util\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:48:07.011974 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:07.011981    2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2c88a39c-e756-4cf5-baba-7830b2ae2791-util\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:48:07.011974 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:07.011988    2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/789f0b5f-41c7-4def-88ad-a5bd94e823bb-util\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:48:07.012261 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:07.011996    2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/789f0b5f-41c7-4def-88ad-a5bd94e823bb-bundle\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:48:07.012261 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:07.012006    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c5fv8\" (UniqueName: \"kubernetes.io/projected/789f0b5f-41c7-4def-88ad-a5bd94e823bb-kube-api-access-c5fv8\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:48:07.012261 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:07.012016    2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2c88a39c-e756-4cf5-baba-7830b2ae2791-bundle\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:48:07.012261 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:07.012024    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4w5vg\" (UniqueName: \"kubernetes.io/projected/2c88a39c-e756-4cf5-baba-7830b2ae2791-kube-api-access-4w5vg\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:48:07.012261 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:07.012032    2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/87f64f2b-06ea-4102-80b6-c997f675c04f-bundle\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:48:07.012261 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:07.012039    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2vvp2\" (UniqueName: \"kubernetes.io/projected/87f64f2b-06ea-4102-80b6-c997f675c04f-kube-api-access-2vvp2\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:48:07.012261 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:07.012049    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x8hql\" (UniqueName: \"kubernetes.io/projected/87d73d59-875d-4c30-826c-652f4e8f8459-kube-api-access-x8hql\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:48:07.631343 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:07.631295    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fmwtr"
Sep 10 17:48:07.631343 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:07.631290    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fmwtr" event={"ID":"87f64f2b-06ea-4102-80b6-c997f675c04f","Type":"ContainerDied","Data":"b8cc677b1cb1d75826920c1e1647b0b49db77c723e8889fda4fddc72f8f54e7d"}
Sep 10 17:48:07.631555 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:07.631383    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b8cc677b1cb1d75826920c1e1647b0b49db77c723e8889fda4fddc72f8f54e7d"
Sep 10 17:48:07.633570 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:07.633545    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6p4846"
Sep 10 17:48:07.633729 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:07.633540    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6p4846" event={"ID":"87d73d59-875d-4c30-826c-652f4e8f8459","Type":"ContainerDied","Data":"0e541880dbd8001ee2dd971a39469d177914ac2680dc945adba3fd811d3a130e"}
Sep 10 17:48:07.633729 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:07.633661    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0e541880dbd8001ee2dd971a39469d177914ac2680dc945adba3fd811d3a130e"
Sep 10 17:48:07.635885 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:07.635845    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg6kq7"
Sep 10 17:48:07.636050 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:07.635842    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg6kq7" event={"ID":"2c88a39c-e756-4cf5-baba-7830b2ae2791","Type":"ContainerDied","Data":"abc30f3525d3ce82363870c8e460e5570ea13223e3e3784597284949311c6bf3"}
Sep 10 17:48:07.636050 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:07.636019    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="abc30f3525d3ce82363870c8e460e5570ea13223e3e3784597284949311c6bf3"
Sep 10 17:48:07.638642 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:07.638610    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a46f7j" event={"ID":"789f0b5f-41c7-4def-88ad-a5bd94e823bb","Type":"ContainerDied","Data":"0a24852533dcfd8f4af46d7da3afcbe5dd8fa02aeed80f815a61b981a6e86e81"}
Sep 10 17:48:07.638806 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:07.638659    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0a24852533dcfd8f4af46d7da3afcbe5dd8fa02aeed80f815a61b981a6e86e81"
Sep 10 17:48:07.638806 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:07.638661    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a46f7j"
Sep 10 17:48:12.557545 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:12.557509    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-fjjr7"]
Sep 10 17:48:12.557921 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:12.557832    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="789f0b5f-41c7-4def-88ad-a5bd94e823bb" containerName="util"
Sep 10 17:48:12.557921 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:12.557846    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="789f0b5f-41c7-4def-88ad-a5bd94e823bb" containerName="util"
Sep 10 17:48:12.557921 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:12.557855    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87d73d59-875d-4c30-826c-652f4e8f8459" containerName="pull"
Sep 10 17:48:12.557921 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:12.557861    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="87d73d59-875d-4c30-826c-652f4e8f8459" containerName="pull"
Sep 10 17:48:12.557921 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:12.557867    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c88a39c-e756-4cf5-baba-7830b2ae2791" containerName="extract"
Sep 10 17:48:12.557921 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:12.557873    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c88a39c-e756-4cf5-baba-7830b2ae2791" containerName="extract"
Sep 10 17:48:12.557921 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:12.557883    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87f64f2b-06ea-4102-80b6-c997f675c04f" containerName="pull"
Sep 10 17:48:12.557921 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:12.557889    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="87f64f2b-06ea-4102-80b6-c997f675c04f" containerName="pull"
Sep 10 17:48:12.557921 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:12.557895    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87d73d59-875d-4c30-826c-652f4e8f8459" containerName="util"
Sep 10 17:48:12.557921 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:12.557900    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="87d73d59-875d-4c30-826c-652f4e8f8459" containerName="util"
Sep 10 17:48:12.557921 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:12.557913    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="789f0b5f-41c7-4def-88ad-a5bd94e823bb" containerName="pull"
Sep 10 17:48:12.557921 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:12.557917    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="789f0b5f-41c7-4def-88ad-a5bd94e823bb" containerName="pull"
Sep 10 17:48:12.557921 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:12.557925    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87d73d59-875d-4c30-826c-652f4e8f8459" containerName="extract"
Sep 10 17:48:12.558311 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:12.557931    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="87d73d59-875d-4c30-826c-652f4e8f8459" containerName="extract"
Sep 10 17:48:12.558311 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:12.557936    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c88a39c-e756-4cf5-baba-7830b2ae2791" containerName="util"
Sep 10 17:48:12.558311 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:12.557941    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c88a39c-e756-4cf5-baba-7830b2ae2791" containerName="util"
Sep 10 17:48:12.558311 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:12.557947    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c88a39c-e756-4cf5-baba-7830b2ae2791" containerName="pull"
Sep 10 17:48:12.558311 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:12.557952    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c88a39c-e756-4cf5-baba-7830b2ae2791" containerName="pull"
Sep 10 17:48:12.558311 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:12.557956    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87f64f2b-06ea-4102-80b6-c997f675c04f" containerName="extract"
Sep 10 17:48:12.558311 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:12.557961    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="87f64f2b-06ea-4102-80b6-c997f675c04f" containerName="extract"
Sep 10 17:48:12.558311 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:12.557968    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87f64f2b-06ea-4102-80b6-c997f675c04f" containerName="util"
Sep 10 17:48:12.558311 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:12.557973    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="87f64f2b-06ea-4102-80b6-c997f675c04f" containerName="util"
Sep 10 17:48:12.558311 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:12.557978    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="789f0b5f-41c7-4def-88ad-a5bd94e823bb" containerName="extract"
Sep 10 17:48:12.558311 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:12.557984    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="789f0b5f-41c7-4def-88ad-a5bd94e823bb" containerName="extract"
Sep 10 17:48:12.558311 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:12.558033    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="87d73d59-875d-4c30-826c-652f4e8f8459" containerName="extract"
Sep 10 17:48:12.558311 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:12.558039    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="87f64f2b-06ea-4102-80b6-c997f675c04f" containerName="extract"
Sep 10 17:48:12.558311 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:12.558046    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c88a39c-e756-4cf5-baba-7830b2ae2791" containerName="extract"
Sep 10 17:48:12.558311 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:12.558052    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="789f0b5f-41c7-4def-88ad-a5bd94e823bb" containerName="extract"
Sep 10 17:48:12.562892 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:12.562868    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-fjjr7"
Sep 10 17:48:12.565905 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:12.565878    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 10 17:48:12.567931 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:12.567909    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-pp5jg\""
Sep 10 17:48:12.568108 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:12.567982    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 10 17:48:12.571186 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:12.571158    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-fjjr7"]
Sep 10 17:48:12.654903 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:12.654861    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgsvh\" (UniqueName: \"kubernetes.io/projected/8be98485-4c35-4f18-b143-ecd241239264-kube-api-access-dgsvh\") pod \"limitador-operator-controller-manager-74495c69f8-fjjr7\" (UID: \"8be98485-4c35-4f18-b143-ecd241239264\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-fjjr7"
Sep 10 17:48:12.755516 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:12.755472    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgsvh\" (UniqueName: \"kubernetes.io/projected/8be98485-4c35-4f18-b143-ecd241239264-kube-api-access-dgsvh\") pod \"limitador-operator-controller-manager-74495c69f8-fjjr7\" (UID: \"8be98485-4c35-4f18-b143-ecd241239264\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-fjjr7"
Sep 10 17:48:12.769012 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:12.768983    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgsvh\" (UniqueName: \"kubernetes.io/projected/8be98485-4c35-4f18-b143-ecd241239264-kube-api-access-dgsvh\") pod \"limitador-operator-controller-manager-74495c69f8-fjjr7\" (UID: \"8be98485-4c35-4f18-b143-ecd241239264\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-fjjr7"
Sep 10 17:48:12.874542 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:12.874442    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-fjjr7"
Sep 10 17:48:13.156067 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:13.156041    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-fjjr7"]
Sep 10 17:48:13.158353 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:48:13.158299    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8be98485_4c35_4f18_b143_ecd241239264.slice/crio-be6755ab7b9f8d651e7b1af20797998f164835d8812fd7336e91fb48f5413c90 WatchSource:0}: Error finding container be6755ab7b9f8d651e7b1af20797998f164835d8812fd7336e91fb48f5413c90: Status 404 returned error can't find the container with id be6755ab7b9f8d651e7b1af20797998f164835d8812fd7336e91fb48f5413c90
Sep 10 17:48:13.668516 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:13.668480    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-fjjr7" event={"ID":"8be98485-4c35-4f18-b143-ecd241239264","Type":"ContainerStarted","Data":"be6755ab7b9f8d651e7b1af20797998f164835d8812fd7336e91fb48f5413c90"}
Sep 10 17:48:14.548825 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:14.548785    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-27s46"]
Sep 10 17:48:14.552898 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:14.552871    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-27s46"
Sep 10 17:48:14.557226 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:14.556503    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Sep 10 17:48:14.557226 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:14.556502    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-srzkh\""
Sep 10 17:48:14.563847 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:14.563819    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-27s46"]
Sep 10 17:48:14.571894 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:14.571864    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bs44z\" (UniqueName: \"kubernetes.io/projected/dfc3f07e-b209-4135-8a50-418754e2aa56-kube-api-access-bs44z\") pod \"dns-operator-controller-manager-7b84cd7c9c-27s46\" (UID: \"dfc3f07e-b209-4135-8a50-418754e2aa56\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-27s46"
Sep 10 17:48:14.672572 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:14.672532    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bs44z\" (UniqueName: \"kubernetes.io/projected/dfc3f07e-b209-4135-8a50-418754e2aa56-kube-api-access-bs44z\") pod \"dns-operator-controller-manager-7b84cd7c9c-27s46\" (UID: \"dfc3f07e-b209-4135-8a50-418754e2aa56\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-27s46"
Sep 10 17:48:14.683003 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:14.682970    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bs44z\" (UniqueName: \"kubernetes.io/projected/dfc3f07e-b209-4135-8a50-418754e2aa56-kube-api-access-bs44z\") pod \"dns-operator-controller-manager-7b84cd7c9c-27s46\" (UID: \"dfc3f07e-b209-4135-8a50-418754e2aa56\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-27s46"
Sep 10 17:48:14.875536 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:14.875439    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-27s46"
Sep 10 17:48:15.167990 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:15.167964    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-27s46"]
Sep 10 17:48:15.170439 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:48:15.170410    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfc3f07e_b209_4135_8a50_418754e2aa56.slice/crio-e435884427daa5be16c589d5d4ac2c80d6d859ef14cb9f7ac81b658f52c65cae WatchSource:0}: Error finding container e435884427daa5be16c589d5d4ac2c80d6d859ef14cb9f7ac81b658f52c65cae: Status 404 returned error can't find the container with id e435884427daa5be16c589d5d4ac2c80d6d859ef14cb9f7ac81b658f52c65cae
Sep 10 17:48:15.686500 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:15.686460    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-27s46" event={"ID":"dfc3f07e-b209-4135-8a50-418754e2aa56","Type":"ContainerStarted","Data":"e435884427daa5be16c589d5d4ac2c80d6d859ef14cb9f7ac81b658f52c65cae"}
Sep 10 17:48:16.696220 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:16.696137    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-fjjr7" event={"ID":"8be98485-4c35-4f18-b143-ecd241239264","Type":"ContainerStarted","Data":"85631febb2d49ab0d7c8902671fe968295b7d1753a632150935616a4cf3ffe05"}
Sep 10 17:48:16.696699 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:16.696264    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-fjjr7"
Sep 10 17:48:16.725089 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:16.725023    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-fjjr7" podStartSLOduration=1.587863657 podStartE2EDuration="4.724998429s" totalImagesPullingTime="3.137134772s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:48:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:48:16.722865737 +0000 UTC m=+432.484173797" watchObservedRunningTime="2026-09-10 17:48:16.724998429 +0000 UTC m=+432.486306472"
Sep 10 17:48:17.480575 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:17.480533    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-bddkx"]
Sep 10 17:48:17.484083 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:17.484055    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-bddkx"
Sep 10 17:48:17.489945 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:17.489910    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-phnsd\""
Sep 10 17:48:17.506304 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:17.506265    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-bddkx"]
Sep 10 17:48:17.598126 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:17.598082    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzmlh\" (UniqueName: \"kubernetes.io/projected/a44b3f30-f474-4486-949c-fc0753c6339a-kube-api-access-dzmlh\") pod \"authorino-operator-76b478bd78-bddkx\" (UID: \"a44b3f30-f474-4486-949c-fc0753c6339a\") " pod="kuadrant-system/authorino-operator-76b478bd78-bddkx"
Sep 10 17:48:17.698761 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:17.698732    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzmlh\" (UniqueName: \"kubernetes.io/projected/a44b3f30-f474-4486-949c-fc0753c6339a-kube-api-access-dzmlh\") pod \"authorino-operator-76b478bd78-bddkx\" (UID: \"a44b3f30-f474-4486-949c-fc0753c6339a\") " pod="kuadrant-system/authorino-operator-76b478bd78-bddkx"
Sep 10 17:48:17.704813 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:17.704775    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-27s46" event={"ID":"dfc3f07e-b209-4135-8a50-418754e2aa56","Type":"ContainerStarted","Data":"9b02a5d2b5310c93cc0b9225d217180d953c23a55984d9c402b67277ebc5b80a"}
Sep 10 17:48:17.705068 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:17.705045    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-27s46"
Sep 10 17:48:17.712634 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:17.712603    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzmlh\" (UniqueName: \"kubernetes.io/projected/a44b3f30-f474-4486-949c-fc0753c6339a-kube-api-access-dzmlh\") pod \"authorino-operator-76b478bd78-bddkx\" (UID: \"a44b3f30-f474-4486-949c-fc0753c6339a\") " pod="kuadrant-system/authorino-operator-76b478bd78-bddkx"
Sep 10 17:48:17.736695 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:17.736571    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-27s46" podStartSLOduration=1.712788607 podStartE2EDuration="3.736553355s" totalImagesPullingTime="2.023764748s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:48:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:48:17.734276856 +0000 UTC m=+433.495584900" watchObservedRunningTime="2026-09-10 17:48:17.736553355 +0000 UTC m=+433.497861398"
Sep 10 17:48:17.794802 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:17.794756    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-bddkx"
Sep 10 17:48:18.080345 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:18.080305    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-bddkx"]
Sep 10 17:48:18.082296 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:48:18.082261    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda44b3f30_f474_4486_949c_fc0753c6339a.slice/crio-7d5df7221511415abd808b863630e1b7e01803c1adc60b230afee817b8f06059 WatchSource:0}: Error finding container 7d5df7221511415abd808b863630e1b7e01803c1adc60b230afee817b8f06059: Status 404 returned error can't find the container with id 7d5df7221511415abd808b863630e1b7e01803c1adc60b230afee817b8f06059
Sep 10 17:48:18.711958 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:18.711923    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-bddkx" event={"ID":"a44b3f30-f474-4486-949c-fc0753c6339a","Type":"ContainerStarted","Data":"7d5df7221511415abd808b863630e1b7e01803c1adc60b230afee817b8f06059"}
Sep 10 17:48:19.718306 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:19.718204    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-bddkx" event={"ID":"a44b3f30-f474-4486-949c-fc0753c6339a","Type":"ContainerStarted","Data":"325a5bcd823f2e5bb361c5519566d0695db8c683e4ff15ebebda58e4d7c66b8d"}
Sep 10 17:48:19.718306 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:19.718266    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-76b478bd78-bddkx"
Sep 10 17:48:19.752929 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:19.752868    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-76b478bd78-bddkx" podStartSLOduration=1.416598947 podStartE2EDuration="2.752847941s" totalImagesPullingTime="1.336248994s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:48:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:48:19.751165983 +0000 UTC m=+435.512474030" watchObservedRunningTime="2026-09-10 17:48:19.752847941 +0000 UTC m=+435.514155983"
Sep 10 17:48:22.622808 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:22.622764    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-496hl"]
Sep 10 17:48:22.626413 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:22.626386    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-496hl"
Sep 10 17:48:22.630018 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:22.629990    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-gs9tl\""
Sep 10 17:48:22.658821 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:22.658775    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-496hl"]
Sep 10 17:48:22.743065 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:22.743011    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4x54\" (UniqueName: \"kubernetes.io/projected/fd3043e0-0b51-4fd4-8fd1-43037dba03b7-kube-api-access-p4x54\") pod \"kuadrant-operator-controller-manager-76f8f686bf-496hl\" (UID: \"fd3043e0-0b51-4fd4-8fd1-43037dba03b7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-496hl"
Sep 10 17:48:22.743247 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:22.743122    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fd3043e0-0b51-4fd4-8fd1-43037dba03b7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-496hl\" (UID: \"fd3043e0-0b51-4fd4-8fd1-43037dba03b7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-496hl"
Sep 10 17:48:22.844394 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:22.844344    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fd3043e0-0b51-4fd4-8fd1-43037dba03b7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-496hl\" (UID: \"fd3043e0-0b51-4fd4-8fd1-43037dba03b7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-496hl"
Sep 10 17:48:22.844603 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:22.844413    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4x54\" (UniqueName: \"kubernetes.io/projected/fd3043e0-0b51-4fd4-8fd1-43037dba03b7-kube-api-access-p4x54\") pod \"kuadrant-operator-controller-manager-76f8f686bf-496hl\" (UID: \"fd3043e0-0b51-4fd4-8fd1-43037dba03b7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-496hl"
Sep 10 17:48:22.844779 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:22.844750    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fd3043e0-0b51-4fd4-8fd1-43037dba03b7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-496hl\" (UID: \"fd3043e0-0b51-4fd4-8fd1-43037dba03b7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-496hl"
Sep 10 17:48:22.853751 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:22.853723    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4x54\" (UniqueName: \"kubernetes.io/projected/fd3043e0-0b51-4fd4-8fd1-43037dba03b7-kube-api-access-p4x54\") pod \"kuadrant-operator-controller-manager-76f8f686bf-496hl\" (UID: \"fd3043e0-0b51-4fd4-8fd1-43037dba03b7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-496hl"
Sep 10 17:48:22.936709 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:22.936592    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-496hl"
Sep 10 17:48:23.217915 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:23.217890    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-496hl"]
Sep 10 17:48:23.220107 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:48:23.220078    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd3043e0_0b51_4fd4_8fd1_43037dba03b7.slice/crio-e453e8b21cc73df70354dbd9dc95038e52aa833eaf7be1083d8a530b9d703ad3 WatchSource:0}: Error finding container e453e8b21cc73df70354dbd9dc95038e52aa833eaf7be1083d8a530b9d703ad3: Status 404 returned error can't find the container with id e453e8b21cc73df70354dbd9dc95038e52aa833eaf7be1083d8a530b9d703ad3
Sep 10 17:48:23.742309 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:23.742271    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-496hl" event={"ID":"fd3043e0-0b51-4fd4-8fd1-43037dba03b7","Type":"ContainerStarted","Data":"e453e8b21cc73df70354dbd9dc95038e52aa833eaf7be1083d8a530b9d703ad3"}
Sep 10 17:48:27.707586 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:27.707553    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-fjjr7"
Sep 10 17:48:27.765197 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:27.765148    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-496hl" event={"ID":"fd3043e0-0b51-4fd4-8fd1-43037dba03b7","Type":"ContainerStarted","Data":"5cf0382510e1c846548c7046a2bf7fca04ce9a382b5ef20c75f23771c276b6a3"}
Sep 10 17:48:27.765380 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:27.765264    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-496hl"
Sep 10 17:48:27.790658 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:27.790590    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-496hl" podStartSLOduration=2.005633367 podStartE2EDuration="5.79056578s" totalImagesPullingTime="3.784932413s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:48:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:48:27.786730623 +0000 UTC m=+443.548038665" watchObservedRunningTime="2026-09-10 17:48:27.79056578 +0000 UTC m=+443.551874097"
Sep 10 17:48:28.714286 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:28.714247    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-27s46"
Sep 10 17:48:29.833430 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:29.833390    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-4x2vt"]
Sep 10 17:48:29.837158 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:29.837124    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-4x2vt"
Sep 10 17:48:29.839783 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:29.839744    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Sep 10 17:48:29.839970 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:29.839755    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-c9gdn\""
Sep 10 17:48:29.839970 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:29.839851    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Sep 10 17:48:29.845133 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:29.845101    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-4x2vt"]
Sep 10 17:48:29.905470 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:29.905424    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7qml\" (UniqueName: \"kubernetes.io/projected/b580d504-b549-49ab-824f-368794761193-kube-api-access-n7qml\") pod \"kuadrant-console-plugin-fbdd4f445-4x2vt\" (UID: \"b580d504-b549-49ab-824f-368794761193\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-4x2vt"
Sep 10 17:48:29.905706 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:29.905509    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b580d504-b549-49ab-824f-368794761193-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-4x2vt\" (UID: \"b580d504-b549-49ab-824f-368794761193\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-4x2vt"
Sep 10 17:48:29.905706 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:29.905579    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/b580d504-b549-49ab-824f-368794761193-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-4x2vt\" (UID: \"b580d504-b549-49ab-824f-368794761193\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-4x2vt"
Sep 10 17:48:30.006375 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:30.006290    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/b580d504-b549-49ab-824f-368794761193-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-4x2vt\" (UID: \"b580d504-b549-49ab-824f-368794761193\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-4x2vt"
Sep 10 17:48:30.006566 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:30.006407    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7qml\" (UniqueName: \"kubernetes.io/projected/b580d504-b549-49ab-824f-368794761193-kube-api-access-n7qml\") pod \"kuadrant-console-plugin-fbdd4f445-4x2vt\" (UID: \"b580d504-b549-49ab-824f-368794761193\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-4x2vt"
Sep 10 17:48:30.006566 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:48:30.006457    2568 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Sep 10 17:48:30.006566 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:30.006461    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b580d504-b549-49ab-824f-368794761193-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-4x2vt\" (UID: \"b580d504-b549-49ab-824f-368794761193\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-4x2vt"
Sep 10 17:48:30.006566 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:48:30.006525    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b580d504-b549-49ab-824f-368794761193-plugin-serving-cert podName:b580d504-b549-49ab-824f-368794761193 nodeName:}" failed. No retries permitted until 2026-09-10 17:48:30.506503087 +0000 UTC m=+446.267811119 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/b580d504-b549-49ab-824f-368794761193-plugin-serving-cert") pod "kuadrant-console-plugin-fbdd4f445-4x2vt" (UID: "b580d504-b549-49ab-824f-368794761193") : secret "plugin-serving-cert" not found
Sep 10 17:48:30.007070 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:30.007049    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b580d504-b549-49ab-824f-368794761193-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-4x2vt\" (UID: \"b580d504-b549-49ab-824f-368794761193\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-4x2vt"
Sep 10 17:48:30.021317 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:30.021287    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7qml\" (UniqueName: \"kubernetes.io/projected/b580d504-b549-49ab-824f-368794761193-kube-api-access-n7qml\") pod \"kuadrant-console-plugin-fbdd4f445-4x2vt\" (UID: \"b580d504-b549-49ab-824f-368794761193\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-4x2vt"
Sep 10 17:48:30.510943 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:30.510898    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/b580d504-b549-49ab-824f-368794761193-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-4x2vt\" (UID: \"b580d504-b549-49ab-824f-368794761193\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-4x2vt"
Sep 10 17:48:30.513602 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:30.513571    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/b580d504-b549-49ab-824f-368794761193-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-4x2vt\" (UID: \"b580d504-b549-49ab-824f-368794761193\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-4x2vt"
Sep 10 17:48:30.725116 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:30.725075    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-76b478bd78-bddkx"
Sep 10 17:48:30.749916 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:30.749882    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-4x2vt"
Sep 10 17:48:31.031636 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:31.031606    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-4x2vt"]
Sep 10 17:48:31.033569 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:48:31.033534    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb580d504_b549_49ab_824f_368794761193.slice/crio-1f09a9acea9313990149788711a1a361bf79aa4169f5b650696ea24bbd413b67 WatchSource:0}: Error finding container 1f09a9acea9313990149788711a1a361bf79aa4169f5b650696ea24bbd413b67: Status 404 returned error can't find the container with id 1f09a9acea9313990149788711a1a361bf79aa4169f5b650696ea24bbd413b67
Sep 10 17:48:31.790605 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:31.790568    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-4x2vt" event={"ID":"b580d504-b549-49ab-824f-368794761193","Type":"ContainerStarted","Data":"1f09a9acea9313990149788711a1a361bf79aa4169f5b650696ea24bbd413b67"}
Sep 10 17:48:36.827620 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:36.827583    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-4x2vt" event={"ID":"b580d504-b549-49ab-824f-368794761193","Type":"ContainerStarted","Data":"2daad9ea719b67f4d97e02a23c46bb7ef7b1fd0fa8f5acb2680b87ad8b7cb28b"}
Sep 10 17:48:38.774985 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:38.774954    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-496hl"
Sep 10 17:48:38.801401 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:38.801316    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-4x2vt" podStartSLOduration=4.947824014 podStartE2EDuration="9.801291779s" totalImagesPullingTime="4.853467765s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:48:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:48:36.870421557 +0000 UTC m=+452.631729599" watchObservedRunningTime="2026-09-10 17:48:38.801291779 +0000 UTC m=+454.562599824"
Sep 10 17:48:41.019887 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:41.019850    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-496hl"]
Sep 10 17:48:41.020308 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:41.020059    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-496hl" podUID="fd3043e0-0b51-4fd4-8fd1-43037dba03b7" containerName="manager" containerID="cri-o://5cf0382510e1c846548c7046a2bf7fca04ce9a382b5ef20c75f23771c276b6a3" gracePeriod=2
Sep 10 17:48:41.027101 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:41.027057    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-496hl"]
Sep 10 17:48:41.042518 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:41.042479    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-fjjr7"]
Sep 10 17:48:41.043406 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:41.043369    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-fjjr7" podUID="8be98485-4c35-4f18-b143-ecd241239264" containerName="manager" containerID="cri-o://85631febb2d49ab0d7c8902671fe968295b7d1753a632150935616a4cf3ffe05" gracePeriod=2
Sep 10 17:48:41.046783 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:48:41.046734    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-496hl\" is forbidden: User \"system:node:ip-10-0-136-161.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-161.ec2.internal' and this object" podUID="fd3043e0-0b51-4fd4-8fd1-43037dba03b7" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-496hl"
Sep 10 17:48:41.051031 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:41.050984    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4w6dh"]
Sep 10 17:48:41.051499 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:41.051474    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd3043e0-0b51-4fd4-8fd1-43037dba03b7" containerName="manager"
Sep 10 17:48:41.051625 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:41.051501    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd3043e0-0b51-4fd4-8fd1-43037dba03b7" containerName="manager"
Sep 10 17:48:41.051625 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:41.051610    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd3043e0-0b51-4fd4-8fd1-43037dba03b7" containerName="manager"
Sep 10 17:48:41.053899 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:41.053872    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-fjjr7"]
Sep 10 17:48:41.054104 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:41.053984    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4w6dh"
Sep 10 17:48:41.056678 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:48:41.056637    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-fjjr7\" is forbidden: User \"system:node:ip-10-0-136-161.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-161.ec2.internal' and this object" podUID="8be98485-4c35-4f18-b143-ecd241239264" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-fjjr7"
Sep 10 17:48:41.068695 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:41.068656    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-rqdc8"]
Sep 10 17:48:41.069167 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:41.069142    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8be98485-4c35-4f18-b143-ecd241239264" containerName="manager"
Sep 10 17:48:41.069352 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:41.069313    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="8be98485-4c35-4f18-b143-ecd241239264" containerName="manager"
Sep 10 17:48:41.069508 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:41.069491    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="8be98485-4c35-4f18-b143-ecd241239264" containerName="manager"
Sep 10 17:48:41.071818 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:41.071783    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-rqdc8"
Sep 10 17:48:41.071949 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:41.071853    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4w6dh"]
Sep 10 17:48:41.082932 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:48:41.082872    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-496hl\" is forbidden: User \"system:node:ip-10-0-136-161.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-161.ec2.internal' and this object" podUID="fd3043e0-0b51-4fd4-8fd1-43037dba03b7" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-496hl"
Sep 10 17:48:41.083666 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:41.083634    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-rqdc8"]
Sep 10 17:48:41.113774 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:48:41.113733    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-496hl\" is forbidden: User \"system:node:ip-10-0-136-161.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-161.ec2.internal' and this object" podUID="fd3043e0-0b51-4fd4-8fd1-43037dba03b7" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-496hl"
Sep 10 17:48:41.115868 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:48:41.115829    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-fjjr7\" is forbidden: User \"system:node:ip-10-0-136-161.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-161.ec2.internal' and this object" podUID="8be98485-4c35-4f18-b143-ecd241239264" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-fjjr7"
Sep 10 17:48:41.205915 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:41.205875    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwz4q\" (UniqueName: \"kubernetes.io/projected/1c6b43c8-ded5-4f31-ba6d-26403175fbfb-kube-api-access-dwz4q\") pod \"limitador-operator-controller-manager-74495c69f8-rqdc8\" (UID: \"1c6b43c8-ded5-4f31-ba6d-26403175fbfb\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-rqdc8"
Sep 10 17:48:41.206095 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:41.205939    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a4eb6abb-0e41-44ec-b82f-895c8a3fd30b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-4w6dh\" (UID: \"a4eb6abb-0e41-44ec-b82f-895c8a3fd30b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4w6dh"
Sep 10 17:48:41.206095 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:41.206062    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tsm9r\" (UniqueName: \"kubernetes.io/projected/a4eb6abb-0e41-44ec-b82f-895c8a3fd30b-kube-api-access-tsm9r\") pod \"kuadrant-operator-controller-manager-76f8f686bf-4w6dh\" (UID: \"a4eb6abb-0e41-44ec-b82f-895c8a3fd30b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4w6dh"
Sep 10 17:48:41.302814 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:41.302789    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-496hl"
Sep 10 17:48:41.305536 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:48:41.305498    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-496hl\" is forbidden: User \"system:node:ip-10-0-136-161.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-161.ec2.internal' and this object" podUID="fd3043e0-0b51-4fd4-8fd1-43037dba03b7" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-496hl"
Sep 10 17:48:41.305726 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:41.305709    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-fjjr7"
Sep 10 17:48:41.306802 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:41.306779    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tsm9r\" (UniqueName: \"kubernetes.io/projected/a4eb6abb-0e41-44ec-b82f-895c8a3fd30b-kube-api-access-tsm9r\") pod \"kuadrant-operator-controller-manager-76f8f686bf-4w6dh\" (UID: \"a4eb6abb-0e41-44ec-b82f-895c8a3fd30b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4w6dh"
Sep 10 17:48:41.306945 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:41.306815    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwz4q\" (UniqueName: \"kubernetes.io/projected/1c6b43c8-ded5-4f31-ba6d-26403175fbfb-kube-api-access-dwz4q\") pod \"limitador-operator-controller-manager-74495c69f8-rqdc8\" (UID: \"1c6b43c8-ded5-4f31-ba6d-26403175fbfb\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-rqdc8"
Sep 10 17:48:41.306945 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:41.306859    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a4eb6abb-0e41-44ec-b82f-895c8a3fd30b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-4w6dh\" (UID: \"a4eb6abb-0e41-44ec-b82f-895c8a3fd30b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4w6dh"
Sep 10 17:48:41.307241 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:41.307224    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a4eb6abb-0e41-44ec-b82f-895c8a3fd30b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-4w6dh\" (UID: \"a4eb6abb-0e41-44ec-b82f-895c8a3fd30b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4w6dh"
Sep 10 17:48:41.308013 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:48:41.307993    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-fjjr7\" is forbidden: User \"system:node:ip-10-0-136-161.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-161.ec2.internal' and this object" podUID="8be98485-4c35-4f18-b143-ecd241239264" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-fjjr7"
Sep 10 17:48:41.310124 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:48:41.310102    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-496hl\" is forbidden: User \"system:node:ip-10-0-136-161.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-161.ec2.internal' and this object" podUID="fd3043e0-0b51-4fd4-8fd1-43037dba03b7" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-496hl"
Sep 10 17:48:41.312474 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:48:41.312451    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-fjjr7\" is forbidden: User \"system:node:ip-10-0-136-161.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-161.ec2.internal' and this object" podUID="8be98485-4c35-4f18-b143-ecd241239264" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-fjjr7"
Sep 10 17:48:41.318360 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:41.318310    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tsm9r\" (UniqueName: \"kubernetes.io/projected/a4eb6abb-0e41-44ec-b82f-895c8a3fd30b-kube-api-access-tsm9r\") pod \"kuadrant-operator-controller-manager-76f8f686bf-4w6dh\" (UID: \"a4eb6abb-0e41-44ec-b82f-895c8a3fd30b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4w6dh"
Sep 10 17:48:41.318461 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:41.318406    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwz4q\" (UniqueName: \"kubernetes.io/projected/1c6b43c8-ded5-4f31-ba6d-26403175fbfb-kube-api-access-dwz4q\") pod \"limitador-operator-controller-manager-74495c69f8-rqdc8\" (UID: \"1c6b43c8-ded5-4f31-ba6d-26403175fbfb\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-rqdc8"
Sep 10 17:48:41.407397 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:41.407357    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dgsvh\" (UniqueName: \"kubernetes.io/projected/8be98485-4c35-4f18-b143-ecd241239264-kube-api-access-dgsvh\") pod \"8be98485-4c35-4f18-b143-ecd241239264\" (UID: \"8be98485-4c35-4f18-b143-ecd241239264\") "
Sep 10 17:48:41.407397 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:41.407403    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fd3043e0-0b51-4fd4-8fd1-43037dba03b7-extensions-socket-volume\") pod \"fd3043e0-0b51-4fd4-8fd1-43037dba03b7\" (UID: \"fd3043e0-0b51-4fd4-8fd1-43037dba03b7\") "
Sep 10 17:48:41.407575 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:41.407447    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p4x54\" (UniqueName: \"kubernetes.io/projected/fd3043e0-0b51-4fd4-8fd1-43037dba03b7-kube-api-access-p4x54\") pod \"fd3043e0-0b51-4fd4-8fd1-43037dba03b7\" (UID: \"fd3043e0-0b51-4fd4-8fd1-43037dba03b7\") "
Sep 10 17:48:41.407947 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:41.407919    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd3043e0-0b51-4fd4-8fd1-43037dba03b7-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "fd3043e0-0b51-4fd4-8fd1-43037dba03b7" (UID: "fd3043e0-0b51-4fd4-8fd1-43037dba03b7"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:48:41.409667 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:41.409637    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8be98485-4c35-4f18-b143-ecd241239264-kube-api-access-dgsvh" (OuterVolumeSpecName: "kube-api-access-dgsvh") pod "8be98485-4c35-4f18-b143-ecd241239264" (UID: "8be98485-4c35-4f18-b143-ecd241239264"). InnerVolumeSpecName "kube-api-access-dgsvh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:48:41.409762 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:41.409693    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd3043e0-0b51-4fd4-8fd1-43037dba03b7-kube-api-access-p4x54" (OuterVolumeSpecName: "kube-api-access-p4x54") pod "fd3043e0-0b51-4fd4-8fd1-43037dba03b7" (UID: "fd3043e0-0b51-4fd4-8fd1-43037dba03b7"). InnerVolumeSpecName "kube-api-access-p4x54". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:48:41.454081 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:41.454041    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4w6dh"
Sep 10 17:48:41.461973 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:41.461938    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-rqdc8"
Sep 10 17:48:41.509184 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:41.509145    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dgsvh\" (UniqueName: \"kubernetes.io/projected/8be98485-4c35-4f18-b143-ecd241239264-kube-api-access-dgsvh\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:48:41.509184 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:41.509183    2568 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fd3043e0-0b51-4fd4-8fd1-43037dba03b7-extensions-socket-volume\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:48:41.509464 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:41.509220    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p4x54\" (UniqueName: \"kubernetes.io/projected/fd3043e0-0b51-4fd4-8fd1-43037dba03b7-kube-api-access-p4x54\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:48:41.766099 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:41.766065    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4w6dh"]
Sep 10 17:48:41.767798 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:48:41.767743    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4eb6abb_0e41_44ec_b82f_895c8a3fd30b.slice/crio-7bbae52336520f2a8f151b6aac622d6c5fe5addee92828491b2c210b7c6fad54 WatchSource:0}: Error finding container 7bbae52336520f2a8f151b6aac622d6c5fe5addee92828491b2c210b7c6fad54: Status 404 returned error can't find the container with id 7bbae52336520f2a8f151b6aac622d6c5fe5addee92828491b2c210b7c6fad54
Sep 10 17:48:41.776791 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:41.776688    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-rqdc8"]
Sep 10 17:48:41.779270 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:48:41.779233    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c6b43c8_ded5_4f31_ba6d_26403175fbfb.slice/crio-49568ee609e113288aa088c644f23af8da32df0a3ddd08309a3925e761ee0d9a WatchSource:0}: Error finding container 49568ee609e113288aa088c644f23af8da32df0a3ddd08309a3925e761ee0d9a: Status 404 returned error can't find the container with id 49568ee609e113288aa088c644f23af8da32df0a3ddd08309a3925e761ee0d9a
Sep 10 17:48:41.859110 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:41.859076    2568 generic.go:356] "Generic (PLEG): container finished" podID="fd3043e0-0b51-4fd4-8fd1-43037dba03b7" containerID="5cf0382510e1c846548c7046a2bf7fca04ce9a382b5ef20c75f23771c276b6a3" exitCode=0
Sep 10 17:48:41.859308 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:41.859119    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-496hl"
Sep 10 17:48:41.859308 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:41.859169    2568 scope.go:117] "RemoveContainer" containerID="5cf0382510e1c846548c7046a2bf7fca04ce9a382b5ef20c75f23771c276b6a3"
Sep 10 17:48:41.861006 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:41.860980    2568 generic.go:356] "Generic (PLEG): container finished" podID="8be98485-4c35-4f18-b143-ecd241239264" containerID="85631febb2d49ab0d7c8902671fe968295b7d1753a632150935616a4cf3ffe05" exitCode=0
Sep 10 17:48:41.861123 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:41.861028    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-fjjr7"
Sep 10 17:48:41.861585 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:48:41.861555    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-496hl\" is forbidden: User \"system:node:ip-10-0-136-161.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-161.ec2.internal' and this object" podUID="fd3043e0-0b51-4fd4-8fd1-43037dba03b7" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-496hl"
Sep 10 17:48:41.863647 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:41.863527    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4w6dh" event={"ID":"a4eb6abb-0e41-44ec-b82f-895c8a3fd30b","Type":"ContainerStarted","Data":"ec3fcefdf5f8fb8e74b00a17e86863f43cc185b1b6edf38cc7e0cf53163dcbc1"}
Sep 10 17:48:41.863647 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:41.863593    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4w6dh" event={"ID":"a4eb6abb-0e41-44ec-b82f-895c8a3fd30b","Type":"ContainerStarted","Data":"7bbae52336520f2a8f151b6aac622d6c5fe5addee92828491b2c210b7c6fad54"}
Sep 10 17:48:41.863647 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:41.863625    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4w6dh"
Sep 10 17:48:41.863892 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:48:41.863733    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-fjjr7\" is forbidden: User \"system:node:ip-10-0-136-161.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-161.ec2.internal' and this object" podUID="8be98485-4c35-4f18-b143-ecd241239264" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-fjjr7"
Sep 10 17:48:41.865778 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:41.865740    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-rqdc8" event={"ID":"1c6b43c8-ded5-4f31-ba6d-26403175fbfb","Type":"ContainerStarted","Data":"1d7843bd8439815cb87ae7dffe7935b19c485458bd9219d51b633f3389b63d86"}
Sep 10 17:48:41.865896 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:41.865798    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-rqdc8" event={"ID":"1c6b43c8-ded5-4f31-ba6d-26403175fbfb","Type":"ContainerStarted","Data":"49568ee609e113288aa088c644f23af8da32df0a3ddd08309a3925e761ee0d9a"}
Sep 10 17:48:41.865896 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:41.865830    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-rqdc8"
Sep 10 17:48:41.866118 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:48:41.866073    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-496hl\" is forbidden: User \"system:node:ip-10-0-136-161.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-161.ec2.internal' and this object" podUID="fd3043e0-0b51-4fd4-8fd1-43037dba03b7" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-496hl"
Sep 10 17:48:41.868387 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:48:41.868350    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-fjjr7\" is forbidden: User \"system:node:ip-10-0-136-161.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-161.ec2.internal' and this object" podUID="8be98485-4c35-4f18-b143-ecd241239264" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-fjjr7"
Sep 10 17:48:41.870106 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:41.870089    2568 scope.go:117] "RemoveContainer" containerID="5cf0382510e1c846548c7046a2bf7fca04ce9a382b5ef20c75f23771c276b6a3"
Sep 10 17:48:41.870511 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:48:41.870487    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5cf0382510e1c846548c7046a2bf7fca04ce9a382b5ef20c75f23771c276b6a3\": container with ID starting with 5cf0382510e1c846548c7046a2bf7fca04ce9a382b5ef20c75f23771c276b6a3 not found: ID does not exist" containerID="5cf0382510e1c846548c7046a2bf7fca04ce9a382b5ef20c75f23771c276b6a3"
Sep 10 17:48:41.870619 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:41.870521    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5cf0382510e1c846548c7046a2bf7fca04ce9a382b5ef20c75f23771c276b6a3"} err="failed to get container status \"5cf0382510e1c846548c7046a2bf7fca04ce9a382b5ef20c75f23771c276b6a3\": rpc error: code = NotFound desc = could not find container \"5cf0382510e1c846548c7046a2bf7fca04ce9a382b5ef20c75f23771c276b6a3\": container with ID starting with 5cf0382510e1c846548c7046a2bf7fca04ce9a382b5ef20c75f23771c276b6a3 not found: ID does not exist"
Sep 10 17:48:41.870619 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:41.870545    2568 scope.go:117] "RemoveContainer" containerID="85631febb2d49ab0d7c8902671fe968295b7d1753a632150935616a4cf3ffe05"
Sep 10 17:48:41.879420 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:41.879393    2568 scope.go:117] "RemoveContainer" containerID="85631febb2d49ab0d7c8902671fe968295b7d1753a632150935616a4cf3ffe05"
Sep 10 17:48:41.879828 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:48:41.879769    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85631febb2d49ab0d7c8902671fe968295b7d1753a632150935616a4cf3ffe05\": container with ID starting with 85631febb2d49ab0d7c8902671fe968295b7d1753a632150935616a4cf3ffe05 not found: ID does not exist" containerID="85631febb2d49ab0d7c8902671fe968295b7d1753a632150935616a4cf3ffe05"
Sep 10 17:48:41.879888 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:41.879837    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85631febb2d49ab0d7c8902671fe968295b7d1753a632150935616a4cf3ffe05"} err="failed to get container status \"85631febb2d49ab0d7c8902671fe968295b7d1753a632150935616a4cf3ffe05\": rpc error: code = NotFound desc = could not find container \"85631febb2d49ab0d7c8902671fe968295b7d1753a632150935616a4cf3ffe05\": container with ID starting with 85631febb2d49ab0d7c8902671fe968295b7d1753a632150935616a4cf3ffe05 not found: ID does not exist"
Sep 10 17:48:41.895620 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:41.895561    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4w6dh" podStartSLOduration=0.895541328 podStartE2EDuration="895.541328ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:48:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:48:41.89326236 +0000 UTC m=+457.654570431" watchObservedRunningTime="2026-09-10 17:48:41.895541328 +0000 UTC m=+457.656849371"
Sep 10 17:48:41.919617 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:41.919547    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-rqdc8" podStartSLOduration=0.919525916 podStartE2EDuration="919.525916ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:48:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:48:41.918574031 +0000 UTC m=+457.679882076" watchObservedRunningTime="2026-09-10 17:48:41.919525916 +0000 UTC m=+457.680833960"
Sep 10 17:48:41.920756 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:48:41.920707    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-496hl\" is forbidden: User \"system:node:ip-10-0-136-161.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-161.ec2.internal' and this object" podUID="fd3043e0-0b51-4fd4-8fd1-43037dba03b7" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-496hl"
Sep 10 17:48:41.922815 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:48:41.922780    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-fjjr7\" is forbidden: User \"system:node:ip-10-0-136-161.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-161.ec2.internal' and this object" podUID="8be98485-4c35-4f18-b143-ecd241239264" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-fjjr7"
Sep 10 17:48:42.775933 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:42.775890    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8be98485-4c35-4f18-b143-ecd241239264" path="/var/lib/kubelet/pods/8be98485-4c35-4f18-b143-ecd241239264/volumes"
Sep 10 17:48:42.776363 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:42.776263    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd3043e0-0b51-4fd4-8fd1-43037dba03b7" path="/var/lib/kubelet/pods/fd3043e0-0b51-4fd4-8fd1-43037dba03b7/volumes"
Sep 10 17:48:52.875166 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:52.875126    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4w6dh"
Sep 10 17:48:52.875738 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:52.875558    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-rqdc8"
Sep 10 17:48:56.131253 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:56.131202    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4w6dh"]
Sep 10 17:48:56.131774 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:56.131489    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4w6dh" podUID="a4eb6abb-0e41-44ec-b82f-895c8a3fd30b" containerName="manager" containerID="cri-o://ec3fcefdf5f8fb8e74b00a17e86863f43cc185b1b6edf38cc7e0cf53163dcbc1" gracePeriod=10
Sep 10 17:48:56.389818 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:56.389750    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4w6dh"
Sep 10 17:48:56.410703 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:56.410661    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-wqxjz"]
Sep 10 17:48:56.411208 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:56.411178    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4eb6abb-0e41-44ec-b82f-895c8a3fd30b" containerName="manager"
Sep 10 17:48:56.411208 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:56.411207    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4eb6abb-0e41-44ec-b82f-895c8a3fd30b" containerName="manager"
Sep 10 17:48:56.411460 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:56.411373    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4eb6abb-0e41-44ec-b82f-895c8a3fd30b" containerName="manager"
Sep 10 17:48:56.414368 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:56.414347    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-wqxjz"
Sep 10 17:48:56.430829 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:56.430795    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-wqxjz"]
Sep 10 17:48:56.548095 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:56.548053    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a4eb6abb-0e41-44ec-b82f-895c8a3fd30b-extensions-socket-volume\") pod \"a4eb6abb-0e41-44ec-b82f-895c8a3fd30b\" (UID: \"a4eb6abb-0e41-44ec-b82f-895c8a3fd30b\") "
Sep 10 17:48:56.548095 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:56.548108    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tsm9r\" (UniqueName: \"kubernetes.io/projected/a4eb6abb-0e41-44ec-b82f-895c8a3fd30b-kube-api-access-tsm9r\") pod \"a4eb6abb-0e41-44ec-b82f-895c8a3fd30b\" (UID: \"a4eb6abb-0e41-44ec-b82f-895c8a3fd30b\") "
Sep 10 17:48:56.548386 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:56.548258    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmqq4\" (UniqueName: \"kubernetes.io/projected/22d7835f-6d49-4c74-a74b-12d29c2a63ef-kube-api-access-tmqq4\") pod \"kuadrant-operator-controller-manager-5769f99d9f-wqxjz\" (UID: \"22d7835f-6d49-4c74-a74b-12d29c2a63ef\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-wqxjz"
Sep 10 17:48:56.548386 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:56.548291    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/22d7835f-6d49-4c74-a74b-12d29c2a63ef-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-wqxjz\" (UID: \"22d7835f-6d49-4c74-a74b-12d29c2a63ef\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-wqxjz"
Sep 10 17:48:56.548514 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:56.548482    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4eb6abb-0e41-44ec-b82f-895c8a3fd30b-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "a4eb6abb-0e41-44ec-b82f-895c8a3fd30b" (UID: "a4eb6abb-0e41-44ec-b82f-895c8a3fd30b"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:48:56.550346 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:56.550295    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4eb6abb-0e41-44ec-b82f-895c8a3fd30b-kube-api-access-tsm9r" (OuterVolumeSpecName: "kube-api-access-tsm9r") pod "a4eb6abb-0e41-44ec-b82f-895c8a3fd30b" (UID: "a4eb6abb-0e41-44ec-b82f-895c8a3fd30b"). InnerVolumeSpecName "kube-api-access-tsm9r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:48:56.648856 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:56.648741    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmqq4\" (UniqueName: \"kubernetes.io/projected/22d7835f-6d49-4c74-a74b-12d29c2a63ef-kube-api-access-tmqq4\") pod \"kuadrant-operator-controller-manager-5769f99d9f-wqxjz\" (UID: \"22d7835f-6d49-4c74-a74b-12d29c2a63ef\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-wqxjz"
Sep 10 17:48:56.648856 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:56.648799    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/22d7835f-6d49-4c74-a74b-12d29c2a63ef-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-wqxjz\" (UID: \"22d7835f-6d49-4c74-a74b-12d29c2a63ef\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-wqxjz"
Sep 10 17:48:56.648856 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:56.648847    2568 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a4eb6abb-0e41-44ec-b82f-895c8a3fd30b-extensions-socket-volume\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:48:56.648856 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:56.648858    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tsm9r\" (UniqueName: \"kubernetes.io/projected/a4eb6abb-0e41-44ec-b82f-895c8a3fd30b-kube-api-access-tsm9r\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:48:56.649195 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:56.649177    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/22d7835f-6d49-4c74-a74b-12d29c2a63ef-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-wqxjz\" (UID: \"22d7835f-6d49-4c74-a74b-12d29c2a63ef\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-wqxjz"
Sep 10 17:48:56.658493 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:56.658453    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmqq4\" (UniqueName: \"kubernetes.io/projected/22d7835f-6d49-4c74-a74b-12d29c2a63ef-kube-api-access-tmqq4\") pod \"kuadrant-operator-controller-manager-5769f99d9f-wqxjz\" (UID: \"22d7835f-6d49-4c74-a74b-12d29c2a63ef\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-wqxjz"
Sep 10 17:48:56.725965 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:56.725904    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-wqxjz"
Sep 10 17:48:56.947461 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:56.947363    2568 generic.go:356] "Generic (PLEG): container finished" podID="a4eb6abb-0e41-44ec-b82f-895c8a3fd30b" containerID="ec3fcefdf5f8fb8e74b00a17e86863f43cc185b1b6edf38cc7e0cf53163dcbc1" exitCode=0
Sep 10 17:48:56.947461 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:56.947407    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4w6dh"
Sep 10 17:48:56.947461 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:56.947448    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4w6dh" event={"ID":"a4eb6abb-0e41-44ec-b82f-895c8a3fd30b","Type":"ContainerDied","Data":"ec3fcefdf5f8fb8e74b00a17e86863f43cc185b1b6edf38cc7e0cf53163dcbc1"}
Sep 10 17:48:56.947722 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:56.947504    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4w6dh" event={"ID":"a4eb6abb-0e41-44ec-b82f-895c8a3fd30b","Type":"ContainerDied","Data":"7bbae52336520f2a8f151b6aac622d6c5fe5addee92828491b2c210b7c6fad54"}
Sep 10 17:48:56.947722 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:56.947527    2568 scope.go:117] "RemoveContainer" containerID="ec3fcefdf5f8fb8e74b00a17e86863f43cc185b1b6edf38cc7e0cf53163dcbc1"
Sep 10 17:48:56.957106 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:56.957084    2568 scope.go:117] "RemoveContainer" containerID="ec3fcefdf5f8fb8e74b00a17e86863f43cc185b1b6edf38cc7e0cf53163dcbc1"
Sep 10 17:48:56.957549 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:48:56.957524    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec3fcefdf5f8fb8e74b00a17e86863f43cc185b1b6edf38cc7e0cf53163dcbc1\": container with ID starting with ec3fcefdf5f8fb8e74b00a17e86863f43cc185b1b6edf38cc7e0cf53163dcbc1 not found: ID does not exist" containerID="ec3fcefdf5f8fb8e74b00a17e86863f43cc185b1b6edf38cc7e0cf53163dcbc1"
Sep 10 17:48:56.957637 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:56.957562    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec3fcefdf5f8fb8e74b00a17e86863f43cc185b1b6edf38cc7e0cf53163dcbc1"} err="failed to get container status \"ec3fcefdf5f8fb8e74b00a17e86863f43cc185b1b6edf38cc7e0cf53163dcbc1\": rpc error: code = NotFound desc = could not find container \"ec3fcefdf5f8fb8e74b00a17e86863f43cc185b1b6edf38cc7e0cf53163dcbc1\": container with ID starting with ec3fcefdf5f8fb8e74b00a17e86863f43cc185b1b6edf38cc7e0cf53163dcbc1 not found: ID does not exist"
Sep 10 17:48:56.971418 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:56.971381    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4w6dh"]
Sep 10 17:48:56.982904 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:56.982871    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4w6dh"]
Sep 10 17:48:57.016651 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:57.016618    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-wqxjz"]
Sep 10 17:48:57.020016 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:48:57.019989    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22d7835f_6d49_4c74_a74b_12d29c2a63ef.slice/crio-769143c0da1bdd3ad7197890ddd3436b047d073354f79d6372e431e0510a191e WatchSource:0}: Error finding container 769143c0da1bdd3ad7197890ddd3436b047d073354f79d6372e431e0510a191e: Status 404 returned error can't find the container with id 769143c0da1bdd3ad7197890ddd3436b047d073354f79d6372e431e0510a191e
Sep 10 17:48:57.954278 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:57.954240    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-wqxjz" event={"ID":"22d7835f-6d49-4c74-a74b-12d29c2a63ef","Type":"ContainerStarted","Data":"43e77ab706e3e2c5ae926111441af9b91eee0340bada2a205b954c45c8fb469c"}
Sep 10 17:48:57.954765 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:57.954303    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-wqxjz" event={"ID":"22d7835f-6d49-4c74-a74b-12d29c2a63ef","Type":"ContainerStarted","Data":"769143c0da1bdd3ad7197890ddd3436b047d073354f79d6372e431e0510a191e"}
Sep 10 17:48:57.954765 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:57.954432    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-wqxjz"
Sep 10 17:48:57.978660 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:57.978607    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-wqxjz" podStartSLOduration=1.9785910549999999 podStartE2EDuration="1.978591055s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:48:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:48:57.978458722 +0000 UTC m=+473.739766766" watchObservedRunningTime="2026-09-10 17:48:57.978591055 +0000 UTC m=+473.739899098"
Sep 10 17:48:58.770289 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:48:58.770244    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a4eb6abb-0e41-44ec-b82f-895c8a3fd30b" path="/var/lib/kubelet/pods/a4eb6abb-0e41-44ec-b82f-895c8a3fd30b/volumes"
Sep 10 17:49:08.963230 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:08.963197    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-wqxjz"
Sep 10 17:49:27.755424 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:27.755376    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-fl6zw"]
Sep 10 17:49:27.780387 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:27.780355    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-fl6zw"]
Sep 10 17:49:27.780550 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:27.780435    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-fl6zw"
Sep 10 17:49:27.783197 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:27.783169    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 10 17:49:27.851201 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:27.851166    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-fl6zw"]
Sep 10 17:49:27.912075 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:27.912029    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d6526804-c800-443e-befe-a18e38228ca3-config-file\") pod \"limitador-limitador-8588749977-fl6zw\" (UID: \"d6526804-c800-443e-befe-a18e38228ca3\") " pod="kuadrant-system/limitador-limitador-8588749977-fl6zw"
Sep 10 17:49:27.912075 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:27.912077    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s46z6\" (UniqueName: \"kubernetes.io/projected/d6526804-c800-443e-befe-a18e38228ca3-kube-api-access-s46z6\") pod \"limitador-limitador-8588749977-fl6zw\" (UID: \"d6526804-c800-443e-befe-a18e38228ca3\") " pod="kuadrant-system/limitador-limitador-8588749977-fl6zw"
Sep 10 17:49:28.013251 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:28.013156    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d6526804-c800-443e-befe-a18e38228ca3-config-file\") pod \"limitador-limitador-8588749977-fl6zw\" (UID: \"d6526804-c800-443e-befe-a18e38228ca3\") " pod="kuadrant-system/limitador-limitador-8588749977-fl6zw"
Sep 10 17:49:28.013251 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:28.013208    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s46z6\" (UniqueName: \"kubernetes.io/projected/d6526804-c800-443e-befe-a18e38228ca3-kube-api-access-s46z6\") pod \"limitador-limitador-8588749977-fl6zw\" (UID: \"d6526804-c800-443e-befe-a18e38228ca3\") " pod="kuadrant-system/limitador-limitador-8588749977-fl6zw"
Sep 10 17:49:28.013834 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:28.013809    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d6526804-c800-443e-befe-a18e38228ca3-config-file\") pod \"limitador-limitador-8588749977-fl6zw\" (UID: \"d6526804-c800-443e-befe-a18e38228ca3\") " pod="kuadrant-system/limitador-limitador-8588749977-fl6zw"
Sep 10 17:49:28.023301 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:28.023267    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s46z6\" (UniqueName: \"kubernetes.io/projected/d6526804-c800-443e-befe-a18e38228ca3-kube-api-access-s46z6\") pod \"limitador-limitador-8588749977-fl6zw\" (UID: \"d6526804-c800-443e-befe-a18e38228ca3\") " pod="kuadrant-system/limitador-limitador-8588749977-fl6zw"
Sep 10 17:49:28.090443 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:28.090401    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-fl6zw"
Sep 10 17:49:28.374279 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:28.374249    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-fl6zw"]
Sep 10 17:49:28.376569 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:49:28.376529    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6526804_c800_443e_befe_a18e38228ca3.slice/crio-a6784b514398ed1bf8107554f0b0e2600e0e82d3784be5ce1244abc6cfe2dfb5 WatchSource:0}: Error finding container a6784b514398ed1bf8107554f0b0e2600e0e82d3784be5ce1244abc6cfe2dfb5: Status 404 returned error can't find the container with id a6784b514398ed1bf8107554f0b0e2600e0e82d3784be5ce1244abc6cfe2dfb5
Sep 10 17:49:28.600905 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:28.600864    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-n75zh"]
Sep 10 17:49:28.604594 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:28.604567    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-n75zh"
Sep 10 17:49:28.607468 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:28.607440    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-8v6q4\""
Sep 10 17:49:28.612221 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:28.612183    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-n75zh"]
Sep 10 17:49:28.720849 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:28.720748    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbmw7\" (UniqueName: \"kubernetes.io/projected/c1a78328-267a-407b-89f2-87b3bd398614-kube-api-access-hbmw7\") pod \"authorino-7bcfd8f9cd-n75zh\" (UID: \"c1a78328-267a-407b-89f2-87b3bd398614\") " pod="kuadrant-system/authorino-7bcfd8f9cd-n75zh"
Sep 10 17:49:28.821872 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:28.821829    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbmw7\" (UniqueName: \"kubernetes.io/projected/c1a78328-267a-407b-89f2-87b3bd398614-kube-api-access-hbmw7\") pod \"authorino-7bcfd8f9cd-n75zh\" (UID: \"c1a78328-267a-407b-89f2-87b3bd398614\") " pod="kuadrant-system/authorino-7bcfd8f9cd-n75zh"
Sep 10 17:49:28.831012 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:28.830982    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbmw7\" (UniqueName: \"kubernetes.io/projected/c1a78328-267a-407b-89f2-87b3bd398614-kube-api-access-hbmw7\") pod \"authorino-7bcfd8f9cd-n75zh\" (UID: \"c1a78328-267a-407b-89f2-87b3bd398614\") " pod="kuadrant-system/authorino-7bcfd8f9cd-n75zh"
Sep 10 17:49:28.915936 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:28.915888    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-n75zh"
Sep 10 17:49:29.128428 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:29.128387    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-fl6zw" event={"ID":"d6526804-c800-443e-befe-a18e38228ca3","Type":"ContainerStarted","Data":"a6784b514398ed1bf8107554f0b0e2600e0e82d3784be5ce1244abc6cfe2dfb5"}
Sep 10 17:49:29.191411 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:29.191379    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-n75zh"]
Sep 10 17:49:29.193857 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:49:29.193823    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc1a78328_267a_407b_89f2_87b3bd398614.slice/crio-a35247fe2d25da4d48e088317e09a07b821013808f4220c6f0337a37ef3ec8d7 WatchSource:0}: Error finding container a35247fe2d25da4d48e088317e09a07b821013808f4220c6f0337a37ef3ec8d7: Status 404 returned error can't find the container with id a35247fe2d25da4d48e088317e09a07b821013808f4220c6f0337a37ef3ec8d7
Sep 10 17:49:30.134933 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:30.134884    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-n75zh" event={"ID":"c1a78328-267a-407b-89f2-87b3bd398614","Type":"ContainerStarted","Data":"a35247fe2d25da4d48e088317e09a07b821013808f4220c6f0337a37ef3ec8d7"}
Sep 10 17:49:30.136651 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:30.136618    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-fl6zw" event={"ID":"d6526804-c800-443e-befe-a18e38228ca3","Type":"ContainerStarted","Data":"680126a7cbe6b307de8ac6c0112f0d7352b128a0bfe391eec0251d8f3839495c"}
Sep 10 17:49:30.136840 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:30.136817    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-8588749977-fl6zw"
Sep 10 17:49:30.156950 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:30.156890    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-8588749977-fl6zw" podStartSLOduration=1.9998389159999999 podStartE2EDuration="3.156843649s" totalImagesPullingTime="1.157004733s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:49:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:49:30.154388925 +0000 UTC m=+505.915696969" watchObservedRunningTime="2026-09-10 17:49:30.156843649 +0000 UTC m=+505.918151692"
Sep 10 17:49:31.325747 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:31.325706    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-n75zh"]
Sep 10 17:49:32.151197 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:32.151162    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-n75zh" event={"ID":"c1a78328-267a-407b-89f2-87b3bd398614","Type":"ContainerStarted","Data":"c8cd54fa043af591109dc65b426026ec655afb0bd3044645eb3da4accb6ee4e1"}
Sep 10 17:49:32.196930 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:32.196873    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7bcfd8f9cd-n75zh" podStartSLOduration=2.2751555039999998 podStartE2EDuration="4.196853521s" totalImagesPullingTime="1.921698017s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:49:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:49:32.195442266 +0000 UTC m=+507.956750308" watchObservedRunningTime="2026-09-10 17:49:32.196853521 +0000 UTC m=+507.958161607"
Sep 10 17:49:33.156489 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:33.156449    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7bcfd8f9cd-n75zh" podUID="c1a78328-267a-407b-89f2-87b3bd398614" containerName="authorino" containerID="cri-o://c8cd54fa043af591109dc65b426026ec655afb0bd3044645eb3da4accb6ee4e1" gracePeriod=30
Sep 10 17:49:33.407687 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:33.407614    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-n75zh"
Sep 10 17:49:33.563851 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:33.563807    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hbmw7\" (UniqueName: \"kubernetes.io/projected/c1a78328-267a-407b-89f2-87b3bd398614-kube-api-access-hbmw7\") pod \"c1a78328-267a-407b-89f2-87b3bd398614\" (UID: \"c1a78328-267a-407b-89f2-87b3bd398614\") "
Sep 10 17:49:33.566015 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:33.565989    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1a78328-267a-407b-89f2-87b3bd398614-kube-api-access-hbmw7" (OuterVolumeSpecName: "kube-api-access-hbmw7") pod "c1a78328-267a-407b-89f2-87b3bd398614" (UID: "c1a78328-267a-407b-89f2-87b3bd398614"). InnerVolumeSpecName "kube-api-access-hbmw7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:49:33.665138 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:33.665049    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hbmw7\" (UniqueName: \"kubernetes.io/projected/c1a78328-267a-407b-89f2-87b3bd398614-kube-api-access-hbmw7\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:49:34.162382 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:34.162343    2568 generic.go:356] "Generic (PLEG): container finished" podID="c1a78328-267a-407b-89f2-87b3bd398614" containerID="c8cd54fa043af591109dc65b426026ec655afb0bd3044645eb3da4accb6ee4e1" exitCode=0
Sep 10 17:49:34.162382 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:34.162373    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-n75zh" event={"ID":"c1a78328-267a-407b-89f2-87b3bd398614","Type":"ContainerDied","Data":"c8cd54fa043af591109dc65b426026ec655afb0bd3044645eb3da4accb6ee4e1"}
Sep 10 17:49:34.162856 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:34.162424    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-n75zh" event={"ID":"c1a78328-267a-407b-89f2-87b3bd398614","Type":"ContainerDied","Data":"a35247fe2d25da4d48e088317e09a07b821013808f4220c6f0337a37ef3ec8d7"}
Sep 10 17:49:34.162856 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:34.162384    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-n75zh"
Sep 10 17:49:34.162856 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:34.162441    2568 scope.go:117] "RemoveContainer" containerID="c8cd54fa043af591109dc65b426026ec655afb0bd3044645eb3da4accb6ee4e1"
Sep 10 17:49:34.171192 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:34.171171    2568 scope.go:117] "RemoveContainer" containerID="c8cd54fa043af591109dc65b426026ec655afb0bd3044645eb3da4accb6ee4e1"
Sep 10 17:49:34.171542 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:49:34.171521    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c8cd54fa043af591109dc65b426026ec655afb0bd3044645eb3da4accb6ee4e1\": container with ID starting with c8cd54fa043af591109dc65b426026ec655afb0bd3044645eb3da4accb6ee4e1 not found: ID does not exist" containerID="c8cd54fa043af591109dc65b426026ec655afb0bd3044645eb3da4accb6ee4e1"
Sep 10 17:49:34.171612 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:34.171556    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8cd54fa043af591109dc65b426026ec655afb0bd3044645eb3da4accb6ee4e1"} err="failed to get container status \"c8cd54fa043af591109dc65b426026ec655afb0bd3044645eb3da4accb6ee4e1\": rpc error: code = NotFound desc = could not find container \"c8cd54fa043af591109dc65b426026ec655afb0bd3044645eb3da4accb6ee4e1\": container with ID starting with c8cd54fa043af591109dc65b426026ec655afb0bd3044645eb3da4accb6ee4e1 not found: ID does not exist"
Sep 10 17:49:34.187051 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:34.187014    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-n75zh"]
Sep 10 17:49:34.190116 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:34.190078    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-n75zh"]
Sep 10 17:49:34.770361 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:34.770304    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c1a78328-267a-407b-89f2-87b3bd398614" path="/var/lib/kubelet/pods/c1a78328-267a-407b-89f2-87b3bd398614/volumes"
Sep 10 17:49:41.144526 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:41.144489    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-8588749977-fl6zw"
Sep 10 17:49:41.326544 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:41.326499    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-fl6zw"]
Sep 10 17:49:41.326720 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:41.326697    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-8588749977-fl6zw" podUID="d6526804-c800-443e-befe-a18e38228ca3" containerName="limitador" containerID="cri-o://680126a7cbe6b307de8ac6c0112f0d7352b128a0bfe391eec0251d8f3839495c" gracePeriod=30
Sep 10 17:49:42.207818 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:42.207770    2568 generic.go:356] "Generic (PLEG): container finished" podID="d6526804-c800-443e-befe-a18e38228ca3" containerID="680126a7cbe6b307de8ac6c0112f0d7352b128a0bfe391eec0251d8f3839495c" exitCode=0
Sep 10 17:49:42.208313 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:42.207836    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-fl6zw" event={"ID":"d6526804-c800-443e-befe-a18e38228ca3","Type":"ContainerDied","Data":"680126a7cbe6b307de8ac6c0112f0d7352b128a0bfe391eec0251d8f3839495c"}
Sep 10 17:49:42.280178 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:42.280149    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-fl6zw"
Sep 10 17:49:42.444148 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:42.444061    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s46z6\" (UniqueName: \"kubernetes.io/projected/d6526804-c800-443e-befe-a18e38228ca3-kube-api-access-s46z6\") pod \"d6526804-c800-443e-befe-a18e38228ca3\" (UID: \"d6526804-c800-443e-befe-a18e38228ca3\") "
Sep 10 17:49:42.444148 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:42.444124    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d6526804-c800-443e-befe-a18e38228ca3-config-file\") pod \"d6526804-c800-443e-befe-a18e38228ca3\" (UID: \"d6526804-c800-443e-befe-a18e38228ca3\") "
Sep 10 17:49:42.444523 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:42.444501    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6526804-c800-443e-befe-a18e38228ca3-config-file" (OuterVolumeSpecName: "config-file") pod "d6526804-c800-443e-befe-a18e38228ca3" (UID: "d6526804-c800-443e-befe-a18e38228ca3"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 17:49:42.446379 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:42.446351    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6526804-c800-443e-befe-a18e38228ca3-kube-api-access-s46z6" (OuterVolumeSpecName: "kube-api-access-s46z6") pod "d6526804-c800-443e-befe-a18e38228ca3" (UID: "d6526804-c800-443e-befe-a18e38228ca3"). InnerVolumeSpecName "kube-api-access-s46z6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:49:42.545131 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:42.545092    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s46z6\" (UniqueName: \"kubernetes.io/projected/d6526804-c800-443e-befe-a18e38228ca3-kube-api-access-s46z6\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:49:42.545131 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:42.545125    2568 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d6526804-c800-443e-befe-a18e38228ca3-config-file\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:49:43.214338 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:43.214235    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-fl6zw" event={"ID":"d6526804-c800-443e-befe-a18e38228ca3","Type":"ContainerDied","Data":"a6784b514398ed1bf8107554f0b0e2600e0e82d3784be5ce1244abc6cfe2dfb5"}
Sep 10 17:49:43.214338 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:43.214259    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-fl6zw"
Sep 10 17:49:43.214338 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:43.214303    2568 scope.go:117] "RemoveContainer" containerID="680126a7cbe6b307de8ac6c0112f0d7352b128a0bfe391eec0251d8f3839495c"
Sep 10 17:49:43.231680 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:43.231643    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-fl6zw"]
Sep 10 17:49:43.235688 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:43.235652    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-fl6zw"]
Sep 10 17:49:44.769851 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:44.769814    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6526804-c800-443e-befe-a18e38228ca3" path="/var/lib/kubelet/pods/d6526804-c800-443e-befe-a18e38228ca3/volumes"
Sep 10 17:49:47.055381 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:47.055343    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-q5h5n"]
Sep 10 17:49:47.055766 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:47.055662    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6526804-c800-443e-befe-a18e38228ca3" containerName="limitador"
Sep 10 17:49:47.055766 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:47.055674    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6526804-c800-443e-befe-a18e38228ca3" containerName="limitador"
Sep 10 17:49:47.055766 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:47.055692    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1a78328-267a-407b-89f2-87b3bd398614" containerName="authorino"
Sep 10 17:49:47.055766 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:47.055697    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1a78328-267a-407b-89f2-87b3bd398614" containerName="authorino"
Sep 10 17:49:47.055766 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:47.055763    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6526804-c800-443e-befe-a18e38228ca3" containerName="limitador"
Sep 10 17:49:47.055927 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:47.055773    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="c1a78328-267a-407b-89f2-87b3bd398614" containerName="authorino"
Sep 10 17:49:47.062132 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:47.062106    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-q5h5n"
Sep 10 17:49:47.064972 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:47.064941    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 17:49:47.064972 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:47.064958    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 10 17:49:47.066208 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:47.066180    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-q5h6g\""
Sep 10 17:49:47.066377 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:47.066295    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 10 17:49:47.068792 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:47.068768    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-q5h5n"]
Sep 10 17:49:47.183453 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:47.183413    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/7c8bd3c5-efe6-4fdb-b6ff-4955854c3da0-data\") pod \"postgres-69fb4594cf-q5h5n\" (UID: \"7c8bd3c5-efe6-4fdb-b6ff-4955854c3da0\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-q5h5n"
Sep 10 17:49:47.183453 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:47.183455    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vxws\" (UniqueName: \"kubernetes.io/projected/7c8bd3c5-efe6-4fdb-b6ff-4955854c3da0-kube-api-access-9vxws\") pod \"postgres-69fb4594cf-q5h5n\" (UID: \"7c8bd3c5-efe6-4fdb-b6ff-4955854c3da0\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-q5h5n"
Sep 10 17:49:47.284400 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:47.284353    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/7c8bd3c5-efe6-4fdb-b6ff-4955854c3da0-data\") pod \"postgres-69fb4594cf-q5h5n\" (UID: \"7c8bd3c5-efe6-4fdb-b6ff-4955854c3da0\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-q5h5n"
Sep 10 17:49:47.284400 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:47.284400    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vxws\" (UniqueName: \"kubernetes.io/projected/7c8bd3c5-efe6-4fdb-b6ff-4955854c3da0-kube-api-access-9vxws\") pod \"postgres-69fb4594cf-q5h5n\" (UID: \"7c8bd3c5-efe6-4fdb-b6ff-4955854c3da0\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-q5h5n"
Sep 10 17:49:47.284815 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:47.284792    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/7c8bd3c5-efe6-4fdb-b6ff-4955854c3da0-data\") pod \"postgres-69fb4594cf-q5h5n\" (UID: \"7c8bd3c5-efe6-4fdb-b6ff-4955854c3da0\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-q5h5n"
Sep 10 17:49:47.299925 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:47.299891    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vxws\" (UniqueName: \"kubernetes.io/projected/7c8bd3c5-efe6-4fdb-b6ff-4955854c3da0-kube-api-access-9vxws\") pod \"postgres-69fb4594cf-q5h5n\" (UID: \"7c8bd3c5-efe6-4fdb-b6ff-4955854c3da0\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-q5h5n"
Sep 10 17:49:47.374072 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:47.373964    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-q5h5n"
Sep 10 17:49:47.646624 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:47.646587    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-q5h5n"]
Sep 10 17:49:47.649190 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:49:47.649148    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c8bd3c5_efe6_4fdb_b6ff_4955854c3da0.slice/crio-8a20621525e1bdb90b65747cebd3563f40b8f1def1bb2104bfcabeb4f77d3996 WatchSource:0}: Error finding container 8a20621525e1bdb90b65747cebd3563f40b8f1def1bb2104bfcabeb4f77d3996: Status 404 returned error can't find the container with id 8a20621525e1bdb90b65747cebd3563f40b8f1def1bb2104bfcabeb4f77d3996
Sep 10 17:49:48.242810 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:48.242771    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-q5h5n" event={"ID":"7c8bd3c5-efe6-4fdb-b6ff-4955854c3da0","Type":"ContainerStarted","Data":"8a20621525e1bdb90b65747cebd3563f40b8f1def1bb2104bfcabeb4f77d3996"}
Sep 10 17:49:50.255271 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:50.255233    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-q5h5n" event={"ID":"7c8bd3c5-efe6-4fdb-b6ff-4955854c3da0","Type":"ContainerStarted","Data":"7c3c43cdfcfa3fdbdf22b470c1f0f4efa0aa94642cd794baa0ae2857b440de99"}
Sep 10 17:49:50.255791 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:50.255418    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-q5h5n"
Sep 10 17:49:50.275111 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:50.275055    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-q5h5n" podStartSLOduration=0.845893886 podStartE2EDuration="3.275037085s" totalImagesPullingTime="2.429143199s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:49:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:49:50.273200719 +0000 UTC m=+526.034508763" watchObservedRunningTime="2026-09-10 17:49:50.275037085 +0000 UTC m=+526.036345154"
Sep 10 17:49:56.291868 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:56.291831    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-q5h5n"
Sep 10 17:49:56.817047 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:56.816935    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-557f876f69-7kbzs"]
Sep 10 17:49:56.825154 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:56.825090    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-7kbzs"
Sep 10 17:49:56.828226 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:56.828196    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-8v6q4\""
Sep 10 17:49:56.828751 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:56.828724    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-557f876f69-7kbzs"]
Sep 10 17:49:56.865008 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:56.864956    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llxnp\" (UniqueName: \"kubernetes.io/projected/aa9245bb-f495-4047-af1b-61cc07d7b498-kube-api-access-llxnp\") pod \"authorino-557f876f69-7kbzs\" (UID: \"aa9245bb-f495-4047-af1b-61cc07d7b498\") " pod="kuadrant-system/authorino-557f876f69-7kbzs"
Sep 10 17:49:56.924225 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:56.924173    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-7kbzs"]
Sep 10 17:49:56.924530 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:49:56.924501    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-llxnp], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-557f876f69-7kbzs" podUID="aa9245bb-f495-4047-af1b-61cc07d7b498"
Sep 10 17:49:56.949388 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:56.949340    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-ln2sl"]
Sep 10 17:49:56.952905 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:56.952870    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-ln2sl"
Sep 10 17:49:56.956510 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:56.956478    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Sep 10 17:49:56.961662 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:56.961597    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-ln2sl"]
Sep 10 17:49:56.966298 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:56.966264    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qx8d7\" (UniqueName: \"kubernetes.io/projected/40e276c1-b411-4de2-a94e-8ad3da4d939f-kube-api-access-qx8d7\") pod \"authorino-6d4dfc649f-ln2sl\" (UID: \"40e276c1-b411-4de2-a94e-8ad3da4d939f\") " pod="kuadrant-system/authorino-6d4dfc649f-ln2sl"
Sep 10 17:49:56.966472 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:56.966298    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/40e276c1-b411-4de2-a94e-8ad3da4d939f-tls-cert\") pod \"authorino-6d4dfc649f-ln2sl\" (UID: \"40e276c1-b411-4de2-a94e-8ad3da4d939f\") " pod="kuadrant-system/authorino-6d4dfc649f-ln2sl"
Sep 10 17:49:56.966472 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:56.966414    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llxnp\" (UniqueName: \"kubernetes.io/projected/aa9245bb-f495-4047-af1b-61cc07d7b498-kube-api-access-llxnp\") pod \"authorino-557f876f69-7kbzs\" (UID: \"aa9245bb-f495-4047-af1b-61cc07d7b498\") " pod="kuadrant-system/authorino-557f876f69-7kbzs"
Sep 10 17:49:56.977259 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:56.977225    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-llxnp\" (UniqueName: \"kubernetes.io/projected/aa9245bb-f495-4047-af1b-61cc07d7b498-kube-api-access-llxnp\") pod \"authorino-557f876f69-7kbzs\" (UID: \"aa9245bb-f495-4047-af1b-61cc07d7b498\") " pod="kuadrant-system/authorino-557f876f69-7kbzs"
Sep 10 17:49:57.062556 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:57.062518    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-ln2sl"]
Sep 10 17:49:57.062787 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:49:57.062766    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-qx8d7 tls-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-6d4dfc649f-ln2sl" podUID="40e276c1-b411-4de2-a94e-8ad3da4d939f"
Sep 10 17:49:57.067722 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:57.067667    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qx8d7\" (UniqueName: \"kubernetes.io/projected/40e276c1-b411-4de2-a94e-8ad3da4d939f-kube-api-access-qx8d7\") pod \"authorino-6d4dfc649f-ln2sl\" (UID: \"40e276c1-b411-4de2-a94e-8ad3da4d939f\") " pod="kuadrant-system/authorino-6d4dfc649f-ln2sl"
Sep 10 17:49:57.067722 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:57.067699    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/40e276c1-b411-4de2-a94e-8ad3da4d939f-tls-cert\") pod \"authorino-6d4dfc649f-ln2sl\" (UID: \"40e276c1-b411-4de2-a94e-8ad3da4d939f\") " pod="kuadrant-system/authorino-6d4dfc649f-ln2sl"
Sep 10 17:49:57.070228 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:57.070201    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/40e276c1-b411-4de2-a94e-8ad3da4d939f-tls-cert\") pod \"authorino-6d4dfc649f-ln2sl\" (UID: \"40e276c1-b411-4de2-a94e-8ad3da4d939f\") " pod="kuadrant-system/authorino-6d4dfc649f-ln2sl"
Sep 10 17:49:57.080694 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:57.080658    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qx8d7\" (UniqueName: \"kubernetes.io/projected/40e276c1-b411-4de2-a94e-8ad3da4d939f-kube-api-access-qx8d7\") pod \"authorino-6d4dfc649f-ln2sl\" (UID: \"40e276c1-b411-4de2-a94e-8ad3da4d939f\") " pod="kuadrant-system/authorino-6d4dfc649f-ln2sl"
Sep 10 17:49:57.089180 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:57.089147    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7bfbf5bd6f-wfw2m"]
Sep 10 17:49:57.092679 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:57.092656    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bfbf5bd6f-wfw2m"
Sep 10 17:49:57.099745 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:57.099708    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bfbf5bd6f-wfw2m"]
Sep 10 17:49:57.168502 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:57.168469    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzx24\" (UniqueName: \"kubernetes.io/projected/787a641b-4166-4bc4-954a-8442eaab6b38-kube-api-access-pzx24\") pod \"authorino-7bfbf5bd6f-wfw2m\" (UID: \"787a641b-4166-4bc4-954a-8442eaab6b38\") " pod="kuadrant-system/authorino-7bfbf5bd6f-wfw2m"
Sep 10 17:49:57.168708 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:57.168534    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/787a641b-4166-4bc4-954a-8442eaab6b38-tls-cert\") pod \"authorino-7bfbf5bd6f-wfw2m\" (UID: \"787a641b-4166-4bc4-954a-8442eaab6b38\") " pod="kuadrant-system/authorino-7bfbf5bd6f-wfw2m"
Sep 10 17:49:57.269479 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:57.269435    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzx24\" (UniqueName: \"kubernetes.io/projected/787a641b-4166-4bc4-954a-8442eaab6b38-kube-api-access-pzx24\") pod \"authorino-7bfbf5bd6f-wfw2m\" (UID: \"787a641b-4166-4bc4-954a-8442eaab6b38\") " pod="kuadrant-system/authorino-7bfbf5bd6f-wfw2m"
Sep 10 17:49:57.269639 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:57.269512    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/787a641b-4166-4bc4-954a-8442eaab6b38-tls-cert\") pod \"authorino-7bfbf5bd6f-wfw2m\" (UID: \"787a641b-4166-4bc4-954a-8442eaab6b38\") " pod="kuadrant-system/authorino-7bfbf5bd6f-wfw2m"
Sep 10 17:49:57.272060 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:57.272026    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/787a641b-4166-4bc4-954a-8442eaab6b38-tls-cert\") pod \"authorino-7bfbf5bd6f-wfw2m\" (UID: \"787a641b-4166-4bc4-954a-8442eaab6b38\") " pod="kuadrant-system/authorino-7bfbf5bd6f-wfw2m"
Sep 10 17:49:57.279240 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:57.279204    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzx24\" (UniqueName: \"kubernetes.io/projected/787a641b-4166-4bc4-954a-8442eaab6b38-kube-api-access-pzx24\") pod \"authorino-7bfbf5bd6f-wfw2m\" (UID: \"787a641b-4166-4bc4-954a-8442eaab6b38\") " pod="kuadrant-system/authorino-7bfbf5bd6f-wfw2m"
Sep 10 17:49:57.292870 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:57.292836    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-ln2sl"
Sep 10 17:49:57.293289 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:57.292841    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-7kbzs"
Sep 10 17:49:57.300351 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:57.300300    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-ln2sl"
Sep 10 17:49:57.303782 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:57.303757    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-7kbzs"
Sep 10 17:49:57.370257 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:57.370169    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qx8d7\" (UniqueName: \"kubernetes.io/projected/40e276c1-b411-4de2-a94e-8ad3da4d939f-kube-api-access-qx8d7\") pod \"40e276c1-b411-4de2-a94e-8ad3da4d939f\" (UID: \"40e276c1-b411-4de2-a94e-8ad3da4d939f\") "
Sep 10 17:49:57.372477 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:57.372439    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40e276c1-b411-4de2-a94e-8ad3da4d939f-kube-api-access-qx8d7" (OuterVolumeSpecName: "kube-api-access-qx8d7") pod "40e276c1-b411-4de2-a94e-8ad3da4d939f" (UID: "40e276c1-b411-4de2-a94e-8ad3da4d939f"). InnerVolumeSpecName "kube-api-access-qx8d7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:49:57.404244 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:57.404213    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bfbf5bd6f-wfw2m"
Sep 10 17:49:57.471407 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:57.470798    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-llxnp\" (UniqueName: \"kubernetes.io/projected/aa9245bb-f495-4047-af1b-61cc07d7b498-kube-api-access-llxnp\") pod \"aa9245bb-f495-4047-af1b-61cc07d7b498\" (UID: \"aa9245bb-f495-4047-af1b-61cc07d7b498\") "
Sep 10 17:49:57.471407 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:57.470880    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/40e276c1-b411-4de2-a94e-8ad3da4d939f-tls-cert\") pod \"40e276c1-b411-4de2-a94e-8ad3da4d939f\" (UID: \"40e276c1-b411-4de2-a94e-8ad3da4d939f\") "
Sep 10 17:49:57.471407 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:57.471142    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qx8d7\" (UniqueName: \"kubernetes.io/projected/40e276c1-b411-4de2-a94e-8ad3da4d939f-kube-api-access-qx8d7\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:49:57.473572 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:57.473535    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa9245bb-f495-4047-af1b-61cc07d7b498-kube-api-access-llxnp" (OuterVolumeSpecName: "kube-api-access-llxnp") pod "aa9245bb-f495-4047-af1b-61cc07d7b498" (UID: "aa9245bb-f495-4047-af1b-61cc07d7b498"). InnerVolumeSpecName "kube-api-access-llxnp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:49:57.475021 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:57.474996    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/40e276c1-b411-4de2-a94e-8ad3da4d939f-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "40e276c1-b411-4de2-a94e-8ad3da4d939f" (UID: "40e276c1-b411-4de2-a94e-8ad3da4d939f"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 17:49:57.571645 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:57.571605    2568 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/40e276c1-b411-4de2-a94e-8ad3da4d939f-tls-cert\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:49:57.571645 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:57.571641    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-llxnp\" (UniqueName: \"kubernetes.io/projected/aa9245bb-f495-4047-af1b-61cc07d7b498-kube-api-access-llxnp\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:49:57.678383 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:57.678352    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bfbf5bd6f-wfw2m"]
Sep 10 17:49:57.680160 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:49:57.680115    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod787a641b_4166_4bc4_954a_8442eaab6b38.slice/crio-330043df4e665f96697b72d3c29909db15631c9646a2381fcb2434073b7f809e WatchSource:0}: Error finding container 330043df4e665f96697b72d3c29909db15631c9646a2381fcb2434073b7f809e: Status 404 returned error can't find the container with id 330043df4e665f96697b72d3c29909db15631c9646a2381fcb2434073b7f809e
Sep 10 17:49:58.300387 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:58.300280    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bfbf5bd6f-wfw2m" event={"ID":"787a641b-4166-4bc4-954a-8442eaab6b38","Type":"ContainerStarted","Data":"330043df4e665f96697b72d3c29909db15631c9646a2381fcb2434073b7f809e"}
Sep 10 17:49:58.300387 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:58.300303    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-7kbzs"
Sep 10 17:49:58.300809 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:58.300306    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-ln2sl"
Sep 10 17:49:58.336201 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:58.336168    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-7kbzs"]
Sep 10 17:49:58.339925 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:58.339892    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-557f876f69-7kbzs"]
Sep 10 17:49:58.362058 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:58.362019    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-ln2sl"]
Sep 10 17:49:58.366421 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:58.366383    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-ln2sl"]
Sep 10 17:49:58.770473 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:58.770427    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="40e276c1-b411-4de2-a94e-8ad3da4d939f" path="/var/lib/kubelet/pods/40e276c1-b411-4de2-a94e-8ad3da4d939f/volumes"
Sep 10 17:49:58.770751 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:58.770732    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa9245bb-f495-4047-af1b-61cc07d7b498" path="/var/lib/kubelet/pods/aa9245bb-f495-4047-af1b-61cc07d7b498/volumes"
Sep 10 17:49:59.308069 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:59.308033    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bfbf5bd6f-wfw2m" event={"ID":"787a641b-4166-4bc4-954a-8442eaab6b38","Type":"ContainerStarted","Data":"3e15cf93e2da4f0c5656101265cc5f0a1c9407982f0ea2a3e7fc62e8726c8faf"}
Sep 10 17:49:59.328461 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:49:59.328395    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7bfbf5bd6f-wfw2m" podStartSLOduration=1.389511706 podStartE2EDuration="2.328370188s" totalImagesPullingTime="938.858482ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:49:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:49:59.326881156 +0000 UTC m=+535.088189198" watchObservedRunningTime="2026-09-10 17:49:59.328370188 +0000 UTC m=+535.089678230"
Sep 10 17:50:04.038814 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:50:04.038774    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6c7dc64cb9-pzk4k"]
Sep 10 17:50:04.043369 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:50:04.043305    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6c7dc64cb9-pzk4k"
Sep 10 17:50:04.046379 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:50:04.046345    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 10 17:50:04.046554 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:50:04.046442    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-kqhz6\""
Sep 10 17:50:04.046795 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:50:04.046767    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 10 17:50:04.047583 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:50:04.047564    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 10 17:50:04.055997 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:50:04.055966    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6c7dc64cb9-pzk4k"]
Sep 10 17:50:04.126224 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:50:04.126172    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pngql\" (UniqueName: \"kubernetes.io/projected/792c88d3-8efc-49e2-ad8a-1c731f8f31bc-kube-api-access-pngql\") pod \"maas-controller-6c7dc64cb9-pzk4k\" (UID: \"792c88d3-8efc-49e2-ad8a-1c731f8f31bc\") " pod="opendatahub/maas-controller-6c7dc64cb9-pzk4k"
Sep 10 17:50:04.126416 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:50:04.126280    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/792c88d3-8efc-49e2-ad8a-1c731f8f31bc-webhook-cert\") pod \"maas-controller-6c7dc64cb9-pzk4k\" (UID: \"792c88d3-8efc-49e2-ad8a-1c731f8f31bc\") " pod="opendatahub/maas-controller-6c7dc64cb9-pzk4k"
Sep 10 17:50:04.126416 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:50:04.126348    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/792c88d3-8efc-49e2-ad8a-1c731f8f31bc-metrics-certs\") pod \"maas-controller-6c7dc64cb9-pzk4k\" (UID: \"792c88d3-8efc-49e2-ad8a-1c731f8f31bc\") " pod="opendatahub/maas-controller-6c7dc64cb9-pzk4k"
Sep 10 17:50:04.199170 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:50:04.199127    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7df97ff6cc-6mcjz"]
Sep 10 17:50:04.202605 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:50:04.202578    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7df97ff6cc-6mcjz"
Sep 10 17:50:04.215835 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:50:04.215801    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7df97ff6cc-6mcjz"]
Sep 10 17:50:04.227082 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:50:04.227040    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/792c88d3-8efc-49e2-ad8a-1c731f8f31bc-webhook-cert\") pod \"maas-controller-6c7dc64cb9-pzk4k\" (UID: \"792c88d3-8efc-49e2-ad8a-1c731f8f31bc\") " pod="opendatahub/maas-controller-6c7dc64cb9-pzk4k"
Sep 10 17:50:04.227269 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:50:04.227116    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/792c88d3-8efc-49e2-ad8a-1c731f8f31bc-metrics-certs\") pod \"maas-controller-6c7dc64cb9-pzk4k\" (UID: \"792c88d3-8efc-49e2-ad8a-1c731f8f31bc\") " pod="opendatahub/maas-controller-6c7dc64cb9-pzk4k"
Sep 10 17:50:04.227269 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:50:04.227181    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/411c224a-8c1e-4ff1-9e83-de0aa2e907f3-webhook-cert\") pod \"maas-controller-7df97ff6cc-6mcjz\" (UID: \"411c224a-8c1e-4ff1-9e83-de0aa2e907f3\") " pod="opendatahub/maas-controller-7df97ff6cc-6mcjz"
Sep 10 17:50:04.227269 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:50:04.227221    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/411c224a-8c1e-4ff1-9e83-de0aa2e907f3-metrics-certs\") pod \"maas-controller-7df97ff6cc-6mcjz\" (UID: \"411c224a-8c1e-4ff1-9e83-de0aa2e907f3\") " pod="opendatahub/maas-controller-7df97ff6cc-6mcjz"
Sep 10 17:50:04.227269 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:50:04.227221    2568 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Sep 10 17:50:04.227525 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:50:04.227269    2568 secret.go:189] Couldn't get secret opendatahub/maas-controller-metrics-tls: secret "maas-controller-metrics-tls" not found
Sep 10 17:50:04.227525 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:50:04.227367    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/792c88d3-8efc-49e2-ad8a-1c731f8f31bc-webhook-cert podName:792c88d3-8efc-49e2-ad8a-1c731f8f31bc nodeName:}" failed. No retries permitted until 2026-09-10 17:50:04.727314811 +0000 UTC m=+540.488622832 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/792c88d3-8efc-49e2-ad8a-1c731f8f31bc-webhook-cert") pod "maas-controller-6c7dc64cb9-pzk4k" (UID: "792c88d3-8efc-49e2-ad8a-1c731f8f31bc") : secret "maas-controller-webhook-cert" not found
Sep 10 17:50:04.227525 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:50:04.227395    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/792c88d3-8efc-49e2-ad8a-1c731f8f31bc-metrics-certs podName:792c88d3-8efc-49e2-ad8a-1c731f8f31bc nodeName:}" failed. No retries permitted until 2026-09-10 17:50:04.727385446 +0000 UTC m=+540.488693468 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/792c88d3-8efc-49e2-ad8a-1c731f8f31bc-metrics-certs") pod "maas-controller-6c7dc64cb9-pzk4k" (UID: "792c88d3-8efc-49e2-ad8a-1c731f8f31bc") : secret "maas-controller-metrics-tls" not found
Sep 10 17:50:04.227525 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:50:04.227431    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pngql\" (UniqueName: \"kubernetes.io/projected/792c88d3-8efc-49e2-ad8a-1c731f8f31bc-kube-api-access-pngql\") pod \"maas-controller-6c7dc64cb9-pzk4k\" (UID: \"792c88d3-8efc-49e2-ad8a-1c731f8f31bc\") " pod="opendatahub/maas-controller-6c7dc64cb9-pzk4k"
Sep 10 17:50:04.227525 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:50:04.227465    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crsmh\" (UniqueName: \"kubernetes.io/projected/411c224a-8c1e-4ff1-9e83-de0aa2e907f3-kube-api-access-crsmh\") pod \"maas-controller-7df97ff6cc-6mcjz\" (UID: \"411c224a-8c1e-4ff1-9e83-de0aa2e907f3\") " pod="opendatahub/maas-controller-7df97ff6cc-6mcjz"
Sep 10 17:50:04.236218 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:50:04.236178    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pngql\" (UniqueName: \"kubernetes.io/projected/792c88d3-8efc-49e2-ad8a-1c731f8f31bc-kube-api-access-pngql\") pod \"maas-controller-6c7dc64cb9-pzk4k\" (UID: \"792c88d3-8efc-49e2-ad8a-1c731f8f31bc\") " pod="opendatahub/maas-controller-6c7dc64cb9-pzk4k"
Sep 10 17:50:04.328017 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:50:04.327915    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/411c224a-8c1e-4ff1-9e83-de0aa2e907f3-webhook-cert\") pod \"maas-controller-7df97ff6cc-6mcjz\" (UID: \"411c224a-8c1e-4ff1-9e83-de0aa2e907f3\") " pod="opendatahub/maas-controller-7df97ff6cc-6mcjz"
Sep 10 17:50:04.328017 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:50:04.327962    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/411c224a-8c1e-4ff1-9e83-de0aa2e907f3-metrics-certs\") pod \"maas-controller-7df97ff6cc-6mcjz\" (UID: \"411c224a-8c1e-4ff1-9e83-de0aa2e907f3\") " pod="opendatahub/maas-controller-7df97ff6cc-6mcjz"
Sep 10 17:50:04.328017 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:50:04.327985    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crsmh\" (UniqueName: \"kubernetes.io/projected/411c224a-8c1e-4ff1-9e83-de0aa2e907f3-kube-api-access-crsmh\") pod \"maas-controller-7df97ff6cc-6mcjz\" (UID: \"411c224a-8c1e-4ff1-9e83-de0aa2e907f3\") " pod="opendatahub/maas-controller-7df97ff6cc-6mcjz"
Sep 10 17:50:04.328256 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:50:04.328090    2568 secret.go:189] Couldn't get secret opendatahub/maas-controller-metrics-tls: secret "maas-controller-metrics-tls" not found
Sep 10 17:50:04.328256 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:50:04.328124    2568 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Sep 10 17:50:04.328256 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:50:04.328179    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/411c224a-8c1e-4ff1-9e83-de0aa2e907f3-metrics-certs podName:411c224a-8c1e-4ff1-9e83-de0aa2e907f3 nodeName:}" failed. No retries permitted until 2026-09-10 17:50:04.828157881 +0000 UTC m=+540.589465907 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/411c224a-8c1e-4ff1-9e83-de0aa2e907f3-metrics-certs") pod "maas-controller-7df97ff6cc-6mcjz" (UID: "411c224a-8c1e-4ff1-9e83-de0aa2e907f3") : secret "maas-controller-metrics-tls" not found
Sep 10 17:50:04.328256 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:50:04.328199    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/411c224a-8c1e-4ff1-9e83-de0aa2e907f3-webhook-cert podName:411c224a-8c1e-4ff1-9e83-de0aa2e907f3 nodeName:}" failed. No retries permitted until 2026-09-10 17:50:04.828188242 +0000 UTC m=+540.589496270 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/411c224a-8c1e-4ff1-9e83-de0aa2e907f3-webhook-cert") pod "maas-controller-7df97ff6cc-6mcjz" (UID: "411c224a-8c1e-4ff1-9e83-de0aa2e907f3") : secret "maas-controller-webhook-cert" not found
Sep 10 17:50:04.337571 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:50:04.337534    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-crsmh\" (UniqueName: \"kubernetes.io/projected/411c224a-8c1e-4ff1-9e83-de0aa2e907f3-kube-api-access-crsmh\") pod \"maas-controller-7df97ff6cc-6mcjz\" (UID: \"411c224a-8c1e-4ff1-9e83-de0aa2e907f3\") " pod="opendatahub/maas-controller-7df97ff6cc-6mcjz"
Sep 10 17:50:04.732406 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:50:04.732364    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/792c88d3-8efc-49e2-ad8a-1c731f8f31bc-webhook-cert\") pod \"maas-controller-6c7dc64cb9-pzk4k\" (UID: \"792c88d3-8efc-49e2-ad8a-1c731f8f31bc\") " pod="opendatahub/maas-controller-6c7dc64cb9-pzk4k"
Sep 10 17:50:04.732575 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:50:04.732426    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/792c88d3-8efc-49e2-ad8a-1c731f8f31bc-metrics-certs\") pod \"maas-controller-6c7dc64cb9-pzk4k\" (UID: \"792c88d3-8efc-49e2-ad8a-1c731f8f31bc\") " pod="opendatahub/maas-controller-6c7dc64cb9-pzk4k"
Sep 10 17:50:04.735190 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:50:04.735163    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/792c88d3-8efc-49e2-ad8a-1c731f8f31bc-webhook-cert\") pod \"maas-controller-6c7dc64cb9-pzk4k\" (UID: \"792c88d3-8efc-49e2-ad8a-1c731f8f31bc\") " pod="opendatahub/maas-controller-6c7dc64cb9-pzk4k"
Sep 10 17:50:04.735243 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:50:04.735195    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/792c88d3-8efc-49e2-ad8a-1c731f8f31bc-metrics-certs\") pod \"maas-controller-6c7dc64cb9-pzk4k\" (UID: \"792c88d3-8efc-49e2-ad8a-1c731f8f31bc\") " pod="opendatahub/maas-controller-6c7dc64cb9-pzk4k"
Sep 10 17:50:04.833894 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:50:04.833854    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/411c224a-8c1e-4ff1-9e83-de0aa2e907f3-webhook-cert\") pod \"maas-controller-7df97ff6cc-6mcjz\" (UID: \"411c224a-8c1e-4ff1-9e83-de0aa2e907f3\") " pod="opendatahub/maas-controller-7df97ff6cc-6mcjz"
Sep 10 17:50:04.834086 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:50:04.833907    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/411c224a-8c1e-4ff1-9e83-de0aa2e907f3-metrics-certs\") pod \"maas-controller-7df97ff6cc-6mcjz\" (UID: \"411c224a-8c1e-4ff1-9e83-de0aa2e907f3\") " pod="opendatahub/maas-controller-7df97ff6cc-6mcjz"
Sep 10 17:50:04.836553 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:50:04.836515    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/411c224a-8c1e-4ff1-9e83-de0aa2e907f3-webhook-cert\") pod \"maas-controller-7df97ff6cc-6mcjz\" (UID: \"411c224a-8c1e-4ff1-9e83-de0aa2e907f3\") " pod="opendatahub/maas-controller-7df97ff6cc-6mcjz"
Sep 10 17:50:04.836692 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:50:04.836611    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/411c224a-8c1e-4ff1-9e83-de0aa2e907f3-metrics-certs\") pod \"maas-controller-7df97ff6cc-6mcjz\" (UID: \"411c224a-8c1e-4ff1-9e83-de0aa2e907f3\") " pod="opendatahub/maas-controller-7df97ff6cc-6mcjz"
Sep 10 17:50:04.960700 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:50:04.960659    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-kqhz6\""
Sep 10 17:50:04.968126 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:50:04.968091    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6c7dc64cb9-pzk4k"
Sep 10 17:50:05.114367 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:50:05.114334    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7df97ff6cc-6mcjz"
Sep 10 17:50:05.247104 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:50:05.247076    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6c7dc64cb9-pzk4k"]
Sep 10 17:50:05.248521 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:50:05.248490    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod792c88d3_8efc_49e2_ad8a_1c731f8f31bc.slice/crio-d9bb2fca0129e9634ea1c6c5e3029f5ad11348008c4c0fae4209d5c4059a4bf9 WatchSource:0}: Error finding container d9bb2fca0129e9634ea1c6c5e3029f5ad11348008c4c0fae4209d5c4059a4bf9: Status 404 returned error can't find the container with id d9bb2fca0129e9634ea1c6c5e3029f5ad11348008c4c0fae4209d5c4059a4bf9
Sep 10 17:50:05.341354 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:50:05.341244    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6c7dc64cb9-pzk4k" event={"ID":"792c88d3-8efc-49e2-ad8a-1c731f8f31bc","Type":"ContainerStarted","Data":"d9bb2fca0129e9634ea1c6c5e3029f5ad11348008c4c0fae4209d5c4059a4bf9"}
Sep 10 17:50:05.389793 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:50:05.389766    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7df97ff6cc-6mcjz"]
Sep 10 17:50:05.391926 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:50:05.391899    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod411c224a_8c1e_4ff1_9e83_de0aa2e907f3.slice/crio-d4244acf6a85cfc9919f112cb93192b45ff0171ed9c1500effcefb5c6a1e148e WatchSource:0}: Error finding container d4244acf6a85cfc9919f112cb93192b45ff0171ed9c1500effcefb5c6a1e148e: Status 404 returned error can't find the container with id d4244acf6a85cfc9919f112cb93192b45ff0171ed9c1500effcefb5c6a1e148e
Sep 10 17:50:06.353406 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:50:06.353360    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7df97ff6cc-6mcjz" event={"ID":"411c224a-8c1e-4ff1-9e83-de0aa2e907f3","Type":"ContainerStarted","Data":"d4244acf6a85cfc9919f112cb93192b45ff0171ed9c1500effcefb5c6a1e148e"}
Sep 10 17:50:07.879528 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:50:07.879498    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 10 17:50:08.365579 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:50:08.365529    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7df97ff6cc-6mcjz" event={"ID":"411c224a-8c1e-4ff1-9e83-de0aa2e907f3","Type":"ContainerStarted","Data":"ed28df7f97ce05b8c4d4ea2a0d650ba6aa7f4093c57b20c68a6f8b7a8a8a1e60"}
Sep 10 17:50:08.365790 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:50:08.365606    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7df97ff6cc-6mcjz"
Sep 10 17:50:08.367234 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:50:08.367196    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6c7dc64cb9-pzk4k" event={"ID":"792c88d3-8efc-49e2-ad8a-1c731f8f31bc","Type":"ContainerStarted","Data":"c11ce5131cac811e76dc00ac471a9782d6ff3a20945d11b43005419b4e445198"}
Sep 10 17:50:08.367404 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:50:08.367250    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6c7dc64cb9-pzk4k"
Sep 10 17:50:08.391342 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:50:08.391232    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7df97ff6cc-6mcjz" podStartSLOduration=1.908157428 podStartE2EDuration="4.391213699s" totalImagesPullingTime="2.483056271s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:50:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:50:08.391163401 +0000 UTC m=+544.152471446" watchObservedRunningTime="2026-09-10 17:50:08.391213699 +0000 UTC m=+544.152521723"
Sep 10 17:50:08.421129 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:50:08.421031    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6c7dc64cb9-pzk4k" podStartSLOduration=1.7868929150000001 podStartE2EDuration="4.421002219s" totalImagesPullingTime="2.634109304s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:50:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:50:08.416652138 +0000 UTC m=+544.177960183" watchObservedRunningTime="2026-09-10 17:50:08.421002219 +0000 UTC m=+544.182310264"
Sep 10 17:50:19.375762 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:50:19.375718    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7df97ff6cc-6mcjz"
Sep 10 17:50:19.376394 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:50:19.375892    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6c7dc64cb9-pzk4k"
Sep 10 17:50:19.445733 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:50:19.445692    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6c7dc64cb9-pzk4k"]
Sep 10 17:50:19.445976 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:50:19.445947    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6c7dc64cb9-pzk4k" podUID="792c88d3-8efc-49e2-ad8a-1c731f8f31bc" containerName="manager" containerID="cri-o://c11ce5131cac811e76dc00ac471a9782d6ff3a20945d11b43005419b4e445198" gracePeriod=30
Sep 10 17:50:19.702351 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:50:19.702312    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6c7dc64cb9-pzk4k"
Sep 10 17:50:19.765945 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:50:19.765903    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/792c88d3-8efc-49e2-ad8a-1c731f8f31bc-webhook-cert\") pod \"792c88d3-8efc-49e2-ad8a-1c731f8f31bc\" (UID: \"792c88d3-8efc-49e2-ad8a-1c731f8f31bc\") "
Sep 10 17:50:19.766125 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:50:19.765988    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pngql\" (UniqueName: \"kubernetes.io/projected/792c88d3-8efc-49e2-ad8a-1c731f8f31bc-kube-api-access-pngql\") pod \"792c88d3-8efc-49e2-ad8a-1c731f8f31bc\" (UID: \"792c88d3-8efc-49e2-ad8a-1c731f8f31bc\") "
Sep 10 17:50:19.766125 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:50:19.766042    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/792c88d3-8efc-49e2-ad8a-1c731f8f31bc-metrics-certs\") pod \"792c88d3-8efc-49e2-ad8a-1c731f8f31bc\" (UID: \"792c88d3-8efc-49e2-ad8a-1c731f8f31bc\") "
Sep 10 17:50:19.768454 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:50:19.768410    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/792c88d3-8efc-49e2-ad8a-1c731f8f31bc-kube-api-access-pngql" (OuterVolumeSpecName: "kube-api-access-pngql") pod "792c88d3-8efc-49e2-ad8a-1c731f8f31bc" (UID: "792c88d3-8efc-49e2-ad8a-1c731f8f31bc"). InnerVolumeSpecName "kube-api-access-pngql". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:50:19.768454 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:50:19.768410    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/792c88d3-8efc-49e2-ad8a-1c731f8f31bc-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "792c88d3-8efc-49e2-ad8a-1c731f8f31bc" (UID: "792c88d3-8efc-49e2-ad8a-1c731f8f31bc"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 17:50:19.768454 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:50:19.768449    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/792c88d3-8efc-49e2-ad8a-1c731f8f31bc-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "792c88d3-8efc-49e2-ad8a-1c731f8f31bc" (UID: "792c88d3-8efc-49e2-ad8a-1c731f8f31bc"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 17:50:19.867035 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:50:19.866997    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pngql\" (UniqueName: \"kubernetes.io/projected/792c88d3-8efc-49e2-ad8a-1c731f8f31bc-kube-api-access-pngql\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:50:19.867035 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:50:19.867033    2568 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/792c88d3-8efc-49e2-ad8a-1c731f8f31bc-metrics-certs\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:50:19.867035 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:50:19.867046    2568 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/792c88d3-8efc-49e2-ad8a-1c731f8f31bc-webhook-cert\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:50:20.434923 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:50:20.434879    2568 generic.go:356] "Generic (PLEG): container finished" podID="792c88d3-8efc-49e2-ad8a-1c731f8f31bc" containerID="c11ce5131cac811e76dc00ac471a9782d6ff3a20945d11b43005419b4e445198" exitCode=0
Sep 10 17:50:20.435429 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:50:20.434940    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6c7dc64cb9-pzk4k"
Sep 10 17:50:20.435429 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:50:20.434972    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6c7dc64cb9-pzk4k" event={"ID":"792c88d3-8efc-49e2-ad8a-1c731f8f31bc","Type":"ContainerDied","Data":"c11ce5131cac811e76dc00ac471a9782d6ff3a20945d11b43005419b4e445198"}
Sep 10 17:50:20.435429 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:50:20.435059    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6c7dc64cb9-pzk4k" event={"ID":"792c88d3-8efc-49e2-ad8a-1c731f8f31bc","Type":"ContainerDied","Data":"d9bb2fca0129e9634ea1c6c5e3029f5ad11348008c4c0fae4209d5c4059a4bf9"}
Sep 10 17:50:20.435429 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:50:20.435084    2568 scope.go:117] "RemoveContainer" containerID="c11ce5131cac811e76dc00ac471a9782d6ff3a20945d11b43005419b4e445198"
Sep 10 17:50:20.444163 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:50:20.444147    2568 scope.go:117] "RemoveContainer" containerID="c11ce5131cac811e76dc00ac471a9782d6ff3a20945d11b43005419b4e445198"
Sep 10 17:50:20.444445 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:50:20.444424    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c11ce5131cac811e76dc00ac471a9782d6ff3a20945d11b43005419b4e445198\": container with ID starting with c11ce5131cac811e76dc00ac471a9782d6ff3a20945d11b43005419b4e445198 not found: ID does not exist" containerID="c11ce5131cac811e76dc00ac471a9782d6ff3a20945d11b43005419b4e445198"
Sep 10 17:50:20.444516 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:50:20.444452    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c11ce5131cac811e76dc00ac471a9782d6ff3a20945d11b43005419b4e445198"} err="failed to get container status \"c11ce5131cac811e76dc00ac471a9782d6ff3a20945d11b43005419b4e445198\": rpc error: code = NotFound desc = could not find container \"c11ce5131cac811e76dc00ac471a9782d6ff3a20945d11b43005419b4e445198\": container with ID starting with c11ce5131cac811e76dc00ac471a9782d6ff3a20945d11b43005419b4e445198 not found: ID does not exist"
Sep 10 17:50:20.457285 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:50:20.457264    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6c7dc64cb9-pzk4k"]
Sep 10 17:50:20.460917 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:50:20.460898    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6c7dc64cb9-pzk4k"]
Sep 10 17:50:20.769817 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:50:20.769782    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="792c88d3-8efc-49e2-ad8a-1c731f8f31bc" path="/var/lib/kubelet/pods/792c88d3-8efc-49e2-ad8a-1c731f8f31bc/volumes"
Sep 10 17:50:42.925342 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:50:42.925291    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-vqpk8"]
Sep 10 17:50:42.925870 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:50:42.925848    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="792c88d3-8efc-49e2-ad8a-1c731f8f31bc" containerName="manager"
Sep 10 17:50:42.925916 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:50:42.925876    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="792c88d3-8efc-49e2-ad8a-1c731f8f31bc" containerName="manager"
Sep 10 17:50:42.925987 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:50:42.925975    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="792c88d3-8efc-49e2-ad8a-1c731f8f31bc" containerName="manager"
Sep 10 17:50:42.932979 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:50:42.932951    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-vqpk8"
Sep 10 17:50:42.937513 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:50:42.937472    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 10 17:50:42.941239 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:50:42.941199    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-vqpk8"]
Sep 10 17:50:43.075046 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:50:43.075007    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzkpn\" (UniqueName: \"kubernetes.io/projected/5b4bc747-b99d-4bf5-b1ac-4a60ca137839-kube-api-access-jzkpn\") pod \"payload-processing-5b54b7fbb7-vqpk8\" (UID: \"5b4bc747-b99d-4bf5-b1ac-4a60ca137839\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-vqpk8"
Sep 10 17:50:43.075234 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:50:43.075150    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5b4bc747-b99d-4bf5-b1ac-4a60ca137839-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-vqpk8\" (UID: \"5b4bc747-b99d-4bf5-b1ac-4a60ca137839\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-vqpk8"
Sep 10 17:50:43.176448 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:50:43.176311    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzkpn\" (UniqueName: \"kubernetes.io/projected/5b4bc747-b99d-4bf5-b1ac-4a60ca137839-kube-api-access-jzkpn\") pod \"payload-processing-5b54b7fbb7-vqpk8\" (UID: \"5b4bc747-b99d-4bf5-b1ac-4a60ca137839\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-vqpk8"
Sep 10 17:50:43.176611 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:50:43.176449    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5b4bc747-b99d-4bf5-b1ac-4a60ca137839-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-vqpk8\" (UID: \"5b4bc747-b99d-4bf5-b1ac-4a60ca137839\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-vqpk8"
Sep 10 17:50:43.177283 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:50:43.177255    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5b4bc747-b99d-4bf5-b1ac-4a60ca137839-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-vqpk8\" (UID: \"5b4bc747-b99d-4bf5-b1ac-4a60ca137839\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-vqpk8"
Sep 10 17:50:43.185386 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:50:43.185352    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzkpn\" (UniqueName: \"kubernetes.io/projected/5b4bc747-b99d-4bf5-b1ac-4a60ca137839-kube-api-access-jzkpn\") pod \"payload-processing-5b54b7fbb7-vqpk8\" (UID: \"5b4bc747-b99d-4bf5-b1ac-4a60ca137839\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-vqpk8"
Sep 10 17:50:43.249242 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:50:43.249189    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-vqpk8"
Sep 10 17:50:43.531834 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:50:43.531797    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-vqpk8"]
Sep 10 17:50:43.533807 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:50:43.533775    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b4bc747_b99d_4bf5_b1ac_4a60ca137839.slice/crio-66645540ac3a6326c56a967d5633abe07dd2a6b014fa86c5644b11e12ff5e7b7 WatchSource:0}: Error finding container 66645540ac3a6326c56a967d5633abe07dd2a6b014fa86c5644b11e12ff5e7b7: Status 404 returned error can't find the container with id 66645540ac3a6326c56a967d5633abe07dd2a6b014fa86c5644b11e12ff5e7b7
Sep 10 17:50:43.558452 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:50:43.558416    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-vqpk8" event={"ID":"5b4bc747-b99d-4bf5-b1ac-4a60ca137839","Type":"ContainerStarted","Data":"66645540ac3a6326c56a967d5633abe07dd2a6b014fa86c5644b11e12ff5e7b7"}
Sep 10 17:50:46.579262 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:50:46.579216    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-vqpk8" event={"ID":"5b4bc747-b99d-4bf5-b1ac-4a60ca137839","Type":"ContainerStarted","Data":"64a376e6b88caf059c7d1926891f0501e207362ef0d65e49a306335485938c75"}
Sep 10 17:50:46.579710 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:50:46.579357    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-vqpk8"
Sep 10 17:50:46.599562 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:50:46.599490    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-vqpk8" podStartSLOduration=2.596406036 podStartE2EDuration="4.599472276s" totalImagesPullingTime="2.00306624s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:50:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:50:46.59812671 +0000 UTC m=+582.359434755" watchObservedRunningTime="2026-09-10 17:50:46.599472276 +0000 UTC m=+582.360780347"
Sep 10 17:50:57.587503 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:50:57.587461    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-vqpk8"
Sep 10 17:51:04.710957 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:51:04.710928    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-jwfnv_e90054ec-91dc-4cda-94a2-fbe7a2a1fff0/console-operator/1.log"
Sep 10 17:51:04.715530 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:51:04.715503    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-jwfnv_e90054ec-91dc-4cda-94a2-fbe7a2a1fff0/console-operator/1.log"
Sep 10 17:51:39.201857 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:51:39.201772    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9w6r5"]
Sep 10 17:51:39.205718 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:51:39.205682    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9w6r5"
Sep 10 17:51:39.208870 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:51:39.208842    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-6fj4v\""
Sep 10 17:51:39.209036 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:51:39.208950    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 10 17:51:39.210066 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:51:39.210040    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 10 17:51:39.210196 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:51:39.210046    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Sep 10 17:51:39.219534 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:51:39.219505    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9w6r5"]
Sep 10 17:51:39.346499 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:51:39.346461    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8dpd\" (UniqueName: \"kubernetes.io/projected/4c1a6955-fcc1-4cce-9d04-6d333ff6d0da-kube-api-access-k8dpd\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-9w6r5\" (UID: \"4c1a6955-fcc1-4cce-9d04-6d333ff6d0da\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9w6r5"
Sep 10 17:51:39.346717 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:51:39.346515    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c1a6955-fcc1-4cce-9d04-6d333ff6d0da-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-9w6r5\" (UID: \"4c1a6955-fcc1-4cce-9d04-6d333ff6d0da\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9w6r5"
Sep 10 17:51:39.346717 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:51:39.346543    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4c1a6955-fcc1-4cce-9d04-6d333ff6d0da-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-9w6r5\" (UID: \"4c1a6955-fcc1-4cce-9d04-6d333ff6d0da\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9w6r5"
Sep 10 17:51:39.346717 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:51:39.346633    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c1a6955-fcc1-4cce-9d04-6d333ff6d0da-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-9w6r5\" (UID: \"4c1a6955-fcc1-4cce-9d04-6d333ff6d0da\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9w6r5"
Sep 10 17:51:39.346717 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:51:39.346672    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4c1a6955-fcc1-4cce-9d04-6d333ff6d0da-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-9w6r5\" (UID: \"4c1a6955-fcc1-4cce-9d04-6d333ff6d0da\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9w6r5"
Sep 10 17:51:39.346717 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:51:39.346697    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4c1a6955-fcc1-4cce-9d04-6d333ff6d0da-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-9w6r5\" (UID: \"4c1a6955-fcc1-4cce-9d04-6d333ff6d0da\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9w6r5"
Sep 10 17:51:39.447287 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:51:39.447248    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8dpd\" (UniqueName: \"kubernetes.io/projected/4c1a6955-fcc1-4cce-9d04-6d333ff6d0da-kube-api-access-k8dpd\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-9w6r5\" (UID: \"4c1a6955-fcc1-4cce-9d04-6d333ff6d0da\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9w6r5"
Sep 10 17:51:39.447664 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:51:39.447311    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c1a6955-fcc1-4cce-9d04-6d333ff6d0da-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-9w6r5\" (UID: \"4c1a6955-fcc1-4cce-9d04-6d333ff6d0da\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9w6r5"
Sep 10 17:51:39.447664 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:51:39.447356    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4c1a6955-fcc1-4cce-9d04-6d333ff6d0da-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-9w6r5\" (UID: \"4c1a6955-fcc1-4cce-9d04-6d333ff6d0da\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9w6r5"
Sep 10 17:51:39.447664 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:51:39.447380    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c1a6955-fcc1-4cce-9d04-6d333ff6d0da-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-9w6r5\" (UID: \"4c1a6955-fcc1-4cce-9d04-6d333ff6d0da\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9w6r5"
Sep 10 17:51:39.447664 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:51:39.447401    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4c1a6955-fcc1-4cce-9d04-6d333ff6d0da-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-9w6r5\" (UID: \"4c1a6955-fcc1-4cce-9d04-6d333ff6d0da\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9w6r5"
Sep 10 17:51:39.447664 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:51:39.447416    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4c1a6955-fcc1-4cce-9d04-6d333ff6d0da-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-9w6r5\" (UID: \"4c1a6955-fcc1-4cce-9d04-6d333ff6d0da\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9w6r5"
Sep 10 17:51:39.447955 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:51:39.447864    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c1a6955-fcc1-4cce-9d04-6d333ff6d0da-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-9w6r5\" (UID: \"4c1a6955-fcc1-4cce-9d04-6d333ff6d0da\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9w6r5"
Sep 10 17:51:39.447955 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:51:39.447888    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4c1a6955-fcc1-4cce-9d04-6d333ff6d0da-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-9w6r5\" (UID: \"4c1a6955-fcc1-4cce-9d04-6d333ff6d0da\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9w6r5"
Sep 10 17:51:39.447955 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:51:39.447944    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4c1a6955-fcc1-4cce-9d04-6d333ff6d0da-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-9w6r5\" (UID: \"4c1a6955-fcc1-4cce-9d04-6d333ff6d0da\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9w6r5"
Sep 10 17:51:39.449912 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:51:39.449890    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4c1a6955-fcc1-4cce-9d04-6d333ff6d0da-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-9w6r5\" (UID: \"4c1a6955-fcc1-4cce-9d04-6d333ff6d0da\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9w6r5"
Sep 10 17:51:39.450277 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:51:39.450258    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c1a6955-fcc1-4cce-9d04-6d333ff6d0da-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-9w6r5\" (UID: \"4c1a6955-fcc1-4cce-9d04-6d333ff6d0da\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9w6r5"
Sep 10 17:51:39.455376 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:51:39.455280    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8dpd\" (UniqueName: \"kubernetes.io/projected/4c1a6955-fcc1-4cce-9d04-6d333ff6d0da-kube-api-access-k8dpd\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-9w6r5\" (UID: \"4c1a6955-fcc1-4cce-9d04-6d333ff6d0da\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9w6r5"
Sep 10 17:51:39.520225 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:51:39.520181    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9w6r5"
Sep 10 17:51:39.798945 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:51:39.798876    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9w6r5"]
Sep 10 17:51:39.802009 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:51:39.801970    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c1a6955_fcc1_4cce_9d04_6d333ff6d0da.slice/crio-9314be599a465f954bd3a4ef342ee32f89f59892da1d378d8c2eb162ba433ea8 WatchSource:0}: Error finding container 9314be599a465f954bd3a4ef342ee32f89f59892da1d378d8c2eb162ba433ea8: Status 404 returned error can't find the container with id 9314be599a465f954bd3a4ef342ee32f89f59892da1d378d8c2eb162ba433ea8
Sep 10 17:51:39.803486 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:51:39.803459    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 17:51:39.884652 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:51:39.884607    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9w6r5" event={"ID":"4c1a6955-fcc1-4cce-9d04-6d333ff6d0da","Type":"ContainerStarted","Data":"9314be599a465f954bd3a4ef342ee32f89f59892da1d378d8c2eb162ba433ea8"}
Sep 10 17:51:41.896961 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:51:41.896919    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9w6r5" event={"ID":"4c1a6955-fcc1-4cce-9d04-6d333ff6d0da","Type":"ContainerStarted","Data":"b35485f20125ca75db1ca45ba13f2ef97e787913fbfc7da03511ea97597c75e5"}
Sep 10 17:51:41.918918 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:51:41.918855    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9w6r5" podStartSLOduration=1.7917323280000002 podStartE2EDuration="2.918833139s" totalImagesPullingTime="1.127100811s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:51:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:51:41.917884116 +0000 UTC m=+637.679192160" watchObservedRunningTime="2026-09-10 17:51:41.918833139 +0000 UTC m=+637.680141183"
Sep 10 17:51:49.520928 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:51:49.520883    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9w6r5"
Sep 10 17:51:49.521368 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:51:49.520955    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9w6r5"
Sep 10 17:51:49.533921 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:51:49.533887    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9w6r5"
Sep 10 17:51:49.961544 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:51:49.961456    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9w6r5"
Sep 10 17:51:51.110023 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:51:51.109985    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-829cl"]
Sep 10 17:51:51.113886 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:51:51.113864    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-829cl"
Sep 10 17:51:51.116822 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:51:51.116800    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Sep 10 17:51:51.124063 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:51:51.124034    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-829cl"]
Sep 10 17:51:51.151510 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:51:51.151466    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8ff35a61-46cf-482e-b409-12afdaaca041-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-829cl\" (UID: \"8ff35a61-46cf-482e-b409-12afdaaca041\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-829cl"
Sep 10 17:51:51.151510 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:51:51.151517    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8ff35a61-46cf-482e-b409-12afdaaca041-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-829cl\" (UID: \"8ff35a61-46cf-482e-b409-12afdaaca041\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-829cl"
Sep 10 17:51:51.151755 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:51:51.151588    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ff35a61-46cf-482e-b409-12afdaaca041-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-829cl\" (UID: \"8ff35a61-46cf-482e-b409-12afdaaca041\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-829cl"
Sep 10 17:51:51.151755 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:51:51.151621    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6s82\" (UniqueName: \"kubernetes.io/projected/8ff35a61-46cf-482e-b409-12afdaaca041-kube-api-access-t6s82\") pod \"e2e-trlp-test-simulated-kserve-598466548d-829cl\" (UID: \"8ff35a61-46cf-482e-b409-12afdaaca041\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-829cl"
Sep 10 17:51:51.151755 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:51:51.151647    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8ff35a61-46cf-482e-b409-12afdaaca041-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-829cl\" (UID: \"8ff35a61-46cf-482e-b409-12afdaaca041\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-829cl"
Sep 10 17:51:51.151755 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:51:51.151702    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ff35a61-46cf-482e-b409-12afdaaca041-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-829cl\" (UID: \"8ff35a61-46cf-482e-b409-12afdaaca041\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-829cl"
Sep 10 17:51:51.252236 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:51:51.252193    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8ff35a61-46cf-482e-b409-12afdaaca041-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-829cl\" (UID: \"8ff35a61-46cf-482e-b409-12afdaaca041\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-829cl"
Sep 10 17:51:51.252236 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:51:51.252239    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8ff35a61-46cf-482e-b409-12afdaaca041-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-829cl\" (UID: \"8ff35a61-46cf-482e-b409-12afdaaca041\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-829cl"
Sep 10 17:51:51.252515 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:51:51.252311    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ff35a61-46cf-482e-b409-12afdaaca041-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-829cl\" (UID: \"8ff35a61-46cf-482e-b409-12afdaaca041\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-829cl"
Sep 10 17:51:51.252515 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:51:51.252387    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6s82\" (UniqueName: \"kubernetes.io/projected/8ff35a61-46cf-482e-b409-12afdaaca041-kube-api-access-t6s82\") pod \"e2e-trlp-test-simulated-kserve-598466548d-829cl\" (UID: \"8ff35a61-46cf-482e-b409-12afdaaca041\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-829cl"
Sep 10 17:51:51.252515 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:51:51.252418    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8ff35a61-46cf-482e-b409-12afdaaca041-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-829cl\" (UID: \"8ff35a61-46cf-482e-b409-12afdaaca041\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-829cl"
Sep 10 17:51:51.252515 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:51:51.252442    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ff35a61-46cf-482e-b409-12afdaaca041-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-829cl\" (UID: \"8ff35a61-46cf-482e-b409-12afdaaca041\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-829cl"
Sep 10 17:51:51.252732 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:51:51.252707    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8ff35a61-46cf-482e-b409-12afdaaca041-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-829cl\" (UID: \"8ff35a61-46cf-482e-b409-12afdaaca041\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-829cl"
Sep 10 17:51:51.252811 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:51:51.252789    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8ff35a61-46cf-482e-b409-12afdaaca041-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-829cl\" (UID: \"8ff35a61-46cf-482e-b409-12afdaaca041\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-829cl"
Sep 10 17:51:51.252887 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:51:51.252862    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ff35a61-46cf-482e-b409-12afdaaca041-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-829cl\" (UID: \"8ff35a61-46cf-482e-b409-12afdaaca041\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-829cl"
Sep 10 17:51:51.254699 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:51:51.254678    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8ff35a61-46cf-482e-b409-12afdaaca041-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-829cl\" (UID: \"8ff35a61-46cf-482e-b409-12afdaaca041\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-829cl"
Sep 10 17:51:51.254953 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:51:51.254936    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ff35a61-46cf-482e-b409-12afdaaca041-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-829cl\" (UID: \"8ff35a61-46cf-482e-b409-12afdaaca041\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-829cl"
Sep 10 17:51:51.267537 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:51:51.267504    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6s82\" (UniqueName: \"kubernetes.io/projected/8ff35a61-46cf-482e-b409-12afdaaca041-kube-api-access-t6s82\") pod \"e2e-trlp-test-simulated-kserve-598466548d-829cl\" (UID: \"8ff35a61-46cf-482e-b409-12afdaaca041\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-829cl"
Sep 10 17:51:51.425063 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:51:51.424959    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-829cl"
Sep 10 17:51:51.703159 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:51:51.703129    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-829cl"]
Sep 10 17:51:51.705230 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:51:51.705196    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ff35a61_46cf_482e_b409_12afdaaca041.slice/crio-6badf98d7731ddf2f7dc4f452f56b3619f66fefe8868b5e9c8284cc2cbb452c1 WatchSource:0}: Error finding container 6badf98d7731ddf2f7dc4f452f56b3619f66fefe8868b5e9c8284cc2cbb452c1: Status 404 returned error can't find the container with id 6badf98d7731ddf2f7dc4f452f56b3619f66fefe8868b5e9c8284cc2cbb452c1
Sep 10 17:51:51.954993 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:51:51.954962    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-829cl" event={"ID":"8ff35a61-46cf-482e-b409-12afdaaca041","Type":"ContainerStarted","Data":"6badf98d7731ddf2f7dc4f452f56b3619f66fefe8868b5e9c8284cc2cbb452c1"}
Sep 10 17:51:52.962411 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:51:52.962366    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-829cl" event={"ID":"8ff35a61-46cf-482e-b409-12afdaaca041","Type":"ContainerStarted","Data":"388a13ce5c696d4eddf7f4caf34b52a5b03b4767d9981cb23ebfd03bb3e23639"}
Sep 10 17:51:52.981492 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:51:52.981431    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-829cl" podStartSLOduration=1.752236659 podStartE2EDuration="1.98141422s" totalImagesPullingTime="229.177561ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:51:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:51:52.979719605 +0000 UTC m=+648.741027648" watchObservedRunningTime="2026-09-10 17:51:52.98141422 +0000 UTC m=+648.742722262"
Sep 10 17:52:01.425736 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:52:01.425694    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-829cl"
Sep 10 17:52:01.426169 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:52:01.425769    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-829cl"
Sep 10 17:52:01.437949 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:52:01.437917    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-829cl"
Sep 10 17:52:02.022954 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:52:02.022921    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-829cl"
Sep 10 17:54:08.530668 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:08.530623    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bfbf5bd6f-wfw2m"]
Sep 10 17:54:08.531280 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:08.530869    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7bfbf5bd6f-wfw2m" podUID="787a641b-4166-4bc4-954a-8442eaab6b38" containerName="authorino" containerID="cri-o://3e15cf93e2da4f0c5656101265cc5f0a1c9407982f0ea2a3e7fc62e8726c8faf" gracePeriod=30
Sep 10 17:54:08.717532 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:08.717492    2568 generic.go:356] "Generic (PLEG): container finished" podID="787a641b-4166-4bc4-954a-8442eaab6b38" containerID="3e15cf93e2da4f0c5656101265cc5f0a1c9407982f0ea2a3e7fc62e8726c8faf" exitCode=0
Sep 10 17:54:08.717532 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:08.717526    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bfbf5bd6f-wfw2m" event={"ID":"787a641b-4166-4bc4-954a-8442eaab6b38","Type":"ContainerDied","Data":"3e15cf93e2da4f0c5656101265cc5f0a1c9407982f0ea2a3e7fc62e8726c8faf"}
Sep 10 17:54:08.778581 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:08.778543    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bfbf5bd6f-wfw2m"
Sep 10 17:54:08.852217 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:08.852108    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/787a641b-4166-4bc4-954a-8442eaab6b38-tls-cert\") pod \"787a641b-4166-4bc4-954a-8442eaab6b38\" (UID: \"787a641b-4166-4bc4-954a-8442eaab6b38\") "
Sep 10 17:54:08.852217 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:08.852157    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pzx24\" (UniqueName: \"kubernetes.io/projected/787a641b-4166-4bc4-954a-8442eaab6b38-kube-api-access-pzx24\") pod \"787a641b-4166-4bc4-954a-8442eaab6b38\" (UID: \"787a641b-4166-4bc4-954a-8442eaab6b38\") "
Sep 10 17:54:08.854270 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:08.854231    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/787a641b-4166-4bc4-954a-8442eaab6b38-kube-api-access-pzx24" (OuterVolumeSpecName: "kube-api-access-pzx24") pod "787a641b-4166-4bc4-954a-8442eaab6b38" (UID: "787a641b-4166-4bc4-954a-8442eaab6b38"). InnerVolumeSpecName "kube-api-access-pzx24". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:54:08.863074 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:08.863037    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/787a641b-4166-4bc4-954a-8442eaab6b38-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "787a641b-4166-4bc4-954a-8442eaab6b38" (UID: "787a641b-4166-4bc4-954a-8442eaab6b38"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 17:54:08.952986 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:08.952942    2568 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/787a641b-4166-4bc4-954a-8442eaab6b38-tls-cert\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:54:08.952986 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:08.952975    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pzx24\" (UniqueName: \"kubernetes.io/projected/787a641b-4166-4bc4-954a-8442eaab6b38-kube-api-access-pzx24\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:54:09.724913 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:09.724876    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bfbf5bd6f-wfw2m" event={"ID":"787a641b-4166-4bc4-954a-8442eaab6b38","Type":"ContainerDied","Data":"330043df4e665f96697b72d3c29909db15631c9646a2381fcb2434073b7f809e"}
Sep 10 17:54:09.724913 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:09.724903    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bfbf5bd6f-wfw2m"
Sep 10 17:54:09.725535 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:09.724929    2568 scope.go:117] "RemoveContainer" containerID="3e15cf93e2da4f0c5656101265cc5f0a1c9407982f0ea2a3e7fc62e8726c8faf"
Sep 10 17:54:09.753150 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:09.753110    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bfbf5bd6f-wfw2m"]
Sep 10 17:54:09.757135 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:09.757100    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7bfbf5bd6f-wfw2m"]
Sep 10 17:54:10.770464 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:10.770417    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="787a641b-4166-4bc4-954a-8442eaab6b38" path="/var/lib/kubelet/pods/787a641b-4166-4bc4-954a-8442eaab6b38/volumes"
Sep 10 17:54:27.629234 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:27.629150    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7800-2ee4e7"]
Sep 10 17:54:27.629727 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:27.629543    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="787a641b-4166-4bc4-954a-8442eaab6b38" containerName="authorino"
Sep 10 17:54:27.629727 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:27.629557    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="787a641b-4166-4bc4-954a-8442eaab6b38" containerName="authorino"
Sep 10 17:54:27.629727 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:27.629625    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="787a641b-4166-4bc4-954a-8442eaab6b38" containerName="authorino"
Sep 10 17:54:27.634073 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:27.634043    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7800-2ee4e7"
Sep 10 17:54:27.636786 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:27.636754    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7800-2ee4e7"]
Sep 10 17:54:27.636786 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:27.636779    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-r67rg\""
Sep 10 17:54:27.727496 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:27.727459    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxrlx\" (UniqueName: \"kubernetes.io/projected/0aedc5f7-ee6b-424f-85c2-7f8e28776b28-kube-api-access-qxrlx\") pod \"test-curl-7800-2ee4e7\" (UID: \"0aedc5f7-ee6b-424f-85c2-7f8e28776b28\") " pod="opendatahub/test-curl-7800-2ee4e7"
Sep 10 17:54:27.828480 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:27.828442    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxrlx\" (UniqueName: \"kubernetes.io/projected/0aedc5f7-ee6b-424f-85c2-7f8e28776b28-kube-api-access-qxrlx\") pod \"test-curl-7800-2ee4e7\" (UID: \"0aedc5f7-ee6b-424f-85c2-7f8e28776b28\") " pod="opendatahub/test-curl-7800-2ee4e7"
Sep 10 17:54:27.837249 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:27.837212    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxrlx\" (UniqueName: \"kubernetes.io/projected/0aedc5f7-ee6b-424f-85c2-7f8e28776b28-kube-api-access-qxrlx\") pod \"test-curl-7800-2ee4e7\" (UID: \"0aedc5f7-ee6b-424f-85c2-7f8e28776b28\") " pod="opendatahub/test-curl-7800-2ee4e7"
Sep 10 17:54:27.945575 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:27.945480    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7800-2ee4e7"
Sep 10 17:54:28.224533 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:28.224501    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7800-2ee4e7"]
Sep 10 17:54:28.226512 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:54:28.226467    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0aedc5f7_ee6b_424f_85c2_7f8e28776b28.slice/crio-b6bb126ab6595e7714a6caee747ca53d046afbf7a567a129f05f05dbcaaad4e2 WatchSource:0}: Error finding container b6bb126ab6595e7714a6caee747ca53d046afbf7a567a129f05f05dbcaaad4e2: Status 404 returned error can't find the container with id b6bb126ab6595e7714a6caee747ca53d046afbf7a567a129f05f05dbcaaad4e2
Sep 10 17:54:28.833375 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:28.833340    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7800-2ee4e7" event={"ID":"0aedc5f7-ee6b-424f-85c2-7f8e28776b28","Type":"ContainerStarted","Data":"b6bb126ab6595e7714a6caee747ca53d046afbf7a567a129f05f05dbcaaad4e2"}
Sep 10 17:54:30.849283 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:30.849247    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7800-2ee4e7" event={"ID":"0aedc5f7-ee6b-424f-85c2-7f8e28776b28","Type":"ContainerStarted","Data":"610fc51696462d6e25ac89473f7c41104f8000ea00bdbf2246683f73745ef6b4"}
Sep 10 17:54:30.865470 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:30.865411    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7800-2ee4e7" podStartSLOduration=1.77883653 podStartE2EDuration="3.865395007s" totalImagesPullingTime="2.086558477s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:54:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:54:30.864009391 +0000 UTC m=+806.625317435" watchObservedRunningTime="2026-09-10 17:54:30.865395007 +0000 UTC m=+806.626703049"
Sep 10 17:54:31.279555 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:31.279508    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-c34c13-65ff6fd994-gkkcw"]
Sep 10 17:54:31.284154 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:31.284121    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c34c13-65ff6fd994-gkkcw"
Sep 10 17:54:31.287271 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:31.287236    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-c34c13\""
Sep 10 17:54:31.294678 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:31.294644    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-c34c13-65ff6fd994-gkkcw"]
Sep 10 17:54:31.339860 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:31.339819    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-c34c13-84646c5cbc-fvk65"]
Sep 10 17:54:31.343482 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:31.343447    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-c34c13-84646c5cbc-fvk65"
Sep 10 17:54:31.346654 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:31.346620    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-c34c13-dockercfg-p45rb\""
Sep 10 17:54:31.352670 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:31.352635    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-c34c13-84646c5cbc-fvk65"]
Sep 10 17:54:31.463352 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:31.463271    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5qnx\" (UniqueName: \"kubernetes.io/projected/baa9deef-3235-49de-8786-d42baffe159c-kube-api-access-z5qnx\") pod \"payload-pre-processing-e2e-inf-a-c34c13-65ff6fd994-gkkcw\" (UID: \"baa9deef-3235-49de-8786-d42baffe159c\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c34c13-65ff6fd994-gkkcw"
Sep 10 17:54:31.463546 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:31.463391    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/96c332e5-93b8-41ac-92e2-60d55aebce62-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-c34c13-84646c5cbc-fvk65\" (UID: \"96c332e5-93b8-41ac-92e2-60d55aebce62\") " pod="openshift-ingress/payload-processing-e2e-inf-a-c34c13-84646c5cbc-fvk65"
Sep 10 17:54:31.463546 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:31.463464    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xgsb\" (UniqueName: \"kubernetes.io/projected/96c332e5-93b8-41ac-92e2-60d55aebce62-kube-api-access-4xgsb\") pod \"payload-processing-e2e-inf-a-c34c13-84646c5cbc-fvk65\" (UID: \"96c332e5-93b8-41ac-92e2-60d55aebce62\") " pod="openshift-ingress/payload-processing-e2e-inf-a-c34c13-84646c5cbc-fvk65"
Sep 10 17:54:31.463546 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:31.463529    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/baa9deef-3235-49de-8786-d42baffe159c-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-c34c13-65ff6fd994-gkkcw\" (UID: \"baa9deef-3235-49de-8786-d42baffe159c\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c34c13-65ff6fd994-gkkcw"
Sep 10 17:54:31.468600 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:31.468561    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7800-2ee4e7"]
Sep 10 17:54:31.471531 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:31.471493    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7800-2ee4e7"]
Sep 10 17:54:31.564027 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:31.563929    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/baa9deef-3235-49de-8786-d42baffe159c-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-c34c13-65ff6fd994-gkkcw\" (UID: \"baa9deef-3235-49de-8786-d42baffe159c\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c34c13-65ff6fd994-gkkcw"
Sep 10 17:54:31.564027 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:31.563998    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5qnx\" (UniqueName: \"kubernetes.io/projected/baa9deef-3235-49de-8786-d42baffe159c-kube-api-access-z5qnx\") pod \"payload-pre-processing-e2e-inf-a-c34c13-65ff6fd994-gkkcw\" (UID: \"baa9deef-3235-49de-8786-d42baffe159c\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c34c13-65ff6fd994-gkkcw"
Sep 10 17:54:31.564236 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:31.564035    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/96c332e5-93b8-41ac-92e2-60d55aebce62-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-c34c13-84646c5cbc-fvk65\" (UID: \"96c332e5-93b8-41ac-92e2-60d55aebce62\") " pod="openshift-ingress/payload-processing-e2e-inf-a-c34c13-84646c5cbc-fvk65"
Sep 10 17:54:31.564236 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:31.564058    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xgsb\" (UniqueName: \"kubernetes.io/projected/96c332e5-93b8-41ac-92e2-60d55aebce62-kube-api-access-4xgsb\") pod \"payload-processing-e2e-inf-a-c34c13-84646c5cbc-fvk65\" (UID: \"96c332e5-93b8-41ac-92e2-60d55aebce62\") " pod="openshift-ingress/payload-processing-e2e-inf-a-c34c13-84646c5cbc-fvk65"
Sep 10 17:54:31.564726 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:31.564702    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/baa9deef-3235-49de-8786-d42baffe159c-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-c34c13-65ff6fd994-gkkcw\" (UID: \"baa9deef-3235-49de-8786-d42baffe159c\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c34c13-65ff6fd994-gkkcw"
Sep 10 17:54:31.564789 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:31.564766    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/96c332e5-93b8-41ac-92e2-60d55aebce62-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-c34c13-84646c5cbc-fvk65\" (UID: \"96c332e5-93b8-41ac-92e2-60d55aebce62\") " pod="openshift-ingress/payload-processing-e2e-inf-a-c34c13-84646c5cbc-fvk65"
Sep 10 17:54:31.573027 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:31.572990    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5qnx\" (UniqueName: \"kubernetes.io/projected/baa9deef-3235-49de-8786-d42baffe159c-kube-api-access-z5qnx\") pod \"payload-pre-processing-e2e-inf-a-c34c13-65ff6fd994-gkkcw\" (UID: \"baa9deef-3235-49de-8786-d42baffe159c\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c34c13-65ff6fd994-gkkcw"
Sep 10 17:54:31.573178 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:31.572990    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xgsb\" (UniqueName: \"kubernetes.io/projected/96c332e5-93b8-41ac-92e2-60d55aebce62-kube-api-access-4xgsb\") pod \"payload-processing-e2e-inf-a-c34c13-84646c5cbc-fvk65\" (UID: \"96c332e5-93b8-41ac-92e2-60d55aebce62\") " pod="openshift-ingress/payload-processing-e2e-inf-a-c34c13-84646c5cbc-fvk65"
Sep 10 17:54:31.585091 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:31.585046    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7800-ac7c9b"]
Sep 10 17:54:31.585615 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:31.585588    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0aedc5f7-ee6b-424f-85c2-7f8e28776b28" containerName="test-curl-7800-2ee4e7"
Sep 10 17:54:31.585615 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:31.585614    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="0aedc5f7-ee6b-424f-85c2-7f8e28776b28" containerName="test-curl-7800-2ee4e7"
Sep 10 17:54:31.585816 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:31.585700    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="0aedc5f7-ee6b-424f-85c2-7f8e28776b28" containerName="test-curl-7800-2ee4e7"
Sep 10 17:54:31.590114 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:31.590082    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7800-ac7c9b"
Sep 10 17:54:31.596160 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:31.596124    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7800-ac7c9b"]
Sep 10 17:54:31.597749 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:31.597721    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c34c13-65ff6fd994-gkkcw"
Sep 10 17:54:31.658797 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:31.658298    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-c34c13-84646c5cbc-fvk65"
Sep 10 17:54:31.665254 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:31.665145    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxpdr\" (UniqueName: \"kubernetes.io/projected/e3fa2a95-aab6-45ea-9d56-2a3976a6bb69-kube-api-access-bxpdr\") pod \"test-curl-7800-ac7c9b\" (UID: \"e3fa2a95-aab6-45ea-9d56-2a3976a6bb69\") " pod="opendatahub/test-curl-7800-ac7c9b"
Sep 10 17:54:31.766029 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:31.765989    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxpdr\" (UniqueName: \"kubernetes.io/projected/e3fa2a95-aab6-45ea-9d56-2a3976a6bb69-kube-api-access-bxpdr\") pod \"test-curl-7800-ac7c9b\" (UID: \"e3fa2a95-aab6-45ea-9d56-2a3976a6bb69\") " pod="opendatahub/test-curl-7800-ac7c9b"
Sep 10 17:54:31.774016 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:31.773984    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxpdr\" (UniqueName: \"kubernetes.io/projected/e3fa2a95-aab6-45ea-9d56-2a3976a6bb69-kube-api-access-bxpdr\") pod \"test-curl-7800-ac7c9b\" (UID: \"e3fa2a95-aab6-45ea-9d56-2a3976a6bb69\") " pod="opendatahub/test-curl-7800-ac7c9b"
Sep 10 17:54:31.855110 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:54:31.854997    2568 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7800-2ee4e7" container="test-curl-7800-2ee4e7"
Sep 10 17:54:31.878983 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:31.878956    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-c34c13-65ff6fd994-gkkcw"]
Sep 10 17:54:31.880399 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:54:31.880366    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbaa9deef_3235_49de_8786_d42baffe159c.slice/crio-e77d882dfb3838e0c75639abfe2f982175d0b0897b5d8e809bcb5e5265c0324a WatchSource:0}: Error finding container e77d882dfb3838e0c75639abfe2f982175d0b0897b5d8e809bcb5e5265c0324a: Status 404 returned error can't find the container with id e77d882dfb3838e0c75639abfe2f982175d0b0897b5d8e809bcb5e5265c0324a
Sep 10 17:54:31.902206 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:31.902176    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7800-ac7c9b"
Sep 10 17:54:31.943671 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:31.943134    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-c34c13-84646c5cbc-fvk65"]
Sep 10 17:54:31.946620 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:54:31.946588    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96c332e5_93b8_41ac_92e2_60d55aebce62.slice/crio-e5b378a806395031ce0f9784eef70d3da2de34d9928398c210ddc24ccbdf878b WatchSource:0}: Error finding container e5b378a806395031ce0f9784eef70d3da2de34d9928398c210ddc24ccbdf878b: Status 404 returned error can't find the container with id e5b378a806395031ce0f9784eef70d3da2de34d9928398c210ddc24ccbdf878b
Sep 10 17:54:32.196213 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:32.196177    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7800-ac7c9b"]
Sep 10 17:54:32.197277 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:54:32.197248    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode3fa2a95_aab6_45ea_9d56_2a3976a6bb69.slice/crio-1257f921b2293e7d681066b34fafde7965160889223b849722dae07af5178b26 WatchSource:0}: Error finding container 1257f921b2293e7d681066b34fafde7965160889223b849722dae07af5178b26: Status 404 returned error can't find the container with id 1257f921b2293e7d681066b34fafde7965160889223b849722dae07af5178b26
Sep 10 17:54:32.863358 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:32.863298    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-c34c13-84646c5cbc-fvk65" event={"ID":"96c332e5-93b8-41ac-92e2-60d55aebce62","Type":"ContainerStarted","Data":"ffefd7d4420faf6791a43a54e9bcfcf1aba9f422de73bb80b264e26713a0b205"}
Sep 10 17:54:32.863930 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:32.863388    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-c34c13-84646c5cbc-fvk65"
Sep 10 17:54:32.863930 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:32.863414    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-c34c13-84646c5cbc-fvk65" event={"ID":"96c332e5-93b8-41ac-92e2-60d55aebce62","Type":"ContainerStarted","Data":"e5b378a806395031ce0f9784eef70d3da2de34d9928398c210ddc24ccbdf878b"}
Sep 10 17:54:32.865160 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:32.865122    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c34c13-65ff6fd994-gkkcw" event={"ID":"baa9deef-3235-49de-8786-d42baffe159c","Type":"ContainerStarted","Data":"530a84caa1fe2a8f61576aaeeeb14a2a92682a73af871724bfaba84c8905430e"}
Sep 10 17:54:32.865337 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:32.865190    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c34c13-65ff6fd994-gkkcw" event={"ID":"baa9deef-3235-49de-8786-d42baffe159c","Type":"ContainerStarted","Data":"e77d882dfb3838e0c75639abfe2f982175d0b0897b5d8e809bcb5e5265c0324a"}
Sep 10 17:54:32.865337 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:32.865218    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c34c13-65ff6fd994-gkkcw"
Sep 10 17:54:32.866934 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:32.866905    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7800-ac7c9b" event={"ID":"e3fa2a95-aab6-45ea-9d56-2a3976a6bb69","Type":"ContainerStarted","Data":"f9f00c6c30ca0f8d669764775e8aa946fcb777b8ae67070300b72dcc8bb5bf9c"}
Sep 10 17:54:32.867077 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:32.866957    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7800-ac7c9b" event={"ID":"e3fa2a95-aab6-45ea-9d56-2a3976a6bb69","Type":"ContainerStarted","Data":"1257f921b2293e7d681066b34fafde7965160889223b849722dae07af5178b26"}
Sep 10 17:54:32.867077 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:32.867050    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7800-2ee4e7" podUID="0aedc5f7-ee6b-424f-85c2-7f8e28776b28" containerName="test-curl-7800-2ee4e7" containerID="cri-o://610fc51696462d6e25ac89473f7c41104f8000ea00bdbf2246683f73745ef6b4" gracePeriod=2
Sep 10 17:54:32.880240 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:32.880185    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-c34c13-84646c5cbc-fvk65" podStartSLOduration=1.880168731 podStartE2EDuration="1.880168731s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:54:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:54:32.87930798 +0000 UTC m=+808.640616035" watchObservedRunningTime="2026-09-10 17:54:32.880168731 +0000 UTC m=+808.641476773"
Sep 10 17:54:32.893335 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:32.893261    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7800-ac7c9b" podStartSLOduration=1.8932435239999998 podStartE2EDuration="1.893243524s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:54:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:54:32.892801407 +0000 UTC m=+808.654109450" watchObservedRunningTime="2026-09-10 17:54:32.893243524 +0000 UTC m=+808.654551566"
Sep 10 17:54:32.922194 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:32.922113    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c34c13-65ff6fd994-gkkcw" podStartSLOduration=1.922086038 podStartE2EDuration="1.922086038s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:54:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:54:32.920563417 +0000 UTC m=+808.681871445" watchObservedRunningTime="2026-09-10 17:54:32.922086038 +0000 UTC m=+808.683394082"
Sep 10 17:54:33.519762 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:33.519710    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7800-ac7c9b"]
Sep 10 17:54:33.523637 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:33.523606    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7800-ac7c9b"]
Sep 10 17:54:33.874912 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:54:33.874875    2568 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7800-ac7c9b" container="test-curl-7800-ac7c9b"
Sep 10 17:54:34.879689 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:34.879652    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7800-ac7c9b" podUID="e3fa2a95-aab6-45ea-9d56-2a3976a6bb69" containerName="test-curl-7800-ac7c9b" containerID="cri-o://f9f00c6c30ca0f8d669764775e8aa946fcb777b8ae67070300b72dcc8bb5bf9c" gracePeriod=2
Sep 10 17:54:35.016972 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:35.016944    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7800-2ee4e7"
Sep 10 17:54:35.092191 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:35.092155    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qxrlx\" (UniqueName: \"kubernetes.io/projected/0aedc5f7-ee6b-424f-85c2-7f8e28776b28-kube-api-access-qxrlx\") pod \"0aedc5f7-ee6b-424f-85c2-7f8e28776b28\" (UID: \"0aedc5f7-ee6b-424f-85c2-7f8e28776b28\") "
Sep 10 17:54:35.094442 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:35.094401    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0aedc5f7-ee6b-424f-85c2-7f8e28776b28-kube-api-access-qxrlx" (OuterVolumeSpecName: "kube-api-access-qxrlx") pod "0aedc5f7-ee6b-424f-85c2-7f8e28776b28" (UID: "0aedc5f7-ee6b-424f-85c2-7f8e28776b28"). InnerVolumeSpecName "kube-api-access-qxrlx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:54:35.192964 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:35.192871    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qxrlx\" (UniqueName: \"kubernetes.io/projected/0aedc5f7-ee6b-424f-85c2-7f8e28776b28-kube-api-access-qxrlx\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:54:35.885935 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:35.885899    2568 generic.go:356] "Generic (PLEG): container finished" podID="0aedc5f7-ee6b-424f-85c2-7f8e28776b28" containerID="610fc51696462d6e25ac89473f7c41104f8000ea00bdbf2246683f73745ef6b4" exitCode=137
Sep 10 17:54:35.886360 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:35.885940    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7800-2ee4e7"
Sep 10 17:54:35.886360 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:35.885982    2568 scope.go:117] "RemoveContainer" containerID="610fc51696462d6e25ac89473f7c41104f8000ea00bdbf2246683f73745ef6b4"
Sep 10 17:54:35.895170 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:35.895147    2568 scope.go:117] "RemoveContainer" containerID="610fc51696462d6e25ac89473f7c41104f8000ea00bdbf2246683f73745ef6b4"
Sep 10 17:54:35.895607 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:54:35.895589    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"610fc51696462d6e25ac89473f7c41104f8000ea00bdbf2246683f73745ef6b4\": container with ID starting with 610fc51696462d6e25ac89473f7c41104f8000ea00bdbf2246683f73745ef6b4 not found: ID does not exist" containerID="610fc51696462d6e25ac89473f7c41104f8000ea00bdbf2246683f73745ef6b4"
Sep 10 17:54:35.895662 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:35.895617    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"610fc51696462d6e25ac89473f7c41104f8000ea00bdbf2246683f73745ef6b4"} err="failed to get container status \"610fc51696462d6e25ac89473f7c41104f8000ea00bdbf2246683f73745ef6b4\": rpc error: code = NotFound desc = could not find container \"610fc51696462d6e25ac89473f7c41104f8000ea00bdbf2246683f73745ef6b4\": container with ID starting with 610fc51696462d6e25ac89473f7c41104f8000ea00bdbf2246683f73745ef6b4 not found: ID does not exist"
Sep 10 17:54:35.896643 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:54:35.896609    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7800-2ee4e7\" is forbidden: User \"system:node:ip-10-0-136-161.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-161.ec2.internal' and this object" podUID="0aedc5f7-ee6b-424f-85c2-7f8e28776b28" pod="opendatahub/test-curl-7800-2ee4e7"
Sep 10 17:54:36.770746 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:36.770711    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0aedc5f7-ee6b-424f-85c2-7f8e28776b28" path="/var/lib/kubelet/pods/0aedc5f7-ee6b-424f-85c2-7f8e28776b28/volumes"
Sep 10 17:54:37.022370 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:37.022285    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7800-ac7c9b"
Sep 10 17:54:37.103721 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:37.103685    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bxpdr\" (UniqueName: \"kubernetes.io/projected/e3fa2a95-aab6-45ea-9d56-2a3976a6bb69-kube-api-access-bxpdr\") pod \"e3fa2a95-aab6-45ea-9d56-2a3976a6bb69\" (UID: \"e3fa2a95-aab6-45ea-9d56-2a3976a6bb69\") "
Sep 10 17:54:37.105815 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:37.105790    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3fa2a95-aab6-45ea-9d56-2a3976a6bb69-kube-api-access-bxpdr" (OuterVolumeSpecName: "kube-api-access-bxpdr") pod "e3fa2a95-aab6-45ea-9d56-2a3976a6bb69" (UID: "e3fa2a95-aab6-45ea-9d56-2a3976a6bb69"). InnerVolumeSpecName "kube-api-access-bxpdr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:54:37.204805 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:37.204750    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bxpdr\" (UniqueName: \"kubernetes.io/projected/e3fa2a95-aab6-45ea-9d56-2a3976a6bb69-kube-api-access-bxpdr\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:54:37.678553 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:37.678511    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-conflict-a-b42bbba1-kserve-5c4d9974b5-jjtk8"]
Sep 10 17:54:37.678893 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:37.678879    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3fa2a95-aab6-45ea-9d56-2a3976a6bb69" containerName="test-curl-7800-ac7c9b"
Sep 10 17:54:37.678941 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:37.678894    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3fa2a95-aab6-45ea-9d56-2a3976a6bb69" containerName="test-curl-7800-ac7c9b"
Sep 10 17:54:37.678977 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:37.678964    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3fa2a95-aab6-45ea-9d56-2a3976a6bb69" containerName="test-curl-7800-ac7c9b"
Sep 10 17:54:37.682056 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:37.682032    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-b42bbba1-kserve-5c4d9974b5-jjtk8"
Sep 10 17:54:37.685168 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:37.685141    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-conflict-a-b42bbba1-kserve-self-signed-certs\""
Sep 10 17:54:37.691068 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:37.691032    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-conflict-a-b42bbba1-kserve-5c4d9974b5-jjtk8"]
Sep 10 17:54:37.708372 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:37.708301    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/18fba35c-cbc6-4330-ae60-edd72c307f5c-dshm\") pod \"e2e-conflict-a-b42bbba1-kserve-5c4d9974b5-jjtk8\" (UID: \"18fba35c-cbc6-4330-ae60-edd72c307f5c\") " pod="llm/e2e-conflict-a-b42bbba1-kserve-5c4d9974b5-jjtk8"
Sep 10 17:54:37.708372 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:37.708368    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/18fba35c-cbc6-4330-ae60-edd72c307f5c-tls-certs\") pod \"e2e-conflict-a-b42bbba1-kserve-5c4d9974b5-jjtk8\" (UID: \"18fba35c-cbc6-4330-ae60-edd72c307f5c\") " pod="llm/e2e-conflict-a-b42bbba1-kserve-5c4d9974b5-jjtk8"
Sep 10 17:54:37.708674 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:37.708401    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/18fba35c-cbc6-4330-ae60-edd72c307f5c-tmp-dir\") pod \"e2e-conflict-a-b42bbba1-kserve-5c4d9974b5-jjtk8\" (UID: \"18fba35c-cbc6-4330-ae60-edd72c307f5c\") " pod="llm/e2e-conflict-a-b42bbba1-kserve-5c4d9974b5-jjtk8"
Sep 10 17:54:37.708674 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:37.708423    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c57fk\" (UniqueName: \"kubernetes.io/projected/18fba35c-cbc6-4330-ae60-edd72c307f5c-kube-api-access-c57fk\") pod \"e2e-conflict-a-b42bbba1-kserve-5c4d9974b5-jjtk8\" (UID: \"18fba35c-cbc6-4330-ae60-edd72c307f5c\") " pod="llm/e2e-conflict-a-b42bbba1-kserve-5c4d9974b5-jjtk8"
Sep 10 17:54:37.708674 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:37.708444    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/18fba35c-cbc6-4330-ae60-edd72c307f5c-model-cache\") pod \"e2e-conflict-a-b42bbba1-kserve-5c4d9974b5-jjtk8\" (UID: \"18fba35c-cbc6-4330-ae60-edd72c307f5c\") " pod="llm/e2e-conflict-a-b42bbba1-kserve-5c4d9974b5-jjtk8"
Sep 10 17:54:37.708674 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:37.708542    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/18fba35c-cbc6-4330-ae60-edd72c307f5c-home\") pod \"e2e-conflict-a-b42bbba1-kserve-5c4d9974b5-jjtk8\" (UID: \"18fba35c-cbc6-4330-ae60-edd72c307f5c\") " pod="llm/e2e-conflict-a-b42bbba1-kserve-5c4d9974b5-jjtk8"
Sep 10 17:54:37.810180 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:37.810130    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/18fba35c-cbc6-4330-ae60-edd72c307f5c-home\") pod \"e2e-conflict-a-b42bbba1-kserve-5c4d9974b5-jjtk8\" (UID: \"18fba35c-cbc6-4330-ae60-edd72c307f5c\") " pod="llm/e2e-conflict-a-b42bbba1-kserve-5c4d9974b5-jjtk8"
Sep 10 17:54:37.810718 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:37.810691    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/18fba35c-cbc6-4330-ae60-edd72c307f5c-dshm\") pod \"e2e-conflict-a-b42bbba1-kserve-5c4d9974b5-jjtk8\" (UID: \"18fba35c-cbc6-4330-ae60-edd72c307f5c\") " pod="llm/e2e-conflict-a-b42bbba1-kserve-5c4d9974b5-jjtk8"
Sep 10 17:54:37.810899 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:37.810869    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/18fba35c-cbc6-4330-ae60-edd72c307f5c-tls-certs\") pod \"e2e-conflict-a-b42bbba1-kserve-5c4d9974b5-jjtk8\" (UID: \"18fba35c-cbc6-4330-ae60-edd72c307f5c\") " pod="llm/e2e-conflict-a-b42bbba1-kserve-5c4d9974b5-jjtk8"
Sep 10 17:54:37.810983 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:37.810964    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/18fba35c-cbc6-4330-ae60-edd72c307f5c-tmp-dir\") pod \"e2e-conflict-a-b42bbba1-kserve-5c4d9974b5-jjtk8\" (UID: \"18fba35c-cbc6-4330-ae60-edd72c307f5c\") " pod="llm/e2e-conflict-a-b42bbba1-kserve-5c4d9974b5-jjtk8"
Sep 10 17:54:37.811058 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:37.811010    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c57fk\" (UniqueName: \"kubernetes.io/projected/18fba35c-cbc6-4330-ae60-edd72c307f5c-kube-api-access-c57fk\") pod \"e2e-conflict-a-b42bbba1-kserve-5c4d9974b5-jjtk8\" (UID: \"18fba35c-cbc6-4330-ae60-edd72c307f5c\") " pod="llm/e2e-conflict-a-b42bbba1-kserve-5c4d9974b5-jjtk8"
Sep 10 17:54:37.811058 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:37.811049    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/18fba35c-cbc6-4330-ae60-edd72c307f5c-model-cache\") pod \"e2e-conflict-a-b42bbba1-kserve-5c4d9974b5-jjtk8\" (UID: \"18fba35c-cbc6-4330-ae60-edd72c307f5c\") " pod="llm/e2e-conflict-a-b42bbba1-kserve-5c4d9974b5-jjtk8"
Sep 10 17:54:37.811479 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:37.811452    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/18fba35c-cbc6-4330-ae60-edd72c307f5c-tmp-dir\") pod \"e2e-conflict-a-b42bbba1-kserve-5c4d9974b5-jjtk8\" (UID: \"18fba35c-cbc6-4330-ae60-edd72c307f5c\") " pod="llm/e2e-conflict-a-b42bbba1-kserve-5c4d9974b5-jjtk8"
Sep 10 17:54:37.812109 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:37.812078    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/18fba35c-cbc6-4330-ae60-edd72c307f5c-model-cache\") pod \"e2e-conflict-a-b42bbba1-kserve-5c4d9974b5-jjtk8\" (UID: \"18fba35c-cbc6-4330-ae60-edd72c307f5c\") " pod="llm/e2e-conflict-a-b42bbba1-kserve-5c4d9974b5-jjtk8"
Sep 10 17:54:37.812301 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:37.812269    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/18fba35c-cbc6-4330-ae60-edd72c307f5c-home\") pod \"e2e-conflict-a-b42bbba1-kserve-5c4d9974b5-jjtk8\" (UID: \"18fba35c-cbc6-4330-ae60-edd72c307f5c\") " pod="llm/e2e-conflict-a-b42bbba1-kserve-5c4d9974b5-jjtk8"
Sep 10 17:54:37.818978 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:37.818938    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/18fba35c-cbc6-4330-ae60-edd72c307f5c-dshm\") pod \"e2e-conflict-a-b42bbba1-kserve-5c4d9974b5-jjtk8\" (UID: \"18fba35c-cbc6-4330-ae60-edd72c307f5c\") " pod="llm/e2e-conflict-a-b42bbba1-kserve-5c4d9974b5-jjtk8"
Sep 10 17:54:37.819349 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:37.819295    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/18fba35c-cbc6-4330-ae60-edd72c307f5c-tls-certs\") pod \"e2e-conflict-a-b42bbba1-kserve-5c4d9974b5-jjtk8\" (UID: \"18fba35c-cbc6-4330-ae60-edd72c307f5c\") " pod="llm/e2e-conflict-a-b42bbba1-kserve-5c4d9974b5-jjtk8"
Sep 10 17:54:37.832790 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:37.832748    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c57fk\" (UniqueName: \"kubernetes.io/projected/18fba35c-cbc6-4330-ae60-edd72c307f5c-kube-api-access-c57fk\") pod \"e2e-conflict-a-b42bbba1-kserve-5c4d9974b5-jjtk8\" (UID: \"18fba35c-cbc6-4330-ae60-edd72c307f5c\") " pod="llm/e2e-conflict-a-b42bbba1-kserve-5c4d9974b5-jjtk8"
Sep 10 17:54:37.899834 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:37.899791    2568 generic.go:356] "Generic (PLEG): container finished" podID="e3fa2a95-aab6-45ea-9d56-2a3976a6bb69" containerID="f9f00c6c30ca0f8d669764775e8aa946fcb777b8ae67070300b72dcc8bb5bf9c" exitCode=137
Sep 10 17:54:37.900007 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:37.899880    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7800-ac7c9b"
Sep 10 17:54:37.900007 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:37.899914    2568 scope.go:117] "RemoveContainer" containerID="f9f00c6c30ca0f8d669764775e8aa946fcb777b8ae67070300b72dcc8bb5bf9c"
Sep 10 17:54:37.913758 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:54:37.913713    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7800-ac7c9b\" is forbidden: User \"system:node:ip-10-0-136-161.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-161.ec2.internal' and this object" podUID="e3fa2a95-aab6-45ea-9d56-2a3976a6bb69" pod="opendatahub/test-curl-7800-ac7c9b"
Sep 10 17:54:37.914543 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:37.914485    2568 scope.go:117] "RemoveContainer" containerID="f9f00c6c30ca0f8d669764775e8aa946fcb777b8ae67070300b72dcc8bb5bf9c"
Sep 10 17:54:37.914895 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:54:37.914866    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f9f00c6c30ca0f8d669764775e8aa946fcb777b8ae67070300b72dcc8bb5bf9c\": container with ID starting with f9f00c6c30ca0f8d669764775e8aa946fcb777b8ae67070300b72dcc8bb5bf9c not found: ID does not exist" containerID="f9f00c6c30ca0f8d669764775e8aa946fcb777b8ae67070300b72dcc8bb5bf9c"
Sep 10 17:54:37.915017 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:37.914906    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9f00c6c30ca0f8d669764775e8aa946fcb777b8ae67070300b72dcc8bb5bf9c"} err="failed to get container status \"f9f00c6c30ca0f8d669764775e8aa946fcb777b8ae67070300b72dcc8bb5bf9c\": rpc error: code = NotFound desc = could not find container \"f9f00c6c30ca0f8d669764775e8aa946fcb777b8ae67070300b72dcc8bb5bf9c\": container with ID starting with f9f00c6c30ca0f8d669764775e8aa946fcb777b8ae67070300b72dcc8bb5bf9c not found: ID does not exist"
Sep 10 17:54:37.993513 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:37.993481    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-b42bbba1-kserve-5c4d9974b5-jjtk8"
Sep 10 17:54:38.279581 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:38.279554    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-conflict-a-b42bbba1-kserve-5c4d9974b5-jjtk8"]
Sep 10 17:54:38.281886 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:54:38.281854    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod18fba35c_cbc6_4330_ae60_edd72c307f5c.slice/crio-48e35476bc336e6219ad50cb5415e92213e986714750bc64b1c6ebd0151cb41a WatchSource:0}: Error finding container 48e35476bc336e6219ad50cb5415e92213e986714750bc64b1c6ebd0151cb41a: Status 404 returned error can't find the container with id 48e35476bc336e6219ad50cb5415e92213e986714750bc64b1c6ebd0151cb41a
Sep 10 17:54:38.770657 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:38.770621    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e3fa2a95-aab6-45ea-9d56-2a3976a6bb69" path="/var/lib/kubelet/pods/e3fa2a95-aab6-45ea-9d56-2a3976a6bb69/volumes"
Sep 10 17:54:38.909189 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:38.909151    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-b42bbba1-kserve-5c4d9974b5-jjtk8" event={"ID":"18fba35c-cbc6-4330-ae60-edd72c307f5c","Type":"ContainerStarted","Data":"ca5562f86331e24025f28ed749cdaad28b8b631748c181bd5c37efff27a9aeff"}
Sep 10 17:54:38.909410 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:38.909198    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-b42bbba1-kserve-5c4d9974b5-jjtk8" event={"ID":"18fba35c-cbc6-4330-ae60-edd72c307f5c","Type":"ContainerStarted","Data":"48e35476bc336e6219ad50cb5415e92213e986714750bc64b1c6ebd0151cb41a"}
Sep 10 17:54:38.935775 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:38.935696    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-conflict-a-b42bbba1-kserve-5c4d9974b5-jjtk8" podStartSLOduration=1.9356743939999999 podStartE2EDuration="1.935674394s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:54:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:54:38.933012433 +0000 UTC m=+814.694320475" watchObservedRunningTime="2026-09-10 17:54:38.935674394 +0000 UTC m=+814.696982438"
Sep 10 17:54:39.045299 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:39.045205    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-007ef522-5f9b698b66-dlpwp"]
Sep 10 17:54:39.049716 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:39.049688    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-007ef522-5f9b698b66-dlpwp"
Sep 10 17:54:39.052389 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:39.052346    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-007ef522\""
Sep 10 17:54:39.052507 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:39.052476    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-007ef522-dockercfg-hr4kz\""
Sep 10 17:54:39.058625 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:39.058591    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-007ef522-5f9b698b66-dlpwp"]
Sep 10 17:54:39.070108 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:39.070071    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-007ef522-56c59c9c65-r529n"]
Sep 10 17:54:39.073724 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:39.073683    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-007ef522-56c59c9c65-r529n"
Sep 10 17:54:39.087581 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:39.087544    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-007ef522-56c59c9c65-r529n"]
Sep 10 17:54:39.120965 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:39.120922    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9p4q\" (UniqueName: \"kubernetes.io/projected/3afae4f5-cb70-44b8-9848-ac8bff3be33d-kube-api-access-f9p4q\") pod \"payload-processing-e2e-ait-007ef522-56c59c9c65-r529n\" (UID: \"3afae4f5-cb70-44b8-9848-ac8bff3be33d\") " pod="openshift-ingress/payload-processing-e2e-ait-007ef522-56c59c9c65-r529n"
Sep 10 17:54:39.121151 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:39.120975    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3afae4f5-cb70-44b8-9848-ac8bff3be33d-plugins-config-volume\") pod \"payload-processing-e2e-ait-007ef522-56c59c9c65-r529n\" (UID: \"3afae4f5-cb70-44b8-9848-ac8bff3be33d\") " pod="openshift-ingress/payload-processing-e2e-ait-007ef522-56c59c9c65-r529n"
Sep 10 17:54:39.121151 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:39.121053    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mv5fq\" (UniqueName: \"kubernetes.io/projected/be523be7-0638-4a62-be54-76561c521452-kube-api-access-mv5fq\") pod \"payload-pre-processing-e2e-ait-007ef522-5f9b698b66-dlpwp\" (UID: \"be523be7-0638-4a62-be54-76561c521452\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-007ef522-5f9b698b66-dlpwp"
Sep 10 17:54:39.121151 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:39.121115    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/be523be7-0638-4a62-be54-76561c521452-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-007ef522-5f9b698b66-dlpwp\" (UID: \"be523be7-0638-4a62-be54-76561c521452\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-007ef522-5f9b698b66-dlpwp"
Sep 10 17:54:39.222584 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:39.222540    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9p4q\" (UniqueName: \"kubernetes.io/projected/3afae4f5-cb70-44b8-9848-ac8bff3be33d-kube-api-access-f9p4q\") pod \"payload-processing-e2e-ait-007ef522-56c59c9c65-r529n\" (UID: \"3afae4f5-cb70-44b8-9848-ac8bff3be33d\") " pod="openshift-ingress/payload-processing-e2e-ait-007ef522-56c59c9c65-r529n"
Sep 10 17:54:39.222780 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:39.222603    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3afae4f5-cb70-44b8-9848-ac8bff3be33d-plugins-config-volume\") pod \"payload-processing-e2e-ait-007ef522-56c59c9c65-r529n\" (UID: \"3afae4f5-cb70-44b8-9848-ac8bff3be33d\") " pod="openshift-ingress/payload-processing-e2e-ait-007ef522-56c59c9c65-r529n"
Sep 10 17:54:39.222780 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:39.222631    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mv5fq\" (UniqueName: \"kubernetes.io/projected/be523be7-0638-4a62-be54-76561c521452-kube-api-access-mv5fq\") pod \"payload-pre-processing-e2e-ait-007ef522-5f9b698b66-dlpwp\" (UID: \"be523be7-0638-4a62-be54-76561c521452\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-007ef522-5f9b698b66-dlpwp"
Sep 10 17:54:39.222904 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:39.222792    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/be523be7-0638-4a62-be54-76561c521452-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-007ef522-5f9b698b66-dlpwp\" (UID: \"be523be7-0638-4a62-be54-76561c521452\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-007ef522-5f9b698b66-dlpwp"
Sep 10 17:54:39.223470 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:39.223449    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/be523be7-0638-4a62-be54-76561c521452-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-007ef522-5f9b698b66-dlpwp\" (UID: \"be523be7-0638-4a62-be54-76561c521452\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-007ef522-5f9b698b66-dlpwp"
Sep 10 17:54:39.223614 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:39.223589    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3afae4f5-cb70-44b8-9848-ac8bff3be33d-plugins-config-volume\") pod \"payload-processing-e2e-ait-007ef522-56c59c9c65-r529n\" (UID: \"3afae4f5-cb70-44b8-9848-ac8bff3be33d\") " pod="openshift-ingress/payload-processing-e2e-ait-007ef522-56c59c9c65-r529n"
Sep 10 17:54:39.232002 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:39.231955    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mv5fq\" (UniqueName: \"kubernetes.io/projected/be523be7-0638-4a62-be54-76561c521452-kube-api-access-mv5fq\") pod \"payload-pre-processing-e2e-ait-007ef522-5f9b698b66-dlpwp\" (UID: \"be523be7-0638-4a62-be54-76561c521452\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-007ef522-5f9b698b66-dlpwp"
Sep 10 17:54:39.232164 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:39.232073    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9p4q\" (UniqueName: \"kubernetes.io/projected/3afae4f5-cb70-44b8-9848-ac8bff3be33d-kube-api-access-f9p4q\") pod \"payload-processing-e2e-ait-007ef522-56c59c9c65-r529n\" (UID: \"3afae4f5-cb70-44b8-9848-ac8bff3be33d\") " pod="openshift-ingress/payload-processing-e2e-ait-007ef522-56c59c9c65-r529n"
Sep 10 17:54:39.364477 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:39.364377    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-007ef522-5f9b698b66-dlpwp"
Sep 10 17:54:39.386316 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:39.386272    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-007ef522-56c59c9c65-r529n"
Sep 10 17:54:39.652915 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:39.652884    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-007ef522-5f9b698b66-dlpwp"]
Sep 10 17:54:39.655846 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:54:39.655812    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe523be7_0638_4a62_be54_76561c521452.slice/crio-6cd14d14989ba69fb0c1df9eb8c1b8bfaa43cfa28d1616293b5887933f21c9b5 WatchSource:0}: Error finding container 6cd14d14989ba69fb0c1df9eb8c1b8bfaa43cfa28d1616293b5887933f21c9b5: Status 404 returned error can't find the container with id 6cd14d14989ba69fb0c1df9eb8c1b8bfaa43cfa28d1616293b5887933f21c9b5
Sep 10 17:54:39.680122 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:39.680085    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-007ef522-56c59c9c65-r529n"]
Sep 10 17:54:39.688598 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:54:39.688563    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3afae4f5_cb70_44b8_9848_ac8bff3be33d.slice/crio-c939c76978cef9aaa2b1b04b97ac8473ef49cd8e0ca31898992863c9ff3f7f07 WatchSource:0}: Error finding container c939c76978cef9aaa2b1b04b97ac8473ef49cd8e0ca31898992863c9ff3f7f07: Status 404 returned error can't find the container with id c939c76978cef9aaa2b1b04b97ac8473ef49cd8e0ca31898992863c9ff3f7f07
Sep 10 17:54:39.920454 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:39.920260    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-007ef522-56c59c9c65-r529n" event={"ID":"3afae4f5-cb70-44b8-9848-ac8bff3be33d","Type":"ContainerStarted","Data":"fb9ef1792c980206e1def3c1930234e976069a4efceb3a6b294b5cb2e9f3fc7d"}
Sep 10 17:54:39.920454 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:39.920348    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-007ef522-56c59c9c65-r529n" event={"ID":"3afae4f5-cb70-44b8-9848-ac8bff3be33d","Type":"ContainerStarted","Data":"c939c76978cef9aaa2b1b04b97ac8473ef49cd8e0ca31898992863c9ff3f7f07"}
Sep 10 17:54:39.922389 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:39.922353    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-007ef522-5f9b698b66-dlpwp" event={"ID":"be523be7-0638-4a62-be54-76561c521452","Type":"ContainerStarted","Data":"a0740aa2a8b2610358ff312ec14300b7329ecd376e868d1fa2a195bba8014d6b"}
Sep 10 17:54:39.922547 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:39.922413    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-007ef522-5f9b698b66-dlpwp" event={"ID":"be523be7-0638-4a62-be54-76561c521452","Type":"ContainerStarted","Data":"6cd14d14989ba69fb0c1df9eb8c1b8bfaa43cfa28d1616293b5887933f21c9b5"}
Sep 10 17:54:39.946520 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:39.946442    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-007ef522-56c59c9c65-r529n" podStartSLOduration=0.946407314 podStartE2EDuration="946.407314ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:54:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:54:39.941578254 +0000 UTC m=+815.702886315" watchObservedRunningTime="2026-09-10 17:54:39.946407314 +0000 UTC m=+815.707715360"
Sep 10 17:54:40.015304 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:40.015246    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-007ef522-5f9b698b66-dlpwp" podStartSLOduration=1.015223285 podStartE2EDuration="1.015223285s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:54:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:54:39.960104319 +0000 UTC m=+815.721412396" watchObservedRunningTime="2026-09-10 17:54:40.015223285 +0000 UTC m=+815.776531319"
Sep 10 17:54:40.017920 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:40.017884    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-bcdd7c-7b9bf7b7d6-mntfh"]
Sep 10 17:54:40.021640 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:40.021613    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-bcdd7c-7b9bf7b7d6-mntfh"
Sep 10 17:54:40.024718 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:40.024682    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-autores-bcdd7c-dockercfg-qjq99\""
Sep 10 17:54:40.024718 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:40.024708    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-autores-bcdd7c\""
Sep 10 17:54:40.028922 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:40.028870    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7f3dd052-e31a-4bfe-a259-9c8c57b65a4b-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-bcdd7c-7b9bf7b7d6-mntfh\" (UID: \"7f3dd052-e31a-4bfe-a259-9c8c57b65a4b\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-bcdd7c-7b9bf7b7d6-mntfh"
Sep 10 17:54:40.029215 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:40.028987    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlgcg\" (UniqueName: \"kubernetes.io/projected/7f3dd052-e31a-4bfe-a259-9c8c57b65a4b-kube-api-access-zlgcg\") pod \"payload-pre-processing-e2e-autores-bcdd7c-7b9bf7b7d6-mntfh\" (UID: \"7f3dd052-e31a-4bfe-a259-9c8c57b65a4b\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-bcdd7c-7b9bf7b7d6-mntfh"
Sep 10 17:54:40.033912 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:40.033879    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-bcdd7c-7b9bf7b7d6-mntfh"]
Sep 10 17:54:40.129874 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:40.129824    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7f3dd052-e31a-4bfe-a259-9c8c57b65a4b-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-bcdd7c-7b9bf7b7d6-mntfh\" (UID: \"7f3dd052-e31a-4bfe-a259-9c8c57b65a4b\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-bcdd7c-7b9bf7b7d6-mntfh"
Sep 10 17:54:40.130070 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:40.129923    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlgcg\" (UniqueName: \"kubernetes.io/projected/7f3dd052-e31a-4bfe-a259-9c8c57b65a4b-kube-api-access-zlgcg\") pod \"payload-pre-processing-e2e-autores-bcdd7c-7b9bf7b7d6-mntfh\" (UID: \"7f3dd052-e31a-4bfe-a259-9c8c57b65a4b\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-bcdd7c-7b9bf7b7d6-mntfh"
Sep 10 17:54:40.130716 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:40.130688    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7f3dd052-e31a-4bfe-a259-9c8c57b65a4b-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-bcdd7c-7b9bf7b7d6-mntfh\" (UID: \"7f3dd052-e31a-4bfe-a259-9c8c57b65a4b\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-bcdd7c-7b9bf7b7d6-mntfh"
Sep 10 17:54:40.140523 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:40.140487    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlgcg\" (UniqueName: \"kubernetes.io/projected/7f3dd052-e31a-4bfe-a259-9c8c57b65a4b-kube-api-access-zlgcg\") pod \"payload-pre-processing-e2e-autores-bcdd7c-7b9bf7b7d6-mntfh\" (UID: \"7f3dd052-e31a-4bfe-a259-9c8c57b65a4b\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-bcdd7c-7b9bf7b7d6-mntfh"
Sep 10 17:54:40.334472 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:40.334426    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-bcdd7c-7b9bf7b7d6-mntfh"
Sep 10 17:54:40.621085 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:40.621057    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-bcdd7c-7b9bf7b7d6-mntfh"]
Sep 10 17:54:40.623135 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:54:40.623106    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f3dd052_e31a_4bfe_a259_9c8c57b65a4b.slice/crio-99b34bf06a3795732f4395b90b2747564157213ee8246df03d1b514751bb6f7f WatchSource:0}: Error finding container 99b34bf06a3795732f4395b90b2747564157213ee8246df03d1b514751bb6f7f: Status 404 returned error can't find the container with id 99b34bf06a3795732f4395b90b2747564157213ee8246df03d1b514751bb6f7f
Sep 10 17:54:40.930286 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:40.930180    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-bcdd7c-7b9bf7b7d6-mntfh" event={"ID":"7f3dd052-e31a-4bfe-a259-9c8c57b65a4b","Type":"ContainerStarted","Data":"5ead9a72c78ea10414007af547f710621aa2b55ff390110b3c6f9b8d04e5787f"}
Sep 10 17:54:40.930286 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:40.930250    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-bcdd7c-7b9bf7b7d6-mntfh" event={"ID":"7f3dd052-e31a-4bfe-a259-9c8c57b65a4b","Type":"ContainerStarted","Data":"99b34bf06a3795732f4395b90b2747564157213ee8246df03d1b514751bb6f7f"}
Sep 10 17:54:40.930497 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:40.930305    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-007ef522-56c59c9c65-r529n"
Sep 10 17:54:40.930586 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:40.930575    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-007ef522-5f9b698b66-dlpwp"
Sep 10 17:54:40.949224 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:40.949150    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-autores-bcdd7c-7b9bf7b7d6-mntfh" podStartSLOduration=0.949126386 podStartE2EDuration="949.126386ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:54:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:54:40.94608187 +0000 UTC m=+816.707389914" watchObservedRunningTime="2026-09-10 17:54:40.949126386 +0000 UTC m=+816.710434433"
Sep 10 17:54:41.936350 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:41.936292    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-autores-bcdd7c-7b9bf7b7d6-mntfh"
Sep 10 17:54:43.877587 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:43.877546    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-c34c13-84646c5cbc-fvk65"
Sep 10 17:54:43.877983 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:43.877645    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c34c13-65ff6fd994-gkkcw"
Sep 10 17:54:47.994070 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:47.994024    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-conflict-a-b42bbba1-kserve-5c4d9974b5-jjtk8"
Sep 10 17:54:47.994527 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:47.994093    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-conflict-a-b42bbba1-kserve-5c4d9974b5-jjtk8"
Sep 10 17:54:48.007038 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:48.007007    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-conflict-a-b42bbba1-kserve-5c4d9974b5-jjtk8"
Sep 10 17:54:48.993526 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:48.993492    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-conflict-a-b42bbba1-kserve-5c4d9974b5-jjtk8"
Sep 10 17:54:51.938907 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:51.938875    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-007ef522-5f9b698b66-dlpwp"
Sep 10 17:54:51.939301 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:51.938950    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-007ef522-56c59c9c65-r529n"
Sep 10 17:54:52.945489 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:54:52.945451    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-autores-bcdd7c-7b9bf7b7d6-mntfh"
Sep 10 17:55:00.895831 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:00.895782    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-18490e-58d54f4766-xlmkw"]
Sep 10 17:55:00.899528 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:00.899499    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-18490e-58d54f4766-xlmkw"
Sep 10 17:55:00.902528 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:00.902495    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-18490e-dockercfg-76bp6\""
Sep 10 17:55:00.902700 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:00.902682    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-18490e\""
Sep 10 17:55:00.910355 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:00.910310    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-18490e-58d54f4766-xlmkw"]
Sep 10 17:55:00.920026 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:00.919992    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-18490e-7b84f588c7-plhdl"]
Sep 10 17:55:00.923698 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:00.923669    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-18490e-7b84f588c7-plhdl"
Sep 10 17:55:00.933438 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:00.933410    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-18490e-7b84f588c7-plhdl"]
Sep 10 17:55:01.024906 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:01.024855    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwf5m\" (UniqueName: \"kubernetes.io/projected/1740fc3a-1225-41a1-bc47-37662459fece-kube-api-access-wwf5m\") pod \"payload-pre-processing-e2e-inf-b-18490e-58d54f4766-xlmkw\" (UID: \"1740fc3a-1225-41a1-bc47-37662459fece\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-18490e-58d54f4766-xlmkw"
Sep 10 17:55:01.024906 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:01.024910    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dt5d7\" (UniqueName: \"kubernetes.io/projected/e91fb3dd-9245-4282-a937-8b96009312ec-kube-api-access-dt5d7\") pod \"payload-processing-e2e-inf-b-18490e-7b84f588c7-plhdl\" (UID: \"e91fb3dd-9245-4282-a937-8b96009312ec\") " pod="openshift-ingress/payload-processing-e2e-inf-b-18490e-7b84f588c7-plhdl"
Sep 10 17:55:01.025163 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:01.025004    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1740fc3a-1225-41a1-bc47-37662459fece-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-18490e-58d54f4766-xlmkw\" (UID: \"1740fc3a-1225-41a1-bc47-37662459fece\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-18490e-58d54f4766-xlmkw"
Sep 10 17:55:01.025163 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:01.025058    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e91fb3dd-9245-4282-a937-8b96009312ec-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-18490e-7b84f588c7-plhdl\" (UID: \"e91fb3dd-9245-4282-a937-8b96009312ec\") " pod="openshift-ingress/payload-processing-e2e-inf-b-18490e-7b84f588c7-plhdl"
Sep 10 17:55:01.126069 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:01.126022    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1740fc3a-1225-41a1-bc47-37662459fece-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-18490e-58d54f4766-xlmkw\" (UID: \"1740fc3a-1225-41a1-bc47-37662459fece\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-18490e-58d54f4766-xlmkw"
Sep 10 17:55:01.126069 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:01.126069    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e91fb3dd-9245-4282-a937-8b96009312ec-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-18490e-7b84f588c7-plhdl\" (UID: \"e91fb3dd-9245-4282-a937-8b96009312ec\") " pod="openshift-ingress/payload-processing-e2e-inf-b-18490e-7b84f588c7-plhdl"
Sep 10 17:55:01.126301 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:01.126134    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwf5m\" (UniqueName: \"kubernetes.io/projected/1740fc3a-1225-41a1-bc47-37662459fece-kube-api-access-wwf5m\") pod \"payload-pre-processing-e2e-inf-b-18490e-58d54f4766-xlmkw\" (UID: \"1740fc3a-1225-41a1-bc47-37662459fece\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-18490e-58d54f4766-xlmkw"
Sep 10 17:55:01.126301 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:01.126155    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dt5d7\" (UniqueName: \"kubernetes.io/projected/e91fb3dd-9245-4282-a937-8b96009312ec-kube-api-access-dt5d7\") pod \"payload-processing-e2e-inf-b-18490e-7b84f588c7-plhdl\" (UID: \"e91fb3dd-9245-4282-a937-8b96009312ec\") " pod="openshift-ingress/payload-processing-e2e-inf-b-18490e-7b84f588c7-plhdl"
Sep 10 17:55:01.126790 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:01.126767    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1740fc3a-1225-41a1-bc47-37662459fece-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-18490e-58d54f4766-xlmkw\" (UID: \"1740fc3a-1225-41a1-bc47-37662459fece\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-18490e-58d54f4766-xlmkw"
Sep 10 17:55:01.126923 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:01.126904    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e91fb3dd-9245-4282-a937-8b96009312ec-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-18490e-7b84f588c7-plhdl\" (UID: \"e91fb3dd-9245-4282-a937-8b96009312ec\") " pod="openshift-ingress/payload-processing-e2e-inf-b-18490e-7b84f588c7-plhdl"
Sep 10 17:55:01.135379 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:01.135349    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwf5m\" (UniqueName: \"kubernetes.io/projected/1740fc3a-1225-41a1-bc47-37662459fece-kube-api-access-wwf5m\") pod \"payload-pre-processing-e2e-inf-b-18490e-58d54f4766-xlmkw\" (UID: \"1740fc3a-1225-41a1-bc47-37662459fece\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-18490e-58d54f4766-xlmkw"
Sep 10 17:55:01.135621 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:01.135589    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dt5d7\" (UniqueName: \"kubernetes.io/projected/e91fb3dd-9245-4282-a937-8b96009312ec-kube-api-access-dt5d7\") pod \"payload-processing-e2e-inf-b-18490e-7b84f588c7-plhdl\" (UID: \"e91fb3dd-9245-4282-a937-8b96009312ec\") " pod="openshift-ingress/payload-processing-e2e-inf-b-18490e-7b84f588c7-plhdl"
Sep 10 17:55:01.212083 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:01.211986    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-18490e-58d54f4766-xlmkw"
Sep 10 17:55:01.235905 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:01.235865    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-18490e-7b84f588c7-plhdl"
Sep 10 17:55:01.497414 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:01.497385    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-18490e-58d54f4766-xlmkw"]
Sep 10 17:55:01.499185 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:55:01.499152    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1740fc3a_1225_41a1_bc47_37662459fece.slice/crio-8232bdd538653a6007dfa7afb91a5e38a283c87e31a45daf71f13f9f4cb17ac0 WatchSource:0}: Error finding container 8232bdd538653a6007dfa7afb91a5e38a283c87e31a45daf71f13f9f4cb17ac0: Status 404 returned error can't find the container with id 8232bdd538653a6007dfa7afb91a5e38a283c87e31a45daf71f13f9f4cb17ac0
Sep 10 17:55:01.532768 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:01.532739    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-18490e-7b84f588c7-plhdl"]
Sep 10 17:55:01.535555 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:55:01.535522    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode91fb3dd_9245_4282_a937_8b96009312ec.slice/crio-f38ad2a1cf04d7523d31b3c1a4e4236a481f04ce775a3ea08380b5dec1b27c8a WatchSource:0}: Error finding container f38ad2a1cf04d7523d31b3c1a4e4236a481f04ce775a3ea08380b5dec1b27c8a: Status 404 returned error can't find the container with id f38ad2a1cf04d7523d31b3c1a4e4236a481f04ce775a3ea08380b5dec1b27c8a
Sep 10 17:55:02.069279 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:02.069241    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-18490e-58d54f4766-xlmkw" event={"ID":"1740fc3a-1225-41a1-bc47-37662459fece","Type":"ContainerStarted","Data":"4d69043abaa285bc3628c9f7b7c7658a2688fca4aca39e9f821b3a88f024e087"}
Sep 10 17:55:02.069792 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:02.069307    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-18490e-58d54f4766-xlmkw" event={"ID":"1740fc3a-1225-41a1-bc47-37662459fece","Type":"ContainerStarted","Data":"8232bdd538653a6007dfa7afb91a5e38a283c87e31a45daf71f13f9f4cb17ac0"}
Sep 10 17:55:02.069792 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:02.069577    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-18490e-58d54f4766-xlmkw"
Sep 10 17:55:02.071850 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:02.071816    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-18490e-7b84f588c7-plhdl" event={"ID":"e91fb3dd-9245-4282-a937-8b96009312ec","Type":"ContainerStarted","Data":"f23ae4ab1ec2828fe6fd3a15071f13d2a5d74c608067423814e9623b3f68bec9"}
Sep 10 17:55:02.072004 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:02.071878    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-18490e-7b84f588c7-plhdl" event={"ID":"e91fb3dd-9245-4282-a937-8b96009312ec","Type":"ContainerStarted","Data":"f38ad2a1cf04d7523d31b3c1a4e4236a481f04ce775a3ea08380b5dec1b27c8a"}
Sep 10 17:55:02.072004 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:02.071966    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-18490e-7b84f588c7-plhdl"
Sep 10 17:55:02.120821 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:02.120755    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-18490e-7b84f588c7-plhdl" podStartSLOduration=2.120733558 podStartE2EDuration="2.120733558s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:55:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:55:02.120463298 +0000 UTC m=+837.881771341" watchObservedRunningTime="2026-09-10 17:55:02.120733558 +0000 UTC m=+837.882041605"
Sep 10 17:55:02.121745 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:02.121714    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-18490e-58d54f4766-xlmkw" podStartSLOduration=2.121700069 podStartE2EDuration="2.121700069s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:55:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:55:02.100783075 +0000 UTC m=+837.862091118" watchObservedRunningTime="2026-09-10 17:55:02.121700069 +0000 UTC m=+837.883008117"
Sep 10 17:55:02.258313 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:02.258272    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-007ef522-gcg8l"]
Sep 10 17:55:02.262694 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:02.262665    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-007ef522-gcg8l"
Sep 10 17:55:02.265348 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:02.265300    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-22shs\""
Sep 10 17:55:02.268809 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:02.268779    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-007ef522-gcg8l"]
Sep 10 17:55:02.339224 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:02.339125    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a69cd5e0-a5c9-44b3-b812-be158c27669e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-007ef522-gcg8l\" (UID: \"a69cd5e0-a5c9-44b3-b812-be158c27669e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-007ef522-gcg8l"
Sep 10 17:55:02.439959 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:02.439914    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a69cd5e0-a5c9-44b3-b812-be158c27669e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-007ef522-gcg8l\" (UID: \"a69cd5e0-a5c9-44b3-b812-be158c27669e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-007ef522-gcg8l"
Sep 10 17:55:02.440703 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:02.440680    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a69cd5e0-a5c9-44b3-b812-be158c27669e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-007ef522-gcg8l\" (UID: \"a69cd5e0-a5c9-44b3-b812-be158c27669e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-007ef522-gcg8l"
Sep 10 17:55:02.577649 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:02.577600    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-007ef522-gcg8l"
Sep 10 17:55:02.862680 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:02.862649    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-007ef522-gcg8l"]
Sep 10 17:55:02.864847 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:55:02.864817    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda69cd5e0_a5c9_44b3_b812_be158c27669e.slice/crio-1d3a361f81299727aa5006750468b5d0adacbaaf5dbf5f13cf83147909a6cd61 WatchSource:0}: Error finding container 1d3a361f81299727aa5006750468b5d0adacbaaf5dbf5f13cf83147909a6cd61: Status 404 returned error can't find the container with id 1d3a361f81299727aa5006750468b5d0adacbaaf5dbf5f13cf83147909a6cd61
Sep 10 17:55:03.079407 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:03.079365    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-007ef522-gcg8l" event={"ID":"a69cd5e0-a5c9-44b3-b812-be158c27669e","Type":"ContainerStarted","Data":"1d3a361f81299727aa5006750468b5d0adacbaaf5dbf5f13cf83147909a6cd61"}
Sep 10 17:55:06.099792 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:06.099675    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-007ef522-gcg8l" event={"ID":"a69cd5e0-a5c9-44b3-b812-be158c27669e","Type":"ContainerStarted","Data":"487100d4178646f4682c4b205f0206dfda1ee4f8bea2b93a1f5160800e270171"}
Sep 10 17:55:06.114390 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:06.114304    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-007ef522-gcg8l" podStartSLOduration=1.443797209 podStartE2EDuration="4.114284674s" totalImagesPullingTime="2.670487465s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:55:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:55:06.113907542 +0000 UTC m=+841.875215588" watchObservedRunningTime="2026-09-10 17:55:06.114284674 +0000 UTC m=+841.875592726"
Sep 10 17:55:07.107637 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:07.107596    2568 generic.go:356] "Generic (PLEG): container finished" podID="a69cd5e0-a5c9-44b3-b812-be158c27669e" containerID="487100d4178646f4682c4b205f0206dfda1ee4f8bea2b93a1f5160800e270171" exitCode=0
Sep 10 17:55:07.108093 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:07.107676    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-007ef522-gcg8l" event={"ID":"a69cd5e0-a5c9-44b3-b812-be158c27669e","Type":"ContainerDied","Data":"487100d4178646f4682c4b205f0206dfda1ee4f8bea2b93a1f5160800e270171"}
Sep 10 17:55:08.259865 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:08.259837    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-007ef522-gcg8l"
Sep 10 17:55:08.400480 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:08.400392    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a69cd5e0-a5c9-44b3-b812-be158c27669e-maas-api-service-ca\") pod \"a69cd5e0-a5c9-44b3-b812-be158c27669e\" (UID: \"a69cd5e0-a5c9-44b3-b812-be158c27669e\") "
Sep 10 17:55:08.400767 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:08.400743    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a69cd5e0-a5c9-44b3-b812-be158c27669e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a69cd5e0-a5c9-44b3-b812-be158c27669e" (UID: "a69cd5e0-a5c9-44b3-b812-be158c27669e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 17:55:08.502015 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:08.501973    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a69cd5e0-a5c9-44b3-b812-be158c27669e-maas-api-service-ca\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:55:09.121948 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:09.121858    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-007ef522-gcg8l"
Sep 10 17:55:09.121948 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:09.121869    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-007ef522-gcg8l" event={"ID":"a69cd5e0-a5c9-44b3-b812-be158c27669e","Type":"ContainerDied","Data":"1d3a361f81299727aa5006750468b5d0adacbaaf5dbf5f13cf83147909a6cd61"}
Sep 10 17:55:09.121948 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:09.121920    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1d3a361f81299727aa5006750468b5d0adacbaaf5dbf5f13cf83147909a6cd61"
Sep 10 17:55:13.081524 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:13.081492    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-18490e-58d54f4766-xlmkw"
Sep 10 17:55:13.081917 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:13.081571    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-18490e-7b84f588c7-plhdl"
Sep 10 17:55:19.057045 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:19.057011    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-007ef522-56c59c9c65-r529n"]
Sep 10 17:55:19.058899 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:19.057449    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-007ef522-56c59c9c65-r529n" podUID="3afae4f5-cb70-44b8-9848-ac8bff3be33d" containerName="payload-processing" containerID="cri-o://fb9ef1792c980206e1def3c1930234e976069a4efceb3a6b294b5cb2e9f3fc7d" gracePeriod=30
Sep 10 17:55:19.060987 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:19.060963    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-007ef522-5f9b698b66-dlpwp"]
Sep 10 17:55:19.061234 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:19.061187    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-007ef522-5f9b698b66-dlpwp" podUID="be523be7-0638-4a62-be54-76561c521452" containerName="payload-pre-processing" containerID="cri-o://a0740aa2a8b2610358ff312ec14300b7329ecd376e868d1fa2a195bba8014d6b" gracePeriod=30
Sep 10 17:55:19.186310 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:19.186272    2568 generic.go:356] "Generic (PLEG): container finished" podID="3afae4f5-cb70-44b8-9848-ac8bff3be33d" containerID="fb9ef1792c980206e1def3c1930234e976069a4efceb3a6b294b5cb2e9f3fc7d" exitCode=0
Sep 10 17:55:19.186498 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:19.186364    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-007ef522-56c59c9c65-r529n" event={"ID":"3afae4f5-cb70-44b8-9848-ac8bff3be33d","Type":"ContainerDied","Data":"fb9ef1792c980206e1def3c1930234e976069a4efceb3a6b294b5cb2e9f3fc7d"}
Sep 10 17:55:19.188682 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:19.188646    2568 generic.go:356] "Generic (PLEG): container finished" podID="be523be7-0638-4a62-be54-76561c521452" containerID="a0740aa2a8b2610358ff312ec14300b7329ecd376e868d1fa2a195bba8014d6b" exitCode=0
Sep 10 17:55:19.188857 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:19.188747    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-007ef522-5f9b698b66-dlpwp" event={"ID":"be523be7-0638-4a62-be54-76561c521452","Type":"ContainerDied","Data":"a0740aa2a8b2610358ff312ec14300b7329ecd376e868d1fa2a195bba8014d6b"}
Sep 10 17:55:19.215016 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:19.214980    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-007ef522-gcg8l"]
Sep 10 17:55:19.221463 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:19.221401    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-007ef522-gcg8l"]
Sep 10 17:55:19.328641 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:19.328565    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-007ef522-56c59c9c65-r529n"
Sep 10 17:55:19.370730 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:19.370699    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-007ef522-5f9b698b66-dlpwp"
Sep 10 17:55:19.501378 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:19.501344    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/be523be7-0638-4a62-be54-76561c521452-plugins-config-volume\") pod \"be523be7-0638-4a62-be54-76561c521452\" (UID: \"be523be7-0638-4a62-be54-76561c521452\") "
Sep 10 17:55:19.501530 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:19.501469    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f9p4q\" (UniqueName: \"kubernetes.io/projected/3afae4f5-cb70-44b8-9848-ac8bff3be33d-kube-api-access-f9p4q\") pod \"3afae4f5-cb70-44b8-9848-ac8bff3be33d\" (UID: \"3afae4f5-cb70-44b8-9848-ac8bff3be33d\") "
Sep 10 17:55:19.501530 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:19.501502    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3afae4f5-cb70-44b8-9848-ac8bff3be33d-plugins-config-volume\") pod \"3afae4f5-cb70-44b8-9848-ac8bff3be33d\" (UID: \"3afae4f5-cb70-44b8-9848-ac8bff3be33d\") "
Sep 10 17:55:19.501625 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:19.501539    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mv5fq\" (UniqueName: \"kubernetes.io/projected/be523be7-0638-4a62-be54-76561c521452-kube-api-access-mv5fq\") pod \"be523be7-0638-4a62-be54-76561c521452\" (UID: \"be523be7-0638-4a62-be54-76561c521452\") "
Sep 10 17:55:19.501883 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:19.501859    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3afae4f5-cb70-44b8-9848-ac8bff3be33d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3afae4f5-cb70-44b8-9848-ac8bff3be33d" (UID: "3afae4f5-cb70-44b8-9848-ac8bff3be33d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 17:55:19.501929 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:19.501858    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be523be7-0638-4a62-be54-76561c521452-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "be523be7-0638-4a62-be54-76561c521452" (UID: "be523be7-0638-4a62-be54-76561c521452"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 17:55:19.503798 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:19.503751    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3afae4f5-cb70-44b8-9848-ac8bff3be33d-kube-api-access-f9p4q" (OuterVolumeSpecName: "kube-api-access-f9p4q") pod "3afae4f5-cb70-44b8-9848-ac8bff3be33d" (UID: "3afae4f5-cb70-44b8-9848-ac8bff3be33d"). InnerVolumeSpecName "kube-api-access-f9p4q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:55:19.503883 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:19.503795    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be523be7-0638-4a62-be54-76561c521452-kube-api-access-mv5fq" (OuterVolumeSpecName: "kube-api-access-mv5fq") pod "be523be7-0638-4a62-be54-76561c521452" (UID: "be523be7-0638-4a62-be54-76561c521452"). InnerVolumeSpecName "kube-api-access-mv5fq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:55:19.602620 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:19.602525    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f9p4q\" (UniqueName: \"kubernetes.io/projected/3afae4f5-cb70-44b8-9848-ac8bff3be33d-kube-api-access-f9p4q\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:55:19.602620 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:19.602560    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3afae4f5-cb70-44b8-9848-ac8bff3be33d-plugins-config-volume\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:55:19.602620 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:19.602570    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mv5fq\" (UniqueName: \"kubernetes.io/projected/be523be7-0638-4a62-be54-76561c521452-kube-api-access-mv5fq\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:55:19.602620 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:19.602580    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/be523be7-0638-4a62-be54-76561c521452-plugins-config-volume\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:55:20.195446 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:20.195410    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-007ef522-56c59c9c65-r529n" event={"ID":"3afae4f5-cb70-44b8-9848-ac8bff3be33d","Type":"ContainerDied","Data":"c939c76978cef9aaa2b1b04b97ac8473ef49cd8e0ca31898992863c9ff3f7f07"}
Sep 10 17:55:20.195446 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:20.195444    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-007ef522-56c59c9c65-r529n"
Sep 10 17:55:20.195963 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:20.195514    2568 scope.go:117] "RemoveContainer" containerID="fb9ef1792c980206e1def3c1930234e976069a4efceb3a6b294b5cb2e9f3fc7d"
Sep 10 17:55:20.197217 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:20.197188    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-007ef522-5f9b698b66-dlpwp" event={"ID":"be523be7-0638-4a62-be54-76561c521452","Type":"ContainerDied","Data":"6cd14d14989ba69fb0c1df9eb8c1b8bfaa43cfa28d1616293b5887933f21c9b5"}
Sep 10 17:55:20.197346 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:20.197198    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-007ef522-5f9b698b66-dlpwp"
Sep 10 17:55:20.205522 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:20.205498    2568 scope.go:117] "RemoveContainer" containerID="a0740aa2a8b2610358ff312ec14300b7329ecd376e868d1fa2a195bba8014d6b"
Sep 10 17:55:20.229964 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:20.229922    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-007ef522-56c59c9c65-r529n"]
Sep 10 17:55:20.237912 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:20.237883    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-007ef522-56c59c9c65-r529n"]
Sep 10 17:55:20.251541 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:20.251507    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-007ef522-5f9b698b66-dlpwp"]
Sep 10 17:55:20.254059 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:20.254031    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-007ef522-5f9b698b66-dlpwp"]
Sep 10 17:55:20.770901 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:20.770864    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3afae4f5-cb70-44b8-9848-ac8bff3be33d" path="/var/lib/kubelet/pods/3afae4f5-cb70-44b8-9848-ac8bff3be33d/volumes"
Sep 10 17:55:20.771214 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:20.771200    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a69cd5e0-a5c9-44b3-b812-be158c27669e" path="/var/lib/kubelet/pods/a69cd5e0-a5c9-44b3-b812-be158c27669e/volumes"
Sep 10 17:55:20.771533 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:20.771520    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be523be7-0638-4a62-be54-76561c521452" path="/var/lib/kubelet/pods/be523be7-0638-4a62-be54-76561c521452/volumes"
Sep 10 17:55:24.308885 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:24.308842    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-826cc2b1-6868df8446-n2xdc"]
Sep 10 17:55:24.309298 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:24.309240    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a69cd5e0-a5c9-44b3-b812-be158c27669e" containerName="revoke-keys"
Sep 10 17:55:24.309298 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:24.309251    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="a69cd5e0-a5c9-44b3-b812-be158c27669e" containerName="revoke-keys"
Sep 10 17:55:24.309298 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:24.309266    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be523be7-0638-4a62-be54-76561c521452" containerName="payload-pre-processing"
Sep 10 17:55:24.309298 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:24.309272    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="be523be7-0638-4a62-be54-76561c521452" containerName="payload-pre-processing"
Sep 10 17:55:24.309298 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:24.309286    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3afae4f5-cb70-44b8-9848-ac8bff3be33d" containerName="payload-processing"
Sep 10 17:55:24.309298 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:24.309292    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="3afae4f5-cb70-44b8-9848-ac8bff3be33d" containerName="payload-processing"
Sep 10 17:55:24.309539 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:24.309364    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="be523be7-0638-4a62-be54-76561c521452" containerName="payload-pre-processing"
Sep 10 17:55:24.309539 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:24.309372    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="3afae4f5-cb70-44b8-9848-ac8bff3be33d" containerName="payload-processing"
Sep 10 17:55:24.309539 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:24.309380    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="a69cd5e0-a5c9-44b3-b812-be158c27669e" containerName="revoke-keys"
Sep 10 17:55:24.313956 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:24.313935    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-826cc2b1-6868df8446-n2xdc"
Sep 10 17:55:24.317176 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:24.317153    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-826cc2b1\""
Sep 10 17:55:24.323280 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:24.323256    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-826cc2b1-6868df8446-n2xdc"]
Sep 10 17:55:24.362625 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:24.362574    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-826cc2b1-7b95c5c4fd-xxx5m"]
Sep 10 17:55:24.368992 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:24.368955    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-826cc2b1-7b95c5c4fd-xxx5m"
Sep 10 17:55:24.372745 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:24.372712    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-826cc2b1-dockercfg-gf7sw\""
Sep 10 17:55:24.374141 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:24.374110    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-826cc2b1-7b95c5c4fd-xxx5m"]
Sep 10 17:55:24.448253 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:24.448207    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/156724d0-e4a1-4bbf-8674-6f3c1ac37399-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-826cc2b1-6868df8446-n2xdc\" (UID: \"156724d0-e4a1-4bbf-8674-6f3c1ac37399\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-826cc2b1-6868df8446-n2xdc"
Sep 10 17:55:24.448455 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:24.448428    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xclfb\" (UniqueName: \"kubernetes.io/projected/156724d0-e4a1-4bbf-8674-6f3c1ac37399-kube-api-access-xclfb\") pod \"payload-pre-processing-e2e-migrate-826cc2b1-6868df8446-n2xdc\" (UID: \"156724d0-e4a1-4bbf-8674-6f3c1ac37399\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-826cc2b1-6868df8446-n2xdc"
Sep 10 17:55:24.549393 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:24.549341    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e68c41cb-b1b7-44ef-b0a8-1ae9a07f203e-plugins-config-volume\") pod \"payload-processing-e2e-migrate-826cc2b1-7b95c5c4fd-xxx5m\" (UID: \"e68c41cb-b1b7-44ef-b0a8-1ae9a07f203e\") " pod="openshift-ingress/payload-processing-e2e-migrate-826cc2b1-7b95c5c4fd-xxx5m"
Sep 10 17:55:24.549393 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:24.549384    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rc8h\" (UniqueName: \"kubernetes.io/projected/e68c41cb-b1b7-44ef-b0a8-1ae9a07f203e-kube-api-access-5rc8h\") pod \"payload-processing-e2e-migrate-826cc2b1-7b95c5c4fd-xxx5m\" (UID: \"e68c41cb-b1b7-44ef-b0a8-1ae9a07f203e\") " pod="openshift-ingress/payload-processing-e2e-migrate-826cc2b1-7b95c5c4fd-xxx5m"
Sep 10 17:55:24.549618 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:24.549422    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xclfb\" (UniqueName: \"kubernetes.io/projected/156724d0-e4a1-4bbf-8674-6f3c1ac37399-kube-api-access-xclfb\") pod \"payload-pre-processing-e2e-migrate-826cc2b1-6868df8446-n2xdc\" (UID: \"156724d0-e4a1-4bbf-8674-6f3c1ac37399\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-826cc2b1-6868df8446-n2xdc"
Sep 10 17:55:24.549618 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:24.549544    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/156724d0-e4a1-4bbf-8674-6f3c1ac37399-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-826cc2b1-6868df8446-n2xdc\" (UID: \"156724d0-e4a1-4bbf-8674-6f3c1ac37399\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-826cc2b1-6868df8446-n2xdc"
Sep 10 17:55:24.550236 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:24.550220    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/156724d0-e4a1-4bbf-8674-6f3c1ac37399-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-826cc2b1-6868df8446-n2xdc\" (UID: \"156724d0-e4a1-4bbf-8674-6f3c1ac37399\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-826cc2b1-6868df8446-n2xdc"
Sep 10 17:55:24.558475 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:24.558441    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xclfb\" (UniqueName: \"kubernetes.io/projected/156724d0-e4a1-4bbf-8674-6f3c1ac37399-kube-api-access-xclfb\") pod \"payload-pre-processing-e2e-migrate-826cc2b1-6868df8446-n2xdc\" (UID: \"156724d0-e4a1-4bbf-8674-6f3c1ac37399\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-826cc2b1-6868df8446-n2xdc"
Sep 10 17:55:24.626029 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:24.625929    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-826cc2b1-6868df8446-n2xdc"
Sep 10 17:55:24.651184 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:24.651143    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e68c41cb-b1b7-44ef-b0a8-1ae9a07f203e-plugins-config-volume\") pod \"payload-processing-e2e-migrate-826cc2b1-7b95c5c4fd-xxx5m\" (UID: \"e68c41cb-b1b7-44ef-b0a8-1ae9a07f203e\") " pod="openshift-ingress/payload-processing-e2e-migrate-826cc2b1-7b95c5c4fd-xxx5m"
Sep 10 17:55:24.651184 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:24.651185    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rc8h\" (UniqueName: \"kubernetes.io/projected/e68c41cb-b1b7-44ef-b0a8-1ae9a07f203e-kube-api-access-5rc8h\") pod \"payload-processing-e2e-migrate-826cc2b1-7b95c5c4fd-xxx5m\" (UID: \"e68c41cb-b1b7-44ef-b0a8-1ae9a07f203e\") " pod="openshift-ingress/payload-processing-e2e-migrate-826cc2b1-7b95c5c4fd-xxx5m"
Sep 10 17:55:24.652041 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:24.652014    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e68c41cb-b1b7-44ef-b0a8-1ae9a07f203e-plugins-config-volume\") pod \"payload-processing-e2e-migrate-826cc2b1-7b95c5c4fd-xxx5m\" (UID: \"e68c41cb-b1b7-44ef-b0a8-1ae9a07f203e\") " pod="openshift-ingress/payload-processing-e2e-migrate-826cc2b1-7b95c5c4fd-xxx5m"
Sep 10 17:55:24.659942 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:24.659849    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rc8h\" (UniqueName: \"kubernetes.io/projected/e68c41cb-b1b7-44ef-b0a8-1ae9a07f203e-kube-api-access-5rc8h\") pod \"payload-processing-e2e-migrate-826cc2b1-7b95c5c4fd-xxx5m\" (UID: \"e68c41cb-b1b7-44ef-b0a8-1ae9a07f203e\") " pod="openshift-ingress/payload-processing-e2e-migrate-826cc2b1-7b95c5c4fd-xxx5m"
Sep 10 17:55:24.682720 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:24.682370    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-826cc2b1-7b95c5c4fd-xxx5m"
Sep 10 17:55:24.924868 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:24.924837    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-826cc2b1-6868df8446-n2xdc"]
Sep 10 17:55:24.927028 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:55:24.926996    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod156724d0_e4a1_4bbf_8674_6f3c1ac37399.slice/crio-669899efac957f2a0bbb5fcd6d3ea95febbcc23dce6ab8fdbd7b498e0db8cbf5 WatchSource:0}: Error finding container 669899efac957f2a0bbb5fcd6d3ea95febbcc23dce6ab8fdbd7b498e0db8cbf5: Status 404 returned error can't find the container with id 669899efac957f2a0bbb5fcd6d3ea95febbcc23dce6ab8fdbd7b498e0db8cbf5
Sep 10 17:55:24.996264 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:24.996232    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-826cc2b1-7b95c5c4fd-xxx5m"]
Sep 10 17:55:24.997764 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:55:24.997739    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode68c41cb_b1b7_44ef_b0a8_1ae9a07f203e.slice/crio-7fe2cdbd4d6957b57d24fcd64fdbd718a4bcea14fe8eaef56baad9b5b531a314 WatchSource:0}: Error finding container 7fe2cdbd4d6957b57d24fcd64fdbd718a4bcea14fe8eaef56baad9b5b531a314: Status 404 returned error can't find the container with id 7fe2cdbd4d6957b57d24fcd64fdbd718a4bcea14fe8eaef56baad9b5b531a314
Sep 10 17:55:25.232879 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:25.232820    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-826cc2b1-7b95c5c4fd-xxx5m" event={"ID":"e68c41cb-b1b7-44ef-b0a8-1ae9a07f203e","Type":"ContainerStarted","Data":"44087fe0f546b8f2a0d24e908a397271a80af35cedd92cb5a315a55f9ecc2f3f"}
Sep 10 17:55:25.233106 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:25.232907    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-826cc2b1-7b95c5c4fd-xxx5m"
Sep 10 17:55:25.233106 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:25.232933    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-826cc2b1-7b95c5c4fd-xxx5m" event={"ID":"e68c41cb-b1b7-44ef-b0a8-1ae9a07f203e","Type":"ContainerStarted","Data":"7fe2cdbd4d6957b57d24fcd64fdbd718a4bcea14fe8eaef56baad9b5b531a314"}
Sep 10 17:55:25.234750 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:25.234707    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-826cc2b1-6868df8446-n2xdc" event={"ID":"156724d0-e4a1-4bbf-8674-6f3c1ac37399","Type":"ContainerStarted","Data":"b0870d3ba2423a7f4d999e45b6ea4405323c0e82016ce2ebc3c0dfd606ca453d"}
Sep 10 17:55:25.234881 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:25.234781    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-826cc2b1-6868df8446-n2xdc"
Sep 10 17:55:25.234881 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:25.234808    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-826cc2b1-6868df8446-n2xdc" event={"ID":"156724d0-e4a1-4bbf-8674-6f3c1ac37399","Type":"ContainerStarted","Data":"669899efac957f2a0bbb5fcd6d3ea95febbcc23dce6ab8fdbd7b498e0db8cbf5"}
Sep 10 17:55:25.252621 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:25.252564    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-826cc2b1-7b95c5c4fd-xxx5m" podStartSLOduration=1.252545106 podStartE2EDuration="1.252545106s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:55:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:55:25.249137522 +0000 UTC m=+861.010445566" watchObservedRunningTime="2026-09-10 17:55:25.252545106 +0000 UTC m=+861.013853146"
Sep 10 17:55:25.270049 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:25.269973    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-826cc2b1-6868df8446-n2xdc" podStartSLOduration=1.269949041 podStartE2EDuration="1.269949041s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:55:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:55:25.267781184 +0000 UTC m=+861.029089221" watchObservedRunningTime="2026-09-10 17:55:25.269949041 +0000 UTC m=+861.031257087"
Sep 10 17:55:36.244132 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:36.244096    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-826cc2b1-6868df8446-n2xdc"
Sep 10 17:55:36.244801 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:36.244171    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-826cc2b1-7b95c5c4fd-xxx5m"
Sep 10 17:55:45.581252 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:45.581205    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-conflict-b-b42bbba1-kserve-648c6897c9-s4fvt"]
Sep 10 17:55:45.589103 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:45.589070    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-b-b42bbba1-kserve-648c6897c9-s4fvt"
Sep 10 17:55:45.591957 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:45.591925    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-conflict-b-b42bbba1-kserve-self-signed-certs\""
Sep 10 17:55:45.598222 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:45.597680    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-conflict-b-b42bbba1-kserve-648c6897c9-s4fvt"]
Sep 10 17:55:45.639732 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:45.639687    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b81e624-80cf-4ec8-90f8-20b0ce9ee12a-home\") pod \"e2e-conflict-b-b42bbba1-kserve-648c6897c9-s4fvt\" (UID: \"2b81e624-80cf-4ec8-90f8-20b0ce9ee12a\") " pod="llm/e2e-conflict-b-b42bbba1-kserve-648c6897c9-s4fvt"
Sep 10 17:55:45.639931 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:45.639753    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8mqc\" (UniqueName: \"kubernetes.io/projected/2b81e624-80cf-4ec8-90f8-20b0ce9ee12a-kube-api-access-h8mqc\") pod \"e2e-conflict-b-b42bbba1-kserve-648c6897c9-s4fvt\" (UID: \"2b81e624-80cf-4ec8-90f8-20b0ce9ee12a\") " pod="llm/e2e-conflict-b-b42bbba1-kserve-648c6897c9-s4fvt"
Sep 10 17:55:45.639931 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:45.639818    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b81e624-80cf-4ec8-90f8-20b0ce9ee12a-tmp-dir\") pod \"e2e-conflict-b-b42bbba1-kserve-648c6897c9-s4fvt\" (UID: \"2b81e624-80cf-4ec8-90f8-20b0ce9ee12a\") " pod="llm/e2e-conflict-b-b42bbba1-kserve-648c6897c9-s4fvt"
Sep 10 17:55:45.639931 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:45.639886    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b81e624-80cf-4ec8-90f8-20b0ce9ee12a-model-cache\") pod \"e2e-conflict-b-b42bbba1-kserve-648c6897c9-s4fvt\" (UID: \"2b81e624-80cf-4ec8-90f8-20b0ce9ee12a\") " pod="llm/e2e-conflict-b-b42bbba1-kserve-648c6897c9-s4fvt"
Sep 10 17:55:45.640041 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:45.639942    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b81e624-80cf-4ec8-90f8-20b0ce9ee12a-tls-certs\") pod \"e2e-conflict-b-b42bbba1-kserve-648c6897c9-s4fvt\" (UID: \"2b81e624-80cf-4ec8-90f8-20b0ce9ee12a\") " pod="llm/e2e-conflict-b-b42bbba1-kserve-648c6897c9-s4fvt"
Sep 10 17:55:45.640041 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:45.639973    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b81e624-80cf-4ec8-90f8-20b0ce9ee12a-dshm\") pod \"e2e-conflict-b-b42bbba1-kserve-648c6897c9-s4fvt\" (UID: \"2b81e624-80cf-4ec8-90f8-20b0ce9ee12a\") " pod="llm/e2e-conflict-b-b42bbba1-kserve-648c6897c9-s4fvt"
Sep 10 17:55:45.741536 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:45.741498    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8mqc\" (UniqueName: \"kubernetes.io/projected/2b81e624-80cf-4ec8-90f8-20b0ce9ee12a-kube-api-access-h8mqc\") pod \"e2e-conflict-b-b42bbba1-kserve-648c6897c9-s4fvt\" (UID: \"2b81e624-80cf-4ec8-90f8-20b0ce9ee12a\") " pod="llm/e2e-conflict-b-b42bbba1-kserve-648c6897c9-s4fvt"
Sep 10 17:55:45.741740 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:45.741547    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b81e624-80cf-4ec8-90f8-20b0ce9ee12a-tmp-dir\") pod \"e2e-conflict-b-b42bbba1-kserve-648c6897c9-s4fvt\" (UID: \"2b81e624-80cf-4ec8-90f8-20b0ce9ee12a\") " pod="llm/e2e-conflict-b-b42bbba1-kserve-648c6897c9-s4fvt"
Sep 10 17:55:45.741740 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:45.741683    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b81e624-80cf-4ec8-90f8-20b0ce9ee12a-model-cache\") pod \"e2e-conflict-b-b42bbba1-kserve-648c6897c9-s4fvt\" (UID: \"2b81e624-80cf-4ec8-90f8-20b0ce9ee12a\") " pod="llm/e2e-conflict-b-b42bbba1-kserve-648c6897c9-s4fvt"
Sep 10 17:55:45.741957 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:45.741936    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b81e624-80cf-4ec8-90f8-20b0ce9ee12a-tmp-dir\") pod \"e2e-conflict-b-b42bbba1-kserve-648c6897c9-s4fvt\" (UID: \"2b81e624-80cf-4ec8-90f8-20b0ce9ee12a\") " pod="llm/e2e-conflict-b-b42bbba1-kserve-648c6897c9-s4fvt"
Sep 10 17:55:45.742056 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:45.742022    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b81e624-80cf-4ec8-90f8-20b0ce9ee12a-tls-certs\") pod \"e2e-conflict-b-b42bbba1-kserve-648c6897c9-s4fvt\" (UID: \"2b81e624-80cf-4ec8-90f8-20b0ce9ee12a\") " pod="llm/e2e-conflict-b-b42bbba1-kserve-648c6897c9-s4fvt"
Sep 10 17:55:45.742132 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:45.742071    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b81e624-80cf-4ec8-90f8-20b0ce9ee12a-model-cache\") pod \"e2e-conflict-b-b42bbba1-kserve-648c6897c9-s4fvt\" (UID: \"2b81e624-80cf-4ec8-90f8-20b0ce9ee12a\") " pod="llm/e2e-conflict-b-b42bbba1-kserve-648c6897c9-s4fvt"
Sep 10 17:55:45.742132 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:45.742103    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b81e624-80cf-4ec8-90f8-20b0ce9ee12a-dshm\") pod \"e2e-conflict-b-b42bbba1-kserve-648c6897c9-s4fvt\" (UID: \"2b81e624-80cf-4ec8-90f8-20b0ce9ee12a\") " pod="llm/e2e-conflict-b-b42bbba1-kserve-648c6897c9-s4fvt"
Sep 10 17:55:45.742236 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:45.742180    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b81e624-80cf-4ec8-90f8-20b0ce9ee12a-home\") pod \"e2e-conflict-b-b42bbba1-kserve-648c6897c9-s4fvt\" (UID: \"2b81e624-80cf-4ec8-90f8-20b0ce9ee12a\") " pod="llm/e2e-conflict-b-b42bbba1-kserve-648c6897c9-s4fvt"
Sep 10 17:55:45.742549 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:45.742523    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b81e624-80cf-4ec8-90f8-20b0ce9ee12a-home\") pod \"e2e-conflict-b-b42bbba1-kserve-648c6897c9-s4fvt\" (UID: \"2b81e624-80cf-4ec8-90f8-20b0ce9ee12a\") " pod="llm/e2e-conflict-b-b42bbba1-kserve-648c6897c9-s4fvt"
Sep 10 17:55:45.745222 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:45.745187    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b81e624-80cf-4ec8-90f8-20b0ce9ee12a-dshm\") pod \"e2e-conflict-b-b42bbba1-kserve-648c6897c9-s4fvt\" (UID: \"2b81e624-80cf-4ec8-90f8-20b0ce9ee12a\") " pod="llm/e2e-conflict-b-b42bbba1-kserve-648c6897c9-s4fvt"
Sep 10 17:55:45.745601 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:45.745577    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b81e624-80cf-4ec8-90f8-20b0ce9ee12a-tls-certs\") pod \"e2e-conflict-b-b42bbba1-kserve-648c6897c9-s4fvt\" (UID: \"2b81e624-80cf-4ec8-90f8-20b0ce9ee12a\") " pod="llm/e2e-conflict-b-b42bbba1-kserve-648c6897c9-s4fvt"
Sep 10 17:55:45.751522 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:45.751489    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8mqc\" (UniqueName: \"kubernetes.io/projected/2b81e624-80cf-4ec8-90f8-20b0ce9ee12a-kube-api-access-h8mqc\") pod \"e2e-conflict-b-b42bbba1-kserve-648c6897c9-s4fvt\" (UID: \"2b81e624-80cf-4ec8-90f8-20b0ce9ee12a\") " pod="llm/e2e-conflict-b-b42bbba1-kserve-648c6897c9-s4fvt"
Sep 10 17:55:45.903044 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:45.902938    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-b-b42bbba1-kserve-648c6897c9-s4fvt"
Sep 10 17:55:46.187262 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:46.187220    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-conflict-b-b42bbba1-kserve-648c6897c9-s4fvt"]
Sep 10 17:55:46.188747 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:55:46.188717    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2b81e624_80cf_4ec8_90f8_20b0ce9ee12a.slice/crio-42209d34b80b90450e7b5f1228c83402e437a7076f8150a05ddd63264a370ebe WatchSource:0}: Error finding container 42209d34b80b90450e7b5f1228c83402e437a7076f8150a05ddd63264a370ebe: Status 404 returned error can't find the container with id 42209d34b80b90450e7b5f1228c83402e437a7076f8150a05ddd63264a370ebe
Sep 10 17:55:46.370377 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:46.370303    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-b-b42bbba1-kserve-648c6897c9-s4fvt" event={"ID":"2b81e624-80cf-4ec8-90f8-20b0ce9ee12a","Type":"ContainerStarted","Data":"797dde18d20a4065c8b0f4e703ed752b871e53045a216ea1212f122fde508cc5"}
Sep 10 17:55:46.370574 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:46.370387    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-b-b42bbba1-kserve-648c6897c9-s4fvt" event={"ID":"2b81e624-80cf-4ec8-90f8-20b0ce9ee12a","Type":"ContainerStarted","Data":"42209d34b80b90450e7b5f1228c83402e437a7076f8150a05ddd63264a370ebe"}
Sep 10 17:55:46.396376 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:46.391037    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-conflict-b-b42bbba1-kserve-648c6897c9-s4fvt" podStartSLOduration=1.391003582 podStartE2EDuration="1.391003582s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:55:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:55:46.388725261 +0000 UTC m=+882.150033305" watchObservedRunningTime="2026-09-10 17:55:46.391003582 +0000 UTC m=+882.152311625"
Sep 10 17:55:48.283927 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:48.283889    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-826cc2b1-v8jgg"]
Sep 10 17:55:48.287880 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:48.287856    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-826cc2b1-v8jgg"
Sep 10 17:55:48.290738 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:48.290709    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-22shs\""
Sep 10 17:55:48.296040 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:48.295999    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-826cc2b1-v8jgg"]
Sep 10 17:55:48.372049 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:48.372012    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef5adad6-308f-4abb-a2cf-40742032a234-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-826cc2b1-v8jgg\" (UID: \"ef5adad6-308f-4abb-a2cf-40742032a234\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-826cc2b1-v8jgg"
Sep 10 17:55:48.472751 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:48.472711    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef5adad6-308f-4abb-a2cf-40742032a234-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-826cc2b1-v8jgg\" (UID: \"ef5adad6-308f-4abb-a2cf-40742032a234\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-826cc2b1-v8jgg"
Sep 10 17:55:48.473457 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:48.473435    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef5adad6-308f-4abb-a2cf-40742032a234-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-826cc2b1-v8jgg\" (UID: \"ef5adad6-308f-4abb-a2cf-40742032a234\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-826cc2b1-v8jgg"
Sep 10 17:55:48.601810 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:48.601709    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-826cc2b1-v8jgg"
Sep 10 17:55:48.881047 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:48.880997    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-826cc2b1-v8jgg"]
Sep 10 17:55:48.882390 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:55:48.882360    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef5adad6_308f_4abb_a2cf_40742032a234.slice/crio-0844e6815792bebc179d7376a41f92dec57272293ddeebf85bbc230a7637a74b WatchSource:0}: Error finding container 0844e6815792bebc179d7376a41f92dec57272293ddeebf85bbc230a7637a74b: Status 404 returned error can't find the container with id 0844e6815792bebc179d7376a41f92dec57272293ddeebf85bbc230a7637a74b
Sep 10 17:55:49.390395 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:49.390355    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-826cc2b1-v8jgg" event={"ID":"ef5adad6-308f-4abb-a2cf-40742032a234","Type":"ContainerStarted","Data":"d8786edb519faaadf58376d9df4d7a5faa7dd2fdb0c074ea91ed6229711b6cd8"}
Sep 10 17:55:49.390821 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:49.390414    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-826cc2b1-v8jgg" event={"ID":"ef5adad6-308f-4abb-a2cf-40742032a234","Type":"ContainerStarted","Data":"0844e6815792bebc179d7376a41f92dec57272293ddeebf85bbc230a7637a74b"}
Sep 10 17:55:49.407533 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:49.407477    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-826cc2b1-v8jgg" podStartSLOduration=1.407457409 podStartE2EDuration="1.407457409s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:55:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:55:49.405908996 +0000 UTC m=+885.167217035" watchObservedRunningTime="2026-09-10 17:55:49.407457409 +0000 UTC m=+885.168765488"
Sep 10 17:55:50.397773 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:50.397737    2568 generic.go:356] "Generic (PLEG): container finished" podID="ef5adad6-308f-4abb-a2cf-40742032a234" containerID="d8786edb519faaadf58376d9df4d7a5faa7dd2fdb0c074ea91ed6229711b6cd8" exitCode=0
Sep 10 17:55:50.398192 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:50.397829    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-826cc2b1-v8jgg" event={"ID":"ef5adad6-308f-4abb-a2cf-40742032a234","Type":"ContainerDied","Data":"d8786edb519faaadf58376d9df4d7a5faa7dd2fdb0c074ea91ed6229711b6cd8"}
Sep 10 17:55:51.569258 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:51.569222    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-826cc2b1-v8jgg"
Sep 10 17:55:51.703712 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:51.703625    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef5adad6-308f-4abb-a2cf-40742032a234-maas-api-service-ca\") pod \"ef5adad6-308f-4abb-a2cf-40742032a234\" (UID: \"ef5adad6-308f-4abb-a2cf-40742032a234\") "
Sep 10 17:55:51.703992 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:51.703968    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef5adad6-308f-4abb-a2cf-40742032a234-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ef5adad6-308f-4abb-a2cf-40742032a234" (UID: "ef5adad6-308f-4abb-a2cf-40742032a234"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 17:55:51.804781 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:51.804739    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef5adad6-308f-4abb-a2cf-40742032a234-maas-api-service-ca\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:55:52.412103 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:52.412067    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-826cc2b1-v8jgg"
Sep 10 17:55:52.412284 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:52.412101    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-826cc2b1-v8jgg" event={"ID":"ef5adad6-308f-4abb-a2cf-40742032a234","Type":"ContainerDied","Data":"0844e6815792bebc179d7376a41f92dec57272293ddeebf85bbc230a7637a74b"}
Sep 10 17:55:52.412284 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:52.412156    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0844e6815792bebc179d7376a41f92dec57272293ddeebf85bbc230a7637a74b"
Sep 10 17:55:55.000774 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:54.998658    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-826cc2b1-7b95c5c4fd-xxx5m"]
Sep 10 17:55:55.000774 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:54.998879    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-826cc2b1-7b95c5c4fd-xxx5m" podUID="e68c41cb-b1b7-44ef-b0a8-1ae9a07f203e" containerName="payload-processing" containerID="cri-o://44087fe0f546b8f2a0d24e908a397271a80af35cedd92cb5a315a55f9ecc2f3f" gracePeriod=30
Sep 10 17:55:55.003973 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:55.003935    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-826cc2b1-6868df8446-n2xdc"]
Sep 10 17:55:55.004425 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:55.004392    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-826cc2b1-6868df8446-n2xdc" podUID="156724d0-e4a1-4bbf-8674-6f3c1ac37399" containerName="payload-pre-processing" containerID="cri-o://b0870d3ba2423a7f4d999e45b6ea4405323c0e82016ce2ebc3c0dfd606ca453d" gracePeriod=30
Sep 10 17:55:55.240352 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:55.240150    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-826cc2b1-v8jgg"]
Sep 10 17:55:55.244498 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:55.244396    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-826cc2b1-v8jgg"]
Sep 10 17:55:55.270309 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:55.270278    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-826cc2b1-7b95c5c4fd-xxx5m"
Sep 10 17:55:55.303972 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:55.303938    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-826cc2b1-6868df8446-n2xdc"
Sep 10 17:55:55.338867 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:55.338823    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e68c41cb-b1b7-44ef-b0a8-1ae9a07f203e-plugins-config-volume\") pod \"e68c41cb-b1b7-44ef-b0a8-1ae9a07f203e\" (UID: \"e68c41cb-b1b7-44ef-b0a8-1ae9a07f203e\") "
Sep 10 17:55:55.339089 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:55.338904    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5rc8h\" (UniqueName: \"kubernetes.io/projected/e68c41cb-b1b7-44ef-b0a8-1ae9a07f203e-kube-api-access-5rc8h\") pod \"e68c41cb-b1b7-44ef-b0a8-1ae9a07f203e\" (UID: \"e68c41cb-b1b7-44ef-b0a8-1ae9a07f203e\") "
Sep 10 17:55:55.339458 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:55.339404    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e68c41cb-b1b7-44ef-b0a8-1ae9a07f203e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e68c41cb-b1b7-44ef-b0a8-1ae9a07f203e" (UID: "e68c41cb-b1b7-44ef-b0a8-1ae9a07f203e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 17:55:55.341429 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:55.341388    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e68c41cb-b1b7-44ef-b0a8-1ae9a07f203e-kube-api-access-5rc8h" (OuterVolumeSpecName: "kube-api-access-5rc8h") pod "e68c41cb-b1b7-44ef-b0a8-1ae9a07f203e" (UID: "e68c41cb-b1b7-44ef-b0a8-1ae9a07f203e"). InnerVolumeSpecName "kube-api-access-5rc8h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:55:55.432332 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:55.432285    2568 generic.go:356] "Generic (PLEG): container finished" podID="e68c41cb-b1b7-44ef-b0a8-1ae9a07f203e" containerID="44087fe0f546b8f2a0d24e908a397271a80af35cedd92cb5a315a55f9ecc2f3f" exitCode=0
Sep 10 17:55:55.432533 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:55.432355    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-826cc2b1-7b95c5c4fd-xxx5m" event={"ID":"e68c41cb-b1b7-44ef-b0a8-1ae9a07f203e","Type":"ContainerDied","Data":"44087fe0f546b8f2a0d24e908a397271a80af35cedd92cb5a315a55f9ecc2f3f"}
Sep 10 17:55:55.432533 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:55.432368    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-826cc2b1-7b95c5c4fd-xxx5m"
Sep 10 17:55:55.432533 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:55.432444    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-826cc2b1-7b95c5c4fd-xxx5m" event={"ID":"e68c41cb-b1b7-44ef-b0a8-1ae9a07f203e","Type":"ContainerDied","Data":"7fe2cdbd4d6957b57d24fcd64fdbd718a4bcea14fe8eaef56baad9b5b531a314"}
Sep 10 17:55:55.432533 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:55.432478    2568 scope.go:117] "RemoveContainer" containerID="44087fe0f546b8f2a0d24e908a397271a80af35cedd92cb5a315a55f9ecc2f3f"
Sep 10 17:55:55.433804 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:55.433784    2568 generic.go:356] "Generic (PLEG): container finished" podID="156724d0-e4a1-4bbf-8674-6f3c1ac37399" containerID="b0870d3ba2423a7f4d999e45b6ea4405323c0e82016ce2ebc3c0dfd606ca453d" exitCode=0
Sep 10 17:55:55.433912 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:55.433813    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-826cc2b1-6868df8446-n2xdc" event={"ID":"156724d0-e4a1-4bbf-8674-6f3c1ac37399","Type":"ContainerDied","Data":"b0870d3ba2423a7f4d999e45b6ea4405323c0e82016ce2ebc3c0dfd606ca453d"}
Sep 10 17:55:55.433912 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:55.433845    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-826cc2b1-6868df8446-n2xdc"
Sep 10 17:55:55.434031 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:55.433847    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-826cc2b1-6868df8446-n2xdc" event={"ID":"156724d0-e4a1-4bbf-8674-6f3c1ac37399","Type":"ContainerDied","Data":"669899efac957f2a0bbb5fcd6d3ea95febbcc23dce6ab8fdbd7b498e0db8cbf5"}
Sep 10 17:55:55.440066 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:55.439897    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/156724d0-e4a1-4bbf-8674-6f3c1ac37399-plugins-config-volume\") pod \"156724d0-e4a1-4bbf-8674-6f3c1ac37399\" (UID: \"156724d0-e4a1-4bbf-8674-6f3c1ac37399\") "
Sep 10 17:55:55.440066 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:55.440016    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xclfb\" (UniqueName: \"kubernetes.io/projected/156724d0-e4a1-4bbf-8674-6f3c1ac37399-kube-api-access-xclfb\") pod \"156724d0-e4a1-4bbf-8674-6f3c1ac37399\" (UID: \"156724d0-e4a1-4bbf-8674-6f3c1ac37399\") "
Sep 10 17:55:55.440310 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:55.440283    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e68c41cb-b1b7-44ef-b0a8-1ae9a07f203e-plugins-config-volume\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:55:55.440426 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:55.440311    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5rc8h\" (UniqueName: \"kubernetes.io/projected/e68c41cb-b1b7-44ef-b0a8-1ae9a07f203e-kube-api-access-5rc8h\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:55:55.440611 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:55.440576    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/156724d0-e4a1-4bbf-8674-6f3c1ac37399-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "156724d0-e4a1-4bbf-8674-6f3c1ac37399" (UID: "156724d0-e4a1-4bbf-8674-6f3c1ac37399"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 17:55:55.442448 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:55.442425    2568 scope.go:117] "RemoveContainer" containerID="44087fe0f546b8f2a0d24e908a397271a80af35cedd92cb5a315a55f9ecc2f3f"
Sep 10 17:55:55.442843 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:55:55.442818    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44087fe0f546b8f2a0d24e908a397271a80af35cedd92cb5a315a55f9ecc2f3f\": container with ID starting with 44087fe0f546b8f2a0d24e908a397271a80af35cedd92cb5a315a55f9ecc2f3f not found: ID does not exist" containerID="44087fe0f546b8f2a0d24e908a397271a80af35cedd92cb5a315a55f9ecc2f3f"
Sep 10 17:55:55.442938 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:55.442857    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44087fe0f546b8f2a0d24e908a397271a80af35cedd92cb5a315a55f9ecc2f3f"} err="failed to get container status \"44087fe0f546b8f2a0d24e908a397271a80af35cedd92cb5a315a55f9ecc2f3f\": rpc error: code = NotFound desc = could not find container \"44087fe0f546b8f2a0d24e908a397271a80af35cedd92cb5a315a55f9ecc2f3f\": container with ID starting with 44087fe0f546b8f2a0d24e908a397271a80af35cedd92cb5a315a55f9ecc2f3f not found: ID does not exist"
Sep 10 17:55:55.442938 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:55.442880    2568 scope.go:117] "RemoveContainer" containerID="b0870d3ba2423a7f4d999e45b6ea4405323c0e82016ce2ebc3c0dfd606ca453d"
Sep 10 17:55:55.443087 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:55.443049    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/156724d0-e4a1-4bbf-8674-6f3c1ac37399-kube-api-access-xclfb" (OuterVolumeSpecName: "kube-api-access-xclfb") pod "156724d0-e4a1-4bbf-8674-6f3c1ac37399" (UID: "156724d0-e4a1-4bbf-8674-6f3c1ac37399"). InnerVolumeSpecName "kube-api-access-xclfb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:55:55.455828 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:55.455797    2568 scope.go:117] "RemoveContainer" containerID="b0870d3ba2423a7f4d999e45b6ea4405323c0e82016ce2ebc3c0dfd606ca453d"
Sep 10 17:55:55.456272 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:55.456175    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-826cc2b1-7b95c5c4fd-xxx5m"]
Sep 10 17:55:55.456272 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:55:55.456226    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b0870d3ba2423a7f4d999e45b6ea4405323c0e82016ce2ebc3c0dfd606ca453d\": container with ID starting with b0870d3ba2423a7f4d999e45b6ea4405323c0e82016ce2ebc3c0dfd606ca453d not found: ID does not exist" containerID="b0870d3ba2423a7f4d999e45b6ea4405323c0e82016ce2ebc3c0dfd606ca453d"
Sep 10 17:55:55.456514 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:55.456264    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0870d3ba2423a7f4d999e45b6ea4405323c0e82016ce2ebc3c0dfd606ca453d"} err="failed to get container status \"b0870d3ba2423a7f4d999e45b6ea4405323c0e82016ce2ebc3c0dfd606ca453d\": rpc error: code = NotFound desc = could not find container \"b0870d3ba2423a7f4d999e45b6ea4405323c0e82016ce2ebc3c0dfd606ca453d\": container with ID starting with b0870d3ba2423a7f4d999e45b6ea4405323c0e82016ce2ebc3c0dfd606ca453d not found: ID does not exist"
Sep 10 17:55:55.459294 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:55.459270    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-826cc2b1-7b95c5c4fd-xxx5m"]
Sep 10 17:55:55.541050 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:55.540959    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xclfb\" (UniqueName: \"kubernetes.io/projected/156724d0-e4a1-4bbf-8674-6f3c1ac37399-kube-api-access-xclfb\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:55:55.541050 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:55.540992    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/156724d0-e4a1-4bbf-8674-6f3c1ac37399-plugins-config-volume\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:55:55.756925 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:55.756882    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-826cc2b1-6868df8446-n2xdc"]
Sep 10 17:55:55.762661 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:55.762626    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-826cc2b1-6868df8446-n2xdc"]
Sep 10 17:55:55.903819 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:55.903706    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-conflict-b-b42bbba1-kserve-648c6897c9-s4fvt"
Sep 10 17:55:55.903819 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:55.903779    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-conflict-b-b42bbba1-kserve-648c6897c9-s4fvt"
Sep 10 17:55:55.916293 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:55.916255    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-conflict-b-b42bbba1-kserve-648c6897c9-s4fvt"
Sep 10 17:55:56.454508 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:56.454475    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-conflict-b-b42bbba1-kserve-648c6897c9-s4fvt"
Sep 10 17:55:56.771303 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:56.771264    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="156724d0-e4a1-4bbf-8674-6f3c1ac37399" path="/var/lib/kubelet/pods/156724d0-e4a1-4bbf-8674-6f3c1ac37399/volumes"
Sep 10 17:55:56.771743 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:56.771725    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e68c41cb-b1b7-44ef-b0a8-1ae9a07f203e" path="/var/lib/kubelet/pods/e68c41cb-b1b7-44ef-b0a8-1ae9a07f203e/volumes"
Sep 10 17:55:56.772094 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:55:56.772079    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef5adad6-308f-4abb-a2cf-40742032a234" path="/var/lib/kubelet/pods/ef5adad6-308f-4abb-a2cf-40742032a234/volumes"
Sep 10 17:56:00.189616 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:00.189573    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-9584e914-86f5bb8c54-bbstg"]
Sep 10 17:56:00.190011 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:00.189991    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e68c41cb-b1b7-44ef-b0a8-1ae9a07f203e" containerName="payload-processing"
Sep 10 17:56:00.190011 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:00.190004    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="e68c41cb-b1b7-44ef-b0a8-1ae9a07f203e" containerName="payload-processing"
Sep 10 17:56:00.190109 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:00.190015    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef5adad6-308f-4abb-a2cf-40742032a234" containerName="revoke-keys"
Sep 10 17:56:00.190109 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:00.190020    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef5adad6-308f-4abb-a2cf-40742032a234" containerName="revoke-keys"
Sep 10 17:56:00.190109 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:00.190031    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="156724d0-e4a1-4bbf-8674-6f3c1ac37399" containerName="payload-pre-processing"
Sep 10 17:56:00.190109 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:00.190038    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="156724d0-e4a1-4bbf-8674-6f3c1ac37399" containerName="payload-pre-processing"
Sep 10 17:56:00.190109 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:00.190102    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="156724d0-e4a1-4bbf-8674-6f3c1ac37399" containerName="payload-pre-processing"
Sep 10 17:56:00.190109 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:00.190109    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef5adad6-308f-4abb-a2cf-40742032a234" containerName="revoke-keys"
Sep 10 17:56:00.190289 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:00.190116    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="e68c41cb-b1b7-44ef-b0a8-1ae9a07f203e" containerName="payload-processing"
Sep 10 17:56:00.195003 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:00.194975    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-9584e914-86f5bb8c54-bbstg"
Sep 10 17:56:00.198370 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:00.198341    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-9584e914-dockercfg-m9v69\""
Sep 10 17:56:00.198691 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:00.198671    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-9584e914\""
Sep 10 17:56:00.203922 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:00.203892    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-9584e914-86f5bb8c54-bbstg"]
Sep 10 17:56:00.214831 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:00.214787    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-9584e914-76c8844685-tgmtd"]
Sep 10 17:56:00.219517 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:00.219486    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-9584e914-76c8844685-tgmtd"
Sep 10 17:56:00.231505 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:00.231478    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-9584e914-76c8844685-tgmtd"]
Sep 10 17:56:00.287616 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:00.287575    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1b0b643e-7a10-4125-88e1-d53e9eacb5c3-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-9584e914-86f5bb8c54-bbstg\" (UID: \"1b0b643e-7a10-4125-88e1-d53e9eacb5c3\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-9584e914-86f5bb8c54-bbstg"
Sep 10 17:56:00.287821 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:00.287688    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqvvd\" (UniqueName: \"kubernetes.io/projected/1b0b643e-7a10-4125-88e1-d53e9eacb5c3-kube-api-access-cqvvd\") pod \"payload-pre-processing-e2e-ait-9584e914-86f5bb8c54-bbstg\" (UID: \"1b0b643e-7a10-4125-88e1-d53e9eacb5c3\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-9584e914-86f5bb8c54-bbstg"
Sep 10 17:56:00.388567 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:00.388519    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1b0b643e-7a10-4125-88e1-d53e9eacb5c3-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-9584e914-86f5bb8c54-bbstg\" (UID: \"1b0b643e-7a10-4125-88e1-d53e9eacb5c3\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-9584e914-86f5bb8c54-bbstg"
Sep 10 17:56:00.388567 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:00.388570    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvz2p\" (UniqueName: \"kubernetes.io/projected/0a85ec33-b1ad-44d3-9feb-32ea9f5fae07-kube-api-access-kvz2p\") pod \"payload-processing-e2e-ait-9584e914-76c8844685-tgmtd\" (UID: \"0a85ec33-b1ad-44d3-9feb-32ea9f5fae07\") " pod="openshift-ingress/payload-processing-e2e-ait-9584e914-76c8844685-tgmtd"
Sep 10 17:56:00.388796 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:00.388628    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqvvd\" (UniqueName: \"kubernetes.io/projected/1b0b643e-7a10-4125-88e1-d53e9eacb5c3-kube-api-access-cqvvd\") pod \"payload-pre-processing-e2e-ait-9584e914-86f5bb8c54-bbstg\" (UID: \"1b0b643e-7a10-4125-88e1-d53e9eacb5c3\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-9584e914-86f5bb8c54-bbstg"
Sep 10 17:56:00.388796 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:00.388668    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0a85ec33-b1ad-44d3-9feb-32ea9f5fae07-plugins-config-volume\") pod \"payload-processing-e2e-ait-9584e914-76c8844685-tgmtd\" (UID: \"0a85ec33-b1ad-44d3-9feb-32ea9f5fae07\") " pod="openshift-ingress/payload-processing-e2e-ait-9584e914-76c8844685-tgmtd"
Sep 10 17:56:00.389279 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:00.389256    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1b0b643e-7a10-4125-88e1-d53e9eacb5c3-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-9584e914-86f5bb8c54-bbstg\" (UID: \"1b0b643e-7a10-4125-88e1-d53e9eacb5c3\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-9584e914-86f5bb8c54-bbstg"
Sep 10 17:56:00.396877 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:00.396845    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqvvd\" (UniqueName: \"kubernetes.io/projected/1b0b643e-7a10-4125-88e1-d53e9eacb5c3-kube-api-access-cqvvd\") pod \"payload-pre-processing-e2e-ait-9584e914-86f5bb8c54-bbstg\" (UID: \"1b0b643e-7a10-4125-88e1-d53e9eacb5c3\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-9584e914-86f5bb8c54-bbstg"
Sep 10 17:56:00.489490 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:00.489453    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0a85ec33-b1ad-44d3-9feb-32ea9f5fae07-plugins-config-volume\") pod \"payload-processing-e2e-ait-9584e914-76c8844685-tgmtd\" (UID: \"0a85ec33-b1ad-44d3-9feb-32ea9f5fae07\") " pod="openshift-ingress/payload-processing-e2e-ait-9584e914-76c8844685-tgmtd"
Sep 10 17:56:00.489692 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:00.489520    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvz2p\" (UniqueName: \"kubernetes.io/projected/0a85ec33-b1ad-44d3-9feb-32ea9f5fae07-kube-api-access-kvz2p\") pod \"payload-processing-e2e-ait-9584e914-76c8844685-tgmtd\" (UID: \"0a85ec33-b1ad-44d3-9feb-32ea9f5fae07\") " pod="openshift-ingress/payload-processing-e2e-ait-9584e914-76c8844685-tgmtd"
Sep 10 17:56:00.490193 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:00.490168    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0a85ec33-b1ad-44d3-9feb-32ea9f5fae07-plugins-config-volume\") pod \"payload-processing-e2e-ait-9584e914-76c8844685-tgmtd\" (UID: \"0a85ec33-b1ad-44d3-9feb-32ea9f5fae07\") " pod="openshift-ingress/payload-processing-e2e-ait-9584e914-76c8844685-tgmtd"
Sep 10 17:56:00.498442 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:00.498398    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvz2p\" (UniqueName: \"kubernetes.io/projected/0a85ec33-b1ad-44d3-9feb-32ea9f5fae07-kube-api-access-kvz2p\") pod \"payload-processing-e2e-ait-9584e914-76c8844685-tgmtd\" (UID: \"0a85ec33-b1ad-44d3-9feb-32ea9f5fae07\") " pod="openshift-ingress/payload-processing-e2e-ait-9584e914-76c8844685-tgmtd"
Sep 10 17:56:00.508130 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:00.508093    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-9584e914-86f5bb8c54-bbstg"
Sep 10 17:56:00.531599 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:00.531557    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-9584e914-76c8844685-tgmtd"
Sep 10 17:56:00.792548 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:00.792453    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-9584e914-86f5bb8c54-bbstg"]
Sep 10 17:56:00.796812 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:56:00.796782    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b0b643e_7a10_4125_88e1_d53e9eacb5c3.slice/crio-905566bf02d258f3d47a61ffcdc7c470baedd2bb9e026f9cd19a4c462b0069f0 WatchSource:0}: Error finding container 905566bf02d258f3d47a61ffcdc7c470baedd2bb9e026f9cd19a4c462b0069f0: Status 404 returned error can't find the container with id 905566bf02d258f3d47a61ffcdc7c470baedd2bb9e026f9cd19a4c462b0069f0
Sep 10 17:56:00.828112 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:00.828085    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-9584e914-76c8844685-tgmtd"]
Sep 10 17:56:00.830529 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:56:00.830504    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a85ec33_b1ad_44d3_9feb_32ea9f5fae07.slice/crio-22aa64a9fadd5139e1614b6189269d6b6d4694239a60e4cb0c3d708bc4502f48 WatchSource:0}: Error finding container 22aa64a9fadd5139e1614b6189269d6b6d4694239a60e4cb0c3d708bc4502f48: Status 404 returned error can't find the container with id 22aa64a9fadd5139e1614b6189269d6b6d4694239a60e4cb0c3d708bc4502f48
Sep 10 17:56:01.479054 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:01.479010    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-9584e914-86f5bb8c54-bbstg" event={"ID":"1b0b643e-7a10-4125-88e1-d53e9eacb5c3","Type":"ContainerStarted","Data":"9f0c4475d3d8ba82faf1a2309ab4f61df29b0bdee0c7f3e3bf0bd07179396ec5"}
Sep 10 17:56:01.479527 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:01.479079    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-9584e914-86f5bb8c54-bbstg" event={"ID":"1b0b643e-7a10-4125-88e1-d53e9eacb5c3","Type":"ContainerStarted","Data":"905566bf02d258f3d47a61ffcdc7c470baedd2bb9e026f9cd19a4c462b0069f0"}
Sep 10 17:56:01.479527 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:01.479115    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-9584e914-86f5bb8c54-bbstg"
Sep 10 17:56:01.480649 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:01.480628    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-9584e914-76c8844685-tgmtd" event={"ID":"0a85ec33-b1ad-44d3-9feb-32ea9f5fae07","Type":"ContainerStarted","Data":"b3de31a436ff161d81ef2e721836c4ed40ae382ff2a68cd144c9befe3134f2ec"}
Sep 10 17:56:01.480730 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:01.480672    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-9584e914-76c8844685-tgmtd" event={"ID":"0a85ec33-b1ad-44d3-9feb-32ea9f5fae07","Type":"ContainerStarted","Data":"22aa64a9fadd5139e1614b6189269d6b6d4694239a60e4cb0c3d708bc4502f48"}
Sep 10 17:56:01.480730 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:01.480707    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-9584e914-76c8844685-tgmtd"
Sep 10 17:56:01.497255 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:01.497202    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-9584e914-86f5bb8c54-bbstg" podStartSLOduration=1.497186932 podStartE2EDuration="1.497186932s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:56:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:56:01.495783543 +0000 UTC m=+897.257091586" watchObservedRunningTime="2026-09-10 17:56:01.497186932 +0000 UTC m=+897.258494975"
Sep 10 17:56:01.515177 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:01.515116    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-9584e914-76c8844685-tgmtd" podStartSLOduration=1.515096956 podStartE2EDuration="1.515096956s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:56:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:56:01.513237162 +0000 UTC m=+897.274545205" watchObservedRunningTime="2026-09-10 17:56:01.515096956 +0000 UTC m=+897.276405050"
Sep 10 17:56:04.758800 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:04.758760    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-jwfnv_e90054ec-91dc-4cda-94a2-fbe7a2a1fff0/console-operator/1.log"
Sep 10 17:56:04.760121 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:04.760098    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-jwfnv_e90054ec-91dc-4cda-94a2-fbe7a2a1fff0/console-operator/1.log"
Sep 10 17:56:12.489850 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:12.489811    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-9584e914-76c8844685-tgmtd"
Sep 10 17:56:12.490543 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:12.490106    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-9584e914-86f5bb8c54-bbstg"
Sep 10 17:56:24.031127 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:24.031086    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9584e914-v5lss"]
Sep 10 17:56:24.036410 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:24.036381    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9584e914-v5lss"
Sep 10 17:56:24.040609 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:24.040578    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-22shs\""
Sep 10 17:56:24.042268 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:24.042229    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9584e914-v5lss"]
Sep 10 17:56:24.127847 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:24.127788    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7993d673-8172-4022-974b-f3d4b5c36f67-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-9584e914-v5lss\" (UID: \"7993d673-8172-4022-974b-f3d4b5c36f67\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9584e914-v5lss"
Sep 10 17:56:24.229244 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:24.229199    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7993d673-8172-4022-974b-f3d4b5c36f67-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-9584e914-v5lss\" (UID: \"7993d673-8172-4022-974b-f3d4b5c36f67\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9584e914-v5lss"
Sep 10 17:56:24.229918 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:24.229893    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7993d673-8172-4022-974b-f3d4b5c36f67-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-9584e914-v5lss\" (UID: \"7993d673-8172-4022-974b-f3d4b5c36f67\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9584e914-v5lss"
Sep 10 17:56:24.353646 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:24.353554    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9584e914-v5lss"
Sep 10 17:56:24.625504 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:24.625476    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9584e914-v5lss"]
Sep 10 17:56:24.627177 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:56:24.627148    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7993d673_8172_4022_974b_f3d4b5c36f67.slice/crio-be7131681177dbd8e510ed91e96442f5351c100afcf748f269a86f6e61a9ab21 WatchSource:0}: Error finding container be7131681177dbd8e510ed91e96442f5351c100afcf748f269a86f6e61a9ab21: Status 404 returned error can't find the container with id be7131681177dbd8e510ed91e96442f5351c100afcf748f269a86f6e61a9ab21
Sep 10 17:56:25.627196 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:25.627162    2568 generic.go:356] "Generic (PLEG): container finished" podID="7993d673-8172-4022-974b-f3d4b5c36f67" containerID="6212b6561727f41cd20d50928ed8d0f4196aa49a64e9d49d608fe724c1feeff2" exitCode=0
Sep 10 17:56:25.627655 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:25.627255    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9584e914-v5lss" event={"ID":"7993d673-8172-4022-974b-f3d4b5c36f67","Type":"ContainerDied","Data":"6212b6561727f41cd20d50928ed8d0f4196aa49a64e9d49d608fe724c1feeff2"}
Sep 10 17:56:25.627655 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:25.627367    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9584e914-v5lss" event={"ID":"7993d673-8172-4022-974b-f3d4b5c36f67","Type":"ContainerStarted","Data":"be7131681177dbd8e510ed91e96442f5351c100afcf748f269a86f6e61a9ab21"}
Sep 10 17:56:26.782625 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:26.782594    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9584e914-v5lss"
Sep 10 17:56:26.852979 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:26.852939    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7993d673-8172-4022-974b-f3d4b5c36f67-maas-api-service-ca\") pod \"7993d673-8172-4022-974b-f3d4b5c36f67\" (UID: \"7993d673-8172-4022-974b-f3d4b5c36f67\") "
Sep 10 17:56:26.853412 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:26.853383    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7993d673-8172-4022-974b-f3d4b5c36f67-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7993d673-8172-4022-974b-f3d4b5c36f67" (UID: "7993d673-8172-4022-974b-f3d4b5c36f67"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 17:56:26.954131 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:26.954033    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7993d673-8172-4022-974b-f3d4b5c36f67-maas-api-service-ca\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:56:27.639778 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:27.639733    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9584e914-v5lss"
Sep 10 17:56:27.639959 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:27.639733    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9584e914-v5lss" event={"ID":"7993d673-8172-4022-974b-f3d4b5c36f67","Type":"ContainerDied","Data":"be7131681177dbd8e510ed91e96442f5351c100afcf748f269a86f6e61a9ab21"}
Sep 10 17:56:27.639959 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:27.639873    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="be7131681177dbd8e510ed91e96442f5351c100afcf748f269a86f6e61a9ab21"
Sep 10 17:56:29.974607 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:29.974568    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-9584e914-76c8844685-tgmtd"]
Sep 10 17:56:29.975301 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:29.974827    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-9584e914-76c8844685-tgmtd" podUID="0a85ec33-b1ad-44d3-9feb-32ea9f5fae07" containerName="payload-processing" containerID="cri-o://b3de31a436ff161d81ef2e721836c4ed40ae382ff2a68cd144c9befe3134f2ec" gracePeriod=30
Sep 10 17:56:29.980791 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:29.980749    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-9584e914-86f5bb8c54-bbstg"]
Sep 10 17:56:29.981063 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:29.981032    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-9584e914-86f5bb8c54-bbstg" podUID="1b0b643e-7a10-4125-88e1-d53e9eacb5c3" containerName="payload-pre-processing" containerID="cri-o://9f0c4475d3d8ba82faf1a2309ab4f61df29b0bdee0c7f3e3bf0bd07179396ec5" gracePeriod=30
Sep 10 17:56:30.180465 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:30.180421    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9584e914-v5lss"]
Sep 10 17:56:30.182984 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:30.182946    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9584e914-v5lss"]
Sep 10 17:56:30.248531 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:30.248495    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-9584e914-76c8844685-tgmtd"
Sep 10 17:56:30.276191 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:30.276161    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-9584e914-86f5bb8c54-bbstg"
Sep 10 17:56:30.388814 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:30.388772    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0a85ec33-b1ad-44d3-9feb-32ea9f5fae07-plugins-config-volume\") pod \"0a85ec33-b1ad-44d3-9feb-32ea9f5fae07\" (UID: \"0a85ec33-b1ad-44d3-9feb-32ea9f5fae07\") "
Sep 10 17:56:30.389027 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:30.388847    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1b0b643e-7a10-4125-88e1-d53e9eacb5c3-plugins-config-volume\") pod \"1b0b643e-7a10-4125-88e1-d53e9eacb5c3\" (UID: \"1b0b643e-7a10-4125-88e1-d53e9eacb5c3\") "
Sep 10 17:56:30.389027 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:30.388875    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kvz2p\" (UniqueName: \"kubernetes.io/projected/0a85ec33-b1ad-44d3-9feb-32ea9f5fae07-kube-api-access-kvz2p\") pod \"0a85ec33-b1ad-44d3-9feb-32ea9f5fae07\" (UID: \"0a85ec33-b1ad-44d3-9feb-32ea9f5fae07\") "
Sep 10 17:56:30.389027 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:30.388920    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cqvvd\" (UniqueName: \"kubernetes.io/projected/1b0b643e-7a10-4125-88e1-d53e9eacb5c3-kube-api-access-cqvvd\") pod \"1b0b643e-7a10-4125-88e1-d53e9eacb5c3\" (UID: \"1b0b643e-7a10-4125-88e1-d53e9eacb5c3\") "
Sep 10 17:56:30.389209 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:30.389149    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a85ec33-b1ad-44d3-9feb-32ea9f5fae07-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0a85ec33-b1ad-44d3-9feb-32ea9f5fae07" (UID: "0a85ec33-b1ad-44d3-9feb-32ea9f5fae07"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 17:56:30.389267 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:30.389228    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b0b643e-7a10-4125-88e1-d53e9eacb5c3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1b0b643e-7a10-4125-88e1-d53e9eacb5c3" (UID: "1b0b643e-7a10-4125-88e1-d53e9eacb5c3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 17:56:30.391036 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:30.391010    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b0b643e-7a10-4125-88e1-d53e9eacb5c3-kube-api-access-cqvvd" (OuterVolumeSpecName: "kube-api-access-cqvvd") pod "1b0b643e-7a10-4125-88e1-d53e9eacb5c3" (UID: "1b0b643e-7a10-4125-88e1-d53e9eacb5c3"). InnerVolumeSpecName "kube-api-access-cqvvd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:56:30.391131 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:30.391030    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a85ec33-b1ad-44d3-9feb-32ea9f5fae07-kube-api-access-kvz2p" (OuterVolumeSpecName: "kube-api-access-kvz2p") pod "0a85ec33-b1ad-44d3-9feb-32ea9f5fae07" (UID: "0a85ec33-b1ad-44d3-9feb-32ea9f5fae07"). InnerVolumeSpecName "kube-api-access-kvz2p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:56:30.490480 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:30.490376    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1b0b643e-7a10-4125-88e1-d53e9eacb5c3-plugins-config-volume\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:56:30.490480 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:30.490412    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kvz2p\" (UniqueName: \"kubernetes.io/projected/0a85ec33-b1ad-44d3-9feb-32ea9f5fae07-kube-api-access-kvz2p\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:56:30.490480 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:30.490421    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cqvvd\" (UniqueName: \"kubernetes.io/projected/1b0b643e-7a10-4125-88e1-d53e9eacb5c3-kube-api-access-cqvvd\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:56:30.490480 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:30.490430    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0a85ec33-b1ad-44d3-9feb-32ea9f5fae07-plugins-config-volume\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:56:30.661732 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:30.661693    2568 generic.go:356] "Generic (PLEG): container finished" podID="0a85ec33-b1ad-44d3-9feb-32ea9f5fae07" containerID="b3de31a436ff161d81ef2e721836c4ed40ae382ff2a68cd144c9befe3134f2ec" exitCode=0
Sep 10 17:56:30.661957 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:30.661740    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-9584e914-76c8844685-tgmtd"
Sep 10 17:56:30.661957 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:30.661781    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-9584e914-76c8844685-tgmtd" event={"ID":"0a85ec33-b1ad-44d3-9feb-32ea9f5fae07","Type":"ContainerDied","Data":"b3de31a436ff161d81ef2e721836c4ed40ae382ff2a68cd144c9befe3134f2ec"}
Sep 10 17:56:30.661957 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:30.661841    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-9584e914-76c8844685-tgmtd" event={"ID":"0a85ec33-b1ad-44d3-9feb-32ea9f5fae07","Type":"ContainerDied","Data":"22aa64a9fadd5139e1614b6189269d6b6d4694239a60e4cb0c3d708bc4502f48"}
Sep 10 17:56:30.661957 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:30.661881    2568 scope.go:117] "RemoveContainer" containerID="b3de31a436ff161d81ef2e721836c4ed40ae382ff2a68cd144c9befe3134f2ec"
Sep 10 17:56:30.663429 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:30.663405    2568 generic.go:356] "Generic (PLEG): container finished" podID="1b0b643e-7a10-4125-88e1-d53e9eacb5c3" containerID="9f0c4475d3d8ba82faf1a2309ab4f61df29b0bdee0c7f3e3bf0bd07179396ec5" exitCode=0
Sep 10 17:56:30.663535 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:30.663449    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-9584e914-86f5bb8c54-bbstg"
Sep 10 17:56:30.663535 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:30.663474    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-9584e914-86f5bb8c54-bbstg" event={"ID":"1b0b643e-7a10-4125-88e1-d53e9eacb5c3","Type":"ContainerDied","Data":"9f0c4475d3d8ba82faf1a2309ab4f61df29b0bdee0c7f3e3bf0bd07179396ec5"}
Sep 10 17:56:30.663535 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:30.663510    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-9584e914-86f5bb8c54-bbstg" event={"ID":"1b0b643e-7a10-4125-88e1-d53e9eacb5c3","Type":"ContainerDied","Data":"905566bf02d258f3d47a61ffcdc7c470baedd2bb9e026f9cd19a4c462b0069f0"}
Sep 10 17:56:30.676090 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:30.674508    2568 scope.go:117] "RemoveContainer" containerID="b3de31a436ff161d81ef2e721836c4ed40ae382ff2a68cd144c9befe3134f2ec"
Sep 10 17:56:30.676090 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:56:30.675859    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b3de31a436ff161d81ef2e721836c4ed40ae382ff2a68cd144c9befe3134f2ec\": container with ID starting with b3de31a436ff161d81ef2e721836c4ed40ae382ff2a68cd144c9befe3134f2ec not found: ID does not exist" containerID="b3de31a436ff161d81ef2e721836c4ed40ae382ff2a68cd144c9befe3134f2ec"
Sep 10 17:56:30.676090 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:30.675921    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3de31a436ff161d81ef2e721836c4ed40ae382ff2a68cd144c9befe3134f2ec"} err="failed to get container status \"b3de31a436ff161d81ef2e721836c4ed40ae382ff2a68cd144c9befe3134f2ec\": rpc error: code = NotFound desc = could not find container \"b3de31a436ff161d81ef2e721836c4ed40ae382ff2a68cd144c9befe3134f2ec\": container with ID starting with b3de31a436ff161d81ef2e721836c4ed40ae382ff2a68cd144c9befe3134f2ec not found: ID does not exist"
Sep 10 17:56:30.676090 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:30.675954    2568 scope.go:117] "RemoveContainer" containerID="9f0c4475d3d8ba82faf1a2309ab4f61df29b0bdee0c7f3e3bf0bd07179396ec5"
Sep 10 17:56:30.685977 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:30.685954    2568 scope.go:117] "RemoveContainer" containerID="9f0c4475d3d8ba82faf1a2309ab4f61df29b0bdee0c7f3e3bf0bd07179396ec5"
Sep 10 17:56:30.686405 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:56:30.686352    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f0c4475d3d8ba82faf1a2309ab4f61df29b0bdee0c7f3e3bf0bd07179396ec5\": container with ID starting with 9f0c4475d3d8ba82faf1a2309ab4f61df29b0bdee0c7f3e3bf0bd07179396ec5 not found: ID does not exist" containerID="9f0c4475d3d8ba82faf1a2309ab4f61df29b0bdee0c7f3e3bf0bd07179396ec5"
Sep 10 17:56:30.686557 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:30.686393    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f0c4475d3d8ba82faf1a2309ab4f61df29b0bdee0c7f3e3bf0bd07179396ec5"} err="failed to get container status \"9f0c4475d3d8ba82faf1a2309ab4f61df29b0bdee0c7f3e3bf0bd07179396ec5\": rpc error: code = NotFound desc = could not find container \"9f0c4475d3d8ba82faf1a2309ab4f61df29b0bdee0c7f3e3bf0bd07179396ec5\": container with ID starting with 9f0c4475d3d8ba82faf1a2309ab4f61df29b0bdee0c7f3e3bf0bd07179396ec5 not found: ID does not exist"
Sep 10 17:56:30.689275 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:30.689244    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-9584e914-86f5bb8c54-bbstg"]
Sep 10 17:56:30.693228 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:30.693191    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-9584e914-86f5bb8c54-bbstg"]
Sep 10 17:56:30.705899 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:30.705852    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-9584e914-76c8844685-tgmtd"]
Sep 10 17:56:30.715938 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:30.715893    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-9584e914-76c8844685-tgmtd"]
Sep 10 17:56:30.771695 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:30.771602    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a85ec33-b1ad-44d3-9feb-32ea9f5fae07" path="/var/lib/kubelet/pods/0a85ec33-b1ad-44d3-9feb-32ea9f5fae07/volumes"
Sep 10 17:56:30.772042 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:30.772027    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b0b643e-7a10-4125-88e1-d53e9eacb5c3" path="/var/lib/kubelet/pods/1b0b643e-7a10-4125-88e1-d53e9eacb5c3/volumes"
Sep 10 17:56:30.772363 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:30.772350    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7993d673-8172-4022-974b-f3d4b5c36f67" path="/var/lib/kubelet/pods/7993d673-8172-4022-974b-f3d4b5c36f67/volumes"
Sep 10 17:56:36.427292 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:36.427240    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-d0df615c-7bc5cfccfd-h8mwc"]
Sep 10 17:56:36.427876 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:36.427853    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7993d673-8172-4022-974b-f3d4b5c36f67" containerName="revoke-keys"
Sep 10 17:56:36.427962 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:36.427879    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="7993d673-8172-4022-974b-f3d4b5c36f67" containerName="revoke-keys"
Sep 10 17:56:36.427962 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:36.427899    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b0b643e-7a10-4125-88e1-d53e9eacb5c3" containerName="payload-pre-processing"
Sep 10 17:56:36.427962 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:36.427907    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b0b643e-7a10-4125-88e1-d53e9eacb5c3" containerName="payload-pre-processing"
Sep 10 17:56:36.427962 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:36.427920    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a85ec33-b1ad-44d3-9feb-32ea9f5fae07" containerName="payload-processing"
Sep 10 17:56:36.427962 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:36.427930    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a85ec33-b1ad-44d3-9feb-32ea9f5fae07" containerName="payload-processing"
Sep 10 17:56:36.428208 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:36.428066    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b0b643e-7a10-4125-88e1-d53e9eacb5c3" containerName="payload-pre-processing"
Sep 10 17:56:36.428208 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:36.428079    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a85ec33-b1ad-44d3-9feb-32ea9f5fae07" containerName="payload-processing"
Sep 10 17:56:36.428208 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:36.428090    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="7993d673-8172-4022-974b-f3d4b5c36f67" containerName="revoke-keys"
Sep 10 17:56:36.431434 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:36.431409    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-d0df615c-7bc5cfccfd-h8mwc"
Sep 10 17:56:36.434114 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:36.434076    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-d0df615c\""
Sep 10 17:56:36.434279 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:36.434183    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-d0df615c-dockercfg-hwdw2\""
Sep 10 17:56:36.443681 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:36.443617    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-d0df615c-7bc5cfccfd-h8mwc"]
Sep 10 17:56:36.453371 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:36.453309    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-d0df615c-86c96f68f-gsq5b"]
Sep 10 17:56:36.457671 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:36.457641    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-d0df615c-86c96f68f-gsq5b"
Sep 10 17:56:36.465626 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:36.465570    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-d0df615c-86c96f68f-gsq5b"]
Sep 10 17:56:36.550494 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:36.550451    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdzpg\" (UniqueName: \"kubernetes.io/projected/f6c1cde9-8f69-4d0a-8d70-de5d4d27d9e5-kube-api-access-tdzpg\") pod \"payload-processing-e2e-derive-d0df615c-86c96f68f-gsq5b\" (UID: \"f6c1cde9-8f69-4d0a-8d70-de5d4d27d9e5\") " pod="openshift-ingress/payload-processing-e2e-derive-d0df615c-86c96f68f-gsq5b"
Sep 10 17:56:36.550494 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:36.550499    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wh49\" (UniqueName: \"kubernetes.io/projected/f5f30f83-3b63-4a66-8895-5a1deeed398b-kube-api-access-9wh49\") pod \"payload-pre-processing-e2e-derive-d0df615c-7bc5cfccfd-h8mwc\" (UID: \"f5f30f83-3b63-4a66-8895-5a1deeed398b\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-d0df615c-7bc5cfccfd-h8mwc"
Sep 10 17:56:36.550804 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:36.550521    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f5f30f83-3b63-4a66-8895-5a1deeed398b-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-d0df615c-7bc5cfccfd-h8mwc\" (UID: \"f5f30f83-3b63-4a66-8895-5a1deeed398b\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-d0df615c-7bc5cfccfd-h8mwc"
Sep 10 17:56:36.550804 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:36.550620    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f6c1cde9-8f69-4d0a-8d70-de5d4d27d9e5-plugins-config-volume\") pod \"payload-processing-e2e-derive-d0df615c-86c96f68f-gsq5b\" (UID: \"f6c1cde9-8f69-4d0a-8d70-de5d4d27d9e5\") " pod="openshift-ingress/payload-processing-e2e-derive-d0df615c-86c96f68f-gsq5b"
Sep 10 17:56:36.651521 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:36.651473    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f6c1cde9-8f69-4d0a-8d70-de5d4d27d9e5-plugins-config-volume\") pod \"payload-processing-e2e-derive-d0df615c-86c96f68f-gsq5b\" (UID: \"f6c1cde9-8f69-4d0a-8d70-de5d4d27d9e5\") " pod="openshift-ingress/payload-processing-e2e-derive-d0df615c-86c96f68f-gsq5b"
Sep 10 17:56:36.651755 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:36.651616    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdzpg\" (UniqueName: \"kubernetes.io/projected/f6c1cde9-8f69-4d0a-8d70-de5d4d27d9e5-kube-api-access-tdzpg\") pod \"payload-processing-e2e-derive-d0df615c-86c96f68f-gsq5b\" (UID: \"f6c1cde9-8f69-4d0a-8d70-de5d4d27d9e5\") " pod="openshift-ingress/payload-processing-e2e-derive-d0df615c-86c96f68f-gsq5b"
Sep 10 17:56:36.651755 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:36.651661    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wh49\" (UniqueName: \"kubernetes.io/projected/f5f30f83-3b63-4a66-8895-5a1deeed398b-kube-api-access-9wh49\") pod \"payload-pre-processing-e2e-derive-d0df615c-7bc5cfccfd-h8mwc\" (UID: \"f5f30f83-3b63-4a66-8895-5a1deeed398b\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-d0df615c-7bc5cfccfd-h8mwc"
Sep 10 17:56:36.651755 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:36.651695    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f5f30f83-3b63-4a66-8895-5a1deeed398b-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-d0df615c-7bc5cfccfd-h8mwc\" (UID: \"f5f30f83-3b63-4a66-8895-5a1deeed398b\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-d0df615c-7bc5cfccfd-h8mwc"
Sep 10 17:56:36.652492 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:36.652465    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f5f30f83-3b63-4a66-8895-5a1deeed398b-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-d0df615c-7bc5cfccfd-h8mwc\" (UID: \"f5f30f83-3b63-4a66-8895-5a1deeed398b\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-d0df615c-7bc5cfccfd-h8mwc"
Sep 10 17:56:36.652683 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:36.652661    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f6c1cde9-8f69-4d0a-8d70-de5d4d27d9e5-plugins-config-volume\") pod \"payload-processing-e2e-derive-d0df615c-86c96f68f-gsq5b\" (UID: \"f6c1cde9-8f69-4d0a-8d70-de5d4d27d9e5\") " pod="openshift-ingress/payload-processing-e2e-derive-d0df615c-86c96f68f-gsq5b"
Sep 10 17:56:36.660395 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:36.660361    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdzpg\" (UniqueName: \"kubernetes.io/projected/f6c1cde9-8f69-4d0a-8d70-de5d4d27d9e5-kube-api-access-tdzpg\") pod \"payload-processing-e2e-derive-d0df615c-86c96f68f-gsq5b\" (UID: \"f6c1cde9-8f69-4d0a-8d70-de5d4d27d9e5\") " pod="openshift-ingress/payload-processing-e2e-derive-d0df615c-86c96f68f-gsq5b"
Sep 10 17:56:36.660540 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:36.660477    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wh49\" (UniqueName: \"kubernetes.io/projected/f5f30f83-3b63-4a66-8895-5a1deeed398b-kube-api-access-9wh49\") pod \"payload-pre-processing-e2e-derive-d0df615c-7bc5cfccfd-h8mwc\" (UID: \"f5f30f83-3b63-4a66-8895-5a1deeed398b\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-d0df615c-7bc5cfccfd-h8mwc"
Sep 10 17:56:36.745300 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:36.745260    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-d0df615c-7bc5cfccfd-h8mwc"
Sep 10 17:56:36.771196 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:36.771163    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-d0df615c-86c96f68f-gsq5b"
Sep 10 17:56:37.025827 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:37.025797    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-d0df615c-7bc5cfccfd-h8mwc"]
Sep 10 17:56:37.027849 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:56:37.027817    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5f30f83_3b63_4a66_8895_5a1deeed398b.slice/crio-c8c08918c8a69467ff0e6c406f110bce205e0886f2881bc07025300f84740d9f WatchSource:0}: Error finding container c8c08918c8a69467ff0e6c406f110bce205e0886f2881bc07025300f84740d9f: Status 404 returned error can't find the container with id c8c08918c8a69467ff0e6c406f110bce205e0886f2881bc07025300f84740d9f
Sep 10 17:56:37.068955 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:37.068922    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-d0df615c-86c96f68f-gsq5b"]
Sep 10 17:56:37.071622 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:56:37.071584    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6c1cde9_8f69_4d0a_8d70_de5d4d27d9e5.slice/crio-49c8186627ea32809d1bc58f0f6638411fc5422780c37a6bb8f7f7e7fdde67d4 WatchSource:0}: Error finding container 49c8186627ea32809d1bc58f0f6638411fc5422780c37a6bb8f7f7e7fdde67d4: Status 404 returned error can't find the container with id 49c8186627ea32809d1bc58f0f6638411fc5422780c37a6bb8f7f7e7fdde67d4
Sep 10 17:56:37.711619 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:37.711582    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-d0df615c-86c96f68f-gsq5b" event={"ID":"f6c1cde9-8f69-4d0a-8d70-de5d4d27d9e5","Type":"ContainerStarted","Data":"ac113c5d93b121dc440c533cf2f01f529dbd9563018321badebe4abb38a4fbe4"}
Sep 10 17:56:37.712119 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:37.711648    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-d0df615c-86c96f68f-gsq5b" event={"ID":"f6c1cde9-8f69-4d0a-8d70-de5d4d27d9e5","Type":"ContainerStarted","Data":"49c8186627ea32809d1bc58f0f6638411fc5422780c37a6bb8f7f7e7fdde67d4"}
Sep 10 17:56:37.712119 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:37.711687    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-d0df615c-86c96f68f-gsq5b"
Sep 10 17:56:37.713809 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:37.713769    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-d0df615c-7bc5cfccfd-h8mwc" event={"ID":"f5f30f83-3b63-4a66-8895-5a1deeed398b","Type":"ContainerStarted","Data":"db122353a696b8412b70222d819588b5984eb8e9536e5908c5df44d5e8e54aa5"}
Sep 10 17:56:37.713956 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:37.713821    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-d0df615c-7bc5cfccfd-h8mwc" event={"ID":"f5f30f83-3b63-4a66-8895-5a1deeed398b","Type":"ContainerStarted","Data":"c8c08918c8a69467ff0e6c406f110bce205e0886f2881bc07025300f84740d9f"}
Sep 10 17:56:37.713956 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:37.713842    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-d0df615c-7bc5cfccfd-h8mwc"
Sep 10 17:56:37.729270 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:37.729214    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-d0df615c-86c96f68f-gsq5b" podStartSLOduration=1.729196329 podStartE2EDuration="1.729196329s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:56:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:56:37.728558526 +0000 UTC m=+933.489866571" watchObservedRunningTime="2026-09-10 17:56:37.729196329 +0000 UTC m=+933.490504372"
Sep 10 17:56:38.583041 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:38.582969    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-d0df615c-7bc5cfccfd-h8mwc" podStartSLOduration=2.582942745 podStartE2EDuration="2.582942745s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:56:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:56:37.748393025 +0000 UTC m=+933.509701071" watchObservedRunningTime="2026-09-10 17:56:38.582942745 +0000 UTC m=+934.344250789"
Sep 10 17:56:38.584754 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:38.584720    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-conflict-a-b42bbba1-kserve-5c4d9974b5-jjtk8"]
Sep 10 17:56:39.498023 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:39.497976    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-conflict-b-b42bbba1-kserve-648c6897c9-s4fvt"]
Sep 10 17:56:44.902815 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:44.902775    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-bcdd7c-tdcdr"]
Sep 10 17:56:44.906775 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:44.906745    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-bcdd7c-tdcdr"
Sep 10 17:56:44.909785 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:44.909755    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-22shs\""
Sep 10 17:56:44.913995 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:44.913960    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-bcdd7c-tdcdr"]
Sep 10 17:56:44.923630 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:44.923596    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a26eccd-5a3c-4452-9208-8d1c3f2f1cce-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-bcdd7c-tdcdr\" (UID: \"3a26eccd-5a3c-4452-9208-8d1c3f2f1cce\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-bcdd7c-tdcdr"
Sep 10 17:56:45.024570 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:45.024526    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a26eccd-5a3c-4452-9208-8d1c3f2f1cce-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-bcdd7c-tdcdr\" (UID: \"3a26eccd-5a3c-4452-9208-8d1c3f2f1cce\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-bcdd7c-tdcdr"
Sep 10 17:56:45.025198 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:45.025175    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a26eccd-5a3c-4452-9208-8d1c3f2f1cce-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-bcdd7c-tdcdr\" (UID: \"3a26eccd-5a3c-4452-9208-8d1c3f2f1cce\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-bcdd7c-tdcdr"
Sep 10 17:56:45.221727 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:45.221618    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-bcdd7c-tdcdr"
Sep 10 17:56:45.500767 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:45.500738    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-bcdd7c-tdcdr"]
Sep 10 17:56:45.501828 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:56:45.501803    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a26eccd_5a3c_4452_9208_8d1c3f2f1cce.slice/crio-ca3aa09eae3373f7f729c9157548194e5d0128085a350f479ae1c8f090c8cab5 WatchSource:0}: Error finding container ca3aa09eae3373f7f729c9157548194e5d0128085a350f479ae1c8f090c8cab5: Status 404 returned error can't find the container with id ca3aa09eae3373f7f729c9157548194e5d0128085a350f479ae1c8f090c8cab5
Sep 10 17:56:45.767195 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:45.767156    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-bcdd7c-tdcdr" event={"ID":"3a26eccd-5a3c-4452-9208-8d1c3f2f1cce","Type":"ContainerStarted","Data":"ca3aa09eae3373f7f729c9157548194e5d0128085a350f479ae1c8f090c8cab5"}
Sep 10 17:56:46.777263 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:46.777222    2568 generic.go:356] "Generic (PLEG): container finished" podID="3a26eccd-5a3c-4452-9208-8d1c3f2f1cce" containerID="3cd43badf9e4bf1a66de79a1e7adfb55e999d42ddf9c9d56ff898a05e236a673" exitCode=0
Sep 10 17:56:46.777671 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:46.777305    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-bcdd7c-tdcdr" event={"ID":"3a26eccd-5a3c-4452-9208-8d1c3f2f1cce","Type":"ContainerDied","Data":"3cd43badf9e4bf1a66de79a1e7adfb55e999d42ddf9c9d56ff898a05e236a673"}
Sep 10 17:56:47.921345 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:47.921284    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-bcdd7c-tdcdr"
Sep 10 17:56:47.952608 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:47.952576    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a26eccd-5a3c-4452-9208-8d1c3f2f1cce-maas-api-service-ca\") pod \"3a26eccd-5a3c-4452-9208-8d1c3f2f1cce\" (UID: \"3a26eccd-5a3c-4452-9208-8d1c3f2f1cce\") "
Sep 10 17:56:47.953023 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:47.952994    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a26eccd-5a3c-4452-9208-8d1c3f2f1cce-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3a26eccd-5a3c-4452-9208-8d1c3f2f1cce" (UID: "3a26eccd-5a3c-4452-9208-8d1c3f2f1cce"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 17:56:48.054114 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:48.054010    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a26eccd-5a3c-4452-9208-8d1c3f2f1cce-maas-api-service-ca\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:56:48.722941 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:48.722905    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-d0df615c-86c96f68f-gsq5b"
Sep 10 17:56:48.723226 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:48.723207    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-d0df615c-7bc5cfccfd-h8mwc"
Sep 10 17:56:48.789879 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:48.789842    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-bcdd7c-tdcdr" event={"ID":"3a26eccd-5a3c-4452-9208-8d1c3f2f1cce","Type":"ContainerDied","Data":"ca3aa09eae3373f7f729c9157548194e5d0128085a350f479ae1c8f090c8cab5"}
Sep 10 17:56:48.790072 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:48.789907    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ca3aa09eae3373f7f729c9157548194e5d0128085a350f479ae1c8f090c8cab5"
Sep 10 17:56:48.790072 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:48.789858    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-bcdd7c-tdcdr"
Sep 10 17:56:53.606927 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:53.606876    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-conflict-a-b42bbba1-kserve-5c4d9974b5-jjtk8" podUID="18fba35c-cbc6-4330-ae60-edd72c307f5c" containerName="main" containerID="cri-o://ca5562f86331e24025f28ed749cdaad28b8b631748c181bd5c37efff27a9aeff" gracePeriod=45
Sep 10 17:56:53.841090 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:53.841034    2568 generic.go:356] "Generic (PLEG): container finished" podID="18fba35c-cbc6-4330-ae60-edd72c307f5c" containerID="ca5562f86331e24025f28ed749cdaad28b8b631748c181bd5c37efff27a9aeff" exitCode=0
Sep 10 17:56:53.841338 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:53.841121    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-b42bbba1-kserve-5c4d9974b5-jjtk8" event={"ID":"18fba35c-cbc6-4330-ae60-edd72c307f5c","Type":"ContainerDied","Data":"ca5562f86331e24025f28ed749cdaad28b8b631748c181bd5c37efff27a9aeff"}
Sep 10 17:56:53.894567 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:53.894534    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-b42bbba1-kserve-5c4d9974b5-jjtk8"
Sep 10 17:56:54.032251 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:54.032203    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/18fba35c-cbc6-4330-ae60-edd72c307f5c-home\") pod \"18fba35c-cbc6-4330-ae60-edd72c307f5c\" (UID: \"18fba35c-cbc6-4330-ae60-edd72c307f5c\") "
Sep 10 17:56:54.032251 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:54.032255    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c57fk\" (UniqueName: \"kubernetes.io/projected/18fba35c-cbc6-4330-ae60-edd72c307f5c-kube-api-access-c57fk\") pod \"18fba35c-cbc6-4330-ae60-edd72c307f5c\" (UID: \"18fba35c-cbc6-4330-ae60-edd72c307f5c\") "
Sep 10 17:56:54.032539 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:54.032278    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/18fba35c-cbc6-4330-ae60-edd72c307f5c-dshm\") pod \"18fba35c-cbc6-4330-ae60-edd72c307f5c\" (UID: \"18fba35c-cbc6-4330-ae60-edd72c307f5c\") "
Sep 10 17:56:54.032539 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:54.032294    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/18fba35c-cbc6-4330-ae60-edd72c307f5c-model-cache\") pod \"18fba35c-cbc6-4330-ae60-edd72c307f5c\" (UID: \"18fba35c-cbc6-4330-ae60-edd72c307f5c\") "
Sep 10 17:56:54.032539 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:54.032313    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/18fba35c-cbc6-4330-ae60-edd72c307f5c-tmp-dir\") pod \"18fba35c-cbc6-4330-ae60-edd72c307f5c\" (UID: \"18fba35c-cbc6-4330-ae60-edd72c307f5c\") "
Sep 10 17:56:54.032539 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:54.032385    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/18fba35c-cbc6-4330-ae60-edd72c307f5c-tls-certs\") pod \"18fba35c-cbc6-4330-ae60-edd72c307f5c\" (UID: \"18fba35c-cbc6-4330-ae60-edd72c307f5c\") "
Sep 10 17:56:54.032761 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:54.032578    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18fba35c-cbc6-4330-ae60-edd72c307f5c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "18fba35c-cbc6-4330-ae60-edd72c307f5c" (UID: "18fba35c-cbc6-4330-ae60-edd72c307f5c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:56:54.032761 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:54.032603    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18fba35c-cbc6-4330-ae60-edd72c307f5c-model-cache" (OuterVolumeSpecName: "model-cache") pod "18fba35c-cbc6-4330-ae60-edd72c307f5c" (UID: "18fba35c-cbc6-4330-ae60-edd72c307f5c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:56:54.032761 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:54.032618    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18fba35c-cbc6-4330-ae60-edd72c307f5c-home" (OuterVolumeSpecName: "home") pod "18fba35c-cbc6-4330-ae60-edd72c307f5c" (UID: "18fba35c-cbc6-4330-ae60-edd72c307f5c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:56:54.032761 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:54.032661    2568 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/18fba35c-cbc6-4330-ae60-edd72c307f5c-tmp-dir\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:56:54.034689 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:54.034662    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18fba35c-cbc6-4330-ae60-edd72c307f5c-dshm" (OuterVolumeSpecName: "dshm") pod "18fba35c-cbc6-4330-ae60-edd72c307f5c" (UID: "18fba35c-cbc6-4330-ae60-edd72c307f5c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:56:54.034782 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:54.034744    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18fba35c-cbc6-4330-ae60-edd72c307f5c-kube-api-access-c57fk" (OuterVolumeSpecName: "kube-api-access-c57fk") pod "18fba35c-cbc6-4330-ae60-edd72c307f5c" (UID: "18fba35c-cbc6-4330-ae60-edd72c307f5c"). InnerVolumeSpecName "kube-api-access-c57fk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:56:54.034821 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:54.034784    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18fba35c-cbc6-4330-ae60-edd72c307f5c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "18fba35c-cbc6-4330-ae60-edd72c307f5c" (UID: "18fba35c-cbc6-4330-ae60-edd72c307f5c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 17:56:54.133481 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:54.133381    2568 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/18fba35c-cbc6-4330-ae60-edd72c307f5c-home\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:56:54.133481 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:54.133417    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c57fk\" (UniqueName: \"kubernetes.io/projected/18fba35c-cbc6-4330-ae60-edd72c307f5c-kube-api-access-c57fk\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:56:54.133481 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:54.133429    2568 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/18fba35c-cbc6-4330-ae60-edd72c307f5c-dshm\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:56:54.133481 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:54.133438    2568 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/18fba35c-cbc6-4330-ae60-edd72c307f5c-model-cache\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:56:54.133481 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:54.133447    2568 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/18fba35c-cbc6-4330-ae60-edd72c307f5c-tls-certs\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:56:54.520428 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:54.520378    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-conflict-b-b42bbba1-kserve-648c6897c9-s4fvt" podUID="2b81e624-80cf-4ec8-90f8-20b0ce9ee12a" containerName="main" containerID="cri-o://797dde18d20a4065c8b0f4e703ed752b871e53045a216ea1212f122fde508cc5" gracePeriod=45
Sep 10 17:56:54.793917 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:54.793887    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-b-b42bbba1-kserve-648c6897c9-s4fvt"
Sep 10 17:56:54.839993 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:54.839952    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h8mqc\" (UniqueName: \"kubernetes.io/projected/2b81e624-80cf-4ec8-90f8-20b0ce9ee12a-kube-api-access-h8mqc\") pod \"2b81e624-80cf-4ec8-90f8-20b0ce9ee12a\" (UID: \"2b81e624-80cf-4ec8-90f8-20b0ce9ee12a\") "
Sep 10 17:56:54.840177 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:54.840049    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b81e624-80cf-4ec8-90f8-20b0ce9ee12a-tmp-dir\") pod \"2b81e624-80cf-4ec8-90f8-20b0ce9ee12a\" (UID: \"2b81e624-80cf-4ec8-90f8-20b0ce9ee12a\") "
Sep 10 17:56:54.840177 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:54.840099    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b81e624-80cf-4ec8-90f8-20b0ce9ee12a-tls-certs\") pod \"2b81e624-80cf-4ec8-90f8-20b0ce9ee12a\" (UID: \"2b81e624-80cf-4ec8-90f8-20b0ce9ee12a\") "
Sep 10 17:56:54.840177 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:54.840141    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b81e624-80cf-4ec8-90f8-20b0ce9ee12a-home\") pod \"2b81e624-80cf-4ec8-90f8-20b0ce9ee12a\" (UID: \"2b81e624-80cf-4ec8-90f8-20b0ce9ee12a\") "
Sep 10 17:56:54.840357 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:54.840193    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b81e624-80cf-4ec8-90f8-20b0ce9ee12a-dshm\") pod \"2b81e624-80cf-4ec8-90f8-20b0ce9ee12a\" (UID: \"2b81e624-80cf-4ec8-90f8-20b0ce9ee12a\") "
Sep 10 17:56:54.840357 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:54.840243    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b81e624-80cf-4ec8-90f8-20b0ce9ee12a-model-cache\") pod \"2b81e624-80cf-4ec8-90f8-20b0ce9ee12a\" (UID: \"2b81e624-80cf-4ec8-90f8-20b0ce9ee12a\") "
Sep 10 17:56:54.840488 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:54.840412    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b81e624-80cf-4ec8-90f8-20b0ce9ee12a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2b81e624-80cf-4ec8-90f8-20b0ce9ee12a" (UID: "2b81e624-80cf-4ec8-90f8-20b0ce9ee12a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:56:54.840794 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:54.840611    2568 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b81e624-80cf-4ec8-90f8-20b0ce9ee12a-tmp-dir\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:56:54.840794 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:54.840681    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b81e624-80cf-4ec8-90f8-20b0ce9ee12a-model-cache" (OuterVolumeSpecName: "model-cache") pod "2b81e624-80cf-4ec8-90f8-20b0ce9ee12a" (UID: "2b81e624-80cf-4ec8-90f8-20b0ce9ee12a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:56:54.840794 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:54.840738    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b81e624-80cf-4ec8-90f8-20b0ce9ee12a-home" (OuterVolumeSpecName: "home") pod "2b81e624-80cf-4ec8-90f8-20b0ce9ee12a" (UID: "2b81e624-80cf-4ec8-90f8-20b0ce9ee12a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:56:54.845524 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:54.844172    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b81e624-80cf-4ec8-90f8-20b0ce9ee12a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2b81e624-80cf-4ec8-90f8-20b0ce9ee12a" (UID: "2b81e624-80cf-4ec8-90f8-20b0ce9ee12a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 17:56:54.845524 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:54.844189    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b81e624-80cf-4ec8-90f8-20b0ce9ee12a-kube-api-access-h8mqc" (OuterVolumeSpecName: "kube-api-access-h8mqc") pod "2b81e624-80cf-4ec8-90f8-20b0ce9ee12a" (UID: "2b81e624-80cf-4ec8-90f8-20b0ce9ee12a"). InnerVolumeSpecName "kube-api-access-h8mqc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:56:54.845524 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:54.845477    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b81e624-80cf-4ec8-90f8-20b0ce9ee12a-dshm" (OuterVolumeSpecName: "dshm") pod "2b81e624-80cf-4ec8-90f8-20b0ce9ee12a" (UID: "2b81e624-80cf-4ec8-90f8-20b0ce9ee12a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:56:54.852234 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:54.852202    2568 generic.go:356] "Generic (PLEG): container finished" podID="2b81e624-80cf-4ec8-90f8-20b0ce9ee12a" containerID="797dde18d20a4065c8b0f4e703ed752b871e53045a216ea1212f122fde508cc5" exitCode=0
Sep 10 17:56:54.852417 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:54.852253    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-b-b42bbba1-kserve-648c6897c9-s4fvt"
Sep 10 17:56:54.852417 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:54.852287    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-b-b42bbba1-kserve-648c6897c9-s4fvt" event={"ID":"2b81e624-80cf-4ec8-90f8-20b0ce9ee12a","Type":"ContainerDied","Data":"797dde18d20a4065c8b0f4e703ed752b871e53045a216ea1212f122fde508cc5"}
Sep 10 17:56:54.852417 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:54.852346    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-b-b42bbba1-kserve-648c6897c9-s4fvt" event={"ID":"2b81e624-80cf-4ec8-90f8-20b0ce9ee12a","Type":"ContainerDied","Data":"42209d34b80b90450e7b5f1228c83402e437a7076f8150a05ddd63264a370ebe"}
Sep 10 17:56:54.852417 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:54.852369    2568 scope.go:117] "RemoveContainer" containerID="797dde18d20a4065c8b0f4e703ed752b871e53045a216ea1212f122fde508cc5"
Sep 10 17:56:54.854240 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:54.854204    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-b42bbba1-kserve-5c4d9974b5-jjtk8"
Sep 10 17:56:54.854240 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:54.854199    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-b42bbba1-kserve-5c4d9974b5-jjtk8" event={"ID":"18fba35c-cbc6-4330-ae60-edd72c307f5c","Type":"ContainerDied","Data":"48e35476bc336e6219ad50cb5415e92213e986714750bc64b1c6ebd0151cb41a"}
Sep 10 17:56:54.867083 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:54.867060    2568 scope.go:117] "RemoveContainer" containerID="797dde18d20a4065c8b0f4e703ed752b871e53045a216ea1212f122fde508cc5"
Sep 10 17:56:54.867508 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:56:54.867483    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"797dde18d20a4065c8b0f4e703ed752b871e53045a216ea1212f122fde508cc5\": container with ID starting with 797dde18d20a4065c8b0f4e703ed752b871e53045a216ea1212f122fde508cc5 not found: ID does not exist" containerID="797dde18d20a4065c8b0f4e703ed752b871e53045a216ea1212f122fde508cc5"
Sep 10 17:56:54.867638 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:54.867518    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"797dde18d20a4065c8b0f4e703ed752b871e53045a216ea1212f122fde508cc5"} err="failed to get container status \"797dde18d20a4065c8b0f4e703ed752b871e53045a216ea1212f122fde508cc5\": rpc error: code = NotFound desc = could not find container \"797dde18d20a4065c8b0f4e703ed752b871e53045a216ea1212f122fde508cc5\": container with ID starting with 797dde18d20a4065c8b0f4e703ed752b871e53045a216ea1212f122fde508cc5 not found: ID does not exist"
Sep 10 17:56:54.867638 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:54.867542    2568 scope.go:117] "RemoveContainer" containerID="ca5562f86331e24025f28ed749cdaad28b8b631748c181bd5c37efff27a9aeff"
Sep 10 17:56:54.880093 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:54.880062    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-conflict-b-b42bbba1-kserve-648c6897c9-s4fvt"]
Sep 10 17:56:54.883108 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:54.883079    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-conflict-b-b42bbba1-kserve-648c6897c9-s4fvt"]
Sep 10 17:56:54.899815 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:54.899779    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-conflict-a-b42bbba1-kserve-5c4d9974b5-jjtk8"]
Sep 10 17:56:54.905303 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:54.905270    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-conflict-a-b42bbba1-kserve-5c4d9974b5-jjtk8"]
Sep 10 17:56:54.941122 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:54.941083    2568 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b81e624-80cf-4ec8-90f8-20b0ce9ee12a-model-cache\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:56:54.941122 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:54.941119    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h8mqc\" (UniqueName: \"kubernetes.io/projected/2b81e624-80cf-4ec8-90f8-20b0ce9ee12a-kube-api-access-h8mqc\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:56:54.941122 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:54.941132    2568 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b81e624-80cf-4ec8-90f8-20b0ce9ee12a-tls-certs\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:56:54.941414 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:54.941142    2568 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b81e624-80cf-4ec8-90f8-20b0ce9ee12a-home\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:56:54.941414 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:54.941150    2568 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b81e624-80cf-4ec8-90f8-20b0ce9ee12a-dshm\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:56:55.658718 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:55.658682    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-bcdd7c-7b9bf7b7d6-mntfh"]
Sep 10 17:56:55.659033 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:55.658935    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-autores-bcdd7c-7b9bf7b7d6-mntfh" podUID="7f3dd052-e31a-4bfe-a259-9c8c57b65a4b" containerName="payload-pre-processing" containerID="cri-o://5ead9a72c78ea10414007af547f710621aa2b55ff390110b3c6f9b8d04e5787f" gracePeriod=30
Sep 10 17:56:55.850490 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:55.850416    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-bcdd7c-tdcdr"]
Sep 10 17:56:55.854502 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:55.854366    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-bcdd7c-tdcdr"]
Sep 10 17:56:55.864351 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:55.864272    2568 generic.go:356] "Generic (PLEG): container finished" podID="7f3dd052-e31a-4bfe-a259-9c8c57b65a4b" containerID="5ead9a72c78ea10414007af547f710621aa2b55ff390110b3c6f9b8d04e5787f" exitCode=0
Sep 10 17:56:55.864351 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:55.864342    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-bcdd7c-7b9bf7b7d6-mntfh" event={"ID":"7f3dd052-e31a-4bfe-a259-9c8c57b65a4b","Type":"ContainerDied","Data":"5ead9a72c78ea10414007af547f710621aa2b55ff390110b3c6f9b8d04e5787f"}
Sep 10 17:56:55.926025 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:55.925946    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-bcdd7c-7b9bf7b7d6-mntfh"
Sep 10 17:56:56.052608 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:56.052572    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7f3dd052-e31a-4bfe-a259-9c8c57b65a4b-plugins-config-volume\") pod \"7f3dd052-e31a-4bfe-a259-9c8c57b65a4b\" (UID: \"7f3dd052-e31a-4bfe-a259-9c8c57b65a4b\") "
Sep 10 17:56:56.052821 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:56.052630    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zlgcg\" (UniqueName: \"kubernetes.io/projected/7f3dd052-e31a-4bfe-a259-9c8c57b65a4b-kube-api-access-zlgcg\") pod \"7f3dd052-e31a-4bfe-a259-9c8c57b65a4b\" (UID: \"7f3dd052-e31a-4bfe-a259-9c8c57b65a4b\") "
Sep 10 17:56:56.052991 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:56.052965    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f3dd052-e31a-4bfe-a259-9c8c57b65a4b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7f3dd052-e31a-4bfe-a259-9c8c57b65a4b" (UID: "7f3dd052-e31a-4bfe-a259-9c8c57b65a4b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 17:56:56.054819 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:56.054789    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f3dd052-e31a-4bfe-a259-9c8c57b65a4b-kube-api-access-zlgcg" (OuterVolumeSpecName: "kube-api-access-zlgcg") pod "7f3dd052-e31a-4bfe-a259-9c8c57b65a4b" (UID: "7f3dd052-e31a-4bfe-a259-9c8c57b65a4b"). InnerVolumeSpecName "kube-api-access-zlgcg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:56:56.153650 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:56.153608    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7f3dd052-e31a-4bfe-a259-9c8c57b65a4b-plugins-config-volume\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:56:56.153650 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:56.153646    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zlgcg\" (UniqueName: \"kubernetes.io/projected/7f3dd052-e31a-4bfe-a259-9c8c57b65a4b-kube-api-access-zlgcg\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:56:56.771681 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:56.771642    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="18fba35c-cbc6-4330-ae60-edd72c307f5c" path="/var/lib/kubelet/pods/18fba35c-cbc6-4330-ae60-edd72c307f5c/volumes"
Sep 10 17:56:56.772152 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:56.772135    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b81e624-80cf-4ec8-90f8-20b0ce9ee12a" path="/var/lib/kubelet/pods/2b81e624-80cf-4ec8-90f8-20b0ce9ee12a/volumes"
Sep 10 17:56:56.772489 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:56.772473    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a26eccd-5a3c-4452-9208-8d1c3f2f1cce" path="/var/lib/kubelet/pods/3a26eccd-5a3c-4452-9208-8d1c3f2f1cce/volumes"
Sep 10 17:56:56.873441 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:56.873394    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-bcdd7c-7b9bf7b7d6-mntfh" event={"ID":"7f3dd052-e31a-4bfe-a259-9c8c57b65a4b","Type":"ContainerDied","Data":"99b34bf06a3795732f4395b90b2747564157213ee8246df03d1b514751bb6f7f"}
Sep 10 17:56:56.873902 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:56.873408    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-bcdd7c-7b9bf7b7d6-mntfh"
Sep 10 17:56:56.873902 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:56.873513    2568 scope.go:117] "RemoveContainer" containerID="5ead9a72c78ea10414007af547f710621aa2b55ff390110b3c6f9b8d04e5787f"
Sep 10 17:56:56.894744 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:56.894710    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-bcdd7c-7b9bf7b7d6-mntfh"]
Sep 10 17:56:56.897193 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:56.897165    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-bcdd7c-7b9bf7b7d6-mntfh"]
Sep 10 17:56:58.771412 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:58.771379    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f3dd052-e31a-4bfe-a259-9c8c57b65a4b" path="/var/lib/kubelet/pods/7f3dd052-e31a-4bfe-a259-9c8c57b65a4b/volumes"
Sep 10 17:56:59.403993 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:59.403947    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d0df615c-jdq8k"]
Sep 10 17:56:59.404584 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:59.404557    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b81e624-80cf-4ec8-90f8-20b0ce9ee12a" containerName="main"
Sep 10 17:56:59.404584 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:59.404581    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b81e624-80cf-4ec8-90f8-20b0ce9ee12a" containerName="main"
Sep 10 17:56:59.404794 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:59.404594    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18fba35c-cbc6-4330-ae60-edd72c307f5c" containerName="main"
Sep 10 17:56:59.404794 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:59.404602    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="18fba35c-cbc6-4330-ae60-edd72c307f5c" containerName="main"
Sep 10 17:56:59.404794 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:59.404610    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f3dd052-e31a-4bfe-a259-9c8c57b65a4b" containerName="payload-pre-processing"
Sep 10 17:56:59.404794 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:59.404618    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f3dd052-e31a-4bfe-a259-9c8c57b65a4b" containerName="payload-pre-processing"
Sep 10 17:56:59.404794 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:59.404640    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a26eccd-5a3c-4452-9208-8d1c3f2f1cce" containerName="revoke-keys"
Sep 10 17:56:59.404794 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:59.404647    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a26eccd-5a3c-4452-9208-8d1c3f2f1cce" containerName="revoke-keys"
Sep 10 17:56:59.404794 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:59.404736    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="18fba35c-cbc6-4330-ae60-edd72c307f5c" containerName="main"
Sep 10 17:56:59.404794 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:59.404750    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a26eccd-5a3c-4452-9208-8d1c3f2f1cce" containerName="revoke-keys"
Sep 10 17:56:59.404794 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:59.404759    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f3dd052-e31a-4bfe-a259-9c8c57b65a4b" containerName="payload-pre-processing"
Sep 10 17:56:59.404794 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:59.404770    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b81e624-80cf-4ec8-90f8-20b0ce9ee12a" containerName="main"
Sep 10 17:56:59.409686 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:59.409659    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d0df615c-jdq8k"
Sep 10 17:56:59.413964 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:59.413936    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-22shs\""
Sep 10 17:56:59.416353 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:59.416311    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d0df615c-jdq8k"]
Sep 10 17:56:59.483002 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:59.482961    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/069bf511-af57-4eab-8f31-52752425c25e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-d0df615c-jdq8k\" (UID: \"069bf511-af57-4eab-8f31-52752425c25e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d0df615c-jdq8k"
Sep 10 17:56:59.584442 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:59.584402    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/069bf511-af57-4eab-8f31-52752425c25e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-d0df615c-jdq8k\" (UID: \"069bf511-af57-4eab-8f31-52752425c25e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d0df615c-jdq8k"
Sep 10 17:56:59.585135 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:59.585110    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/069bf511-af57-4eab-8f31-52752425c25e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-d0df615c-jdq8k\" (UID: \"069bf511-af57-4eab-8f31-52752425c25e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d0df615c-jdq8k"
Sep 10 17:56:59.723054 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:56:59.722968    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d0df615c-jdq8k"
Sep 10 17:57:00.006854 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:00.006824    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d0df615c-jdq8k"]
Sep 10 17:57:00.008607 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:57:00.008563    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod069bf511_af57_4eab_8f31_52752425c25e.slice/crio-54cbc57b835038ea56314cb3729b774210342a0abbdc614992e3ac85329f37d3 WatchSource:0}: Error finding container 54cbc57b835038ea56314cb3729b774210342a0abbdc614992e3ac85329f37d3: Status 404 returned error can't find the container with id 54cbc57b835038ea56314cb3729b774210342a0abbdc614992e3ac85329f37d3
Sep 10 17:57:00.900595 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:00.900561    2568 generic.go:356] "Generic (PLEG): container finished" podID="069bf511-af57-4eab-8f31-52752425c25e" containerID="6360522d7bf02529b383a79ed594975952f114d85966627d88c5f5964fc731e5" exitCode=0
Sep 10 17:57:00.900764 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:00.900648    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d0df615c-jdq8k" event={"ID":"069bf511-af57-4eab-8f31-52752425c25e","Type":"ContainerDied","Data":"6360522d7bf02529b383a79ed594975952f114d85966627d88c5f5964fc731e5"}
Sep 10 17:57:00.900764 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:00.900709    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d0df615c-jdq8k" event={"ID":"069bf511-af57-4eab-8f31-52752425c25e","Type":"ContainerStarted","Data":"54cbc57b835038ea56314cb3729b774210342a0abbdc614992e3ac85329f37d3"}
Sep 10 17:57:02.042212 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:02.042187    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d0df615c-jdq8k"
Sep 10 17:57:02.109132 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:02.109099    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/069bf511-af57-4eab-8f31-52752425c25e-maas-api-service-ca\") pod \"069bf511-af57-4eab-8f31-52752425c25e\" (UID: \"069bf511-af57-4eab-8f31-52752425c25e\") "
Sep 10 17:57:02.109501 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:02.109477    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/069bf511-af57-4eab-8f31-52752425c25e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "069bf511-af57-4eab-8f31-52752425c25e" (UID: "069bf511-af57-4eab-8f31-52752425c25e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 17:57:02.210392 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:02.210254    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/069bf511-af57-4eab-8f31-52752425c25e-maas-api-service-ca\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:57:02.914687 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:02.914649    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d0df615c-jdq8k"
Sep 10 17:57:02.914687 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:02.914680    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d0df615c-jdq8k" event={"ID":"069bf511-af57-4eab-8f31-52752425c25e","Type":"ContainerDied","Data":"54cbc57b835038ea56314cb3729b774210342a0abbdc614992e3ac85329f37d3"}
Sep 10 17:57:02.914958 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:02.914734    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="54cbc57b835038ea56314cb3729b774210342a0abbdc614992e3ac85329f37d3"
Sep 10 17:57:06.559812 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:06.559758    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-d0df615c-86c96f68f-gsq5b"]
Sep 10 17:57:06.560229 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:06.560029    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-d0df615c-86c96f68f-gsq5b" podUID="f6c1cde9-8f69-4d0a-8d70-de5d4d27d9e5" containerName="payload-processing" containerID="cri-o://ac113c5d93b121dc440c533cf2f01f529dbd9563018321badebe4abb38a4fbe4" gracePeriod=30
Sep 10 17:57:06.572105 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:06.572067    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-d0df615c-7bc5cfccfd-h8mwc"]
Sep 10 17:57:06.572415 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:06.572370    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-d0df615c-7bc5cfccfd-h8mwc" podUID="f5f30f83-3b63-4a66-8895-5a1deeed398b" containerName="payload-pre-processing" containerID="cri-o://db122353a696b8412b70222d819588b5984eb8e9536e5908c5df44d5e8e54aa5" gracePeriod=30
Sep 10 17:57:06.763743 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:06.763674    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d0df615c-jdq8k"]
Sep 10 17:57:06.774127 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:06.774091    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d0df615c-jdq8k"]
Sep 10 17:57:06.829008 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:06.828977    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-d0df615c-86c96f68f-gsq5b"
Sep 10 17:57:06.864416 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:06.864384    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-d0df615c-7bc5cfccfd-h8mwc"
Sep 10 17:57:06.941882 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:06.941839    2568 generic.go:356] "Generic (PLEG): container finished" podID="f6c1cde9-8f69-4d0a-8d70-de5d4d27d9e5" containerID="ac113c5d93b121dc440c533cf2f01f529dbd9563018321badebe4abb38a4fbe4" exitCode=0
Sep 10 17:57:06.942112 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:06.941906    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-d0df615c-86c96f68f-gsq5b"
Sep 10 17:57:06.942112 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:06.942093    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-d0df615c-86c96f68f-gsq5b" event={"ID":"f6c1cde9-8f69-4d0a-8d70-de5d4d27d9e5","Type":"ContainerDied","Data":"ac113c5d93b121dc440c533cf2f01f529dbd9563018321badebe4abb38a4fbe4"}
Sep 10 17:57:06.942234 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:06.942146    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-d0df615c-86c96f68f-gsq5b" event={"ID":"f6c1cde9-8f69-4d0a-8d70-de5d4d27d9e5","Type":"ContainerDied","Data":"49c8186627ea32809d1bc58f0f6638411fc5422780c37a6bb8f7f7e7fdde67d4"}
Sep 10 17:57:06.942234 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:06.942175    2568 scope.go:117] "RemoveContainer" containerID="ac113c5d93b121dc440c533cf2f01f529dbd9563018321badebe4abb38a4fbe4"
Sep 10 17:57:06.944434 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:06.944399    2568 generic.go:356] "Generic (PLEG): container finished" podID="f5f30f83-3b63-4a66-8895-5a1deeed398b" containerID="db122353a696b8412b70222d819588b5984eb8e9536e5908c5df44d5e8e54aa5" exitCode=0
Sep 10 17:57:06.944588 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:06.944455    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-d0df615c-7bc5cfccfd-h8mwc" event={"ID":"f5f30f83-3b63-4a66-8895-5a1deeed398b","Type":"ContainerDied","Data":"db122353a696b8412b70222d819588b5984eb8e9536e5908c5df44d5e8e54aa5"}
Sep 10 17:57:06.944588 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:06.944508    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-d0df615c-7bc5cfccfd-h8mwc" event={"ID":"f5f30f83-3b63-4a66-8895-5a1deeed398b","Type":"ContainerDied","Data":"c8c08918c8a69467ff0e6c406f110bce205e0886f2881bc07025300f84740d9f"}
Sep 10 17:57:06.944818 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:06.944799    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-d0df615c-7bc5cfccfd-h8mwc"
Sep 10 17:57:06.953359 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:06.953312    2568 scope.go:117] "RemoveContainer" containerID="ac113c5d93b121dc440c533cf2f01f529dbd9563018321badebe4abb38a4fbe4"
Sep 10 17:57:06.953787 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:57:06.953763    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac113c5d93b121dc440c533cf2f01f529dbd9563018321badebe4abb38a4fbe4\": container with ID starting with ac113c5d93b121dc440c533cf2f01f529dbd9563018321badebe4abb38a4fbe4 not found: ID does not exist" containerID="ac113c5d93b121dc440c533cf2f01f529dbd9563018321badebe4abb38a4fbe4"
Sep 10 17:57:06.953856 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:06.953801    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac113c5d93b121dc440c533cf2f01f529dbd9563018321badebe4abb38a4fbe4"} err="failed to get container status \"ac113c5d93b121dc440c533cf2f01f529dbd9563018321badebe4abb38a4fbe4\": rpc error: code = NotFound desc = could not find container \"ac113c5d93b121dc440c533cf2f01f529dbd9563018321badebe4abb38a4fbe4\": container with ID starting with ac113c5d93b121dc440c533cf2f01f529dbd9563018321badebe4abb38a4fbe4 not found: ID does not exist"
Sep 10 17:57:06.953856 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:06.953821    2568 scope.go:117] "RemoveContainer" containerID="db122353a696b8412b70222d819588b5984eb8e9536e5908c5df44d5e8e54aa5"
Sep 10 17:57:06.954725 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:06.954700    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f5f30f83-3b63-4a66-8895-5a1deeed398b-plugins-config-volume\") pod \"f5f30f83-3b63-4a66-8895-5a1deeed398b\" (UID: \"f5f30f83-3b63-4a66-8895-5a1deeed398b\") "
Sep 10 17:57:06.954874 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:06.954755    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tdzpg\" (UniqueName: \"kubernetes.io/projected/f6c1cde9-8f69-4d0a-8d70-de5d4d27d9e5-kube-api-access-tdzpg\") pod \"f6c1cde9-8f69-4d0a-8d70-de5d4d27d9e5\" (UID: \"f6c1cde9-8f69-4d0a-8d70-de5d4d27d9e5\") "
Sep 10 17:57:06.954955 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:06.954936    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9wh49\" (UniqueName: \"kubernetes.io/projected/f5f30f83-3b63-4a66-8895-5a1deeed398b-kube-api-access-9wh49\") pod \"f5f30f83-3b63-4a66-8895-5a1deeed398b\" (UID: \"f5f30f83-3b63-4a66-8895-5a1deeed398b\") "
Sep 10 17:57:06.955062 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:06.955027    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f6c1cde9-8f69-4d0a-8d70-de5d4d27d9e5-plugins-config-volume\") pod \"f6c1cde9-8f69-4d0a-8d70-de5d4d27d9e5\" (UID: \"f6c1cde9-8f69-4d0a-8d70-de5d4d27d9e5\") "
Sep 10 17:57:06.955223 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:06.955147    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f5f30f83-3b63-4a66-8895-5a1deeed398b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f5f30f83-3b63-4a66-8895-5a1deeed398b" (UID: "f5f30f83-3b63-4a66-8895-5a1deeed398b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 17:57:06.955447 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:06.955424    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f5f30f83-3b63-4a66-8895-5a1deeed398b-plugins-config-volume\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:57:06.955556 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:06.955494    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6c1cde9-8f69-4d0a-8d70-de5d4d27d9e5-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f6c1cde9-8f69-4d0a-8d70-de5d4d27d9e5" (UID: "f6c1cde9-8f69-4d0a-8d70-de5d4d27d9e5"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 17:57:06.957690 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:06.957661    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6c1cde9-8f69-4d0a-8d70-de5d4d27d9e5-kube-api-access-tdzpg" (OuterVolumeSpecName: "kube-api-access-tdzpg") pod "f6c1cde9-8f69-4d0a-8d70-de5d4d27d9e5" (UID: "f6c1cde9-8f69-4d0a-8d70-de5d4d27d9e5"). InnerVolumeSpecName "kube-api-access-tdzpg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:57:06.957810 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:06.957699    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5f30f83-3b63-4a66-8895-5a1deeed398b-kube-api-access-9wh49" (OuterVolumeSpecName: "kube-api-access-9wh49") pod "f5f30f83-3b63-4a66-8895-5a1deeed398b" (UID: "f5f30f83-3b63-4a66-8895-5a1deeed398b"). InnerVolumeSpecName "kube-api-access-9wh49". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:57:06.964136 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:06.964109    2568 scope.go:117] "RemoveContainer" containerID="db122353a696b8412b70222d819588b5984eb8e9536e5908c5df44d5e8e54aa5"
Sep 10 17:57:06.964588 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:57:06.964563    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db122353a696b8412b70222d819588b5984eb8e9536e5908c5df44d5e8e54aa5\": container with ID starting with db122353a696b8412b70222d819588b5984eb8e9536e5908c5df44d5e8e54aa5 not found: ID does not exist" containerID="db122353a696b8412b70222d819588b5984eb8e9536e5908c5df44d5e8e54aa5"
Sep 10 17:57:06.964667 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:06.964601    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db122353a696b8412b70222d819588b5984eb8e9536e5908c5df44d5e8e54aa5"} err="failed to get container status \"db122353a696b8412b70222d819588b5984eb8e9536e5908c5df44d5e8e54aa5\": rpc error: code = NotFound desc = could not find container \"db122353a696b8412b70222d819588b5984eb8e9536e5908c5df44d5e8e54aa5\": container with ID starting with db122353a696b8412b70222d819588b5984eb8e9536e5908c5df44d5e8e54aa5 not found: ID does not exist"
Sep 10 17:57:07.056663 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:07.056619    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tdzpg\" (UniqueName: \"kubernetes.io/projected/f6c1cde9-8f69-4d0a-8d70-de5d4d27d9e5-kube-api-access-tdzpg\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:57:07.056663 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:07.056657    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9wh49\" (UniqueName: \"kubernetes.io/projected/f5f30f83-3b63-4a66-8895-5a1deeed398b-kube-api-access-9wh49\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:57:07.056663 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:07.056668    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f6c1cde9-8f69-4d0a-8d70-de5d4d27d9e5-plugins-config-volume\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:57:07.269514 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:07.269474    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-d0df615c-86c96f68f-gsq5b"]
Sep 10 17:57:07.273815 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:07.273764    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-d0df615c-86c96f68f-gsq5b"]
Sep 10 17:57:07.286100 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:07.286066    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-d0df615c-7bc5cfccfd-h8mwc"]
Sep 10 17:57:07.307641 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:07.307602    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-d0df615c-7bc5cfccfd-h8mwc"]
Sep 10 17:57:08.246125 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:08.246075    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-c4540c-65c87494d6-brrfk"]
Sep 10 17:57:08.246708 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:08.246682    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="069bf511-af57-4eab-8f31-52752425c25e" containerName="revoke-keys"
Sep 10 17:57:08.246809 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:08.246712    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="069bf511-af57-4eab-8f31-52752425c25e" containerName="revoke-keys"
Sep 10 17:57:08.246809 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:08.246741    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5f30f83-3b63-4a66-8895-5a1deeed398b" containerName="payload-pre-processing"
Sep 10 17:57:08.246809 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:08.246749    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5f30f83-3b63-4a66-8895-5a1deeed398b" containerName="payload-pre-processing"
Sep 10 17:57:08.246809 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:08.246763    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6c1cde9-8f69-4d0a-8d70-de5d4d27d9e5" containerName="payload-processing"
Sep 10 17:57:08.246809 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:08.246771    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6c1cde9-8f69-4d0a-8d70-de5d4d27d9e5" containerName="payload-processing"
Sep 10 17:57:08.247072 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:08.246871    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5f30f83-3b63-4a66-8895-5a1deeed398b" containerName="payload-pre-processing"
Sep 10 17:57:08.247072 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:08.246887    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6c1cde9-8f69-4d0a-8d70-de5d4d27d9e5" containerName="payload-processing"
Sep 10 17:57:08.247072 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:08.246897    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="069bf511-af57-4eab-8f31-52752425c25e" containerName="revoke-keys"
Sep 10 17:57:08.251526 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:08.251501    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-c4540c-745c5497f7-njbjb"]
Sep 10 17:57:08.251688 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:08.251648    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-c4540c-65c87494d6-brrfk"
Sep 10 17:57:08.254594 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:08.254561    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-explicit-c4540c-dockercfg-lppfl\""
Sep 10 17:57:08.254730 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:08.254701    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-explicit-c4540c\""
Sep 10 17:57:08.254880 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:08.254861    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-c4540c-745c5497f7-njbjb"
Sep 10 17:57:08.264804 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:08.264734    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-c4540c-65c87494d6-brrfk"]
Sep 10 17:57:08.267706 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:08.267671    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-c4540c-745c5497f7-njbjb"]
Sep 10 17:57:08.369743 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:08.369702    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9161a26a-64d2-4205-a516-400570b5f3eb-plugins-config-volume\") pod \"payload-processing-e2e-explicit-c4540c-745c5497f7-njbjb\" (UID: \"9161a26a-64d2-4205-a516-400570b5f3eb\") " pod="openshift-ingress/payload-processing-e2e-explicit-c4540c-745c5497f7-njbjb"
Sep 10 17:57:08.369956 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:08.369757    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4ldw\" (UniqueName: \"kubernetes.io/projected/815e0d9a-26d4-4557-935d-706785f2faa6-kube-api-access-r4ldw\") pod \"payload-pre-processing-e2e-explicit-c4540c-65c87494d6-brrfk\" (UID: \"815e0d9a-26d4-4557-935d-706785f2faa6\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-c4540c-65c87494d6-brrfk"
Sep 10 17:57:08.369956 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:08.369789    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/815e0d9a-26d4-4557-935d-706785f2faa6-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-c4540c-65c87494d6-brrfk\" (UID: \"815e0d9a-26d4-4557-935d-706785f2faa6\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-c4540c-65c87494d6-brrfk"
Sep 10 17:57:08.369956 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:08.369837    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvbmj\" (UniqueName: \"kubernetes.io/projected/9161a26a-64d2-4205-a516-400570b5f3eb-kube-api-access-mvbmj\") pod \"payload-processing-e2e-explicit-c4540c-745c5497f7-njbjb\" (UID: \"9161a26a-64d2-4205-a516-400570b5f3eb\") " pod="openshift-ingress/payload-processing-e2e-explicit-c4540c-745c5497f7-njbjb"
Sep 10 17:57:08.470547 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:08.470483    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9161a26a-64d2-4205-a516-400570b5f3eb-plugins-config-volume\") pod \"payload-processing-e2e-explicit-c4540c-745c5497f7-njbjb\" (UID: \"9161a26a-64d2-4205-a516-400570b5f3eb\") " pod="openshift-ingress/payload-processing-e2e-explicit-c4540c-745c5497f7-njbjb"
Sep 10 17:57:08.470547 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:08.470548    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4ldw\" (UniqueName: \"kubernetes.io/projected/815e0d9a-26d4-4557-935d-706785f2faa6-kube-api-access-r4ldw\") pod \"payload-pre-processing-e2e-explicit-c4540c-65c87494d6-brrfk\" (UID: \"815e0d9a-26d4-4557-935d-706785f2faa6\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-c4540c-65c87494d6-brrfk"
Sep 10 17:57:08.470866 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:08.470586    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/815e0d9a-26d4-4557-935d-706785f2faa6-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-c4540c-65c87494d6-brrfk\" (UID: \"815e0d9a-26d4-4557-935d-706785f2faa6\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-c4540c-65c87494d6-brrfk"
Sep 10 17:57:08.470866 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:08.470650    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvbmj\" (UniqueName: \"kubernetes.io/projected/9161a26a-64d2-4205-a516-400570b5f3eb-kube-api-access-mvbmj\") pod \"payload-processing-e2e-explicit-c4540c-745c5497f7-njbjb\" (UID: \"9161a26a-64d2-4205-a516-400570b5f3eb\") " pod="openshift-ingress/payload-processing-e2e-explicit-c4540c-745c5497f7-njbjb"
Sep 10 17:57:08.471503 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:08.471479    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/815e0d9a-26d4-4557-935d-706785f2faa6-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-c4540c-65c87494d6-brrfk\" (UID: \"815e0d9a-26d4-4557-935d-706785f2faa6\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-c4540c-65c87494d6-brrfk"
Sep 10 17:57:08.471590 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:08.471523    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9161a26a-64d2-4205-a516-400570b5f3eb-plugins-config-volume\") pod \"payload-processing-e2e-explicit-c4540c-745c5497f7-njbjb\" (UID: \"9161a26a-64d2-4205-a516-400570b5f3eb\") " pod="openshift-ingress/payload-processing-e2e-explicit-c4540c-745c5497f7-njbjb"
Sep 10 17:57:08.481398 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:08.481364    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4ldw\" (UniqueName: \"kubernetes.io/projected/815e0d9a-26d4-4557-935d-706785f2faa6-kube-api-access-r4ldw\") pod \"payload-pre-processing-e2e-explicit-c4540c-65c87494d6-brrfk\" (UID: \"815e0d9a-26d4-4557-935d-706785f2faa6\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-c4540c-65c87494d6-brrfk"
Sep 10 17:57:08.482893 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:08.482864    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvbmj\" (UniqueName: \"kubernetes.io/projected/9161a26a-64d2-4205-a516-400570b5f3eb-kube-api-access-mvbmj\") pod \"payload-processing-e2e-explicit-c4540c-745c5497f7-njbjb\" (UID: \"9161a26a-64d2-4205-a516-400570b5f3eb\") " pod="openshift-ingress/payload-processing-e2e-explicit-c4540c-745c5497f7-njbjb"
Sep 10 17:57:08.566030 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:08.565917    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-c4540c-65c87494d6-brrfk"
Sep 10 17:57:08.573299 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:08.573266    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-c4540c-745c5497f7-njbjb"
Sep 10 17:57:08.771403 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:08.771353    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="069bf511-af57-4eab-8f31-52752425c25e" path="/var/lib/kubelet/pods/069bf511-af57-4eab-8f31-52752425c25e/volumes"
Sep 10 17:57:08.771851 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:08.771829    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f5f30f83-3b63-4a66-8895-5a1deeed398b" path="/var/lib/kubelet/pods/f5f30f83-3b63-4a66-8895-5a1deeed398b/volumes"
Sep 10 17:57:08.772210 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:08.772192    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f6c1cde9-8f69-4d0a-8d70-de5d4d27d9e5" path="/var/lib/kubelet/pods/f6c1cde9-8f69-4d0a-8d70-de5d4d27d9e5/volumes"
Sep 10 17:57:08.851736 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:08.851701    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-c4540c-65c87494d6-brrfk"]
Sep 10 17:57:08.853705 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:57:08.853677    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod815e0d9a_26d4_4557_935d_706785f2faa6.slice/crio-c414ee9f75758be54a55ac3ec28a1f2e2bad9fae05e9dc6618c6ed488968a949 WatchSource:0}: Error finding container c414ee9f75758be54a55ac3ec28a1f2e2bad9fae05e9dc6618c6ed488968a949: Status 404 returned error can't find the container with id c414ee9f75758be54a55ac3ec28a1f2e2bad9fae05e9dc6618c6ed488968a949
Sep 10 17:57:08.874336 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:08.874291    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-c4540c-745c5497f7-njbjb"]
Sep 10 17:57:08.875355 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:57:08.875308    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9161a26a_64d2_4205_a516_400570b5f3eb.slice/crio-4f955ac57933157abf7791c55b571ac3ae5b9228e522a0618f01aa4972bc95aa WatchSource:0}: Error finding container 4f955ac57933157abf7791c55b571ac3ae5b9228e522a0618f01aa4972bc95aa: Status 404 returned error can't find the container with id 4f955ac57933157abf7791c55b571ac3ae5b9228e522a0618f01aa4972bc95aa
Sep 10 17:57:08.963462 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:08.963166    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-c4540c-65c87494d6-brrfk" event={"ID":"815e0d9a-26d4-4557-935d-706785f2faa6","Type":"ContainerStarted","Data":"07afc590734038510051670d55ccd122079cfe2fe42b5015282fd19b40346c61"}
Sep 10 17:57:08.963462 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:08.963356    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-c4540c-65c87494d6-brrfk"
Sep 10 17:57:08.963462 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:08.963397    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-c4540c-65c87494d6-brrfk" event={"ID":"815e0d9a-26d4-4557-935d-706785f2faa6","Type":"ContainerStarted","Data":"c414ee9f75758be54a55ac3ec28a1f2e2bad9fae05e9dc6618c6ed488968a949"}
Sep 10 17:57:08.965251 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:08.965204    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-c4540c-745c5497f7-njbjb" event={"ID":"9161a26a-64d2-4205-a516-400570b5f3eb","Type":"ContainerStarted","Data":"7ba54b9004d0ca37eca106cf8bea97d9518b575ac2d7bbd0b2f79dd14d049319"}
Sep 10 17:57:08.965445 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:08.965269    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-c4540c-745c5497f7-njbjb" event={"ID":"9161a26a-64d2-4205-a516-400570b5f3eb","Type":"ContainerStarted","Data":"4f955ac57933157abf7791c55b571ac3ae5b9228e522a0618f01aa4972bc95aa"}
Sep 10 17:57:08.965445 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:08.965293    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-explicit-c4540c-745c5497f7-njbjb"
Sep 10 17:57:09.007841 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:09.007783    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-explicit-c4540c-65c87494d6-brrfk" podStartSLOduration=1.00775216 podStartE2EDuration="1.00775216s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:57:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:57:08.987035723 +0000 UTC m=+964.748343766" watchObservedRunningTime="2026-09-10 17:57:09.00775216 +0000 UTC m=+964.769060203"
Sep 10 17:57:09.008814 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:09.008760    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-explicit-c4540c-745c5497f7-njbjb" podStartSLOduration=1.008744349 podStartE2EDuration="1.008744349s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:57:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:57:09.006146393 +0000 UTC m=+964.767454436" watchObservedRunningTime="2026-09-10 17:57:09.008744349 +0000 UTC m=+964.770052396"
Sep 10 17:57:19.974056 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:19.974021    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-explicit-c4540c-745c5497f7-njbjb"
Sep 10 17:57:19.974707 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:19.974098    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-c4540c-65c87494d6-brrfk"
Sep 10 17:57:33.701039 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:33.700956    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-18490e/test-model-18490e-kserve-6c5c46fc87-x4d5t"]
Sep 10 17:57:33.704642 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:33.704614    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-18490e/test-model-18490e-kserve-6c5c46fc87-x4d5t"
Sep 10 17:57:33.708619 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:33.708589    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-18490e\"/\"openshift-service-ca.crt\""
Sep 10 17:57:33.708776 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:33.708623    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-18490e\"/\"default-dockercfg-4bq76\""
Sep 10 17:57:33.708776 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:33.708671    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-18490e\"/\"kube-root-ca.crt\""
Sep 10 17:57:33.708776 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:33.708628    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-18490e\"/\"test-model-18490e-kserve-self-signed-certs\""
Sep 10 17:57:33.714848 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:33.714823    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-18490e/test-model-18490e-kserve-6c5c46fc87-x4d5t"]
Sep 10 17:57:33.806377 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:33.806306    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/740e815d-bec5-4fb9-9e27-bd536189344b-home\") pod \"test-model-18490e-kserve-6c5c46fc87-x4d5t\" (UID: \"740e815d-bec5-4fb9-9e27-bd536189344b\") " pod="ai-tenant-e2e-inf-b-18490e/test-model-18490e-kserve-6c5c46fc87-x4d5t"
Sep 10 17:57:33.806377 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:33.806380    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/740e815d-bec5-4fb9-9e27-bd536189344b-dshm\") pod \"test-model-18490e-kserve-6c5c46fc87-x4d5t\" (UID: \"740e815d-bec5-4fb9-9e27-bd536189344b\") " pod="ai-tenant-e2e-inf-b-18490e/test-model-18490e-kserve-6c5c46fc87-x4d5t"
Sep 10 17:57:33.806644 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:33.806398    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/740e815d-bec5-4fb9-9e27-bd536189344b-tls-certs\") pod \"test-model-18490e-kserve-6c5c46fc87-x4d5t\" (UID: \"740e815d-bec5-4fb9-9e27-bd536189344b\") " pod="ai-tenant-e2e-inf-b-18490e/test-model-18490e-kserve-6c5c46fc87-x4d5t"
Sep 10 17:57:33.806644 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:33.806420    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/740e815d-bec5-4fb9-9e27-bd536189344b-tmp-dir\") pod \"test-model-18490e-kserve-6c5c46fc87-x4d5t\" (UID: \"740e815d-bec5-4fb9-9e27-bd536189344b\") " pod="ai-tenant-e2e-inf-b-18490e/test-model-18490e-kserve-6c5c46fc87-x4d5t"
Sep 10 17:57:33.806644 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:33.806450    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlvlp\" (UniqueName: \"kubernetes.io/projected/740e815d-bec5-4fb9-9e27-bd536189344b-kube-api-access-xlvlp\") pod \"test-model-18490e-kserve-6c5c46fc87-x4d5t\" (UID: \"740e815d-bec5-4fb9-9e27-bd536189344b\") " pod="ai-tenant-e2e-inf-b-18490e/test-model-18490e-kserve-6c5c46fc87-x4d5t"
Sep 10 17:57:33.806644 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:33.806581    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/740e815d-bec5-4fb9-9e27-bd536189344b-model-cache\") pod \"test-model-18490e-kserve-6c5c46fc87-x4d5t\" (UID: \"740e815d-bec5-4fb9-9e27-bd536189344b\") " pod="ai-tenant-e2e-inf-b-18490e/test-model-18490e-kserve-6c5c46fc87-x4d5t"
Sep 10 17:57:33.907794 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:33.907756    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/740e815d-bec5-4fb9-9e27-bd536189344b-tmp-dir\") pod \"test-model-18490e-kserve-6c5c46fc87-x4d5t\" (UID: \"740e815d-bec5-4fb9-9e27-bd536189344b\") " pod="ai-tenant-e2e-inf-b-18490e/test-model-18490e-kserve-6c5c46fc87-x4d5t"
Sep 10 17:57:33.907983 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:33.907813    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlvlp\" (UniqueName: \"kubernetes.io/projected/740e815d-bec5-4fb9-9e27-bd536189344b-kube-api-access-xlvlp\") pod \"test-model-18490e-kserve-6c5c46fc87-x4d5t\" (UID: \"740e815d-bec5-4fb9-9e27-bd536189344b\") " pod="ai-tenant-e2e-inf-b-18490e/test-model-18490e-kserve-6c5c46fc87-x4d5t"
Sep 10 17:57:33.907983 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:33.907863    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/740e815d-bec5-4fb9-9e27-bd536189344b-model-cache\") pod \"test-model-18490e-kserve-6c5c46fc87-x4d5t\" (UID: \"740e815d-bec5-4fb9-9e27-bd536189344b\") " pod="ai-tenant-e2e-inf-b-18490e/test-model-18490e-kserve-6c5c46fc87-x4d5t"
Sep 10 17:57:33.907983 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:33.907894    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/740e815d-bec5-4fb9-9e27-bd536189344b-home\") pod \"test-model-18490e-kserve-6c5c46fc87-x4d5t\" (UID: \"740e815d-bec5-4fb9-9e27-bd536189344b\") " pod="ai-tenant-e2e-inf-b-18490e/test-model-18490e-kserve-6c5c46fc87-x4d5t"
Sep 10 17:57:33.907983 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:33.907913    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/740e815d-bec5-4fb9-9e27-bd536189344b-dshm\") pod \"test-model-18490e-kserve-6c5c46fc87-x4d5t\" (UID: \"740e815d-bec5-4fb9-9e27-bd536189344b\") " pod="ai-tenant-e2e-inf-b-18490e/test-model-18490e-kserve-6c5c46fc87-x4d5t"
Sep 10 17:57:33.907983 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:33.907939    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/740e815d-bec5-4fb9-9e27-bd536189344b-tls-certs\") pod \"test-model-18490e-kserve-6c5c46fc87-x4d5t\" (UID: \"740e815d-bec5-4fb9-9e27-bd536189344b\") " pod="ai-tenant-e2e-inf-b-18490e/test-model-18490e-kserve-6c5c46fc87-x4d5t"
Sep 10 17:57:33.908238 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:33.908177    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/740e815d-bec5-4fb9-9e27-bd536189344b-tmp-dir\") pod \"test-model-18490e-kserve-6c5c46fc87-x4d5t\" (UID: \"740e815d-bec5-4fb9-9e27-bd536189344b\") " pod="ai-tenant-e2e-inf-b-18490e/test-model-18490e-kserve-6c5c46fc87-x4d5t"
Sep 10 17:57:33.908238 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:33.908199    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/740e815d-bec5-4fb9-9e27-bd536189344b-model-cache\") pod \"test-model-18490e-kserve-6c5c46fc87-x4d5t\" (UID: \"740e815d-bec5-4fb9-9e27-bd536189344b\") " pod="ai-tenant-e2e-inf-b-18490e/test-model-18490e-kserve-6c5c46fc87-x4d5t"
Sep 10 17:57:33.908365 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:33.908260    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/740e815d-bec5-4fb9-9e27-bd536189344b-home\") pod \"test-model-18490e-kserve-6c5c46fc87-x4d5t\" (UID: \"740e815d-bec5-4fb9-9e27-bd536189344b\") " pod="ai-tenant-e2e-inf-b-18490e/test-model-18490e-kserve-6c5c46fc87-x4d5t"
Sep 10 17:57:33.910194 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:33.910161    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/740e815d-bec5-4fb9-9e27-bd536189344b-dshm\") pod \"test-model-18490e-kserve-6c5c46fc87-x4d5t\" (UID: \"740e815d-bec5-4fb9-9e27-bd536189344b\") " pod="ai-tenant-e2e-inf-b-18490e/test-model-18490e-kserve-6c5c46fc87-x4d5t"
Sep 10 17:57:33.910407 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:33.910244    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/740e815d-bec5-4fb9-9e27-bd536189344b-tls-certs\") pod \"test-model-18490e-kserve-6c5c46fc87-x4d5t\" (UID: \"740e815d-bec5-4fb9-9e27-bd536189344b\") " pod="ai-tenant-e2e-inf-b-18490e/test-model-18490e-kserve-6c5c46fc87-x4d5t"
Sep 10 17:57:33.915839 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:33.915816    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlvlp\" (UniqueName: \"kubernetes.io/projected/740e815d-bec5-4fb9-9e27-bd536189344b-kube-api-access-xlvlp\") pod \"test-model-18490e-kserve-6c5c46fc87-x4d5t\" (UID: \"740e815d-bec5-4fb9-9e27-bd536189344b\") " pod="ai-tenant-e2e-inf-b-18490e/test-model-18490e-kserve-6c5c46fc87-x4d5t"
Sep 10 17:57:34.015740 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:34.015701    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-18490e/test-model-18490e-kserve-6c5c46fc87-x4d5t"
Sep 10 17:57:34.292443 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:34.292416    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-18490e/test-model-18490e-kserve-6c5c46fc87-x4d5t"]
Sep 10 17:57:34.294582 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:57:34.294553    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod740e815d_bec5_4fb9_9e27_bd536189344b.slice/crio-16ea56c52caa08e1afcae9036a1cb15b0d1b3c194e61e59fe85f2721c1e99b28 WatchSource:0}: Error finding container 16ea56c52caa08e1afcae9036a1cb15b0d1b3c194e61e59fe85f2721c1e99b28: Status 404 returned error can't find the container with id 16ea56c52caa08e1afcae9036a1cb15b0d1b3c194e61e59fe85f2721c1e99b28
Sep 10 17:57:35.126269 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:35.126231    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-18490e/test-model-18490e-kserve-6c5c46fc87-x4d5t" event={"ID":"740e815d-bec5-4fb9-9e27-bd536189344b","Type":"ContainerStarted","Data":"3e7ac979e008cc9ff53500ad6d858b0053b0f334fa07c7526f120d0a5962de55"}
Sep 10 17:57:35.127021 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:35.126278    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-18490e/test-model-18490e-kserve-6c5c46fc87-x4d5t" event={"ID":"740e815d-bec5-4fb9-9e27-bd536189344b","Type":"ContainerStarted","Data":"16ea56c52caa08e1afcae9036a1cb15b0d1b3c194e61e59fe85f2721c1e99b28"}
Sep 10 17:57:35.147900 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:35.147835    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-18490e/test-model-18490e-kserve-6c5c46fc87-x4d5t" podStartSLOduration=2.147817837 podStartE2EDuration="2.147817837s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:57:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:57:35.145395946 +0000 UTC m=+990.906703990" watchObservedRunningTime="2026-09-10 17:57:35.147817837 +0000 UTC m=+990.909125879"
Sep 10 17:57:44.015996 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:44.015949    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-18490e/test-model-18490e-kserve-6c5c46fc87-x4d5t"
Sep 10 17:57:44.016535 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:44.016033    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-18490e/test-model-18490e-kserve-6c5c46fc87-x4d5t"
Sep 10 17:57:44.029424 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:44.029392    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-18490e/test-model-18490e-kserve-6c5c46fc87-x4d5t"
Sep 10 17:57:44.192763 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:44.192667    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-18490e/test-model-18490e-kserve-6c5c46fc87-x4d5t"
Sep 10 17:57:58.351884 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:58.351837    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-c4540c-745c5497f7-njbjb"]
Sep 10 17:57:58.352687 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:58.352625    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-explicit-c4540c-745c5497f7-njbjb" podUID="9161a26a-64d2-4205-a516-400570b5f3eb" containerName="payload-processing" containerID="cri-o://7ba54b9004d0ca37eca106cf8bea97d9518b575ac2d7bbd0b2f79dd14d049319" gracePeriod=30
Sep 10 17:57:58.356488 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:58.356451    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-c4540c-65c87494d6-brrfk"]
Sep 10 17:57:58.356954 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:58.356915    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-explicit-c4540c-65c87494d6-brrfk" podUID="815e0d9a-26d4-4557-935d-706785f2faa6" containerName="payload-pre-processing" containerID="cri-o://07afc590734038510051670d55ccd122079cfe2fe42b5015282fd19b40346c61" gracePeriod=30
Sep 10 17:57:58.637851 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:58.637827    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-c4540c-745c5497f7-njbjb"
Sep 10 17:57:58.640663 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:58.640642    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-c4540c-65c87494d6-brrfk"
Sep 10 17:57:58.750842 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:58.750806    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r4ldw\" (UniqueName: \"kubernetes.io/projected/815e0d9a-26d4-4557-935d-706785f2faa6-kube-api-access-r4ldw\") pod \"815e0d9a-26d4-4557-935d-706785f2faa6\" (UID: \"815e0d9a-26d4-4557-935d-706785f2faa6\") "
Sep 10 17:57:58.751041 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:58.750868    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/815e0d9a-26d4-4557-935d-706785f2faa6-plugins-config-volume\") pod \"815e0d9a-26d4-4557-935d-706785f2faa6\" (UID: \"815e0d9a-26d4-4557-935d-706785f2faa6\") "
Sep 10 17:57:58.751041 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:58.750902    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mvbmj\" (UniqueName: \"kubernetes.io/projected/9161a26a-64d2-4205-a516-400570b5f3eb-kube-api-access-mvbmj\") pod \"9161a26a-64d2-4205-a516-400570b5f3eb\" (UID: \"9161a26a-64d2-4205-a516-400570b5f3eb\") "
Sep 10 17:57:58.751167 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:58.751121    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9161a26a-64d2-4205-a516-400570b5f3eb-plugins-config-volume\") pod \"9161a26a-64d2-4205-a516-400570b5f3eb\" (UID: \"9161a26a-64d2-4205-a516-400570b5f3eb\") "
Sep 10 17:57:58.751372 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:58.751288    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/815e0d9a-26d4-4557-935d-706785f2faa6-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "815e0d9a-26d4-4557-935d-706785f2faa6" (UID: "815e0d9a-26d4-4557-935d-706785f2faa6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 17:57:58.751504 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:58.751479    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9161a26a-64d2-4205-a516-400570b5f3eb-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9161a26a-64d2-4205-a516-400570b5f3eb" (UID: "9161a26a-64d2-4205-a516-400570b5f3eb"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 17:57:58.751590 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:58.751501    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/815e0d9a-26d4-4557-935d-706785f2faa6-plugins-config-volume\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:57:58.753124 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:58.753101    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/815e0d9a-26d4-4557-935d-706785f2faa6-kube-api-access-r4ldw" (OuterVolumeSpecName: "kube-api-access-r4ldw") pod "815e0d9a-26d4-4557-935d-706785f2faa6" (UID: "815e0d9a-26d4-4557-935d-706785f2faa6"). InnerVolumeSpecName "kube-api-access-r4ldw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:57:58.753229 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:58.753208    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9161a26a-64d2-4205-a516-400570b5f3eb-kube-api-access-mvbmj" (OuterVolumeSpecName: "kube-api-access-mvbmj") pod "9161a26a-64d2-4205-a516-400570b5f3eb" (UID: "9161a26a-64d2-4205-a516-400570b5f3eb"). InnerVolumeSpecName "kube-api-access-mvbmj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:57:58.852477 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:58.852437    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r4ldw\" (UniqueName: \"kubernetes.io/projected/815e0d9a-26d4-4557-935d-706785f2faa6-kube-api-access-r4ldw\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:57:58.852477 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:58.852476    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mvbmj\" (UniqueName: \"kubernetes.io/projected/9161a26a-64d2-4205-a516-400570b5f3eb-kube-api-access-mvbmj\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:57:58.852694 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:58.852489    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9161a26a-64d2-4205-a516-400570b5f3eb-plugins-config-volume\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:57:59.275415 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:59.275363    2568 generic.go:356] "Generic (PLEG): container finished" podID="815e0d9a-26d4-4557-935d-706785f2faa6" containerID="07afc590734038510051670d55ccd122079cfe2fe42b5015282fd19b40346c61" exitCode=0
Sep 10 17:57:59.275640 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:59.275471    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-c4540c-65c87494d6-brrfk" event={"ID":"815e0d9a-26d4-4557-935d-706785f2faa6","Type":"ContainerDied","Data":"07afc590734038510051670d55ccd122079cfe2fe42b5015282fd19b40346c61"}
Sep 10 17:57:59.275640 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:59.275475    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-c4540c-65c87494d6-brrfk"
Sep 10 17:57:59.275640 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:59.275538    2568 scope.go:117] "RemoveContainer" containerID="07afc590734038510051670d55ccd122079cfe2fe42b5015282fd19b40346c61"
Sep 10 17:57:59.275879 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:59.275525    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-c4540c-65c87494d6-brrfk" event={"ID":"815e0d9a-26d4-4557-935d-706785f2faa6","Type":"ContainerDied","Data":"c414ee9f75758be54a55ac3ec28a1f2e2bad9fae05e9dc6618c6ed488968a949"}
Sep 10 17:57:59.277006 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:59.276977    2568 generic.go:356] "Generic (PLEG): container finished" podID="9161a26a-64d2-4205-a516-400570b5f3eb" containerID="7ba54b9004d0ca37eca106cf8bea97d9518b575ac2d7bbd0b2f79dd14d049319" exitCode=0
Sep 10 17:57:59.277135 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:59.277009    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-c4540c-745c5497f7-njbjb" event={"ID":"9161a26a-64d2-4205-a516-400570b5f3eb","Type":"ContainerDied","Data":"7ba54b9004d0ca37eca106cf8bea97d9518b575ac2d7bbd0b2f79dd14d049319"}
Sep 10 17:57:59.277135 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:59.277056    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-c4540c-745c5497f7-njbjb" event={"ID":"9161a26a-64d2-4205-a516-400570b5f3eb","Type":"ContainerDied","Data":"4f955ac57933157abf7791c55b571ac3ae5b9228e522a0618f01aa4972bc95aa"}
Sep 10 17:57:59.277135 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:59.277054    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-c4540c-745c5497f7-njbjb"
Sep 10 17:57:59.285551 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:59.285524    2568 scope.go:117] "RemoveContainer" containerID="07afc590734038510051670d55ccd122079cfe2fe42b5015282fd19b40346c61"
Sep 10 17:57:59.285910 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:57:59.285891    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07afc590734038510051670d55ccd122079cfe2fe42b5015282fd19b40346c61\": container with ID starting with 07afc590734038510051670d55ccd122079cfe2fe42b5015282fd19b40346c61 not found: ID does not exist" containerID="07afc590734038510051670d55ccd122079cfe2fe42b5015282fd19b40346c61"
Sep 10 17:57:59.285956 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:59.285922    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07afc590734038510051670d55ccd122079cfe2fe42b5015282fd19b40346c61"} err="failed to get container status \"07afc590734038510051670d55ccd122079cfe2fe42b5015282fd19b40346c61\": rpc error: code = NotFound desc = could not find container \"07afc590734038510051670d55ccd122079cfe2fe42b5015282fd19b40346c61\": container with ID starting with 07afc590734038510051670d55ccd122079cfe2fe42b5015282fd19b40346c61 not found: ID does not exist"
Sep 10 17:57:59.285956 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:59.285940    2568 scope.go:117] "RemoveContainer" containerID="7ba54b9004d0ca37eca106cf8bea97d9518b575ac2d7bbd0b2f79dd14d049319"
Sep 10 17:57:59.295263 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:59.295237    2568 scope.go:117] "RemoveContainer" containerID="7ba54b9004d0ca37eca106cf8bea97d9518b575ac2d7bbd0b2f79dd14d049319"
Sep 10 17:57:59.295673 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:57:59.295627    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ba54b9004d0ca37eca106cf8bea97d9518b575ac2d7bbd0b2f79dd14d049319\": container with ID starting with 7ba54b9004d0ca37eca106cf8bea97d9518b575ac2d7bbd0b2f79dd14d049319 not found: ID does not exist" containerID="7ba54b9004d0ca37eca106cf8bea97d9518b575ac2d7bbd0b2f79dd14d049319"
Sep 10 17:57:59.295774 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:59.295682    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-c4540c-65c87494d6-brrfk"]
Sep 10 17:57:59.295774 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:59.295679    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ba54b9004d0ca37eca106cf8bea97d9518b575ac2d7bbd0b2f79dd14d049319"} err="failed to get container status \"7ba54b9004d0ca37eca106cf8bea97d9518b575ac2d7bbd0b2f79dd14d049319\": rpc error: code = NotFound desc = could not find container \"7ba54b9004d0ca37eca106cf8bea97d9518b575ac2d7bbd0b2f79dd14d049319\": container with ID starting with 7ba54b9004d0ca37eca106cf8bea97d9518b575ac2d7bbd0b2f79dd14d049319 not found: ID does not exist"
Sep 10 17:57:59.300082 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:59.300054    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-c4540c-65c87494d6-brrfk"]
Sep 10 17:57:59.312959 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:59.312920    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-c4540c-745c5497f7-njbjb"]
Sep 10 17:57:59.315710 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:57:59.315678    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-c4540c-745c5497f7-njbjb"]
Sep 10 17:58:00.770374 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:00.770337    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="815e0d9a-26d4-4557-935d-706785f2faa6" path="/var/lib/kubelet/pods/815e0d9a-26d4-4557-935d-706785f2faa6/volumes"
Sep 10 17:58:00.770761 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:00.770686    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9161a26a-64d2-4205-a516-400570b5f3eb" path="/var/lib/kubelet/pods/9161a26a-64d2-4205-a516-400570b5f3eb/volumes"
Sep 10 17:58:22.007974 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:22.007927    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-noten-c3fa7f/noten-model-c3fa7f-kserve-59c7496647-js5dq"]
Sep 10 17:58:22.008594 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:22.008570    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9161a26a-64d2-4205-a516-400570b5f3eb" containerName="payload-processing"
Sep 10 17:58:22.008679 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:22.008599    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="9161a26a-64d2-4205-a516-400570b5f3eb" containerName="payload-processing"
Sep 10 17:58:22.008679 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:22.008620    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="815e0d9a-26d4-4557-935d-706785f2faa6" containerName="payload-pre-processing"
Sep 10 17:58:22.008679 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:22.008629    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="815e0d9a-26d4-4557-935d-706785f2faa6" containerName="payload-pre-processing"
Sep 10 17:58:22.008827 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:22.008745    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="815e0d9a-26d4-4557-935d-706785f2faa6" containerName="payload-pre-processing"
Sep 10 17:58:22.008827 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:22.008764    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="9161a26a-64d2-4205-a516-400570b5f3eb" containerName="payload-processing"
Sep 10 17:58:22.013846 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:22.013817    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-c3fa7f/noten-model-c3fa7f-kserve-59c7496647-js5dq"
Sep 10 17:58:22.018838 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:22.018397    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-noten-c3fa7f\"/\"kube-root-ca.crt\""
Sep 10 17:58:22.018838 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:22.018544    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-noten-c3fa7f\"/\"default-dockercfg-8hk9p\""
Sep 10 17:58:22.018838 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:22.018599    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-noten-c3fa7f\"/\"noten-model-c3fa7f-kserve-self-signed-certs\""
Sep 10 17:58:22.018838 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:22.018736    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-noten-c3fa7f\"/\"openshift-service-ca.crt\""
Sep 10 17:58:22.022639 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:22.022553    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-noten-c3fa7f/noten-model-c3fa7f-kserve-59c7496647-js5dq"]
Sep 10 17:58:22.067483 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:22.067390    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/66187fa7-9e2c-4841-84f5-d33036c21378-tls-certs\") pod \"noten-model-c3fa7f-kserve-59c7496647-js5dq\" (UID: \"66187fa7-9e2c-4841-84f5-d33036c21378\") " pod="ai-tenant-e2e-noten-c3fa7f/noten-model-c3fa7f-kserve-59c7496647-js5dq"
Sep 10 17:58:22.067753 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:22.067504    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/66187fa7-9e2c-4841-84f5-d33036c21378-model-cache\") pod \"noten-model-c3fa7f-kserve-59c7496647-js5dq\" (UID: \"66187fa7-9e2c-4841-84f5-d33036c21378\") " pod="ai-tenant-e2e-noten-c3fa7f/noten-model-c3fa7f-kserve-59c7496647-js5dq"
Sep 10 17:58:22.067753 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:22.067627    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/66187fa7-9e2c-4841-84f5-d33036c21378-home\") pod \"noten-model-c3fa7f-kserve-59c7496647-js5dq\" (UID: \"66187fa7-9e2c-4841-84f5-d33036c21378\") " pod="ai-tenant-e2e-noten-c3fa7f/noten-model-c3fa7f-kserve-59c7496647-js5dq"
Sep 10 17:58:22.067753 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:22.067670    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/66187fa7-9e2c-4841-84f5-d33036c21378-dshm\") pod \"noten-model-c3fa7f-kserve-59c7496647-js5dq\" (UID: \"66187fa7-9e2c-4841-84f5-d33036c21378\") " pod="ai-tenant-e2e-noten-c3fa7f/noten-model-c3fa7f-kserve-59c7496647-js5dq"
Sep 10 17:58:22.067753 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:22.067730    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/66187fa7-9e2c-4841-84f5-d33036c21378-tmp-dir\") pod \"noten-model-c3fa7f-kserve-59c7496647-js5dq\" (UID: \"66187fa7-9e2c-4841-84f5-d33036c21378\") " pod="ai-tenant-e2e-noten-c3fa7f/noten-model-c3fa7f-kserve-59c7496647-js5dq"
Sep 10 17:58:22.067937 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:22.067779    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rkxx\" (UniqueName: \"kubernetes.io/projected/66187fa7-9e2c-4841-84f5-d33036c21378-kube-api-access-4rkxx\") pod \"noten-model-c3fa7f-kserve-59c7496647-js5dq\" (UID: \"66187fa7-9e2c-4841-84f5-d33036c21378\") " pod="ai-tenant-e2e-noten-c3fa7f/noten-model-c3fa7f-kserve-59c7496647-js5dq"
Sep 10 17:58:22.168593 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:22.168545    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/66187fa7-9e2c-4841-84f5-d33036c21378-tmp-dir\") pod \"noten-model-c3fa7f-kserve-59c7496647-js5dq\" (UID: \"66187fa7-9e2c-4841-84f5-d33036c21378\") " pod="ai-tenant-e2e-noten-c3fa7f/noten-model-c3fa7f-kserve-59c7496647-js5dq"
Sep 10 17:58:22.168806 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:22.168609    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rkxx\" (UniqueName: \"kubernetes.io/projected/66187fa7-9e2c-4841-84f5-d33036c21378-kube-api-access-4rkxx\") pod \"noten-model-c3fa7f-kserve-59c7496647-js5dq\" (UID: \"66187fa7-9e2c-4841-84f5-d33036c21378\") " pod="ai-tenant-e2e-noten-c3fa7f/noten-model-c3fa7f-kserve-59c7496647-js5dq"
Sep 10 17:58:22.168806 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:22.168648    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/66187fa7-9e2c-4841-84f5-d33036c21378-tls-certs\") pod \"noten-model-c3fa7f-kserve-59c7496647-js5dq\" (UID: \"66187fa7-9e2c-4841-84f5-d33036c21378\") " pod="ai-tenant-e2e-noten-c3fa7f/noten-model-c3fa7f-kserve-59c7496647-js5dq"
Sep 10 17:58:22.168806 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:22.168683    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/66187fa7-9e2c-4841-84f5-d33036c21378-model-cache\") pod \"noten-model-c3fa7f-kserve-59c7496647-js5dq\" (UID: \"66187fa7-9e2c-4841-84f5-d33036c21378\") " pod="ai-tenant-e2e-noten-c3fa7f/noten-model-c3fa7f-kserve-59c7496647-js5dq"
Sep 10 17:58:22.168806 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:22.168750    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/66187fa7-9e2c-4841-84f5-d33036c21378-home\") pod \"noten-model-c3fa7f-kserve-59c7496647-js5dq\" (UID: \"66187fa7-9e2c-4841-84f5-d33036c21378\") " pod="ai-tenant-e2e-noten-c3fa7f/noten-model-c3fa7f-kserve-59c7496647-js5dq"
Sep 10 17:58:22.168806 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:22.168784    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/66187fa7-9e2c-4841-84f5-d33036c21378-dshm\") pod \"noten-model-c3fa7f-kserve-59c7496647-js5dq\" (UID: \"66187fa7-9e2c-4841-84f5-d33036c21378\") " pod="ai-tenant-e2e-noten-c3fa7f/noten-model-c3fa7f-kserve-59c7496647-js5dq"
Sep 10 17:58:22.169077 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:22.169029    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/66187fa7-9e2c-4841-84f5-d33036c21378-tmp-dir\") pod \"noten-model-c3fa7f-kserve-59c7496647-js5dq\" (UID: \"66187fa7-9e2c-4841-84f5-d33036c21378\") " pod="ai-tenant-e2e-noten-c3fa7f/noten-model-c3fa7f-kserve-59c7496647-js5dq"
Sep 10 17:58:22.169077 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:22.169043    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/66187fa7-9e2c-4841-84f5-d33036c21378-model-cache\") pod \"noten-model-c3fa7f-kserve-59c7496647-js5dq\" (UID: \"66187fa7-9e2c-4841-84f5-d33036c21378\") " pod="ai-tenant-e2e-noten-c3fa7f/noten-model-c3fa7f-kserve-59c7496647-js5dq"
Sep 10 17:58:22.169191 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:22.169087    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/66187fa7-9e2c-4841-84f5-d33036c21378-home\") pod \"noten-model-c3fa7f-kserve-59c7496647-js5dq\" (UID: \"66187fa7-9e2c-4841-84f5-d33036c21378\") " pod="ai-tenant-e2e-noten-c3fa7f/noten-model-c3fa7f-kserve-59c7496647-js5dq"
Sep 10 17:58:22.171031 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:22.171006    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/66187fa7-9e2c-4841-84f5-d33036c21378-dshm\") pod \"noten-model-c3fa7f-kserve-59c7496647-js5dq\" (UID: \"66187fa7-9e2c-4841-84f5-d33036c21378\") " pod="ai-tenant-e2e-noten-c3fa7f/noten-model-c3fa7f-kserve-59c7496647-js5dq"
Sep 10 17:58:22.171454 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:22.171425    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/66187fa7-9e2c-4841-84f5-d33036c21378-tls-certs\") pod \"noten-model-c3fa7f-kserve-59c7496647-js5dq\" (UID: \"66187fa7-9e2c-4841-84f5-d33036c21378\") " pod="ai-tenant-e2e-noten-c3fa7f/noten-model-c3fa7f-kserve-59c7496647-js5dq"
Sep 10 17:58:22.177311 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:22.177278    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rkxx\" (UniqueName: \"kubernetes.io/projected/66187fa7-9e2c-4841-84f5-d33036c21378-kube-api-access-4rkxx\") pod \"noten-model-c3fa7f-kserve-59c7496647-js5dq\" (UID: \"66187fa7-9e2c-4841-84f5-d33036c21378\") " pod="ai-tenant-e2e-noten-c3fa7f/noten-model-c3fa7f-kserve-59c7496647-js5dq"
Sep 10 17:58:22.327844 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:22.327738    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-c3fa7f/noten-model-c3fa7f-kserve-59c7496647-js5dq"
Sep 10 17:58:22.605432 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:22.605404    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-noten-c3fa7f/noten-model-c3fa7f-kserve-59c7496647-js5dq"]
Sep 10 17:58:22.607368 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:58:22.607310    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod66187fa7_9e2c_4841_84f5_d33036c21378.slice/crio-9255b931b5f5817cb2247bc21b127c0b024f951c46ef0147a2a919f579c98b8d WatchSource:0}: Error finding container 9255b931b5f5817cb2247bc21b127c0b024f951c46ef0147a2a919f579c98b8d: Status 404 returned error can't find the container with id 9255b931b5f5817cb2247bc21b127c0b024f951c46ef0147a2a919f579c98b8d
Sep 10 17:58:23.423805 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:23.423745    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-c3fa7f/noten-model-c3fa7f-kserve-59c7496647-js5dq" event={"ID":"66187fa7-9e2c-4841-84f5-d33036c21378","Type":"ContainerStarted","Data":"586d95ab0455584c7ce8f8669ed53036da5bd93ba2039ae6165dc515964726e4"}
Sep 10 17:58:23.424207 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:23.423815    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-c3fa7f/noten-model-c3fa7f-kserve-59c7496647-js5dq" event={"ID":"66187fa7-9e2c-4841-84f5-d33036c21378","Type":"ContainerStarted","Data":"9255b931b5f5817cb2247bc21b127c0b024f951c46ef0147a2a919f579c98b8d"}
Sep 10 17:58:23.443340 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:23.443253    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-noten-c3fa7f/noten-model-c3fa7f-kserve-59c7496647-js5dq" podStartSLOduration=2.443228709 podStartE2EDuration="2.443228709s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:58:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:58:23.440006189 +0000 UTC m=+1039.201314233" watchObservedRunningTime="2026-09-10 17:58:23.443228709 +0000 UTC m=+1039.204536752"
Sep 10 17:58:27.411467 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:27.411424    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-noten-c3fa7f/noten-model-c3fa7f-kserve-59c7496647-js5dq"]
Sep 10 17:58:32.328417 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:32.328374    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-noten-c3fa7f/noten-model-c3fa7f-kserve-59c7496647-js5dq"
Sep 10 17:58:40.619181 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:40.619140    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-18490e/test-model-18490e-kserve-6c5c46fc87-x4d5t"]
Sep 10 17:58:42.432797 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:42.432755    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-noten-c3fa7f/noten-model-c3fa7f-kserve-59c7496647-js5dq" podUID="66187fa7-9e2c-4841-84f5-d33036c21378" containerName="main" containerID="cri-o://586d95ab0455584c7ce8f8669ed53036da5bd93ba2039ae6165dc515964726e4" gracePeriod=45
Sep 10 17:58:42.699525 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:42.699484    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-c3fa7f/noten-model-c3fa7f-kserve-59c7496647-js5dq"
Sep 10 17:58:42.862234 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:42.862193    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/66187fa7-9e2c-4841-84f5-d33036c21378-model-cache\") pod \"66187fa7-9e2c-4841-84f5-d33036c21378\" (UID: \"66187fa7-9e2c-4841-84f5-d33036c21378\") "
Sep 10 17:58:42.862234 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:42.862238    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/66187fa7-9e2c-4841-84f5-d33036c21378-tmp-dir\") pod \"66187fa7-9e2c-4841-84f5-d33036c21378\" (UID: \"66187fa7-9e2c-4841-84f5-d33036c21378\") "
Sep 10 17:58:42.862527 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:42.862282    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/66187fa7-9e2c-4841-84f5-d33036c21378-dshm\") pod \"66187fa7-9e2c-4841-84f5-d33036c21378\" (UID: \"66187fa7-9e2c-4841-84f5-d33036c21378\") "
Sep 10 17:58:42.862527 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:42.862315    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4rkxx\" (UniqueName: \"kubernetes.io/projected/66187fa7-9e2c-4841-84f5-d33036c21378-kube-api-access-4rkxx\") pod \"66187fa7-9e2c-4841-84f5-d33036c21378\" (UID: \"66187fa7-9e2c-4841-84f5-d33036c21378\") "
Sep 10 17:58:42.862527 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:42.862415    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/66187fa7-9e2c-4841-84f5-d33036c21378-tls-certs\") pod \"66187fa7-9e2c-4841-84f5-d33036c21378\" (UID: \"66187fa7-9e2c-4841-84f5-d33036c21378\") "
Sep 10 17:58:42.862527 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:42.862453    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/66187fa7-9e2c-4841-84f5-d33036c21378-home\") pod \"66187fa7-9e2c-4841-84f5-d33036c21378\" (UID: \"66187fa7-9e2c-4841-84f5-d33036c21378\") "
Sep 10 17:58:42.862739 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:42.862560    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66187fa7-9e2c-4841-84f5-d33036c21378-model-cache" (OuterVolumeSpecName: "model-cache") pod "66187fa7-9e2c-4841-84f5-d33036c21378" (UID: "66187fa7-9e2c-4841-84f5-d33036c21378"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:58:42.862739 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:42.862582    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66187fa7-9e2c-4841-84f5-d33036c21378-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "66187fa7-9e2c-4841-84f5-d33036c21378" (UID: "66187fa7-9e2c-4841-84f5-d33036c21378"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:58:42.862851 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:42.862775    2568 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/66187fa7-9e2c-4841-84f5-d33036c21378-model-cache\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:58:42.862851 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:42.862793    2568 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/66187fa7-9e2c-4841-84f5-d33036c21378-tmp-dir\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:58:42.863173 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:42.863144    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66187fa7-9e2c-4841-84f5-d33036c21378-home" (OuterVolumeSpecName: "home") pod "66187fa7-9e2c-4841-84f5-d33036c21378" (UID: "66187fa7-9e2c-4841-84f5-d33036c21378"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:58:42.864761 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:42.864738    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66187fa7-9e2c-4841-84f5-d33036c21378-dshm" (OuterVolumeSpecName: "dshm") pod "66187fa7-9e2c-4841-84f5-d33036c21378" (UID: "66187fa7-9e2c-4841-84f5-d33036c21378"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:58:42.864854 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:42.864780    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/66187fa7-9e2c-4841-84f5-d33036c21378-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "66187fa7-9e2c-4841-84f5-d33036c21378" (UID: "66187fa7-9e2c-4841-84f5-d33036c21378"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 17:58:42.864854 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:42.864793    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66187fa7-9e2c-4841-84f5-d33036c21378-kube-api-access-4rkxx" (OuterVolumeSpecName: "kube-api-access-4rkxx") pod "66187fa7-9e2c-4841-84f5-d33036c21378" (UID: "66187fa7-9e2c-4841-84f5-d33036c21378"). InnerVolumeSpecName "kube-api-access-4rkxx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:58:42.963642 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:42.963549    2568 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/66187fa7-9e2c-4841-84f5-d33036c21378-tls-certs\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:58:42.963642 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:42.963579    2568 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/66187fa7-9e2c-4841-84f5-d33036c21378-home\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:58:42.963642 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:42.963587    2568 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/66187fa7-9e2c-4841-84f5-d33036c21378-dshm\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:58:42.963642 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:42.963595    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4rkxx\" (UniqueName: \"kubernetes.io/projected/66187fa7-9e2c-4841-84f5-d33036c21378-kube-api-access-4rkxx\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:58:43.554719 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:43.554677    2568 generic.go:356] "Generic (PLEG): container finished" podID="66187fa7-9e2c-4841-84f5-d33036c21378" containerID="586d95ab0455584c7ce8f8669ed53036da5bd93ba2039ae6165dc515964726e4" exitCode=0
Sep 10 17:58:43.555279 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:43.554727    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-c3fa7f/noten-model-c3fa7f-kserve-59c7496647-js5dq"
Sep 10 17:58:43.555279 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:43.554729    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-c3fa7f/noten-model-c3fa7f-kserve-59c7496647-js5dq" event={"ID":"66187fa7-9e2c-4841-84f5-d33036c21378","Type":"ContainerDied","Data":"586d95ab0455584c7ce8f8669ed53036da5bd93ba2039ae6165dc515964726e4"}
Sep 10 17:58:43.555279 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:43.554775    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-c3fa7f/noten-model-c3fa7f-kserve-59c7496647-js5dq" event={"ID":"66187fa7-9e2c-4841-84f5-d33036c21378","Type":"ContainerDied","Data":"9255b931b5f5817cb2247bc21b127c0b024f951c46ef0147a2a919f579c98b8d"}
Sep 10 17:58:43.555279 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:43.554798    2568 scope.go:117] "RemoveContainer" containerID="586d95ab0455584c7ce8f8669ed53036da5bd93ba2039ae6165dc515964726e4"
Sep 10 17:58:43.566556 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:43.566534    2568 scope.go:117] "RemoveContainer" containerID="586d95ab0455584c7ce8f8669ed53036da5bd93ba2039ae6165dc515964726e4"
Sep 10 17:58:43.566945 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:58:43.566919    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"586d95ab0455584c7ce8f8669ed53036da5bd93ba2039ae6165dc515964726e4\": container with ID starting with 586d95ab0455584c7ce8f8669ed53036da5bd93ba2039ae6165dc515964726e4 not found: ID does not exist" containerID="586d95ab0455584c7ce8f8669ed53036da5bd93ba2039ae6165dc515964726e4"
Sep 10 17:58:43.567003 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:43.566955    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"586d95ab0455584c7ce8f8669ed53036da5bd93ba2039ae6165dc515964726e4"} err="failed to get container status \"586d95ab0455584c7ce8f8669ed53036da5bd93ba2039ae6165dc515964726e4\": rpc error: code = NotFound desc = could not find container \"586d95ab0455584c7ce8f8669ed53036da5bd93ba2039ae6165dc515964726e4\": container with ID starting with 586d95ab0455584c7ce8f8669ed53036da5bd93ba2039ae6165dc515964726e4 not found: ID does not exist"
Sep 10 17:58:43.585132 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:43.585080    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-noten-c3fa7f/noten-model-c3fa7f-kserve-59c7496647-js5dq"]
Sep 10 17:58:43.593301 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:43.593261    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-noten-c3fa7f/noten-model-c3fa7f-kserve-59c7496647-js5dq"]
Sep 10 17:58:44.775370 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:44.772375    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="66187fa7-9e2c-4841-84f5-d33036c21378" path="/var/lib/kubelet/pods/66187fa7-9e2c-4841-84f5-d33036c21378/volumes"
Sep 10 17:58:48.782778 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:48.782742    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-1fb38e82-578d46cc9d-tgvrg"]
Sep 10 17:58:48.783220 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:48.783163    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66187fa7-9e2c-4841-84f5-d33036c21378" containerName="main"
Sep 10 17:58:48.783220 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:48.783176    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="66187fa7-9e2c-4841-84f5-d33036c21378" containerName="main"
Sep 10 17:58:48.783299 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:48.783243    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="66187fa7-9e2c-4841-84f5-d33036c21378" containerName="main"
Sep 10 17:58:48.787907 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:48.787884    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-1fb38e82-578d46cc9d-tgvrg"
Sep 10 17:58:48.790684 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:48.790656    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-1fb38e82\""
Sep 10 17:58:48.790838 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:48.790658    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-1fb38e82-dockercfg-z879k\""
Sep 10 17:58:48.797975 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:48.797942    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-1fb38e82-578d46cc9d-tgvrg"]
Sep 10 17:58:48.922250 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:48.922200    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1b5231d1-4a51-4b95-a288-890c92111cda-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-1fb38e82-578d46cc9d-tgvrg\" (UID: \"1b5231d1-4a51-4b95-a288-890c92111cda\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-1fb38e82-578d46cc9d-tgvrg"
Sep 10 17:58:48.922483 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:48.922271    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4x9sq\" (UniqueName: \"kubernetes.io/projected/1b5231d1-4a51-4b95-a288-890c92111cda-kube-api-access-4x9sq\") pod \"payload-pre-processing-e2e-mt-1fb38e82-578d46cc9d-tgvrg\" (UID: \"1b5231d1-4a51-4b95-a288-890c92111cda\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-1fb38e82-578d46cc9d-tgvrg"
Sep 10 17:58:49.022794 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:49.022754    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1b5231d1-4a51-4b95-a288-890c92111cda-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-1fb38e82-578d46cc9d-tgvrg\" (UID: \"1b5231d1-4a51-4b95-a288-890c92111cda\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-1fb38e82-578d46cc9d-tgvrg"
Sep 10 17:58:49.022977 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:49.022815    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4x9sq\" (UniqueName: \"kubernetes.io/projected/1b5231d1-4a51-4b95-a288-890c92111cda-kube-api-access-4x9sq\") pod \"payload-pre-processing-e2e-mt-1fb38e82-578d46cc9d-tgvrg\" (UID: \"1b5231d1-4a51-4b95-a288-890c92111cda\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-1fb38e82-578d46cc9d-tgvrg"
Sep 10 17:58:49.023543 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:49.023519    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1b5231d1-4a51-4b95-a288-890c92111cda-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-1fb38e82-578d46cc9d-tgvrg\" (UID: \"1b5231d1-4a51-4b95-a288-890c92111cda\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-1fb38e82-578d46cc9d-tgvrg"
Sep 10 17:58:49.030895 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:49.030862    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4x9sq\" (UniqueName: \"kubernetes.io/projected/1b5231d1-4a51-4b95-a288-890c92111cda-kube-api-access-4x9sq\") pod \"payload-pre-processing-e2e-mt-1fb38e82-578d46cc9d-tgvrg\" (UID: \"1b5231d1-4a51-4b95-a288-890c92111cda\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-1fb38e82-578d46cc9d-tgvrg"
Sep 10 17:58:49.100616 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:49.100515    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-1fb38e82-578d46cc9d-tgvrg"
Sep 10 17:58:49.380303 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:49.380273    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-1fb38e82-578d46cc9d-tgvrg"]
Sep 10 17:58:49.381727 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:58:49.381692    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b5231d1_4a51_4b95_a288_890c92111cda.slice/crio-cac9111fe3fbea0ec83ab520b1b24c51ed061f9167c36930fe2d80abd8e3b7a4 WatchSource:0}: Error finding container cac9111fe3fbea0ec83ab520b1b24c51ed061f9167c36930fe2d80abd8e3b7a4: Status 404 returned error can't find the container with id cac9111fe3fbea0ec83ab520b1b24c51ed061f9167c36930fe2d80abd8e3b7a4
Sep 10 17:58:49.596996 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:49.596962    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-1fb38e82-578d46cc9d-tgvrg" event={"ID":"1b5231d1-4a51-4b95-a288-890c92111cda","Type":"ContainerStarted","Data":"fbdab0df3cf8ec78011ee13433a5f9afe85ddf2a93d31b055b147b2c6da9bd9d"}
Sep 10 17:58:49.597180 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:49.597013    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-1fb38e82-578d46cc9d-tgvrg" event={"ID":"1b5231d1-4a51-4b95-a288-890c92111cda","Type":"ContainerStarted","Data":"cac9111fe3fbea0ec83ab520b1b24c51ed061f9167c36930fe2d80abd8e3b7a4"}
Sep 10 17:58:49.597180 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:49.597058    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-1fb38e82-578d46cc9d-tgvrg"
Sep 10 17:58:49.614005 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:49.613949    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-1fb38e82-578d46cc9d-tgvrg" podStartSLOduration=1.613930815 podStartE2EDuration="1.613930815s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:58:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:58:49.612929984 +0000 UTC m=+1065.374238028" watchObservedRunningTime="2026-09-10 17:58:49.613930815 +0000 UTC m=+1065.375238858"
Sep 10 17:58:51.494572 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:51.494531    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-c34c13-84646c5cbc-fvk65"]
Sep 10 17:58:51.495073 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:51.494781    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-c34c13-84646c5cbc-fvk65" podUID="96c332e5-93b8-41ac-92e2-60d55aebce62" containerName="payload-processing" containerID="cri-o://ffefd7d4420faf6791a43a54e9bcfcf1aba9f422de73bb80b264e26713a0b205" gracePeriod=30
Sep 10 17:58:51.504980 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:51.504946    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-c34c13-65ff6fd994-gkkcw"]
Sep 10 17:58:51.505455 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:51.505401    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c34c13-65ff6fd994-gkkcw" podUID="baa9deef-3235-49de-8786-d42baffe159c" containerName="payload-pre-processing" containerID="cri-o://530a84caa1fe2a8f61576aaeeeb14a2a92682a73af871724bfaba84c8905430e" gracePeriod=30
Sep 10 17:58:51.612337 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:51.612285    2568 generic.go:356] "Generic (PLEG): container finished" podID="96c332e5-93b8-41ac-92e2-60d55aebce62" containerID="ffefd7d4420faf6791a43a54e9bcfcf1aba9f422de73bb80b264e26713a0b205" exitCode=0
Sep 10 17:58:51.612526 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:51.612355    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-c34c13-84646c5cbc-fvk65" event={"ID":"96c332e5-93b8-41ac-92e2-60d55aebce62","Type":"ContainerDied","Data":"ffefd7d4420faf6791a43a54e9bcfcf1aba9f422de73bb80b264e26713a0b205"}
Sep 10 17:58:51.788594 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:51.788554    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-c34c13-84646c5cbc-fvk65"
Sep 10 17:58:51.807789 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:51.807745    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c34c13-65ff6fd994-gkkcw"
Sep 10 17:58:51.949132 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:51.949093    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z5qnx\" (UniqueName: \"kubernetes.io/projected/baa9deef-3235-49de-8786-d42baffe159c-kube-api-access-z5qnx\") pod \"baa9deef-3235-49de-8786-d42baffe159c\" (UID: \"baa9deef-3235-49de-8786-d42baffe159c\") "
Sep 10 17:58:51.949132 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:51.949143    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/baa9deef-3235-49de-8786-d42baffe159c-plugins-config-volume\") pod \"baa9deef-3235-49de-8786-d42baffe159c\" (UID: \"baa9deef-3235-49de-8786-d42baffe159c\") "
Sep 10 17:58:51.949459 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:51.949205    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4xgsb\" (UniqueName: \"kubernetes.io/projected/96c332e5-93b8-41ac-92e2-60d55aebce62-kube-api-access-4xgsb\") pod \"96c332e5-93b8-41ac-92e2-60d55aebce62\" (UID: \"96c332e5-93b8-41ac-92e2-60d55aebce62\") "
Sep 10 17:58:51.949459 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:51.949243    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/96c332e5-93b8-41ac-92e2-60d55aebce62-plugins-config-volume\") pod \"96c332e5-93b8-41ac-92e2-60d55aebce62\" (UID: \"96c332e5-93b8-41ac-92e2-60d55aebce62\") "
Sep 10 17:58:51.949687 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:51.949659    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/baa9deef-3235-49de-8786-d42baffe159c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "baa9deef-3235-49de-8786-d42baffe159c" (UID: "baa9deef-3235-49de-8786-d42baffe159c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 17:58:51.949761 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:51.949701    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96c332e5-93b8-41ac-92e2-60d55aebce62-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "96c332e5-93b8-41ac-92e2-60d55aebce62" (UID: "96c332e5-93b8-41ac-92e2-60d55aebce62"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 17:58:51.951437 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:51.951410    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96c332e5-93b8-41ac-92e2-60d55aebce62-kube-api-access-4xgsb" (OuterVolumeSpecName: "kube-api-access-4xgsb") pod "96c332e5-93b8-41ac-92e2-60d55aebce62" (UID: "96c332e5-93b8-41ac-92e2-60d55aebce62"). InnerVolumeSpecName "kube-api-access-4xgsb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:58:51.951515 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:51.951466    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/baa9deef-3235-49de-8786-d42baffe159c-kube-api-access-z5qnx" (OuterVolumeSpecName: "kube-api-access-z5qnx") pod "baa9deef-3235-49de-8786-d42baffe159c" (UID: "baa9deef-3235-49de-8786-d42baffe159c"). InnerVolumeSpecName "kube-api-access-z5qnx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:58:52.050670 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:52.050568    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z5qnx\" (UniqueName: \"kubernetes.io/projected/baa9deef-3235-49de-8786-d42baffe159c-kube-api-access-z5qnx\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:58:52.050670 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:52.050605    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/baa9deef-3235-49de-8786-d42baffe159c-plugins-config-volume\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:58:52.050670 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:52.050615    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4xgsb\" (UniqueName: \"kubernetes.io/projected/96c332e5-93b8-41ac-92e2-60d55aebce62-kube-api-access-4xgsb\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:58:52.050670 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:52.050624    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/96c332e5-93b8-41ac-92e2-60d55aebce62-plugins-config-volume\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:58:52.619783 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:52.619743    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-c34c13-84646c5cbc-fvk65"
Sep 10 17:58:52.620244 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:52.619795    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-c34c13-84646c5cbc-fvk65" event={"ID":"96c332e5-93b8-41ac-92e2-60d55aebce62","Type":"ContainerDied","Data":"e5b378a806395031ce0f9784eef70d3da2de34d9928398c210ddc24ccbdf878b"}
Sep 10 17:58:52.620244 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:52.619869    2568 scope.go:117] "RemoveContainer" containerID="ffefd7d4420faf6791a43a54e9bcfcf1aba9f422de73bb80b264e26713a0b205"
Sep 10 17:58:52.621450 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:52.621421    2568 generic.go:356] "Generic (PLEG): container finished" podID="baa9deef-3235-49de-8786-d42baffe159c" containerID="530a84caa1fe2a8f61576aaeeeb14a2a92682a73af871724bfaba84c8905430e" exitCode=0
Sep 10 17:58:52.621542 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:52.621462    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c34c13-65ff6fd994-gkkcw"
Sep 10 17:58:52.621542 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:52.621502    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c34c13-65ff6fd994-gkkcw" event={"ID":"baa9deef-3235-49de-8786-d42baffe159c","Type":"ContainerDied","Data":"530a84caa1fe2a8f61576aaeeeb14a2a92682a73af871724bfaba84c8905430e"}
Sep 10 17:58:52.621633 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:52.621560    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c34c13-65ff6fd994-gkkcw" event={"ID":"baa9deef-3235-49de-8786-d42baffe159c","Type":"ContainerDied","Data":"e77d882dfb3838e0c75639abfe2f982175d0b0897b5d8e809bcb5e5265c0324a"}
Sep 10 17:58:52.629866 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:52.629844    2568 scope.go:117] "RemoveContainer" containerID="530a84caa1fe2a8f61576aaeeeb14a2a92682a73af871724bfaba84c8905430e"
Sep 10 17:58:52.638867 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:52.638847    2568 scope.go:117] "RemoveContainer" containerID="530a84caa1fe2a8f61576aaeeeb14a2a92682a73af871724bfaba84c8905430e"
Sep 10 17:58:52.639171 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:58:52.639154    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"530a84caa1fe2a8f61576aaeeeb14a2a92682a73af871724bfaba84c8905430e\": container with ID starting with 530a84caa1fe2a8f61576aaeeeb14a2a92682a73af871724bfaba84c8905430e not found: ID does not exist" containerID="530a84caa1fe2a8f61576aaeeeb14a2a92682a73af871724bfaba84c8905430e"
Sep 10 17:58:52.639238 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:52.639178    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"530a84caa1fe2a8f61576aaeeeb14a2a92682a73af871724bfaba84c8905430e"} err="failed to get container status \"530a84caa1fe2a8f61576aaeeeb14a2a92682a73af871724bfaba84c8905430e\": rpc error: code = NotFound desc = could not find container \"530a84caa1fe2a8f61576aaeeeb14a2a92682a73af871724bfaba84c8905430e\": container with ID starting with 530a84caa1fe2a8f61576aaeeeb14a2a92682a73af871724bfaba84c8905430e not found: ID does not exist"
Sep 10 17:58:52.646901 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:52.646858    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-c34c13-84646c5cbc-fvk65"]
Sep 10 17:58:52.649209 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:52.649181    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-c34c13-84646c5cbc-fvk65"]
Sep 10 17:58:52.659175 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:52.659142    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-c34c13-65ff6fd994-gkkcw"]
Sep 10 17:58:52.666197 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:52.666170    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-c34c13-65ff6fd994-gkkcw"]
Sep 10 17:58:52.771114 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:52.771023    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96c332e5-93b8-41ac-92e2-60d55aebce62" path="/var/lib/kubelet/pods/96c332e5-93b8-41ac-92e2-60d55aebce62/volumes"
Sep 10 17:58:52.771415 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:52.771401    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="baa9deef-3235-49de-8786-d42baffe159c" path="/var/lib/kubelet/pods/baa9deef-3235-49de-8786-d42baffe159c/volumes"
Sep 10 17:58:55.641649 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:55.641602    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-18490e/test-model-18490e-kserve-6c5c46fc87-x4d5t" podUID="740e815d-bec5-4fb9-9e27-bd536189344b" containerName="main" containerID="cri-o://3e7ac979e008cc9ff53500ad6d858b0053b0f334fa07c7526f120d0a5962de55" gracePeriod=45
Sep 10 17:58:55.905116 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:55.905042    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-18490e/test-model-18490e-kserve-6c5c46fc87-x4d5t"
Sep 10 17:58:55.981585 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:55.981542    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/740e815d-bec5-4fb9-9e27-bd536189344b-home\") pod \"740e815d-bec5-4fb9-9e27-bd536189344b\" (UID: \"740e815d-bec5-4fb9-9e27-bd536189344b\") "
Sep 10 17:58:55.981585 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:55.981582    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/740e815d-bec5-4fb9-9e27-bd536189344b-tls-certs\") pod \"740e815d-bec5-4fb9-9e27-bd536189344b\" (UID: \"740e815d-bec5-4fb9-9e27-bd536189344b\") "
Sep 10 17:58:55.981858 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:55.981615    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/740e815d-bec5-4fb9-9e27-bd536189344b-dshm\") pod \"740e815d-bec5-4fb9-9e27-bd536189344b\" (UID: \"740e815d-bec5-4fb9-9e27-bd536189344b\") "
Sep 10 17:58:55.981858 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:55.981630    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/740e815d-bec5-4fb9-9e27-bd536189344b-tmp-dir\") pod \"740e815d-bec5-4fb9-9e27-bd536189344b\" (UID: \"740e815d-bec5-4fb9-9e27-bd536189344b\") "
Sep 10 17:58:55.981858 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:55.981648    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xlvlp\" (UniqueName: \"kubernetes.io/projected/740e815d-bec5-4fb9-9e27-bd536189344b-kube-api-access-xlvlp\") pod \"740e815d-bec5-4fb9-9e27-bd536189344b\" (UID: \"740e815d-bec5-4fb9-9e27-bd536189344b\") "
Sep 10 17:58:55.981995 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:55.981872    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/740e815d-bec5-4fb9-9e27-bd536189344b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "740e815d-bec5-4fb9-9e27-bd536189344b" (UID: "740e815d-bec5-4fb9-9e27-bd536189344b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:58:55.981995 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:55.981906    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/740e815d-bec5-4fb9-9e27-bd536189344b-home" (OuterVolumeSpecName: "home") pod "740e815d-bec5-4fb9-9e27-bd536189344b" (UID: "740e815d-bec5-4fb9-9e27-bd536189344b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:58:55.984094 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:55.984053    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/740e815d-bec5-4fb9-9e27-bd536189344b-dshm" (OuterVolumeSpecName: "dshm") pod "740e815d-bec5-4fb9-9e27-bd536189344b" (UID: "740e815d-bec5-4fb9-9e27-bd536189344b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:58:55.984094 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:55.984058    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/740e815d-bec5-4fb9-9e27-bd536189344b-kube-api-access-xlvlp" (OuterVolumeSpecName: "kube-api-access-xlvlp") pod "740e815d-bec5-4fb9-9e27-bd536189344b" (UID: "740e815d-bec5-4fb9-9e27-bd536189344b"). InnerVolumeSpecName "kube-api-access-xlvlp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:58:55.984270 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:55.984063    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/740e815d-bec5-4fb9-9e27-bd536189344b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "740e815d-bec5-4fb9-9e27-bd536189344b" (UID: "740e815d-bec5-4fb9-9e27-bd536189344b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 17:58:56.082528 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:56.082488    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/740e815d-bec5-4fb9-9e27-bd536189344b-model-cache\") pod \"740e815d-bec5-4fb9-9e27-bd536189344b\" (UID: \"740e815d-bec5-4fb9-9e27-bd536189344b\") "
Sep 10 17:58:56.082710 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:56.082676    2568 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/740e815d-bec5-4fb9-9e27-bd536189344b-home\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:58:56.082710 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:56.082688    2568 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/740e815d-bec5-4fb9-9e27-bd536189344b-tls-certs\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:58:56.082710 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:56.082698    2568 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/740e815d-bec5-4fb9-9e27-bd536189344b-dshm\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:58:56.082710 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:56.082706    2568 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/740e815d-bec5-4fb9-9e27-bd536189344b-tmp-dir\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:58:56.082934 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:56.082714    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xlvlp\" (UniqueName: \"kubernetes.io/projected/740e815d-bec5-4fb9-9e27-bd536189344b-kube-api-access-xlvlp\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:58:56.082934 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:56.082800    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/740e815d-bec5-4fb9-9e27-bd536189344b-model-cache" (OuterVolumeSpecName: "model-cache") pod "740e815d-bec5-4fb9-9e27-bd536189344b" (UID: "740e815d-bec5-4fb9-9e27-bd536189344b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:58:56.183180 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:56.183082    2568 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/740e815d-bec5-4fb9-9e27-bd536189344b-model-cache\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:58:56.649130 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:56.649095    2568 generic.go:356] "Generic (PLEG): container finished" podID="740e815d-bec5-4fb9-9e27-bd536189344b" containerID="3e7ac979e008cc9ff53500ad6d858b0053b0f334fa07c7526f120d0a5962de55" exitCode=0
Sep 10 17:58:56.649631 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:56.649140    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-18490e/test-model-18490e-kserve-6c5c46fc87-x4d5t"
Sep 10 17:58:56.649631 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:56.649174    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-18490e/test-model-18490e-kserve-6c5c46fc87-x4d5t" event={"ID":"740e815d-bec5-4fb9-9e27-bd536189344b","Type":"ContainerDied","Data":"3e7ac979e008cc9ff53500ad6d858b0053b0f334fa07c7526f120d0a5962de55"}
Sep 10 17:58:56.649631 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:56.649215    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-18490e/test-model-18490e-kserve-6c5c46fc87-x4d5t" event={"ID":"740e815d-bec5-4fb9-9e27-bd536189344b","Type":"ContainerDied","Data":"16ea56c52caa08e1afcae9036a1cb15b0d1b3c194e61e59fe85f2721c1e99b28"}
Sep 10 17:58:56.649631 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:56.649232    2568 scope.go:117] "RemoveContainer" containerID="3e7ac979e008cc9ff53500ad6d858b0053b0f334fa07c7526f120d0a5962de55"
Sep 10 17:58:56.659790 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:56.659766    2568 scope.go:117] "RemoveContainer" containerID="3e7ac979e008cc9ff53500ad6d858b0053b0f334fa07c7526f120d0a5962de55"
Sep 10 17:58:56.660133 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:58:56.660110    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e7ac979e008cc9ff53500ad6d858b0053b0f334fa07c7526f120d0a5962de55\": container with ID starting with 3e7ac979e008cc9ff53500ad6d858b0053b0f334fa07c7526f120d0a5962de55 not found: ID does not exist" containerID="3e7ac979e008cc9ff53500ad6d858b0053b0f334fa07c7526f120d0a5962de55"
Sep 10 17:58:56.660169 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:56.660143    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e7ac979e008cc9ff53500ad6d858b0053b0f334fa07c7526f120d0a5962de55"} err="failed to get container status \"3e7ac979e008cc9ff53500ad6d858b0053b0f334fa07c7526f120d0a5962de55\": rpc error: code = NotFound desc = could not find container \"3e7ac979e008cc9ff53500ad6d858b0053b0f334fa07c7526f120d0a5962de55\": container with ID starting with 3e7ac979e008cc9ff53500ad6d858b0053b0f334fa07c7526f120d0a5962de55 not found: ID does not exist"
Sep 10 17:58:56.674023 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:56.673988    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-18490e/test-model-18490e-kserve-6c5c46fc87-x4d5t"]
Sep 10 17:58:56.677290 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:56.677258    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-18490e/test-model-18490e-kserve-6c5c46fc87-x4d5t"]
Sep 10 17:58:56.771055 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:56.771015    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="740e815d-bec5-4fb9-9e27-bd536189344b" path="/var/lib/kubelet/pods/740e815d-bec5-4fb9-9e27-bd536189344b/volumes"
Sep 10 17:58:58.841148 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:58.841111    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-18490e-mwmzv"]
Sep 10 17:58:58.841701 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:58.841682    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96c332e5-93b8-41ac-92e2-60d55aebce62" containerName="payload-processing"
Sep 10 17:58:58.841767 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:58.841705    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="96c332e5-93b8-41ac-92e2-60d55aebce62" containerName="payload-processing"
Sep 10 17:58:58.841767 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:58.841718    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="baa9deef-3235-49de-8786-d42baffe159c" containerName="payload-pre-processing"
Sep 10 17:58:58.841767 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:58.841727    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="baa9deef-3235-49de-8786-d42baffe159c" containerName="payload-pre-processing"
Sep 10 17:58:58.841767 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:58.841764    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="740e815d-bec5-4fb9-9e27-bd536189344b" containerName="main"
Sep 10 17:58:58.841903 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:58.841774    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="740e815d-bec5-4fb9-9e27-bd536189344b" containerName="main"
Sep 10 17:58:58.841903 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:58.841848    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="baa9deef-3235-49de-8786-d42baffe159c" containerName="payload-pre-processing"
Sep 10 17:58:58.841903 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:58.841857    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="740e815d-bec5-4fb9-9e27-bd536189344b" containerName="main"
Sep 10 17:58:58.841903 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:58.841864    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="96c332e5-93b8-41ac-92e2-60d55aebce62" containerName="payload-processing"
Sep 10 17:58:58.846029 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:58.845994    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-18490e-mwmzv"
Sep 10 17:58:58.849100 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:58.849069    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-22shs\""
Sep 10 17:58:58.853867 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:58.853834    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-18490e-mwmzv"]
Sep 10 17:58:59.005207 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:59.005169    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0713963e-ebd5-4afd-b639-debd48e7ef6c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-18490e-mwmzv\" (UID: \"0713963e-ebd5-4afd-b639-debd48e7ef6c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-18490e-mwmzv"
Sep 10 17:58:59.105855 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:59.105749    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0713963e-ebd5-4afd-b639-debd48e7ef6c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-18490e-mwmzv\" (UID: \"0713963e-ebd5-4afd-b639-debd48e7ef6c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-18490e-mwmzv"
Sep 10 17:58:59.106471 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:59.106446    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0713963e-ebd5-4afd-b639-debd48e7ef6c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-18490e-mwmzv\" (UID: \"0713963e-ebd5-4afd-b639-debd48e7ef6c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-18490e-mwmzv"
Sep 10 17:58:59.160281 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:59.160239    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-18490e-mwmzv"
Sep 10 17:58:59.435130 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:59.435101    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-18490e-mwmzv"]
Sep 10 17:58:59.436835 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:58:59.436805    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0713963e_ebd5_4afd_b639_debd48e7ef6c.slice/crio-e64f93ac6a0ca16917a5ffc3cfc6b4142475e759e914c65a35ad3f475a768c31 WatchSource:0}: Error finding container e64f93ac6a0ca16917a5ffc3cfc6b4142475e759e914c65a35ad3f475a768c31: Status 404 returned error can't find the container with id e64f93ac6a0ca16917a5ffc3cfc6b4142475e759e914c65a35ad3f475a768c31
Sep 10 17:58:59.670034 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:58:59.669998    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-18490e-mwmzv" event={"ID":"0713963e-ebd5-4afd-b639-debd48e7ef6c","Type":"ContainerStarted","Data":"e64f93ac6a0ca16917a5ffc3cfc6b4142475e759e914c65a35ad3f475a768c31"}
Sep 10 17:59:00.606155 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:00.606115    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-1fb38e82-578d46cc9d-tgvrg"
Sep 10 17:59:00.678597 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:00.678544    2568 generic.go:356] "Generic (PLEG): container finished" podID="0713963e-ebd5-4afd-b639-debd48e7ef6c" containerID="82a66a12d4ae2b8dbadda6fde69741c5794c3626acd23f86dea10bc0a9613aad" exitCode=0
Sep 10 17:59:00.678777 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:00.678608    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-18490e-mwmzv" event={"ID":"0713963e-ebd5-4afd-b639-debd48e7ef6c","Type":"ContainerDied","Data":"82a66a12d4ae2b8dbadda6fde69741c5794c3626acd23f86dea10bc0a9613aad"}
Sep 10 17:59:01.825242 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:01.825208    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-18490e-mwmzv"
Sep 10 17:59:01.929923 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:01.929879    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0713963e-ebd5-4afd-b639-debd48e7ef6c-maas-api-service-ca\") pod \"0713963e-ebd5-4afd-b639-debd48e7ef6c\" (UID: \"0713963e-ebd5-4afd-b639-debd48e7ef6c\") "
Sep 10 17:59:01.930272 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:01.930246    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0713963e-ebd5-4afd-b639-debd48e7ef6c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0713963e-ebd5-4afd-b639-debd48e7ef6c" (UID: "0713963e-ebd5-4afd-b639-debd48e7ef6c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 17:59:02.031362 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:02.031281    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0713963e-ebd5-4afd-b639-debd48e7ef6c-maas-api-service-ca\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:59:02.692665 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:02.692635    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-18490e-mwmzv"
Sep 10 17:59:02.692665 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:02.692638    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-18490e-mwmzv" event={"ID":"0713963e-ebd5-4afd-b639-debd48e7ef6c","Type":"ContainerDied","Data":"e64f93ac6a0ca16917a5ffc3cfc6b4142475e759e914c65a35ad3f475a768c31"}
Sep 10 17:59:02.692977 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:02.692685    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e64f93ac6a0ca16917a5ffc3cfc6b4142475e759e914c65a35ad3f475a768c31"
Sep 10 17:59:10.150495 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:10.150446    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-18490e-7b84f588c7-plhdl"]
Sep 10 17:59:10.151002 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:10.150675    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-18490e-7b84f588c7-plhdl" podUID="e91fb3dd-9245-4282-a937-8b96009312ec" containerName="payload-processing" containerID="cri-o://f23ae4ab1ec2828fe6fd3a15071f13d2a5d74c608067423814e9623b3f68bec9" gracePeriod=30
Sep 10 17:59:10.158696 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:10.158657    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-18490e-58d54f4766-xlmkw"]
Sep 10 17:59:10.159217 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:10.158929    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-18490e-58d54f4766-xlmkw" podUID="1740fc3a-1225-41a1-bc47-37662459fece" containerName="payload-pre-processing" containerID="cri-o://4d69043abaa285bc3628c9f7b7c7658a2688fca4aca39e9f821b3a88f024e087" gracePeriod=30
Sep 10 17:59:10.396292 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:10.391672    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-18490e-mwmzv"]
Sep 10 17:59:10.396292 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:10.395710    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-18490e-mwmzv"]
Sep 10 17:59:10.424596 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:10.424563    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-18490e-7b84f588c7-plhdl"
Sep 10 17:59:10.456664 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:10.456637    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-18490e-58d54f4766-xlmkw"
Sep 10 17:59:10.512144 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:10.512097    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dt5d7\" (UniqueName: \"kubernetes.io/projected/e91fb3dd-9245-4282-a937-8b96009312ec-kube-api-access-dt5d7\") pod \"e91fb3dd-9245-4282-a937-8b96009312ec\" (UID: \"e91fb3dd-9245-4282-a937-8b96009312ec\") "
Sep 10 17:59:10.512144 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:10.512165    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wwf5m\" (UniqueName: \"kubernetes.io/projected/1740fc3a-1225-41a1-bc47-37662459fece-kube-api-access-wwf5m\") pod \"1740fc3a-1225-41a1-bc47-37662459fece\" (UID: \"1740fc3a-1225-41a1-bc47-37662459fece\") "
Sep 10 17:59:10.512444 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:10.512193    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e91fb3dd-9245-4282-a937-8b96009312ec-plugins-config-volume\") pod \"e91fb3dd-9245-4282-a937-8b96009312ec\" (UID: \"e91fb3dd-9245-4282-a937-8b96009312ec\") "
Sep 10 17:59:10.512444 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:10.512211    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1740fc3a-1225-41a1-bc47-37662459fece-plugins-config-volume\") pod \"1740fc3a-1225-41a1-bc47-37662459fece\" (UID: \"1740fc3a-1225-41a1-bc47-37662459fece\") "
Sep 10 17:59:10.512733 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:10.512696    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e91fb3dd-9245-4282-a937-8b96009312ec-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e91fb3dd-9245-4282-a937-8b96009312ec" (UID: "e91fb3dd-9245-4282-a937-8b96009312ec"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 17:59:10.512907 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:10.512763    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1740fc3a-1225-41a1-bc47-37662459fece-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1740fc3a-1225-41a1-bc47-37662459fece" (UID: "1740fc3a-1225-41a1-bc47-37662459fece"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 17:59:10.514518 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:10.514488    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1740fc3a-1225-41a1-bc47-37662459fece-kube-api-access-wwf5m" (OuterVolumeSpecName: "kube-api-access-wwf5m") pod "1740fc3a-1225-41a1-bc47-37662459fece" (UID: "1740fc3a-1225-41a1-bc47-37662459fece"). InnerVolumeSpecName "kube-api-access-wwf5m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:59:10.514606 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:10.514499    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e91fb3dd-9245-4282-a937-8b96009312ec-kube-api-access-dt5d7" (OuterVolumeSpecName: "kube-api-access-dt5d7") pod "e91fb3dd-9245-4282-a937-8b96009312ec" (UID: "e91fb3dd-9245-4282-a937-8b96009312ec"). InnerVolumeSpecName "kube-api-access-dt5d7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:59:10.613426 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:10.613386    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wwf5m\" (UniqueName: \"kubernetes.io/projected/1740fc3a-1225-41a1-bc47-37662459fece-kube-api-access-wwf5m\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:59:10.613426 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:10.613421    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e91fb3dd-9245-4282-a937-8b96009312ec-plugins-config-volume\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:59:10.613426 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:10.613433    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1740fc3a-1225-41a1-bc47-37662459fece-plugins-config-volume\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:59:10.613728 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:10.613445    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dt5d7\" (UniqueName: \"kubernetes.io/projected/e91fb3dd-9245-4282-a937-8b96009312ec-kube-api-access-dt5d7\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:59:10.742845 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:10.742753    2568 generic.go:356] "Generic (PLEG): container finished" podID="e91fb3dd-9245-4282-a937-8b96009312ec" containerID="f23ae4ab1ec2828fe6fd3a15071f13d2a5d74c608067423814e9623b3f68bec9" exitCode=0
Sep 10 17:59:10.742845 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:10.742820    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-18490e-7b84f588c7-plhdl"
Sep 10 17:59:10.743125 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:10.742942    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-18490e-7b84f588c7-plhdl" event={"ID":"e91fb3dd-9245-4282-a937-8b96009312ec","Type":"ContainerDied","Data":"f23ae4ab1ec2828fe6fd3a15071f13d2a5d74c608067423814e9623b3f68bec9"}
Sep 10 17:59:10.743125 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:10.743046    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-18490e-7b84f588c7-plhdl" event={"ID":"e91fb3dd-9245-4282-a937-8b96009312ec","Type":"ContainerDied","Data":"f38ad2a1cf04d7523d31b3c1a4e4236a481f04ce775a3ea08380b5dec1b27c8a"}
Sep 10 17:59:10.743125 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:10.743076    2568 scope.go:117] "RemoveContainer" containerID="f23ae4ab1ec2828fe6fd3a15071f13d2a5d74c608067423814e9623b3f68bec9"
Sep 10 17:59:10.745693 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:10.745591    2568 generic.go:356] "Generic (PLEG): container finished" podID="1740fc3a-1225-41a1-bc47-37662459fece" containerID="4d69043abaa285bc3628c9f7b7c7658a2688fca4aca39e9f821b3a88f024e087" exitCode=0
Sep 10 17:59:10.745693 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:10.745679    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-18490e-58d54f4766-xlmkw" event={"ID":"1740fc3a-1225-41a1-bc47-37662459fece","Type":"ContainerDied","Data":"4d69043abaa285bc3628c9f7b7c7658a2688fca4aca39e9f821b3a88f024e087"}
Sep 10 17:59:10.745936 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:10.745730    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-18490e-58d54f4766-xlmkw" event={"ID":"1740fc3a-1225-41a1-bc47-37662459fece","Type":"ContainerDied","Data":"8232bdd538653a6007dfa7afb91a5e38a283c87e31a45daf71f13f9f4cb17ac0"}
Sep 10 17:59:10.745936 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:10.745803    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-18490e-58d54f4766-xlmkw"
Sep 10 17:59:10.757174 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:10.757146    2568 scope.go:117] "RemoveContainer" containerID="f23ae4ab1ec2828fe6fd3a15071f13d2a5d74c608067423814e9623b3f68bec9"
Sep 10 17:59:10.757703 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:59:10.757676    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f23ae4ab1ec2828fe6fd3a15071f13d2a5d74c608067423814e9623b3f68bec9\": container with ID starting with f23ae4ab1ec2828fe6fd3a15071f13d2a5d74c608067423814e9623b3f68bec9 not found: ID does not exist" containerID="f23ae4ab1ec2828fe6fd3a15071f13d2a5d74c608067423814e9623b3f68bec9"
Sep 10 17:59:10.757813 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:10.757711    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f23ae4ab1ec2828fe6fd3a15071f13d2a5d74c608067423814e9623b3f68bec9"} err="failed to get container status \"f23ae4ab1ec2828fe6fd3a15071f13d2a5d74c608067423814e9623b3f68bec9\": rpc error: code = NotFound desc = could not find container \"f23ae4ab1ec2828fe6fd3a15071f13d2a5d74c608067423814e9623b3f68bec9\": container with ID starting with f23ae4ab1ec2828fe6fd3a15071f13d2a5d74c608067423814e9623b3f68bec9 not found: ID does not exist"
Sep 10 17:59:10.757813 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:10.757735    2568 scope.go:117] "RemoveContainer" containerID="4d69043abaa285bc3628c9f7b7c7658a2688fca4aca39e9f821b3a88f024e087"
Sep 10 17:59:10.767499 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:10.767479    2568 scope.go:117] "RemoveContainer" containerID="4d69043abaa285bc3628c9f7b7c7658a2688fca4aca39e9f821b3a88f024e087"
Sep 10 17:59:10.767825 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:59:10.767806    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d69043abaa285bc3628c9f7b7c7658a2688fca4aca39e9f821b3a88f024e087\": container with ID starting with 4d69043abaa285bc3628c9f7b7c7658a2688fca4aca39e9f821b3a88f024e087 not found: ID does not exist" containerID="4d69043abaa285bc3628c9f7b7c7658a2688fca4aca39e9f821b3a88f024e087"
Sep 10 17:59:10.767893 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:10.767831    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d69043abaa285bc3628c9f7b7c7658a2688fca4aca39e9f821b3a88f024e087"} err="failed to get container status \"4d69043abaa285bc3628c9f7b7c7658a2688fca4aca39e9f821b3a88f024e087\": rpc error: code = NotFound desc = could not find container \"4d69043abaa285bc3628c9f7b7c7658a2688fca4aca39e9f821b3a88f024e087\": container with ID starting with 4d69043abaa285bc3628c9f7b7c7658a2688fca4aca39e9f821b3a88f024e087 not found: ID does not exist"
Sep 10 17:59:10.770653 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:10.770624    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0713963e-ebd5-4afd-b639-debd48e7ef6c" path="/var/lib/kubelet/pods/0713963e-ebd5-4afd-b639-debd48e7ef6c/volumes"
Sep 10 17:59:10.771910 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:10.771885    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-18490e-7b84f588c7-plhdl"]
Sep 10 17:59:10.775661 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:10.775632    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-18490e-7b84f588c7-plhdl"]
Sep 10 17:59:10.787295 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:10.787261    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-18490e-58d54f4766-xlmkw"]
Sep 10 17:59:10.793573 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:10.793542    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-18490e-58d54f4766-xlmkw"]
Sep 10 17:59:12.770298 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:12.770258    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1740fc3a-1225-41a1-bc47-37662459fece" path="/var/lib/kubelet/pods/1740fc3a-1225-41a1-bc47-37662459fece/volumes"
Sep 10 17:59:12.770710 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:12.770649    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e91fb3dd-9245-4282-a937-8b96009312ec" path="/var/lib/kubelet/pods/e91fb3dd-9245-4282-a937-8b96009312ec/volumes"
Sep 10 17:59:17.721280 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:17.721228    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w3-6c9ffc-openshift-default-78b8c7fd54-6dkkf"]
Sep 10 17:59:17.722407 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:17.722375    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1740fc3a-1225-41a1-bc47-37662459fece" containerName="payload-pre-processing"
Sep 10 17:59:17.722407 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:17.722407    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="1740fc3a-1225-41a1-bc47-37662459fece" containerName="payload-pre-processing"
Sep 10 17:59:17.722613 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:17.722427    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0713963e-ebd5-4afd-b639-debd48e7ef6c" containerName="revoke-keys"
Sep 10 17:59:17.722613 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:17.722436    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="0713963e-ebd5-4afd-b639-debd48e7ef6c" containerName="revoke-keys"
Sep 10 17:59:17.722613 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:17.722459    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e91fb3dd-9245-4282-a937-8b96009312ec" containerName="payload-processing"
Sep 10 17:59:17.722613 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:17.722468    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="e91fb3dd-9245-4282-a937-8b96009312ec" containerName="payload-processing"
Sep 10 17:59:17.722613 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:17.722563    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="e91fb3dd-9245-4282-a937-8b96009312ec" containerName="payload-processing"
Sep 10 17:59:17.722613 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:17.722574    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="1740fc3a-1225-41a1-bc47-37662459fece" containerName="payload-pre-processing"
Sep 10 17:59:17.722613 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:17.722583    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="0713963e-ebd5-4afd-b639-debd48e7ef6c" containerName="revoke-keys"
Sep 10 17:59:17.727669 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:17.727643    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-6c9ffc-openshift-default-78b8c7fd54-6dkkf"
Sep 10 17:59:17.730474 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:17.730448    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w3-6c9ffc-openshift-default-dockercfg-xdbrj\""
Sep 10 17:59:17.730618 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:17.730460    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 10 17:59:17.737423 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:17.737395    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-6c9ffc-openshift-default-78b8c7fd54-6dkkf"]
Sep 10 17:59:17.779776 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:17.779718    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19fbb3af-82ca-4d1f-82fe-f8a5756a5dff-credential-socket\") pod \"e2e-shared-a-w3-6c9ffc-openshift-default-78b8c7fd54-6dkkf\" (UID: \"19fbb3af-82ca-4d1f-82fe-f8a5756a5dff\") " pod="openshift-ingress/e2e-shared-a-w3-6c9ffc-openshift-default-78b8c7fd54-6dkkf"
Sep 10 17:59:17.779776 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:17.779775    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19fbb3af-82ca-4d1f-82fe-f8a5756a5dff-workload-certs\") pod \"e2e-shared-a-w3-6c9ffc-openshift-default-78b8c7fd54-6dkkf\" (UID: \"19fbb3af-82ca-4d1f-82fe-f8a5756a5dff\") " pod="openshift-ingress/e2e-shared-a-w3-6c9ffc-openshift-default-78b8c7fd54-6dkkf"
Sep 10 17:59:17.780025 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:17.779826    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gk9x\" (UniqueName: \"kubernetes.io/projected/19fbb3af-82ca-4d1f-82fe-f8a5756a5dff-kube-api-access-6gk9x\") pod \"e2e-shared-a-w3-6c9ffc-openshift-default-78b8c7fd54-6dkkf\" (UID: \"19fbb3af-82ca-4d1f-82fe-f8a5756a5dff\") " pod="openshift-ingress/e2e-shared-a-w3-6c9ffc-openshift-default-78b8c7fd54-6dkkf"
Sep 10 17:59:17.780025 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:17.779871    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19fbb3af-82ca-4d1f-82fe-f8a5756a5dff-istio-token\") pod \"e2e-shared-a-w3-6c9ffc-openshift-default-78b8c7fd54-6dkkf\" (UID: \"19fbb3af-82ca-4d1f-82fe-f8a5756a5dff\") " pod="openshift-ingress/e2e-shared-a-w3-6c9ffc-openshift-default-78b8c7fd54-6dkkf"
Sep 10 17:59:17.780025 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:17.779893    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19fbb3af-82ca-4d1f-82fe-f8a5756a5dff-istio-data\") pod \"e2e-shared-a-w3-6c9ffc-openshift-default-78b8c7fd54-6dkkf\" (UID: \"19fbb3af-82ca-4d1f-82fe-f8a5756a5dff\") " pod="openshift-ingress/e2e-shared-a-w3-6c9ffc-openshift-default-78b8c7fd54-6dkkf"
Sep 10 17:59:17.780025 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:17.779921    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19fbb3af-82ca-4d1f-82fe-f8a5756a5dff-istio-envoy\") pod \"e2e-shared-a-w3-6c9ffc-openshift-default-78b8c7fd54-6dkkf\" (UID: \"19fbb3af-82ca-4d1f-82fe-f8a5756a5dff\") " pod="openshift-ingress/e2e-shared-a-w3-6c9ffc-openshift-default-78b8c7fd54-6dkkf"
Sep 10 17:59:17.780025 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:17.779983    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19fbb3af-82ca-4d1f-82fe-f8a5756a5dff-istio-podinfo\") pod \"e2e-shared-a-w3-6c9ffc-openshift-default-78b8c7fd54-6dkkf\" (UID: \"19fbb3af-82ca-4d1f-82fe-f8a5756a5dff\") " pod="openshift-ingress/e2e-shared-a-w3-6c9ffc-openshift-default-78b8c7fd54-6dkkf"
Sep 10 17:59:17.780239 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:17.780036    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19fbb3af-82ca-4d1f-82fe-f8a5756a5dff-istiod-ca-cert\") pod \"e2e-shared-a-w3-6c9ffc-openshift-default-78b8c7fd54-6dkkf\" (UID: \"19fbb3af-82ca-4d1f-82fe-f8a5756a5dff\") " pod="openshift-ingress/e2e-shared-a-w3-6c9ffc-openshift-default-78b8c7fd54-6dkkf"
Sep 10 17:59:17.780239 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:17.780061    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19fbb3af-82ca-4d1f-82fe-f8a5756a5dff-workload-socket\") pod \"e2e-shared-a-w3-6c9ffc-openshift-default-78b8c7fd54-6dkkf\" (UID: \"19fbb3af-82ca-4d1f-82fe-f8a5756a5dff\") " pod="openshift-ingress/e2e-shared-a-w3-6c9ffc-openshift-default-78b8c7fd54-6dkkf"
Sep 10 17:59:17.880651 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:17.880604    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19fbb3af-82ca-4d1f-82fe-f8a5756a5dff-credential-socket\") pod \"e2e-shared-a-w3-6c9ffc-openshift-default-78b8c7fd54-6dkkf\" (UID: \"19fbb3af-82ca-4d1f-82fe-f8a5756a5dff\") " pod="openshift-ingress/e2e-shared-a-w3-6c9ffc-openshift-default-78b8c7fd54-6dkkf"
Sep 10 17:59:17.880872 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:17.880774    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19fbb3af-82ca-4d1f-82fe-f8a5756a5dff-workload-certs\") pod \"e2e-shared-a-w3-6c9ffc-openshift-default-78b8c7fd54-6dkkf\" (UID: \"19fbb3af-82ca-4d1f-82fe-f8a5756a5dff\") " pod="openshift-ingress/e2e-shared-a-w3-6c9ffc-openshift-default-78b8c7fd54-6dkkf"
Sep 10 17:59:17.880872 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:17.880820    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gk9x\" (UniqueName: \"kubernetes.io/projected/19fbb3af-82ca-4d1f-82fe-f8a5756a5dff-kube-api-access-6gk9x\") pod \"e2e-shared-a-w3-6c9ffc-openshift-default-78b8c7fd54-6dkkf\" (UID: \"19fbb3af-82ca-4d1f-82fe-f8a5756a5dff\") " pod="openshift-ingress/e2e-shared-a-w3-6c9ffc-openshift-default-78b8c7fd54-6dkkf"
Sep 10 17:59:17.880872 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:17.880853    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19fbb3af-82ca-4d1f-82fe-f8a5756a5dff-istio-token\") pod \"e2e-shared-a-w3-6c9ffc-openshift-default-78b8c7fd54-6dkkf\" (UID: \"19fbb3af-82ca-4d1f-82fe-f8a5756a5dff\") " pod="openshift-ingress/e2e-shared-a-w3-6c9ffc-openshift-default-78b8c7fd54-6dkkf"
Sep 10 17:59:17.881044 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:17.880882    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19fbb3af-82ca-4d1f-82fe-f8a5756a5dff-istio-data\") pod \"e2e-shared-a-w3-6c9ffc-openshift-default-78b8c7fd54-6dkkf\" (UID: \"19fbb3af-82ca-4d1f-82fe-f8a5756a5dff\") " pod="openshift-ingress/e2e-shared-a-w3-6c9ffc-openshift-default-78b8c7fd54-6dkkf"
Sep 10 17:59:17.881044 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:17.880941    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19fbb3af-82ca-4d1f-82fe-f8a5756a5dff-istio-envoy\") pod \"e2e-shared-a-w3-6c9ffc-openshift-default-78b8c7fd54-6dkkf\" (UID: \"19fbb3af-82ca-4d1f-82fe-f8a5756a5dff\") " pod="openshift-ingress/e2e-shared-a-w3-6c9ffc-openshift-default-78b8c7fd54-6dkkf"
Sep 10 17:59:17.881044 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:17.880979    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19fbb3af-82ca-4d1f-82fe-f8a5756a5dff-istio-podinfo\") pod \"e2e-shared-a-w3-6c9ffc-openshift-default-78b8c7fd54-6dkkf\" (UID: \"19fbb3af-82ca-4d1f-82fe-f8a5756a5dff\") " pod="openshift-ingress/e2e-shared-a-w3-6c9ffc-openshift-default-78b8c7fd54-6dkkf"
Sep 10 17:59:17.881044 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:17.880980    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19fbb3af-82ca-4d1f-82fe-f8a5756a5dff-credential-socket\") pod \"e2e-shared-a-w3-6c9ffc-openshift-default-78b8c7fd54-6dkkf\" (UID: \"19fbb3af-82ca-4d1f-82fe-f8a5756a5dff\") " pod="openshift-ingress/e2e-shared-a-w3-6c9ffc-openshift-default-78b8c7fd54-6dkkf"
Sep 10 17:59:17.881257 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:17.881060    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19fbb3af-82ca-4d1f-82fe-f8a5756a5dff-istiod-ca-cert\") pod \"e2e-shared-a-w3-6c9ffc-openshift-default-78b8c7fd54-6dkkf\" (UID: \"19fbb3af-82ca-4d1f-82fe-f8a5756a5dff\") " pod="openshift-ingress/e2e-shared-a-w3-6c9ffc-openshift-default-78b8c7fd54-6dkkf"
Sep 10 17:59:17.881257 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:17.881097    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19fbb3af-82ca-4d1f-82fe-f8a5756a5dff-workload-socket\") pod \"e2e-shared-a-w3-6c9ffc-openshift-default-78b8c7fd54-6dkkf\" (UID: \"19fbb3af-82ca-4d1f-82fe-f8a5756a5dff\") " pod="openshift-ingress/e2e-shared-a-w3-6c9ffc-openshift-default-78b8c7fd54-6dkkf"
Sep 10 17:59:17.881257 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:17.881100    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19fbb3af-82ca-4d1f-82fe-f8a5756a5dff-workload-certs\") pod \"e2e-shared-a-w3-6c9ffc-openshift-default-78b8c7fd54-6dkkf\" (UID: \"19fbb3af-82ca-4d1f-82fe-f8a5756a5dff\") " pod="openshift-ingress/e2e-shared-a-w3-6c9ffc-openshift-default-78b8c7fd54-6dkkf"
Sep 10 17:59:17.881257 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:17.881175    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19fbb3af-82ca-4d1f-82fe-f8a5756a5dff-istio-data\") pod \"e2e-shared-a-w3-6c9ffc-openshift-default-78b8c7fd54-6dkkf\" (UID: \"19fbb3af-82ca-4d1f-82fe-f8a5756a5dff\") " pod="openshift-ingress/e2e-shared-a-w3-6c9ffc-openshift-default-78b8c7fd54-6dkkf"
Sep 10 17:59:17.881499 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:17.881405    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19fbb3af-82ca-4d1f-82fe-f8a5756a5dff-workload-socket\") pod \"e2e-shared-a-w3-6c9ffc-openshift-default-78b8c7fd54-6dkkf\" (UID: \"19fbb3af-82ca-4d1f-82fe-f8a5756a5dff\") " pod="openshift-ingress/e2e-shared-a-w3-6c9ffc-openshift-default-78b8c7fd54-6dkkf"
Sep 10 17:59:17.881777 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:17.881755    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19fbb3af-82ca-4d1f-82fe-f8a5756a5dff-istiod-ca-cert\") pod \"e2e-shared-a-w3-6c9ffc-openshift-default-78b8c7fd54-6dkkf\" (UID: \"19fbb3af-82ca-4d1f-82fe-f8a5756a5dff\") " pod="openshift-ingress/e2e-shared-a-w3-6c9ffc-openshift-default-78b8c7fd54-6dkkf"
Sep 10 17:59:17.883242 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:17.883217    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19fbb3af-82ca-4d1f-82fe-f8a5756a5dff-istio-envoy\") pod \"e2e-shared-a-w3-6c9ffc-openshift-default-78b8c7fd54-6dkkf\" (UID: \"19fbb3af-82ca-4d1f-82fe-f8a5756a5dff\") " pod="openshift-ingress/e2e-shared-a-w3-6c9ffc-openshift-default-78b8c7fd54-6dkkf"
Sep 10 17:59:17.883533 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:17.883517    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19fbb3af-82ca-4d1f-82fe-f8a5756a5dff-istio-podinfo\") pod \"e2e-shared-a-w3-6c9ffc-openshift-default-78b8c7fd54-6dkkf\" (UID: \"19fbb3af-82ca-4d1f-82fe-f8a5756a5dff\") " pod="openshift-ingress/e2e-shared-a-w3-6c9ffc-openshift-default-78b8c7fd54-6dkkf"
Sep 10 17:59:17.889452 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:17.889425    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19fbb3af-82ca-4d1f-82fe-f8a5756a5dff-istio-token\") pod \"e2e-shared-a-w3-6c9ffc-openshift-default-78b8c7fd54-6dkkf\" (UID: \"19fbb3af-82ca-4d1f-82fe-f8a5756a5dff\") " pod="openshift-ingress/e2e-shared-a-w3-6c9ffc-openshift-default-78b8c7fd54-6dkkf"
Sep 10 17:59:17.889735 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:17.889715    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gk9x\" (UniqueName: \"kubernetes.io/projected/19fbb3af-82ca-4d1f-82fe-f8a5756a5dff-kube-api-access-6gk9x\") pod \"e2e-shared-a-w3-6c9ffc-openshift-default-78b8c7fd54-6dkkf\" (UID: \"19fbb3af-82ca-4d1f-82fe-f8a5756a5dff\") " pod="openshift-ingress/e2e-shared-a-w3-6c9ffc-openshift-default-78b8c7fd54-6dkkf"
Sep 10 17:59:18.040165 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:18.040119    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-6c9ffc-openshift-default-78b8c7fd54-6dkkf"
Sep 10 17:59:18.324495 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:18.324459    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-6c9ffc-openshift-default-78b8c7fd54-6dkkf"]
Sep 10 17:59:18.325999 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:59:18.325966    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19fbb3af_82ca_4d1f_82fe_f8a5756a5dff.slice/crio-9dbe7443f032e5ce039e578b93727a116b08bbb140cd86f88b42a7978718c154 WatchSource:0}: Error finding container 9dbe7443f032e5ce039e578b93727a116b08bbb140cd86f88b42a7978718c154: Status 404 returned error can't find the container with id 9dbe7443f032e5ce039e578b93727a116b08bbb140cd86f88b42a7978718c154
Sep 10 17:59:18.328271 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:18.328250    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 17:59:18.800610 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:18.800570    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-6c9ffc-openshift-default-78b8c7fd54-6dkkf" event={"ID":"19fbb3af-82ca-4d1f-82fe-f8a5756a5dff","Type":"ContainerStarted","Data":"9dbe7443f032e5ce039e578b93727a116b08bbb140cd86f88b42a7978718c154"}
Sep 10 17:59:19.315658 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:19.315615    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1fb38e82-9j9q8"]
Sep 10 17:59:19.320598 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:19.320569    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1fb38e82-9j9q8"
Sep 10 17:59:19.323304 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:19.323276    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-22shs\""
Sep 10 17:59:19.327992 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:19.327959    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1fb38e82-9j9q8"]
Sep 10 17:59:19.394681 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:19.394638    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/432f5b48-5e9b-4829-8208-c58d07607e80-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-1fb38e82-9j9q8\" (UID: \"432f5b48-5e9b-4829-8208-c58d07607e80\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1fb38e82-9j9q8"
Sep 10 17:59:19.496081 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:19.496045    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/432f5b48-5e9b-4829-8208-c58d07607e80-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-1fb38e82-9j9q8\" (UID: \"432f5b48-5e9b-4829-8208-c58d07607e80\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1fb38e82-9j9q8"
Sep 10 17:59:19.496937 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:19.496902    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/432f5b48-5e9b-4829-8208-c58d07607e80-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-1fb38e82-9j9q8\" (UID: \"432f5b48-5e9b-4829-8208-c58d07607e80\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1fb38e82-9j9q8"
Sep 10 17:59:19.634549 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:19.634448    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1fb38e82-9j9q8"
Sep 10 17:59:19.920536 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:19.920505    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1fb38e82-9j9q8"]
Sep 10 17:59:19.922944 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:59:19.922781    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod432f5b48_5e9b_4829_8208_c58d07607e80.slice/crio-e18a8a350b9568dfa1998549d07803a4d04835d8564cc964dde421a537f925fa WatchSource:0}: Error finding container e18a8a350b9568dfa1998549d07803a4d04835d8564cc964dde421a537f925fa: Status 404 returned error can't find the container with id e18a8a350b9568dfa1998549d07803a4d04835d8564cc964dde421a537f925fa
Sep 10 17:59:20.815472 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:20.815430    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1fb38e82-9j9q8" event={"ID":"432f5b48-5e9b-4829-8208-c58d07607e80","Type":"ContainerStarted","Data":"828678434e9cba0740ddbdaf644c658e3e4486d93c98785394dfdf255c56c131"}
Sep 10 17:59:20.815668 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:20.815537    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1fb38e82-9j9q8" event={"ID":"432f5b48-5e9b-4829-8208-c58d07607e80","Type":"ContainerStarted","Data":"e18a8a350b9568dfa1998549d07803a4d04835d8564cc964dde421a537f925fa"}
Sep 10 17:59:20.833516 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:20.833452    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1fb38e82-9j9q8" podStartSLOduration=1.833423533 podStartE2EDuration="1.833423533s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:59:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:59:20.831678966 +0000 UTC m=+1096.592987014" watchObservedRunningTime="2026-09-10 17:59:20.833423533 +0000 UTC m=+1096.594731576"
Sep 10 17:59:21.430535 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:21.430489    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 17:59:21.430816 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:21.430575    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 17:59:21.430816 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:21.430608    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 17:59:21.824435 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:21.824390    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-6c9ffc-openshift-default-78b8c7fd54-6dkkf" event={"ID":"19fbb3af-82ca-4d1f-82fe-f8a5756a5dff","Type":"ContainerStarted","Data":"ea529c7b6556e3fc99a943e337b733f2f386fcb0465c81d9326979dcf61967d8"}
Sep 10 17:59:21.826244 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:21.826208    2568 generic.go:356] "Generic (PLEG): container finished" podID="432f5b48-5e9b-4829-8208-c58d07607e80" containerID="828678434e9cba0740ddbdaf644c658e3e4486d93c98785394dfdf255c56c131" exitCode=0
Sep 10 17:59:21.826389 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:21.826292    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1fb38e82-9j9q8" event={"ID":"432f5b48-5e9b-4829-8208-c58d07607e80","Type":"ContainerDied","Data":"828678434e9cba0740ddbdaf644c658e3e4486d93c98785394dfdf255c56c131"}
Sep 10 17:59:21.846836 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:21.846779    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w3-6c9ffc-openshift-default-78b8c7fd54-6dkkf" podStartSLOduration=1.745011493 podStartE2EDuration="4.846760821s" totalImagesPullingTime="3.101749328s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:59:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:59:21.844688721 +0000 UTC m=+1097.605996766" watchObservedRunningTime="2026-09-10 17:59:21.846760821 +0000 UTC m=+1097.608068863"
Sep 10 17:59:22.040982 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:22.040932    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-6c9ffc-openshift-default-78b8c7fd54-6dkkf"
Sep 10 17:59:22.048095 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:22.048044    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-6c9ffc-openshift-default-78b8c7fd54-6dkkf"
Sep 10 17:59:22.831914 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:22.831878    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-6c9ffc-openshift-default-78b8c7fd54-6dkkf"
Sep 10 17:59:22.833029 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:22.833004    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-6c9ffc-openshift-default-78b8c7fd54-6dkkf"
Sep 10 17:59:22.983539 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:22.983508    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1fb38e82-9j9q8"
Sep 10 17:59:23.129407 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:23.129283    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/432f5b48-5e9b-4829-8208-c58d07607e80-maas-api-service-ca\") pod \"432f5b48-5e9b-4829-8208-c58d07607e80\" (UID: \"432f5b48-5e9b-4829-8208-c58d07607e80\") "
Sep 10 17:59:23.129666 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:23.129642    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/432f5b48-5e9b-4829-8208-c58d07607e80-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "432f5b48-5e9b-4829-8208-c58d07607e80" (UID: "432f5b48-5e9b-4829-8208-c58d07607e80"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 17:59:23.230993 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:23.230931    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/432f5b48-5e9b-4829-8208-c58d07607e80-maas-api-service-ca\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:59:23.839493 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:23.839468    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1fb38e82-9j9q8"
Sep 10 17:59:23.839873 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:23.839506    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1fb38e82-9j9q8" event={"ID":"432f5b48-5e9b-4829-8208-c58d07607e80","Type":"ContainerDied","Data":"e18a8a350b9568dfa1998549d07803a4d04835d8564cc964dde421a537f925fa"}
Sep 10 17:59:23.839873 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:23.839556    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e18a8a350b9568dfa1998549d07803a4d04835d8564cc964dde421a537f925fa"
Sep 10 17:59:25.578116 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:25.578056    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-6c9ffc-69db85767d-5wt7r"]
Sep 10 17:59:25.579088 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:25.579051    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="432f5b48-5e9b-4829-8208-c58d07607e80" containerName="revoke-keys"
Sep 10 17:59:25.579199 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:25.579092    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="432f5b48-5e9b-4829-8208-c58d07607e80" containerName="revoke-keys"
Sep 10 17:59:25.579382 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:25.579305    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="432f5b48-5e9b-4829-8208-c58d07607e80" containerName="revoke-keys"
Sep 10 17:59:25.584255 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:25.584220    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-6c9ffc-69db85767d-5wt7r"
Sep 10 17:59:25.587336 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:25.587289    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w3-6c9ffc\""
Sep 10 17:59:25.590081 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:25.590054    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-6c9ffc-69db85767d-5wt7r"]
Sep 10 17:59:25.621633 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:25.621592    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-6c9ffc-754bb5cd5c-jhvhf"]
Sep 10 17:59:25.625408 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:25.625377    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-6c9ffc-754bb5cd5c-jhvhf"
Sep 10 17:59:25.627814 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:25.627783    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w3-6c9ffc-dockercfg-7rbj5\""
Sep 10 17:59:25.634891 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:25.634864    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-6c9ffc-754bb5cd5c-jhvhf"]
Sep 10 17:59:25.652435 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:25.652404    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/358112e2-56a1-4a2c-b3e1-086d2b79af21-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-6c9ffc-69db85767d-5wt7r\" (UID: \"358112e2-56a1-4a2c-b3e1-086d2b79af21\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-6c9ffc-69db85767d-5wt7r"
Sep 10 17:59:25.652621 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:25.652519    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kz5sd\" (UniqueName: \"kubernetes.io/projected/358112e2-56a1-4a2c-b3e1-086d2b79af21-kube-api-access-kz5sd\") pod \"payload-pre-processing-e2e-shared-a-w3-6c9ffc-69db85767d-5wt7r\" (UID: \"358112e2-56a1-4a2c-b3e1-086d2b79af21\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-6c9ffc-69db85767d-5wt7r"
Sep 10 17:59:25.753710 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:25.753664    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kz5sd\" (UniqueName: \"kubernetes.io/projected/358112e2-56a1-4a2c-b3e1-086d2b79af21-kube-api-access-kz5sd\") pod \"payload-pre-processing-e2e-shared-a-w3-6c9ffc-69db85767d-5wt7r\" (UID: \"358112e2-56a1-4a2c-b3e1-086d2b79af21\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-6c9ffc-69db85767d-5wt7r"
Sep 10 17:59:25.753894 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:25.753746    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/02ccd568-8956-4999-8c64-25178aca3987-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-6c9ffc-754bb5cd5c-jhvhf\" (UID: \"02ccd568-8956-4999-8c64-25178aca3987\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-6c9ffc-754bb5cd5c-jhvhf"
Sep 10 17:59:25.753894 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:25.753809    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/358112e2-56a1-4a2c-b3e1-086d2b79af21-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-6c9ffc-69db85767d-5wt7r\" (UID: \"358112e2-56a1-4a2c-b3e1-086d2b79af21\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-6c9ffc-69db85767d-5wt7r"
Sep 10 17:59:25.753894 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:25.753845    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d22xg\" (UniqueName: \"kubernetes.io/projected/02ccd568-8956-4999-8c64-25178aca3987-kube-api-access-d22xg\") pod \"payload-processing-e2e-shared-a-w3-6c9ffc-754bb5cd5c-jhvhf\" (UID: \"02ccd568-8956-4999-8c64-25178aca3987\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-6c9ffc-754bb5cd5c-jhvhf"
Sep 10 17:59:25.754630 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:25.754608    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/358112e2-56a1-4a2c-b3e1-086d2b79af21-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-6c9ffc-69db85767d-5wt7r\" (UID: \"358112e2-56a1-4a2c-b3e1-086d2b79af21\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-6c9ffc-69db85767d-5wt7r"
Sep 10 17:59:25.762544 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:25.762509    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kz5sd\" (UniqueName: \"kubernetes.io/projected/358112e2-56a1-4a2c-b3e1-086d2b79af21-kube-api-access-kz5sd\") pod \"payload-pre-processing-e2e-shared-a-w3-6c9ffc-69db85767d-5wt7r\" (UID: \"358112e2-56a1-4a2c-b3e1-086d2b79af21\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-6c9ffc-69db85767d-5wt7r"
Sep 10 17:59:25.854724 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:25.854632    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/02ccd568-8956-4999-8c64-25178aca3987-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-6c9ffc-754bb5cd5c-jhvhf\" (UID: \"02ccd568-8956-4999-8c64-25178aca3987\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-6c9ffc-754bb5cd5c-jhvhf"
Sep 10 17:59:25.854724 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:25.854690    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d22xg\" (UniqueName: \"kubernetes.io/projected/02ccd568-8956-4999-8c64-25178aca3987-kube-api-access-d22xg\") pod \"payload-processing-e2e-shared-a-w3-6c9ffc-754bb5cd5c-jhvhf\" (UID: \"02ccd568-8956-4999-8c64-25178aca3987\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-6c9ffc-754bb5cd5c-jhvhf"
Sep 10 17:59:25.855372 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:25.855313    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/02ccd568-8956-4999-8c64-25178aca3987-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-6c9ffc-754bb5cd5c-jhvhf\" (UID: \"02ccd568-8956-4999-8c64-25178aca3987\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-6c9ffc-754bb5cd5c-jhvhf"
Sep 10 17:59:25.863247 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:25.863214    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d22xg\" (UniqueName: \"kubernetes.io/projected/02ccd568-8956-4999-8c64-25178aca3987-kube-api-access-d22xg\") pod \"payload-processing-e2e-shared-a-w3-6c9ffc-754bb5cd5c-jhvhf\" (UID: \"02ccd568-8956-4999-8c64-25178aca3987\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-6c9ffc-754bb5cd5c-jhvhf"
Sep 10 17:59:25.896536 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:25.896490    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-6c9ffc-69db85767d-5wt7r"
Sep 10 17:59:25.939020 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:25.938698    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-6c9ffc-754bb5cd5c-jhvhf"
Sep 10 17:59:26.187378 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:26.187311    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-6c9ffc-69db85767d-5wt7r"]
Sep 10 17:59:26.189690 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:59:26.189647    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod358112e2_56a1_4a2c_b3e1_086d2b79af21.slice/crio-abb9d6c9b94a367e16186824434313e56e0054628aa528c098067b846bec1d99 WatchSource:0}: Error finding container abb9d6c9b94a367e16186824434313e56e0054628aa528c098067b846bec1d99: Status 404 returned error can't find the container with id abb9d6c9b94a367e16186824434313e56e0054628aa528c098067b846bec1d99
Sep 10 17:59:26.230375 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:26.230340    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-6c9ffc-754bb5cd5c-jhvhf"]
Sep 10 17:59:26.231314 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:59:26.231276    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02ccd568_8956_4999_8c64_25178aca3987.slice/crio-f7bdbc139c6894bd536142929c67e6a3c36f8b3550531fea18f6dfe5ba8f0bd4 WatchSource:0}: Error finding container f7bdbc139c6894bd536142929c67e6a3c36f8b3550531fea18f6dfe5ba8f0bd4: Status 404 returned error can't find the container with id f7bdbc139c6894bd536142929c67e6a3c36f8b3550531fea18f6dfe5ba8f0bd4
Sep 10 17:59:26.860953 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:26.860905    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-6c9ffc-69db85767d-5wt7r" event={"ID":"358112e2-56a1-4a2c-b3e1-086d2b79af21","Type":"ContainerStarted","Data":"2544486ae9af24737b69c76195a67d3d20ad13e12736fbba4966ee4ea03bea04"}
Sep 10 17:59:26.861440 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:26.860978    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-6c9ffc-69db85767d-5wt7r" event={"ID":"358112e2-56a1-4a2c-b3e1-086d2b79af21","Type":"ContainerStarted","Data":"abb9d6c9b94a367e16186824434313e56e0054628aa528c098067b846bec1d99"}
Sep 10 17:59:26.861440 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:26.861010    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-6c9ffc-69db85767d-5wt7r"
Sep 10 17:59:26.862755 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:26.862728    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-6c9ffc-754bb5cd5c-jhvhf" event={"ID":"02ccd568-8956-4999-8c64-25178aca3987","Type":"ContainerStarted","Data":"1ba0be31cd4e5dbad0a4ccb17008d475d55666464c3fbdc82a03592c79e2a087"}
Sep 10 17:59:26.862898 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:26.862779    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-6c9ffc-754bb5cd5c-jhvhf" event={"ID":"02ccd568-8956-4999-8c64-25178aca3987","Type":"ContainerStarted","Data":"f7bdbc139c6894bd536142929c67e6a3c36f8b3550531fea18f6dfe5ba8f0bd4"}
Sep 10 17:59:26.862898 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:26.862863    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-6c9ffc-754bb5cd5c-jhvhf"
Sep 10 17:59:26.880845 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:26.880783    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-6c9ffc-69db85767d-5wt7r" podStartSLOduration=1.880762907 podStartE2EDuration="1.880762907s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:59:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:59:26.879678733 +0000 UTC m=+1102.640986778" watchObservedRunningTime="2026-09-10 17:59:26.880762907 +0000 UTC m=+1102.642070950"
Sep 10 17:59:26.897681 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:26.897616    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-6c9ffc-754bb5cd5c-jhvhf" podStartSLOduration=1.897596345 podStartE2EDuration="1.897596345s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:59:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:59:26.896228577 +0000 UTC m=+1102.657536621" watchObservedRunningTime="2026-09-10 17:59:26.897596345 +0000 UTC m=+1102.658904387"
Sep 10 17:59:30.039820 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:30.039773    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-1fb38e82-578d46cc9d-tgvrg"]
Sep 10 17:59:30.040443 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:30.040107    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-1fb38e82-578d46cc9d-tgvrg" podUID="1b5231d1-4a51-4b95-a288-890c92111cda" containerName="payload-pre-processing" containerID="cri-o://fbdab0df3cf8ec78011ee13433a5f9afe85ddf2a93d31b055b147b2c6da9bd9d" gracePeriod=30
Sep 10 17:59:30.219685 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:30.219649    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1fb38e82-9j9q8"]
Sep 10 17:59:30.222603 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:30.222565    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1fb38e82-9j9q8"]
Sep 10 17:59:30.333761 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:30.333723    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-1fb38e82-578d46cc9d-tgvrg"
Sep 10 17:59:30.498169 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:30.498130    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1b5231d1-4a51-4b95-a288-890c92111cda-plugins-config-volume\") pod \"1b5231d1-4a51-4b95-a288-890c92111cda\" (UID: \"1b5231d1-4a51-4b95-a288-890c92111cda\") "
Sep 10 17:59:30.498377 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:30.498236    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4x9sq\" (UniqueName: \"kubernetes.io/projected/1b5231d1-4a51-4b95-a288-890c92111cda-kube-api-access-4x9sq\") pod \"1b5231d1-4a51-4b95-a288-890c92111cda\" (UID: \"1b5231d1-4a51-4b95-a288-890c92111cda\") "
Sep 10 17:59:30.498593 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:30.498562    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b5231d1-4a51-4b95-a288-890c92111cda-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1b5231d1-4a51-4b95-a288-890c92111cda" (UID: "1b5231d1-4a51-4b95-a288-890c92111cda"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 17:59:30.500374 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:30.500350    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b5231d1-4a51-4b95-a288-890c92111cda-kube-api-access-4x9sq" (OuterVolumeSpecName: "kube-api-access-4x9sq") pod "1b5231d1-4a51-4b95-a288-890c92111cda" (UID: "1b5231d1-4a51-4b95-a288-890c92111cda"). InnerVolumeSpecName "kube-api-access-4x9sq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:59:30.599658 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:30.599556    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1b5231d1-4a51-4b95-a288-890c92111cda-plugins-config-volume\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:59:30.599658 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:30.599595    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4x9sq\" (UniqueName: \"kubernetes.io/projected/1b5231d1-4a51-4b95-a288-890c92111cda-kube-api-access-4x9sq\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 17:59:30.774150 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:30.774107    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="432f5b48-5e9b-4829-8208-c58d07607e80" path="/var/lib/kubelet/pods/432f5b48-5e9b-4829-8208-c58d07607e80/volumes"
Sep 10 17:59:30.889400 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:30.889288    2568 generic.go:356] "Generic (PLEG): container finished" podID="1b5231d1-4a51-4b95-a288-890c92111cda" containerID="fbdab0df3cf8ec78011ee13433a5f9afe85ddf2a93d31b055b147b2c6da9bd9d" exitCode=0
Sep 10 17:59:30.889400 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:30.889361    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-1fb38e82-578d46cc9d-tgvrg" event={"ID":"1b5231d1-4a51-4b95-a288-890c92111cda","Type":"ContainerDied","Data":"fbdab0df3cf8ec78011ee13433a5f9afe85ddf2a93d31b055b147b2c6da9bd9d"}
Sep 10 17:59:30.889607 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:30.889421    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-1fb38e82-578d46cc9d-tgvrg" event={"ID":"1b5231d1-4a51-4b95-a288-890c92111cda","Type":"ContainerDied","Data":"cac9111fe3fbea0ec83ab520b1b24c51ed061f9167c36930fe2d80abd8e3b7a4"}
Sep 10 17:59:30.889607 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:30.889445    2568 scope.go:117] "RemoveContainer" containerID="fbdab0df3cf8ec78011ee13433a5f9afe85ddf2a93d31b055b147b2c6da9bd9d"
Sep 10 17:59:30.889607 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:30.889369    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-1fb38e82-578d46cc9d-tgvrg"
Sep 10 17:59:30.899059 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:30.899031    2568 scope.go:117] "RemoveContainer" containerID="fbdab0df3cf8ec78011ee13433a5f9afe85ddf2a93d31b055b147b2c6da9bd9d"
Sep 10 17:59:30.899404 ip-10-0-136-161 kubenswrapper[2568]: E0910 17:59:30.899383    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fbdab0df3cf8ec78011ee13433a5f9afe85ddf2a93d31b055b147b2c6da9bd9d\": container with ID starting with fbdab0df3cf8ec78011ee13433a5f9afe85ddf2a93d31b055b147b2c6da9bd9d not found: ID does not exist" containerID="fbdab0df3cf8ec78011ee13433a5f9afe85ddf2a93d31b055b147b2c6da9bd9d"
Sep 10 17:59:30.899538 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:30.899416    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fbdab0df3cf8ec78011ee13433a5f9afe85ddf2a93d31b055b147b2c6da9bd9d"} err="failed to get container status \"fbdab0df3cf8ec78011ee13433a5f9afe85ddf2a93d31b055b147b2c6da9bd9d\": rpc error: code = NotFound desc = could not find container \"fbdab0df3cf8ec78011ee13433a5f9afe85ddf2a93d31b055b147b2c6da9bd9d\": container with ID starting with fbdab0df3cf8ec78011ee13433a5f9afe85ddf2a93d31b055b147b2c6da9bd9d not found: ID does not exist"
Sep 10 17:59:30.908983 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:30.908945    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-1fb38e82-578d46cc9d-tgvrg"]
Sep 10 17:59:30.914099 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:30.914066    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-1fb38e82-578d46cc9d-tgvrg"]
Sep 10 17:59:32.774061 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:32.774025    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b5231d1-4a51-4b95-a288-890c92111cda" path="/var/lib/kubelet/pods/1b5231d1-4a51-4b95-a288-890c92111cda/volumes"
Sep 10 17:59:37.872094 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:37.872060    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-6c9ffc-754bb5cd5c-jhvhf"
Sep 10 17:59:37.872560 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:37.872133    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-6c9ffc-69db85767d-5wt7r"
Sep 10 17:59:38.872619 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:38.872558    2568 patch_prober.go:28] interesting pod/e2e-shared-a-w3-6c9ffc-openshift-default-78b8c7fd54-6dkkf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 10 17:59:38.872999 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:38.872660    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w3-6c9ffc-openshift-default-78b8c7fd54-6dkkf" podUID="19fbb3af-82ca-4d1f-82fe-f8a5756a5dff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 10 17:59:39.949743 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:39.949708    2568 generic.go:356] "Generic (PLEG): container finished" podID="19fbb3af-82ca-4d1f-82fe-f8a5756a5dff" containerID="ea529c7b6556e3fc99a943e337b733f2f386fcb0465c81d9326979dcf61967d8" exitCode=0
Sep 10 17:59:39.950252 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:39.949793    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-6c9ffc-openshift-default-78b8c7fd54-6dkkf" event={"ID":"19fbb3af-82ca-4d1f-82fe-f8a5756a5dff","Type":"ContainerDied","Data":"ea529c7b6556e3fc99a943e337b733f2f386fcb0465c81d9326979dcf61967d8"}
Sep 10 17:59:39.950305 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:39.950289    2568 scope.go:117] "RemoveContainer" containerID="ea529c7b6556e3fc99a943e337b733f2f386fcb0465c81d9326979dcf61967d8"
Sep 10 17:59:39.951453 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:39.951421    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 17:59:39.951542 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:39.951491    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 17:59:39.951542 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:39.951526    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 17:59:40.962969 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:40.962915    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-6c9ffc-openshift-default-78b8c7fd54-6dkkf" event={"ID":"19fbb3af-82ca-4d1f-82fe-f8a5756a5dff","Type":"ContainerStarted","Data":"2699718f6304b46ae2f1fd9e3cf783137ddd277a722ab2621289f5876670d15c"}
Sep 10 17:59:41.040739 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:41.040697    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-6c9ffc-openshift-default-78b8c7fd54-6dkkf"
Sep 10 17:59:41.040933 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:41.040896    2568 patch_prober.go:28] interesting pod/e2e-shared-a-w3-6c9ffc-openshift-default-78b8c7fd54-6dkkf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Sep 10 17:59:41.040981 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:41.040956    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-6c9ffc-openshift-default-78b8c7fd54-6dkkf" podUID="19fbb3af-82ca-4d1f-82fe-f8a5756a5dff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Sep 10 17:59:42.040914 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:42.040875    2568 patch_prober.go:28] interesting pod/e2e-shared-a-w3-6c9ffc-openshift-default-78b8c7fd54-6dkkf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Sep 10 17:59:42.041394 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:42.040967    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-6c9ffc-openshift-default-78b8c7fd54-6dkkf" podUID="19fbb3af-82ca-4d1f-82fe-f8a5756a5dff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Sep 10 17:59:43.041432 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:43.041394    2568 patch_prober.go:28] interesting pod/e2e-shared-a-w3-6c9ffc-openshift-default-78b8c7fd54-6dkkf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Sep 10 17:59:43.042057 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:43.042023    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-6c9ffc-openshift-default-78b8c7fd54-6dkkf" podUID="19fbb3af-82ca-4d1f-82fe-f8a5756a5dff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Sep 10 17:59:44.041524 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:44.041476    2568 patch_prober.go:28] interesting pod/e2e-shared-a-w3-6c9ffc-openshift-default-78b8c7fd54-6dkkf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Sep 10 17:59:44.042082 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:44.041577    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-6c9ffc-openshift-default-78b8c7fd54-6dkkf" podUID="19fbb3af-82ca-4d1f-82fe-f8a5756a5dff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Sep 10 17:59:45.041236 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:45.041194    2568 patch_prober.go:28] interesting pod/e2e-shared-a-w3-6c9ffc-openshift-default-78b8c7fd54-6dkkf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Sep 10 17:59:45.041481 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:45.041261    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-6c9ffc-openshift-default-78b8c7fd54-6dkkf" podUID="19fbb3af-82ca-4d1f-82fe-f8a5756a5dff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Sep 10 17:59:46.041028 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:46.040990    2568 patch_prober.go:28] interesting pod/e2e-shared-a-w3-6c9ffc-openshift-default-78b8c7fd54-6dkkf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Sep 10 17:59:46.041525 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:46.041049    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-6c9ffc-openshift-default-78b8c7fd54-6dkkf" podUID="19fbb3af-82ca-4d1f-82fe-f8a5756a5dff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Sep 10 17:59:47.045808 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:47.045757    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-6c9ffc-openshift-default-78b8c7fd54-6dkkf"
Sep 10 17:59:47.046350 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:47.046188    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-6c9ffc-openshift-default-78b8c7fd54-6dkkf"
Sep 10 17:59:47.047255 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:47.047223    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-6c9ffc-openshift-default-78b8c7fd54-6dkkf"
Sep 10 17:59:54.204476 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:54.204432    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-fc23cf-85b74d754-qf7x8"]
Sep 10 17:59:54.204971 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:54.204855    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b5231d1-4a51-4b95-a288-890c92111cda" containerName="payload-pre-processing"
Sep 10 17:59:54.204971 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:54.204871    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b5231d1-4a51-4b95-a288-890c92111cda" containerName="payload-pre-processing"
Sep 10 17:59:54.204971 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:54.204946    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b5231d1-4a51-4b95-a288-890c92111cda" containerName="payload-pre-processing"
Sep 10 17:59:54.208611 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:54.208593    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-fc23cf-85b74d754-qf7x8"
Sep 10 17:59:54.211315 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:54.211290    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w3-fc23cf-dockercfg-z2x56\""
Sep 10 17:59:54.211527 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:54.211506    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w3-fc23cf\""
Sep 10 17:59:54.216422 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:54.216292    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-fc23cf-85b74d754-qf7x8"]
Sep 10 17:59:54.218676 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:54.218644    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbvvw\" (UniqueName: \"kubernetes.io/projected/8a608ca7-db3e-4def-9081-0c34e9c3e6ba-kube-api-access-nbvvw\") pod \"payload-pre-processing-e2e-shared-b-w3-fc23cf-85b74d754-qf7x8\" (UID: \"8a608ca7-db3e-4def-9081-0c34e9c3e6ba\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-fc23cf-85b74d754-qf7x8"
Sep 10 17:59:54.218817 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:54.218743    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8a608ca7-db3e-4def-9081-0c34e9c3e6ba-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-fc23cf-85b74d754-qf7x8\" (UID: \"8a608ca7-db3e-4def-9081-0c34e9c3e6ba\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-fc23cf-85b74d754-qf7x8"
Sep 10 17:59:54.243721 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:54.243687    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-fc23cf-585697849f-2mmq2"]
Sep 10 17:59:54.248543 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:54.248515    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-fc23cf-585697849f-2mmq2"
Sep 10 17:59:54.257058 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:54.257032    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-fc23cf-585697849f-2mmq2"]
Sep 10 17:59:54.319707 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:54.319634    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8a608ca7-db3e-4def-9081-0c34e9c3e6ba-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-fc23cf-85b74d754-qf7x8\" (UID: \"8a608ca7-db3e-4def-9081-0c34e9c3e6ba\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-fc23cf-85b74d754-qf7x8"
Sep 10 17:59:54.319707 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:54.319709    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkgg4\" (UniqueName: \"kubernetes.io/projected/e747ffbe-0da4-4505-81cd-c795aec590fa-kube-api-access-vkgg4\") pod \"payload-processing-e2e-shared-b-w3-fc23cf-585697849f-2mmq2\" (UID: \"e747ffbe-0da4-4505-81cd-c795aec590fa\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-fc23cf-585697849f-2mmq2"
Sep 10 17:59:54.320044 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:54.319813    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e747ffbe-0da4-4505-81cd-c795aec590fa-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-fc23cf-585697849f-2mmq2\" (UID: \"e747ffbe-0da4-4505-81cd-c795aec590fa\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-fc23cf-585697849f-2mmq2"
Sep 10 17:59:54.320044 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:54.319853    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbvvw\" (UniqueName: \"kubernetes.io/projected/8a608ca7-db3e-4def-9081-0c34e9c3e6ba-kube-api-access-nbvvw\") pod \"payload-pre-processing-e2e-shared-b-w3-fc23cf-85b74d754-qf7x8\" (UID: \"8a608ca7-db3e-4def-9081-0c34e9c3e6ba\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-fc23cf-85b74d754-qf7x8"
Sep 10 17:59:54.320844 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:54.320816    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8a608ca7-db3e-4def-9081-0c34e9c3e6ba-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-fc23cf-85b74d754-qf7x8\" (UID: \"8a608ca7-db3e-4def-9081-0c34e9c3e6ba\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-fc23cf-85b74d754-qf7x8"
Sep 10 17:59:54.330178 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:54.330139    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbvvw\" (UniqueName: \"kubernetes.io/projected/8a608ca7-db3e-4def-9081-0c34e9c3e6ba-kube-api-access-nbvvw\") pod \"payload-pre-processing-e2e-shared-b-w3-fc23cf-85b74d754-qf7x8\" (UID: \"8a608ca7-db3e-4def-9081-0c34e9c3e6ba\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-fc23cf-85b74d754-qf7x8"
Sep 10 17:59:54.420335 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:54.420280    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkgg4\" (UniqueName: \"kubernetes.io/projected/e747ffbe-0da4-4505-81cd-c795aec590fa-kube-api-access-vkgg4\") pod \"payload-processing-e2e-shared-b-w3-fc23cf-585697849f-2mmq2\" (UID: \"e747ffbe-0da4-4505-81cd-c795aec590fa\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-fc23cf-585697849f-2mmq2"
Sep 10 17:59:54.420495 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:54.420386    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e747ffbe-0da4-4505-81cd-c795aec590fa-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-fc23cf-585697849f-2mmq2\" (UID: \"e747ffbe-0da4-4505-81cd-c795aec590fa\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-fc23cf-585697849f-2mmq2"
Sep 10 17:59:54.421072 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:54.421051    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e747ffbe-0da4-4505-81cd-c795aec590fa-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-fc23cf-585697849f-2mmq2\" (UID: \"e747ffbe-0da4-4505-81cd-c795aec590fa\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-fc23cf-585697849f-2mmq2"
Sep 10 17:59:54.429763 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:54.429731    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkgg4\" (UniqueName: \"kubernetes.io/projected/e747ffbe-0da4-4505-81cd-c795aec590fa-kube-api-access-vkgg4\") pod \"payload-processing-e2e-shared-b-w3-fc23cf-585697849f-2mmq2\" (UID: \"e747ffbe-0da4-4505-81cd-c795aec590fa\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-fc23cf-585697849f-2mmq2"
Sep 10 17:59:54.520665 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:54.520621    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-fc23cf-85b74d754-qf7x8"
Sep 10 17:59:54.559784 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:54.559720    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-fc23cf-585697849f-2mmq2"
Sep 10 17:59:54.806495 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:54.806467    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-fc23cf-85b74d754-qf7x8"]
Sep 10 17:59:54.807806 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:59:54.807780    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a608ca7_db3e_4def_9081_0c34e9c3e6ba.slice/crio-c32d5bd154f1675fa86d67af4acb14ec09fb0228d5c1acf15c9f81b6fe7a20bd WatchSource:0}: Error finding container c32d5bd154f1675fa86d67af4acb14ec09fb0228d5c1acf15c9f81b6fe7a20bd: Status 404 returned error can't find the container with id c32d5bd154f1675fa86d67af4acb14ec09fb0228d5c1acf15c9f81b6fe7a20bd
Sep 10 17:59:54.850947 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:54.850914    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-fc23cf-585697849f-2mmq2"]
Sep 10 17:59:54.851905 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:59:54.851870    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode747ffbe_0da4_4505_81cd_c795aec590fa.slice/crio-a3e9b2b08e78f41e30823a4e8b8d7d660dfe5f6f1e70acaf162d0ca550470a4d WatchSource:0}: Error finding container a3e9b2b08e78f41e30823a4e8b8d7d660dfe5f6f1e70acaf162d0ca550470a4d: Status 404 returned error can't find the container with id a3e9b2b08e78f41e30823a4e8b8d7d660dfe5f6f1e70acaf162d0ca550470a4d
Sep 10 17:59:55.063206 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:55.063087    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-fc23cf-585697849f-2mmq2" event={"ID":"e747ffbe-0da4-4505-81cd-c795aec590fa","Type":"ContainerStarted","Data":"f92bf18bff9058fa230f729136a98a75913f6db56a30024e7c83700c47ae5477"}
Sep 10 17:59:55.063206 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:55.063160    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-fc23cf-585697849f-2mmq2"
Sep 10 17:59:55.063206 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:55.063186    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-fc23cf-585697849f-2mmq2" event={"ID":"e747ffbe-0da4-4505-81cd-c795aec590fa","Type":"ContainerStarted","Data":"a3e9b2b08e78f41e30823a4e8b8d7d660dfe5f6f1e70acaf162d0ca550470a4d"}
Sep 10 17:59:55.065144 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:55.065102    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-fc23cf-85b74d754-qf7x8" event={"ID":"8a608ca7-db3e-4def-9081-0c34e9c3e6ba","Type":"ContainerStarted","Data":"3f69980e045e94ea1290c5dfd2248f15bcd90faea4a202d40503fa9a4f43f698"}
Sep 10 17:59:55.065345 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:55.065163    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-fc23cf-85b74d754-qf7x8" event={"ID":"8a608ca7-db3e-4def-9081-0c34e9c3e6ba","Type":"ContainerStarted","Data":"c32d5bd154f1675fa86d67af4acb14ec09fb0228d5c1acf15c9f81b6fe7a20bd"}
Sep 10 17:59:55.065345 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:55.065249    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-fc23cf-85b74d754-qf7x8"
Sep 10 17:59:55.082397 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:55.082334    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-fc23cf-585697849f-2mmq2" podStartSLOduration=1.0823032399999999 podStartE2EDuration="1.08230324s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:59:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:59:55.080225667 +0000 UTC m=+1130.841533710" watchObservedRunningTime="2026-09-10 17:59:55.08230324 +0000 UTC m=+1130.843611283"
Sep 10 17:59:55.097205 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:55.097153    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-fc23cf-85b74d754-qf7x8" podStartSLOduration=1.097134244 podStartE2EDuration="1.097134244s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:59:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:59:55.09593177 +0000 UTC m=+1130.857239813" watchObservedRunningTime="2026-09-10 17:59:55.097134244 +0000 UTC m=+1130.858442287"
Sep 10 17:59:56.199885 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:56.199835    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-971a94-75b8ddcdff-jt78p"]
Sep 10 17:59:56.204025 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:56.203993    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-971a94-75b8ddcdff-jt78p"
Sep 10 17:59:56.207915 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:56.207876    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w2-971a94\""
Sep 10 17:59:56.209400 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:56.209370    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w2-971a94-dockercfg-vv9rp\""
Sep 10 17:59:56.235405 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:56.235360    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-872gp\" (UniqueName: \"kubernetes.io/projected/44ceb0c8-2217-44ea-aabe-b21dc399bb50-kube-api-access-872gp\") pod \"payload-processing-e2e-shared-a-w2-971a94-75b8ddcdff-jt78p\" (UID: \"44ceb0c8-2217-44ea-aabe-b21dc399bb50\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-971a94-75b8ddcdff-jt78p"
Sep 10 17:59:56.235602 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:56.235456    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/44ceb0c8-2217-44ea-aabe-b21dc399bb50-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-971a94-75b8ddcdff-jt78p\" (UID: \"44ceb0c8-2217-44ea-aabe-b21dc399bb50\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-971a94-75b8ddcdff-jt78p"
Sep 10 17:59:56.244591 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:56.244545    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-971a94-75b8ddcdff-jt78p"]
Sep 10 17:59:56.336113 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:56.336073    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/44ceb0c8-2217-44ea-aabe-b21dc399bb50-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-971a94-75b8ddcdff-jt78p\" (UID: \"44ceb0c8-2217-44ea-aabe-b21dc399bb50\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-971a94-75b8ddcdff-jt78p"
Sep 10 17:59:56.336312 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:56.336178    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-872gp\" (UniqueName: \"kubernetes.io/projected/44ceb0c8-2217-44ea-aabe-b21dc399bb50-kube-api-access-872gp\") pod \"payload-processing-e2e-shared-a-w2-971a94-75b8ddcdff-jt78p\" (UID: \"44ceb0c8-2217-44ea-aabe-b21dc399bb50\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-971a94-75b8ddcdff-jt78p"
Sep 10 17:59:56.336912 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:56.336885    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/44ceb0c8-2217-44ea-aabe-b21dc399bb50-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-971a94-75b8ddcdff-jt78p\" (UID: \"44ceb0c8-2217-44ea-aabe-b21dc399bb50\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-971a94-75b8ddcdff-jt78p"
Sep 10 17:59:56.352071 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:56.352032    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-872gp\" (UniqueName: \"kubernetes.io/projected/44ceb0c8-2217-44ea-aabe-b21dc399bb50-kube-api-access-872gp\") pod \"payload-processing-e2e-shared-a-w2-971a94-75b8ddcdff-jt78p\" (UID: \"44ceb0c8-2217-44ea-aabe-b21dc399bb50\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-971a94-75b8ddcdff-jt78p"
Sep 10 17:59:56.516422 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:56.516372    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-971a94-75b8ddcdff-jt78p"
Sep 10 17:59:56.799774 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:56.799725    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-971a94-75b8ddcdff-jt78p"]
Sep 10 17:59:56.801033 ip-10-0-136-161 kubenswrapper[2568]: W0910 17:59:56.801001    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44ceb0c8_2217_44ea_aabe_b21dc399bb50.slice/crio-9b248aeed7164455f308498e9f26457b959da073dc35c2f1966e72b61dacea82 WatchSource:0}: Error finding container 9b248aeed7164455f308498e9f26457b959da073dc35c2f1966e72b61dacea82: Status 404 returned error can't find the container with id 9b248aeed7164455f308498e9f26457b959da073dc35c2f1966e72b61dacea82
Sep 10 17:59:57.082130 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:57.082015    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-971a94-75b8ddcdff-jt78p" event={"ID":"44ceb0c8-2217-44ea-aabe-b21dc399bb50","Type":"ContainerStarted","Data":"4010912fd9088bb3a7f0a9a2422977fcbaa7db774531ecd97637ce7719a52455"}
Sep 10 17:59:57.082130 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:57.082087    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-971a94-75b8ddcdff-jt78p" event={"ID":"44ceb0c8-2217-44ea-aabe-b21dc399bb50","Type":"ContainerStarted","Data":"9b248aeed7164455f308498e9f26457b959da073dc35c2f1966e72b61dacea82"}
Sep 10 17:59:57.082130 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:57.082115    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-971a94-75b8ddcdff-jt78p"
Sep 10 17:59:57.103162 ip-10-0-136-161 kubenswrapper[2568]: I0910 17:59:57.103086    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-971a94-75b8ddcdff-jt78p" podStartSLOduration=1.103061429 podStartE2EDuration="1.103061429s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:59:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:59:57.09969782 +0000 UTC m=+1132.861005863" watchObservedRunningTime="2026-09-10 17:59:57.103061429 +0000 UTC m=+1132.864369479"
Sep 10 18:00:00.160348 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:00.160283    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-971a94-29817720-j7cnl"]
Sep 10 18:00:00.164380 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:00.164346    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29817720-4fstp"]
Sep 10 18:00:00.164557 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:00.164421    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-971a94-29817720-j7cnl"
Sep 10 18:00:00.167422 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:00.167390    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-22shs\""
Sep 10 18:00:00.168156 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:00.168113    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817720-4fstp"
Sep 10 18:00:00.173809 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:00.173773    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29817720-4fstp"]
Sep 10 18:00:00.177352 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:00.177302    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-971a94-29817720-j7cnl"]
Sep 10 18:00:00.180597 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:00.180573    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-971a94-29817720-j7cnl"
Sep 10 18:00:00.188614 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:00.188588    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817720-4fstp"
Sep 10 18:00:00.475699 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:00.475665    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-971a94-29817720-j7cnl"]
Sep 10 18:00:00.477231 ip-10-0-136-161 kubenswrapper[2568]: W0910 18:00:00.477195    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39205419_8c70_468c_91e8_79a213ca575c.slice/crio-7fbc5dae3ef19aca47804b19015e8ab878fefe0dc9e1670260ee9702a2c4b8cf WatchSource:0}: Error finding container 7fbc5dae3ef19aca47804b19015e8ab878fefe0dc9e1670260ee9702a2c4b8cf: Status 404 returned error can't find the container with id 7fbc5dae3ef19aca47804b19015e8ab878fefe0dc9e1670260ee9702a2c4b8cf
Sep 10 18:00:00.479249 ip-10-0-136-161 kubenswrapper[2568]: W0910 18:00:00.479224    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba692344_381a_4c8e_ae90_55301e1a987c.slice/crio-22da89b4d10661939d4e499277f1eefcd7a32b840df93d68e4f0b8215167ba02 WatchSource:0}: Error finding container 22da89b4d10661939d4e499277f1eefcd7a32b840df93d68e4f0b8215167ba02: Status 404 returned error can't find the container with id 22da89b4d10661939d4e499277f1eefcd7a32b840df93d68e4f0b8215167ba02
Sep 10 18:00:00.479754 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:00.479719    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29817720-4fstp"]
Sep 10 18:00:01.109580 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:01.109477    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817720-4fstp" event={"ID":"ba692344-381a-4c8e-ae90-55301e1a987c","Type":"ContainerStarted","Data":"a2fd2eb0c084555c087664f7031bf7afed5aac055577907fe19b4bb83a2474ec"}
Sep 10 18:00:01.109580 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:01.109544    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817720-4fstp" event={"ID":"ba692344-381a-4c8e-ae90-55301e1a987c","Type":"ContainerStarted","Data":"22da89b4d10661939d4e499277f1eefcd7a32b840df93d68e4f0b8215167ba02"}
Sep 10 18:00:01.111219 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:01.111187    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-971a94-29817720-j7cnl" event={"ID":"39205419-8c70-468c-91e8-79a213ca575c","Type":"ContainerStarted","Data":"f70cfddef6d51c4e218be01a474cb5d6b77e244fc32a2608cdf9356671e012da"}
Sep 10 18:00:01.111391 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:01.111236    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-971a94-29817720-j7cnl" event={"ID":"39205419-8c70-468c-91e8-79a213ca575c","Type":"ContainerStarted","Data":"7fbc5dae3ef19aca47804b19015e8ab878fefe0dc9e1670260ee9702a2c4b8cf"}
Sep 10 18:00:01.129879 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:01.129819    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817720-4fstp" podStartSLOduration=1.129802201 podStartE2EDuration="1.129802201s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 18:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 18:00:01.127845112 +0000 UTC m=+1136.889153156" watchObservedRunningTime="2026-09-10 18:00:01.129802201 +0000 UTC m=+1136.891110244"
Sep 10 18:00:02.119871 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:02.119832    2568 generic.go:356] "Generic (PLEG): container finished" podID="ba692344-381a-4c8e-ae90-55301e1a987c" containerID="a2fd2eb0c084555c087664f7031bf7afed5aac055577907fe19b4bb83a2474ec" exitCode=0
Sep 10 18:00:02.120382 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:02.119925    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817720-4fstp" event={"ID":"ba692344-381a-4c8e-ae90-55301e1a987c","Type":"ContainerDied","Data":"a2fd2eb0c084555c087664f7031bf7afed5aac055577907fe19b4bb83a2474ec"}
Sep 10 18:00:02.121761 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:02.121731    2568 generic.go:356] "Generic (PLEG): container finished" podID="39205419-8c70-468c-91e8-79a213ca575c" containerID="f70cfddef6d51c4e218be01a474cb5d6b77e244fc32a2608cdf9356671e012da" exitCode=7
Sep 10 18:00:02.121880 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:02.121792    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-971a94-29817720-j7cnl" event={"ID":"39205419-8c70-468c-91e8-79a213ca575c","Type":"ContainerDied","Data":"f70cfddef6d51c4e218be01a474cb5d6b77e244fc32a2608cdf9356671e012da"}
Sep 10 18:00:02.121947 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:02.121934    2568 scope.go:117] "RemoveContainer" containerID="f70cfddef6d51c4e218be01a474cb5d6b77e244fc32a2608cdf9356671e012da"
Sep 10 18:00:02.137064 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:02.136900    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-971a94-29817720-j7cnl" podStartSLOduration=2.136877654 podStartE2EDuration="2.136877654s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 18:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 18:00:01.145982075 +0000 UTC m=+1136.907290121" watchObservedRunningTime="2026-09-10 18:00:02.136877654 +0000 UTC m=+1137.898185698"
Sep 10 18:00:03.130775 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:03.130668    2568 generic.go:356] "Generic (PLEG): container finished" podID="39205419-8c70-468c-91e8-79a213ca575c" containerID="45161fd8e31a522bd1edfadc4808c1ca63cbeced3272699ba89c0954d55365b2" exitCode=7
Sep 10 18:00:03.130775 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:03.130759    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-971a94-29817720-j7cnl" event={"ID":"39205419-8c70-468c-91e8-79a213ca575c","Type":"ContainerDied","Data":"45161fd8e31a522bd1edfadc4808c1ca63cbeced3272699ba89c0954d55365b2"}
Sep 10 18:00:03.131273 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:03.130824    2568 scope.go:117] "RemoveContainer" containerID="f70cfddef6d51c4e218be01a474cb5d6b77e244fc32a2608cdf9356671e012da"
Sep 10 18:00:03.131273 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:03.131038    2568 scope.go:117] "RemoveContainer" containerID="45161fd8e31a522bd1edfadc4808c1ca63cbeced3272699ba89c0954d55365b2"
Sep 10 18:00:03.131626 ip-10-0-136-161 kubenswrapper[2568]: E0910 18:00:03.131317    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-shared-a-w2-971a94-29817720-j7cnl_odh-ai-gateway-infra(39205419-8c70-468c-91e8-79a213ca575c)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-971a94-29817720-j7cnl" podUID="39205419-8c70-468c-91e8-79a213ca575c"
Sep 10 18:00:03.287699 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:03.287660    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817720-4fstp"
Sep 10 18:00:04.138415 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:04.138389    2568 scope.go:117] "RemoveContainer" containerID="45161fd8e31a522bd1edfadc4808c1ca63cbeced3272699ba89c0954d55365b2"
Sep 10 18:00:04.138864 ip-10-0-136-161 kubenswrapper[2568]: E0910 18:00:04.138627    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-shared-a-w2-971a94-29817720-j7cnl_odh-ai-gateway-infra(39205419-8c70-468c-91e8-79a213ca575c)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-971a94-29817720-j7cnl" podUID="39205419-8c70-468c-91e8-79a213ca575c"
Sep 10 18:00:04.139565 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:04.139547    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817720-4fstp"
Sep 10 18:00:04.139659 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:04.139596    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817720-4fstp" event={"ID":"ba692344-381a-4c8e-ae90-55301e1a987c","Type":"ContainerDied","Data":"22da89b4d10661939d4e499277f1eefcd7a32b840df93d68e4f0b8215167ba02"}
Sep 10 18:00:04.139659 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:04.139640    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="22da89b4d10661939d4e499277f1eefcd7a32b840df93d68e4f0b8215167ba02"
Sep 10 18:00:06.076149 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:06.076113    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-fc23cf-585697849f-2mmq2"
Sep 10 18:00:06.076555 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:06.076192    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-fc23cf-85b74d754-qf7x8"
Sep 10 18:00:08.091257 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:08.091221    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-971a94-75b8ddcdff-jt78p"
Sep 10 18:00:16.764527 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:16.764495    2568 scope.go:117] "RemoveContainer" containerID="45161fd8e31a522bd1edfadc4808c1ca63cbeced3272699ba89c0954d55365b2"
Sep 10 18:00:17.224223 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:17.224174    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-971a94-29817720-j7cnl" event={"ID":"39205419-8c70-468c-91e8-79a213ca575c","Type":"ContainerStarted","Data":"e73a054d0dadef93575cb001fb341568815089187a69da221606540b7491623f"}
Sep 10 18:00:18.233190 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:18.233152    2568 generic.go:356] "Generic (PLEG): container finished" podID="39205419-8c70-468c-91e8-79a213ca575c" containerID="e73a054d0dadef93575cb001fb341568815089187a69da221606540b7491623f" exitCode=0
Sep 10 18:00:18.233640 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:18.233232    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-971a94-29817720-j7cnl" event={"ID":"39205419-8c70-468c-91e8-79a213ca575c","Type":"ContainerDied","Data":"e73a054d0dadef93575cb001fb341568815089187a69da221606540b7491623f"}
Sep 10 18:00:18.233640 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:18.233301    2568 scope.go:117] "RemoveContainer" containerID="45161fd8e31a522bd1edfadc4808c1ca63cbeced3272699ba89c0954d55365b2"
Sep 10 18:00:18.263136 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:18.263098    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-971a94-29817720-j7cnl"]
Sep 10 18:00:19.382880 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:19.382852    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-971a94-29817720-j7cnl"
Sep 10 18:00:20.250601 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:20.250566    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-971a94-29817720-j7cnl"
Sep 10 18:00:20.250601 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:20.250575    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-971a94-29817720-j7cnl" event={"ID":"39205419-8c70-468c-91e8-79a213ca575c","Type":"ContainerDied","Data":"7fbc5dae3ef19aca47804b19015e8ab878fefe0dc9e1670260ee9702a2c4b8cf"}
Sep 10 18:00:20.250833 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:20.250634    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7fbc5dae3ef19aca47804b19015e8ab878fefe0dc9e1670260ee9702a2c4b8cf"
Sep 10 18:00:20.295409 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:20.295367    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-971a94-29817720-j7cnl"]
Sep 10 18:00:20.302558 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:20.302523    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-971a94-29817720-j7cnl"]
Sep 10 18:00:20.770382 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:20.770345    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="39205419-8c70-468c-91e8-79a213ca575c" path="/var/lib/kubelet/pods/39205419-8c70-468c-91e8-79a213ca575c/volumes"
Sep 10 18:00:24.776536 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:24.776496    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-09fbb5-6786594459-n5znm"]
Sep 10 18:00:24.776956 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:24.776942    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39205419-8c70-468c-91e8-79a213ca575c" containerName="cleanup"
Sep 10 18:00:24.777000 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:24.776958    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="39205419-8c70-468c-91e8-79a213ca575c" containerName="cleanup"
Sep 10 18:00:24.777000 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:24.776974    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba692344-381a-4c8e-ae90-55301e1a987c" containerName="cleanup"
Sep 10 18:00:24.777000 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:24.776980    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba692344-381a-4c8e-ae90-55301e1a987c" containerName="cleanup"
Sep 10 18:00:24.777000 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:24.776996    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39205419-8c70-468c-91e8-79a213ca575c" containerName="cleanup"
Sep 10 18:00:24.777000 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:24.777002    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="39205419-8c70-468c-91e8-79a213ca575c" containerName="cleanup"
Sep 10 18:00:24.777153 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:24.777057    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba692344-381a-4c8e-ae90-55301e1a987c" containerName="cleanup"
Sep 10 18:00:24.777153 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:24.777065    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="39205419-8c70-468c-91e8-79a213ca575c" containerName="cleanup"
Sep 10 18:00:24.777153 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:24.777074    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="39205419-8c70-468c-91e8-79a213ca575c" containerName="cleanup"
Sep 10 18:00:24.780413 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:24.780383    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-09fbb5-6786594459-n5znm"
Sep 10 18:00:24.783744 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:24.783711    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w2-09fbb5-dockercfg-cjrpn\""
Sep 10 18:00:24.783936 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:24.783717    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w2-09fbb5\""
Sep 10 18:00:24.796424 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:24.796388    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-09fbb5-6786594459-n5znm"]
Sep 10 18:00:24.917822 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:24.917776    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmjx9\" (UniqueName: \"kubernetes.io/projected/0fd929f6-4ff9-40bb-97d8-90faf4b50b9e-kube-api-access-jmjx9\") pod \"payload-processing-e2e-shared-b-w2-09fbb5-6786594459-n5znm\" (UID: \"0fd929f6-4ff9-40bb-97d8-90faf4b50b9e\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-09fbb5-6786594459-n5znm"
Sep 10 18:00:24.918037 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:24.917852    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0fd929f6-4ff9-40bb-97d8-90faf4b50b9e-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-09fbb5-6786594459-n5znm\" (UID: \"0fd929f6-4ff9-40bb-97d8-90faf4b50b9e\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-09fbb5-6786594459-n5znm"
Sep 10 18:00:25.018590 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:25.018534    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0fd929f6-4ff9-40bb-97d8-90faf4b50b9e-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-09fbb5-6786594459-n5znm\" (UID: \"0fd929f6-4ff9-40bb-97d8-90faf4b50b9e\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-09fbb5-6786594459-n5znm"
Sep 10 18:00:25.018803 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:25.018677    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmjx9\" (UniqueName: \"kubernetes.io/projected/0fd929f6-4ff9-40bb-97d8-90faf4b50b9e-kube-api-access-jmjx9\") pod \"payload-processing-e2e-shared-b-w2-09fbb5-6786594459-n5znm\" (UID: \"0fd929f6-4ff9-40bb-97d8-90faf4b50b9e\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-09fbb5-6786594459-n5znm"
Sep 10 18:00:25.019299 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:25.019275    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0fd929f6-4ff9-40bb-97d8-90faf4b50b9e-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-09fbb5-6786594459-n5znm\" (UID: \"0fd929f6-4ff9-40bb-97d8-90faf4b50b9e\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-09fbb5-6786594459-n5znm"
Sep 10 18:00:25.031812 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:25.031740    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmjx9\" (UniqueName: \"kubernetes.io/projected/0fd929f6-4ff9-40bb-97d8-90faf4b50b9e-kube-api-access-jmjx9\") pod \"payload-processing-e2e-shared-b-w2-09fbb5-6786594459-n5znm\" (UID: \"0fd929f6-4ff9-40bb-97d8-90faf4b50b9e\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-09fbb5-6786594459-n5znm"
Sep 10 18:00:25.092589 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:25.092538    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-09fbb5-6786594459-n5znm"
Sep 10 18:00:25.380639 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:25.380614    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-09fbb5-6786594459-n5znm"]
Sep 10 18:00:25.383494 ip-10-0-136-161 kubenswrapper[2568]: W0910 18:00:25.383464    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fd929f6_4ff9_40bb_97d8_90faf4b50b9e.slice/crio-ea4b632382ccbe154da93087ed479704e0d0bdaccbc1dff837a597e868737cd3 WatchSource:0}: Error finding container ea4b632382ccbe154da93087ed479704e0d0bdaccbc1dff837a597e868737cd3: Status 404 returned error can't find the container with id ea4b632382ccbe154da93087ed479704e0d0bdaccbc1dff837a597e868737cd3
Sep 10 18:00:26.290453 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:26.290414    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-09fbb5-6786594459-n5znm" event={"ID":"0fd929f6-4ff9-40bb-97d8-90faf4b50b9e","Type":"ContainerStarted","Data":"b325941eccb4a3ddfdc25edc739f3d83350311d4719dc810732a3d2a5584a167"}
Sep 10 18:00:26.290877 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:26.290503    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-09fbb5-6786594459-n5znm" event={"ID":"0fd929f6-4ff9-40bb-97d8-90faf4b50b9e","Type":"ContainerStarted","Data":"ea4b632382ccbe154da93087ed479704e0d0bdaccbc1dff837a597e868737cd3"}
Sep 10 18:00:26.290877 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:26.290539    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-09fbb5-6786594459-n5znm"
Sep 10 18:00:26.314915 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:26.314851    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-09fbb5-6786594459-n5znm" podStartSLOduration=2.314834148 podStartE2EDuration="2.314834148s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 18:00:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 18:00:26.312388252 +0000 UTC m=+1162.073696295" watchObservedRunningTime="2026-09-10 18:00:26.314834148 +0000 UTC m=+1162.076142192"
Sep 10 18:00:37.298596 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:37.298507    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-09fbb5-6786594459-n5znm"
Sep 10 18:00:48.226156 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:48.226108    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7788-1b4f7b"]
Sep 10 18:00:48.226599 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:48.226545    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39205419-8c70-468c-91e8-79a213ca575c" containerName="cleanup"
Sep 10 18:00:48.226599 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:48.226558    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="39205419-8c70-468c-91e8-79a213ca575c" containerName="cleanup"
Sep 10 18:00:48.226673 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:48.226645    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="39205419-8c70-468c-91e8-79a213ca575c" containerName="cleanup"
Sep 10 18:00:48.229951 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:48.229926    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7788-1b4f7b"
Sep 10 18:00:48.232800 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:48.232773    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-r67rg\""
Sep 10 18:00:48.237437 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:48.237403    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7788-1b4f7b"]
Sep 10 18:00:48.329300 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:48.329247    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5qgf\" (UniqueName: \"kubernetes.io/projected/12bcd01b-1073-4d1e-b580-e314621c39d6-kube-api-access-h5qgf\") pod \"test-curl-7788-1b4f7b\" (UID: \"12bcd01b-1073-4d1e-b580-e314621c39d6\") " pod="opendatahub/test-curl-7788-1b4f7b"
Sep 10 18:00:48.429875 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:48.429832    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5qgf\" (UniqueName: \"kubernetes.io/projected/12bcd01b-1073-4d1e-b580-e314621c39d6-kube-api-access-h5qgf\") pod \"test-curl-7788-1b4f7b\" (UID: \"12bcd01b-1073-4d1e-b580-e314621c39d6\") " pod="opendatahub/test-curl-7788-1b4f7b"
Sep 10 18:00:48.438919 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:48.438886    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5qgf\" (UniqueName: \"kubernetes.io/projected/12bcd01b-1073-4d1e-b580-e314621c39d6-kube-api-access-h5qgf\") pod \"test-curl-7788-1b4f7b\" (UID: \"12bcd01b-1073-4d1e-b580-e314621c39d6\") " pod="opendatahub/test-curl-7788-1b4f7b"
Sep 10 18:00:48.542060 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:48.541958    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7788-1b4f7b"
Sep 10 18:00:48.856990 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:48.856959    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7788-1b4f7b"]
Sep 10 18:00:48.858737 ip-10-0-136-161 kubenswrapper[2568]: W0910 18:00:48.858710    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod12bcd01b_1073_4d1e_b580_e314621c39d6.slice/crio-ddaaab715d6e549793ff92b71e4c9222640a521ad8bad86ac1fc0ed660ba6a14 WatchSource:0}: Error finding container ddaaab715d6e549793ff92b71e4c9222640a521ad8bad86ac1fc0ed660ba6a14: Status 404 returned error can't find the container with id ddaaab715d6e549793ff92b71e4c9222640a521ad8bad86ac1fc0ed660ba6a14
Sep 10 18:00:49.438055 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:49.438018    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7788-1b4f7b" event={"ID":"12bcd01b-1073-4d1e-b580-e314621c39d6","Type":"ContainerStarted","Data":"86512166ddd8e4e4a1673b5fcd6922efa4858fd06947f6df1375c3f802de7cc7"}
Sep 10 18:00:49.438055 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:49.438062    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7788-1b4f7b" event={"ID":"12bcd01b-1073-4d1e-b580-e314621c39d6","Type":"ContainerStarted","Data":"ddaaab715d6e549793ff92b71e4c9222640a521ad8bad86ac1fc0ed660ba6a14"}
Sep 10 18:00:49.454207 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:49.454143    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7788-1b4f7b" podStartSLOduration=1.454124114 podStartE2EDuration="1.454124114s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 18:00:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 18:00:49.453939962 +0000 UTC m=+1185.215248006" watchObservedRunningTime="2026-09-10 18:00:49.454124114 +0000 UTC m=+1185.215432157"
Sep 10 18:00:50.076282 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:50.076245    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7788-1b4f7b"]
Sep 10 18:00:50.079076 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:50.079040    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7788-1b4f7b"]
Sep 10 18:00:50.197942 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:50.197833    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7788-17982d"]
Sep 10 18:00:50.198397 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:50.198376    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12bcd01b-1073-4d1e-b580-e314621c39d6" containerName="test-curl-7788-1b4f7b"
Sep 10 18:00:50.198505 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:50.198400    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="12bcd01b-1073-4d1e-b580-e314621c39d6" containerName="test-curl-7788-1b4f7b"
Sep 10 18:00:50.198569 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:50.198542    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="12bcd01b-1073-4d1e-b580-e314621c39d6" containerName="test-curl-7788-1b4f7b"
Sep 10 18:00:50.201809 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:50.201781    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7788-17982d"
Sep 10 18:00:50.211700 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:50.211667    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7788-17982d"]
Sep 10 18:00:50.246415 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:50.246372    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jct48\" (UniqueName: \"kubernetes.io/projected/3dc419d5-640a-4087-a929-6e6f919ca746-kube-api-access-jct48\") pod \"test-curl-7788-17982d\" (UID: \"3dc419d5-640a-4087-a929-6e6f919ca746\") " pod="opendatahub/test-curl-7788-17982d"
Sep 10 18:00:50.347146 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:50.347106    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jct48\" (UniqueName: \"kubernetes.io/projected/3dc419d5-640a-4087-a929-6e6f919ca746-kube-api-access-jct48\") pod \"test-curl-7788-17982d\" (UID: \"3dc419d5-640a-4087-a929-6e6f919ca746\") " pod="opendatahub/test-curl-7788-17982d"
Sep 10 18:00:50.356910 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:50.356868    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jct48\" (UniqueName: \"kubernetes.io/projected/3dc419d5-640a-4087-a929-6e6f919ca746-kube-api-access-jct48\") pod \"test-curl-7788-17982d\" (UID: \"3dc419d5-640a-4087-a929-6e6f919ca746\") " pod="opendatahub/test-curl-7788-17982d"
Sep 10 18:00:50.445565 ip-10-0-136-161 kubenswrapper[2568]: E0910 18:00:50.445527    2568 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7788-1b4f7b" container="test-curl-7788-1b4f7b"
Sep 10 18:00:50.513094 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:50.513053    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7788-17982d"
Sep 10 18:00:50.792864 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:50.792836    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7788-17982d"]
Sep 10 18:00:50.794863 ip-10-0-136-161 kubenswrapper[2568]: W0910 18:00:50.794834    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3dc419d5_640a_4087_a929_6e6f919ca746.slice/crio-f35ab58674d27fefb587f87153e808ebefc7bf8b2535d4e54a11122acf93d3f0 WatchSource:0}: Error finding container f35ab58674d27fefb587f87153e808ebefc7bf8b2535d4e54a11122acf93d3f0: Status 404 returned error can't find the container with id f35ab58674d27fefb587f87153e808ebefc7bf8b2535d4e54a11122acf93d3f0
Sep 10 18:00:51.455754 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:51.455720    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7788-17982d" event={"ID":"3dc419d5-640a-4087-a929-6e6f919ca746","Type":"ContainerStarted","Data":"fcef7de8594370801cab2d19bd31b4103ebb0a23d2f4b7a563b2a462d0cfb85c"}
Sep 10 18:00:51.456279 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:51.455776    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7788-17982d" event={"ID":"3dc419d5-640a-4087-a929-6e6f919ca746","Type":"ContainerStarted","Data":"f35ab58674d27fefb587f87153e808ebefc7bf8b2535d4e54a11122acf93d3f0"}
Sep 10 18:00:51.456279 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:51.455824    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7788-1b4f7b" podUID="12bcd01b-1073-4d1e-b580-e314621c39d6" containerName="test-curl-7788-1b4f7b" containerID="cri-o://86512166ddd8e4e4a1673b5fcd6922efa4858fd06947f6df1375c3f802de7cc7" gracePeriod=2
Sep 10 18:00:51.475605 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:51.475548    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7788-17982d" podStartSLOduration=1.475529078 podStartE2EDuration="1.475529078s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 18:00:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 18:00:51.473044535 +0000 UTC m=+1187.234352582" watchObservedRunningTime="2026-09-10 18:00:51.475529078 +0000 UTC m=+1187.236837123"
Sep 10 18:00:52.133154 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:52.133110    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7788-17982d"]
Sep 10 18:00:52.144109 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:52.144009    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7788-17982d"]
Sep 10 18:00:52.260825 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:52.260775    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7788-f797d4"]
Sep 10 18:00:52.261240 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:52.261224    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3dc419d5-640a-4087-a929-6e6f919ca746" containerName="test-curl-7788-17982d"
Sep 10 18:00:52.261240 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:52.261240    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="3dc419d5-640a-4087-a929-6e6f919ca746" containerName="test-curl-7788-17982d"
Sep 10 18:00:52.261384 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:52.261307    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="3dc419d5-640a-4087-a929-6e6f919ca746" containerName="test-curl-7788-17982d"
Sep 10 18:00:52.264613 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:52.264586    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7788-f797d4"
Sep 10 18:00:52.282825 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:52.281229    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7788-f797d4"]
Sep 10 18:00:52.365135 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:52.365084    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmxv7\" (UniqueName: \"kubernetes.io/projected/eab7ba41-4950-4eb1-99ae-194045c21695-kube-api-access-mmxv7\") pod \"test-curl-7788-f797d4\" (UID: \"eab7ba41-4950-4eb1-99ae-194045c21695\") " pod="opendatahub/test-curl-7788-f797d4"
Sep 10 18:00:52.461975 ip-10-0-136-161 kubenswrapper[2568]: E0910 18:00:52.461885    2568 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7788-17982d" container="test-curl-7788-17982d"
Sep 10 18:00:52.465795 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:52.465756    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmxv7\" (UniqueName: \"kubernetes.io/projected/eab7ba41-4950-4eb1-99ae-194045c21695-kube-api-access-mmxv7\") pod \"test-curl-7788-f797d4\" (UID: \"eab7ba41-4950-4eb1-99ae-194045c21695\") " pod="opendatahub/test-curl-7788-f797d4"
Sep 10 18:00:52.476343 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:52.476280    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmxv7\" (UniqueName: \"kubernetes.io/projected/eab7ba41-4950-4eb1-99ae-194045c21695-kube-api-access-mmxv7\") pod \"test-curl-7788-f797d4\" (UID: \"eab7ba41-4950-4eb1-99ae-194045c21695\") " pod="opendatahub/test-curl-7788-f797d4"
Sep 10 18:00:52.586772 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:52.586733    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7788-f797d4"
Sep 10 18:00:52.859800 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:52.859769    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7788-f797d4"]
Sep 10 18:00:52.861313 ip-10-0-136-161 kubenswrapper[2568]: W0910 18:00:52.861282    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeab7ba41_4950_4eb1_99ae_194045c21695.slice/crio-e910885dc684a71bdad489fb6f27c4b2a937f5bd19c15db3de863de091cc6f59 WatchSource:0}: Error finding container e910885dc684a71bdad489fb6f27c4b2a937f5bd19c15db3de863de091cc6f59: Status 404 returned error can't find the container with id e910885dc684a71bdad489fb6f27c4b2a937f5bd19c15db3de863de091cc6f59
Sep 10 18:00:53.470142 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:53.470101    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7788-f797d4" event={"ID":"eab7ba41-4950-4eb1-99ae-194045c21695","Type":"ContainerStarted","Data":"996da1b24ea1fad6fe45ae0617f2d5b2ee6603fae9f2e030885243eb5b4472fa"}
Sep 10 18:00:53.470600 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:53.470157    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7788-f797d4" event={"ID":"eab7ba41-4950-4eb1-99ae-194045c21695","Type":"ContainerStarted","Data":"e910885dc684a71bdad489fb6f27c4b2a937f5bd19c15db3de863de091cc6f59"}
Sep 10 18:00:53.470600 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:53.470228    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7788-17982d" podUID="3dc419d5-640a-4087-a929-6e6f919ca746" containerName="test-curl-7788-17982d" containerID="cri-o://fcef7de8594370801cab2d19bd31b4103ebb0a23d2f4b7a563b2a462d0cfb85c" gracePeriod=2
Sep 10 18:00:53.488635 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:53.488573    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7788-f797d4" podStartSLOduration=1.488554016 podStartE2EDuration="1.488554016s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 18:00:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 18:00:53.48634943 +0000 UTC m=+1189.247657476" watchObservedRunningTime="2026-09-10 18:00:53.488554016 +0000 UTC m=+1189.249862058"
Sep 10 18:00:53.647481 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:53.647447    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7788-1b4f7b"
Sep 10 18:00:53.777752 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:53.777714    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h5qgf\" (UniqueName: \"kubernetes.io/projected/12bcd01b-1073-4d1e-b580-e314621c39d6-kube-api-access-h5qgf\") pod \"12bcd01b-1073-4d1e-b580-e314621c39d6\" (UID: \"12bcd01b-1073-4d1e-b580-e314621c39d6\") "
Sep 10 18:00:53.779912 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:53.779872    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12bcd01b-1073-4d1e-b580-e314621c39d6-kube-api-access-h5qgf" (OuterVolumeSpecName: "kube-api-access-h5qgf") pod "12bcd01b-1073-4d1e-b580-e314621c39d6" (UID: "12bcd01b-1073-4d1e-b580-e314621c39d6"). InnerVolumeSpecName "kube-api-access-h5qgf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 18:00:53.879425 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:53.879391    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h5qgf\" (UniqueName: \"kubernetes.io/projected/12bcd01b-1073-4d1e-b580-e314621c39d6-kube-api-access-h5qgf\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 18:00:54.084963 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:54.084853    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7788-f797d4"]
Sep 10 18:00:54.091345 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:54.091278    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7788-f797d4"]
Sep 10 18:00:54.210458 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:54.210417    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7788-729f63"]
Sep 10 18:00:54.210840 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:54.210826    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eab7ba41-4950-4eb1-99ae-194045c21695" containerName="test-curl-7788-f797d4"
Sep 10 18:00:54.210898 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:54.210842    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="eab7ba41-4950-4eb1-99ae-194045c21695" containerName="test-curl-7788-f797d4"
Sep 10 18:00:54.210938 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:54.210914    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="eab7ba41-4950-4eb1-99ae-194045c21695" containerName="test-curl-7788-f797d4"
Sep 10 18:00:54.214121 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:54.214099    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7788-729f63"
Sep 10 18:00:54.221764 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:54.221660    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7788-729f63"]
Sep 10 18:00:54.284146 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:54.284104    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vpm77\" (UniqueName: \"kubernetes.io/projected/01009f1d-5d45-4261-b0eb-48063841e35a-kube-api-access-vpm77\") pod \"test-curl-7788-729f63\" (UID: \"01009f1d-5d45-4261-b0eb-48063841e35a\") " pod="opendatahub/test-curl-7788-729f63"
Sep 10 18:00:54.384984 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:54.384883    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vpm77\" (UniqueName: \"kubernetes.io/projected/01009f1d-5d45-4261-b0eb-48063841e35a-kube-api-access-vpm77\") pod \"test-curl-7788-729f63\" (UID: \"01009f1d-5d45-4261-b0eb-48063841e35a\") " pod="opendatahub/test-curl-7788-729f63"
Sep 10 18:00:54.394260 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:54.394221    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vpm77\" (UniqueName: \"kubernetes.io/projected/01009f1d-5d45-4261-b0eb-48063841e35a-kube-api-access-vpm77\") pod \"test-curl-7788-729f63\" (UID: \"01009f1d-5d45-4261-b0eb-48063841e35a\") " pod="opendatahub/test-curl-7788-729f63"
Sep 10 18:00:54.477144 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:54.477109    2568 generic.go:356] "Generic (PLEG): container finished" podID="12bcd01b-1073-4d1e-b580-e314621c39d6" containerID="86512166ddd8e4e4a1673b5fcd6922efa4858fd06947f6df1375c3f802de7cc7" exitCode=137
Sep 10 18:00:54.477532 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:54.477153    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7788-1b4f7b"
Sep 10 18:00:54.477532 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:54.477214    2568 scope.go:117] "RemoveContainer" containerID="86512166ddd8e4e4a1673b5fcd6922efa4858fd06947f6df1375c3f802de7cc7"
Sep 10 18:00:54.477697 ip-10-0-136-161 kubenswrapper[2568]: E0910 18:00:54.477537    2568 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7788-f797d4" container="test-curl-7788-f797d4"
Sep 10 18:00:54.487244 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:54.487221    2568 scope.go:117] "RemoveContainer" containerID="86512166ddd8e4e4a1673b5fcd6922efa4858fd06947f6df1375c3f802de7cc7"
Sep 10 18:00:54.487586 ip-10-0-136-161 kubenswrapper[2568]: E0910 18:00:54.487563    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86512166ddd8e4e4a1673b5fcd6922efa4858fd06947f6df1375c3f802de7cc7\": container with ID starting with 86512166ddd8e4e4a1673b5fcd6922efa4858fd06947f6df1375c3f802de7cc7 not found: ID does not exist" containerID="86512166ddd8e4e4a1673b5fcd6922efa4858fd06947f6df1375c3f802de7cc7"
Sep 10 18:00:54.487660 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:54.487596    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86512166ddd8e4e4a1673b5fcd6922efa4858fd06947f6df1375c3f802de7cc7"} err="failed to get container status \"86512166ddd8e4e4a1673b5fcd6922efa4858fd06947f6df1375c3f802de7cc7\": rpc error: code = NotFound desc = could not find container \"86512166ddd8e4e4a1673b5fcd6922efa4858fd06947f6df1375c3f802de7cc7\": container with ID starting with 86512166ddd8e4e4a1673b5fcd6922efa4858fd06947f6df1375c3f802de7cc7 not found: ID does not exist"
Sep 10 18:00:54.488683 ip-10-0-136-161 kubenswrapper[2568]: E0910 18:00:54.488653    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7788-1b4f7b\" is forbidden: User \"system:node:ip-10-0-136-161.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-161.ec2.internal' and this object" podUID="12bcd01b-1073-4d1e-b580-e314621c39d6" pod="opendatahub/test-curl-7788-1b4f7b"
Sep 10 18:00:54.525040 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:54.525007    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7788-729f63"
Sep 10 18:00:54.769944 ip-10-0-136-161 kubenswrapper[2568]: E0910 18:00:54.769907    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7788-1b4f7b\" is forbidden: User \"system:node:ip-10-0-136-161.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-161.ec2.internal' and this object" podUID="12bcd01b-1073-4d1e-b580-e314621c39d6" pod="opendatahub/test-curl-7788-1b4f7b"
Sep 10 18:00:54.771062 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:54.771031    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12bcd01b-1073-4d1e-b580-e314621c39d6" path="/var/lib/kubelet/pods/12bcd01b-1073-4d1e-b580-e314621c39d6/volumes"
Sep 10 18:00:54.800561 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:54.800531    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7788-729f63"]
Sep 10 18:00:54.802597 ip-10-0-136-161 kubenswrapper[2568]: W0910 18:00:54.802566    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod01009f1d_5d45_4261_b0eb_48063841e35a.slice/crio-5a48bbdbb0a84d30ae81b63b17cd3d770f914fbcbc2edd8d7a33126afd58b37c WatchSource:0}: Error finding container 5a48bbdbb0a84d30ae81b63b17cd3d770f914fbcbc2edd8d7a33126afd58b37c: Status 404 returned error can't find the container with id 5a48bbdbb0a84d30ae81b63b17cd3d770f914fbcbc2edd8d7a33126afd58b37c
Sep 10 18:00:54.892119 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:54.892083    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-fc23cf/auth-test-model-fc23cf-kserve-957f7bf87-bb26m"]
Sep 10 18:00:54.895745 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:54.895717    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-fc23cf/auth-test-model-fc23cf-kserve-957f7bf87-bb26m"
Sep 10 18:00:54.900667 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:54.900638    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-fc23cf\"/\"kube-root-ca.crt\""
Sep 10 18:00:54.900814 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:54.900677    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-fc23cf\"/\"auth-test-model-fc23cf-kserve-self-signed-certs\""
Sep 10 18:00:54.900932 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:54.900853    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-fc23cf\"/\"openshift-service-ca.crt\""
Sep 10 18:00:54.900992 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:54.900945    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-fc23cf\"/\"default-dockercfg-svv2h\""
Sep 10 18:00:54.916277 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:54.916239    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-fc23cf/auth-test-model-fc23cf-kserve-957f7bf87-bb26m"]
Sep 10 18:00:54.991315 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:54.991269    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8ba37b4-4658-4077-ad42-327a6454b02a-tmp-dir\") pod \"auth-test-model-fc23cf-kserve-957f7bf87-bb26m\" (UID: \"d8ba37b4-4658-4077-ad42-327a6454b02a\") " pod="ai-tenant-e2e-shared-b-w3-fc23cf/auth-test-model-fc23cf-kserve-957f7bf87-bb26m"
Sep 10 18:00:54.991545 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:54.991359    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lssmh\" (UniqueName: \"kubernetes.io/projected/d8ba37b4-4658-4077-ad42-327a6454b02a-kube-api-access-lssmh\") pod \"auth-test-model-fc23cf-kserve-957f7bf87-bb26m\" (UID: \"d8ba37b4-4658-4077-ad42-327a6454b02a\") " pod="ai-tenant-e2e-shared-b-w3-fc23cf/auth-test-model-fc23cf-kserve-957f7bf87-bb26m"
Sep 10 18:00:54.991545 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:54.991401    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d8ba37b4-4658-4077-ad42-327a6454b02a-tls-certs\") pod \"auth-test-model-fc23cf-kserve-957f7bf87-bb26m\" (UID: \"d8ba37b4-4658-4077-ad42-327a6454b02a\") " pod="ai-tenant-e2e-shared-b-w3-fc23cf/auth-test-model-fc23cf-kserve-957f7bf87-bb26m"
Sep 10 18:00:54.991545 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:54.991432    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d8ba37b4-4658-4077-ad42-327a6454b02a-model-cache\") pod \"auth-test-model-fc23cf-kserve-957f7bf87-bb26m\" (UID: \"d8ba37b4-4658-4077-ad42-327a6454b02a\") " pod="ai-tenant-e2e-shared-b-w3-fc23cf/auth-test-model-fc23cf-kserve-957f7bf87-bb26m"
Sep 10 18:00:54.991545 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:54.991468    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d8ba37b4-4658-4077-ad42-327a6454b02a-home\") pod \"auth-test-model-fc23cf-kserve-957f7bf87-bb26m\" (UID: \"d8ba37b4-4658-4077-ad42-327a6454b02a\") " pod="ai-tenant-e2e-shared-b-w3-fc23cf/auth-test-model-fc23cf-kserve-957f7bf87-bb26m"
Sep 10 18:00:54.991545 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:54.991488    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d8ba37b4-4658-4077-ad42-327a6454b02a-dshm\") pod \"auth-test-model-fc23cf-kserve-957f7bf87-bb26m\" (UID: \"d8ba37b4-4658-4077-ad42-327a6454b02a\") " pod="ai-tenant-e2e-shared-b-w3-fc23cf/auth-test-model-fc23cf-kserve-957f7bf87-bb26m"
Sep 10 18:00:55.092163 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:55.092072    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d8ba37b4-4658-4077-ad42-327a6454b02a-tls-certs\") pod \"auth-test-model-fc23cf-kserve-957f7bf87-bb26m\" (UID: \"d8ba37b4-4658-4077-ad42-327a6454b02a\") " pod="ai-tenant-e2e-shared-b-w3-fc23cf/auth-test-model-fc23cf-kserve-957f7bf87-bb26m"
Sep 10 18:00:55.092163 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:55.092122    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d8ba37b4-4658-4077-ad42-327a6454b02a-model-cache\") pod \"auth-test-model-fc23cf-kserve-957f7bf87-bb26m\" (UID: \"d8ba37b4-4658-4077-ad42-327a6454b02a\") " pod="ai-tenant-e2e-shared-b-w3-fc23cf/auth-test-model-fc23cf-kserve-957f7bf87-bb26m"
Sep 10 18:00:55.092163 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:55.092159    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d8ba37b4-4658-4077-ad42-327a6454b02a-home\") pod \"auth-test-model-fc23cf-kserve-957f7bf87-bb26m\" (UID: \"d8ba37b4-4658-4077-ad42-327a6454b02a\") " pod="ai-tenant-e2e-shared-b-w3-fc23cf/auth-test-model-fc23cf-kserve-957f7bf87-bb26m"
Sep 10 18:00:55.092483 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:55.092180    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d8ba37b4-4658-4077-ad42-327a6454b02a-dshm\") pod \"auth-test-model-fc23cf-kserve-957f7bf87-bb26m\" (UID: \"d8ba37b4-4658-4077-ad42-327a6454b02a\") " pod="ai-tenant-e2e-shared-b-w3-fc23cf/auth-test-model-fc23cf-kserve-957f7bf87-bb26m"
Sep 10 18:00:55.092483 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:55.092202    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8ba37b4-4658-4077-ad42-327a6454b02a-tmp-dir\") pod \"auth-test-model-fc23cf-kserve-957f7bf87-bb26m\" (UID: \"d8ba37b4-4658-4077-ad42-327a6454b02a\") " pod="ai-tenant-e2e-shared-b-w3-fc23cf/auth-test-model-fc23cf-kserve-957f7bf87-bb26m"
Sep 10 18:00:55.092483 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:55.092227    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lssmh\" (UniqueName: \"kubernetes.io/projected/d8ba37b4-4658-4077-ad42-327a6454b02a-kube-api-access-lssmh\") pod \"auth-test-model-fc23cf-kserve-957f7bf87-bb26m\" (UID: \"d8ba37b4-4658-4077-ad42-327a6454b02a\") " pod="ai-tenant-e2e-shared-b-w3-fc23cf/auth-test-model-fc23cf-kserve-957f7bf87-bb26m"
Sep 10 18:00:55.092694 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:55.092640    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d8ba37b4-4658-4077-ad42-327a6454b02a-home\") pod \"auth-test-model-fc23cf-kserve-957f7bf87-bb26m\" (UID: \"d8ba37b4-4658-4077-ad42-327a6454b02a\") " pod="ai-tenant-e2e-shared-b-w3-fc23cf/auth-test-model-fc23cf-kserve-957f7bf87-bb26m"
Sep 10 18:00:55.092820 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:55.092715    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8ba37b4-4658-4077-ad42-327a6454b02a-tmp-dir\") pod \"auth-test-model-fc23cf-kserve-957f7bf87-bb26m\" (UID: \"d8ba37b4-4658-4077-ad42-327a6454b02a\") " pod="ai-tenant-e2e-shared-b-w3-fc23cf/auth-test-model-fc23cf-kserve-957f7bf87-bb26m"
Sep 10 18:00:55.092820 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:55.092809    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d8ba37b4-4658-4077-ad42-327a6454b02a-model-cache\") pod \"auth-test-model-fc23cf-kserve-957f7bf87-bb26m\" (UID: \"d8ba37b4-4658-4077-ad42-327a6454b02a\") " pod="ai-tenant-e2e-shared-b-w3-fc23cf/auth-test-model-fc23cf-kserve-957f7bf87-bb26m"
Sep 10 18:00:55.094647 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:55.094619    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d8ba37b4-4658-4077-ad42-327a6454b02a-dshm\") pod \"auth-test-model-fc23cf-kserve-957f7bf87-bb26m\" (UID: \"d8ba37b4-4658-4077-ad42-327a6454b02a\") " pod="ai-tenant-e2e-shared-b-w3-fc23cf/auth-test-model-fc23cf-kserve-957f7bf87-bb26m"
Sep 10 18:00:55.094817 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:55.094801    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d8ba37b4-4658-4077-ad42-327a6454b02a-tls-certs\") pod \"auth-test-model-fc23cf-kserve-957f7bf87-bb26m\" (UID: \"d8ba37b4-4658-4077-ad42-327a6454b02a\") " pod="ai-tenant-e2e-shared-b-w3-fc23cf/auth-test-model-fc23cf-kserve-957f7bf87-bb26m"
Sep 10 18:00:55.102340 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:55.102293    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lssmh\" (UniqueName: \"kubernetes.io/projected/d8ba37b4-4658-4077-ad42-327a6454b02a-kube-api-access-lssmh\") pod \"auth-test-model-fc23cf-kserve-957f7bf87-bb26m\" (UID: \"d8ba37b4-4658-4077-ad42-327a6454b02a\") " pod="ai-tenant-e2e-shared-b-w3-fc23cf/auth-test-model-fc23cf-kserve-957f7bf87-bb26m"
Sep 10 18:00:55.205651 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:55.205621    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-fc23cf/auth-test-model-fc23cf-kserve-957f7bf87-bb26m"
Sep 10 18:00:55.486036 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:55.485995    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7788-729f63" event={"ID":"01009f1d-5d45-4261-b0eb-48063841e35a","Type":"ContainerStarted","Data":"3fe269ccec1b29fc7c77d2f78813c519c24a84e9dd1af09dfee679a9359f7d68"}
Sep 10 18:00:55.486527 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:55.486055    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7788-729f63" event={"ID":"01009f1d-5d45-4261-b0eb-48063841e35a","Type":"ContainerStarted","Data":"5a48bbdbb0a84d30ae81b63b17cd3d770f914fbcbc2edd8d7a33126afd58b37c"}
Sep 10 18:00:55.487222 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:55.487194    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7788-f797d4" podUID="eab7ba41-4950-4eb1-99ae-194045c21695" containerName="test-curl-7788-f797d4" containerID="cri-o://996da1b24ea1fad6fe45ae0617f2d5b2ee6603fae9f2e030885243eb5b4472fa" gracePeriod=2
Sep 10 18:00:55.492380 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:55.492352    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-fc23cf/auth-test-model-fc23cf-kserve-957f7bf87-bb26m"]
Sep 10 18:00:55.503412 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:55.503362    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7788-729f63" podStartSLOduration=1.5033435019999999 podStartE2EDuration="1.503343502s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 18:00:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 18:00:55.501811655 +0000 UTC m=+1191.263119698" watchObservedRunningTime="2026-09-10 18:00:55.503343502 +0000 UTC m=+1191.264651538"
Sep 10 18:00:55.532374 ip-10-0-136-161 kubenswrapper[2568]: W0910 18:00:55.532334    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd8ba37b4_4658_4077_ad42_327a6454b02a.slice/crio-346f20a06ef68003711510c858054bebfb2709abe1b55b7d94303e6dceaf82dd WatchSource:0}: Error finding container 346f20a06ef68003711510c858054bebfb2709abe1b55b7d94303e6dceaf82dd: Status 404 returned error can't find the container with id 346f20a06ef68003711510c858054bebfb2709abe1b55b7d94303e6dceaf82dd
Sep 10 18:00:55.668958 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:55.668916    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7788-17982d"
Sep 10 18:00:55.798233 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:55.798191    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jct48\" (UniqueName: \"kubernetes.io/projected/3dc419d5-640a-4087-a929-6e6f919ca746-kube-api-access-jct48\") pod \"3dc419d5-640a-4087-a929-6e6f919ca746\" (UID: \"3dc419d5-640a-4087-a929-6e6f919ca746\") "
Sep 10 18:00:55.800464 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:55.800419    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3dc419d5-640a-4087-a929-6e6f919ca746-kube-api-access-jct48" (OuterVolumeSpecName: "kube-api-access-jct48") pod "3dc419d5-640a-4087-a929-6e6f919ca746" (UID: "3dc419d5-640a-4087-a929-6e6f919ca746"). InnerVolumeSpecName "kube-api-access-jct48". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 18:00:55.899391 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:55.899354    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jct48\" (UniqueName: \"kubernetes.io/projected/3dc419d5-640a-4087-a929-6e6f919ca746-kube-api-access-jct48\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 18:00:56.102364 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:56.102256    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7788-729f63"]
Sep 10 18:00:56.107332 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:56.107285    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7788-729f63"]
Sep 10 18:00:56.496137 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:56.496097    2568 generic.go:356] "Generic (PLEG): container finished" podID="3dc419d5-640a-4087-a929-6e6f919ca746" containerID="fcef7de8594370801cab2d19bd31b4103ebb0a23d2f4b7a563b2a462d0cfb85c" exitCode=137
Sep 10 18:00:56.496640 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:56.496141    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7788-17982d"
Sep 10 18:00:56.496640 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:56.496194    2568 scope.go:117] "RemoveContainer" containerID="fcef7de8594370801cab2d19bd31b4103ebb0a23d2f4b7a563b2a462d0cfb85c"
Sep 10 18:00:56.498281 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:56.498253    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-fc23cf/auth-test-model-fc23cf-kserve-957f7bf87-bb26m" event={"ID":"d8ba37b4-4658-4077-ad42-327a6454b02a","Type":"ContainerStarted","Data":"e21975e3f3437a56e7cc7eecae78468151a01ed9106ed3728c8f4f4078654a1c"}
Sep 10 18:00:56.498439 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:56.498303    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-fc23cf/auth-test-model-fc23cf-kserve-957f7bf87-bb26m" event={"ID":"d8ba37b4-4658-4077-ad42-327a6454b02a","Type":"ContainerStarted","Data":"346f20a06ef68003711510c858054bebfb2709abe1b55b7d94303e6dceaf82dd"}
Sep 10 18:00:56.498522 ip-10-0-136-161 kubenswrapper[2568]: E0910 18:00:56.498503    2568 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7788-729f63" container="test-curl-7788-729f63"
Sep 10 18:00:56.508027 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:56.507992    2568 scope.go:117] "RemoveContainer" containerID="fcef7de8594370801cab2d19bd31b4103ebb0a23d2f4b7a563b2a462d0cfb85c"
Sep 10 18:00:56.508432 ip-10-0-136-161 kubenswrapper[2568]: E0910 18:00:56.508400    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fcef7de8594370801cab2d19bd31b4103ebb0a23d2f4b7a563b2a462d0cfb85c\": container with ID starting with fcef7de8594370801cab2d19bd31b4103ebb0a23d2f4b7a563b2a462d0cfb85c not found: ID does not exist" containerID="fcef7de8594370801cab2d19bd31b4103ebb0a23d2f4b7a563b2a462d0cfb85c"
Sep 10 18:00:56.508519 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:56.508440    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fcef7de8594370801cab2d19bd31b4103ebb0a23d2f4b7a563b2a462d0cfb85c"} err="failed to get container status \"fcef7de8594370801cab2d19bd31b4103ebb0a23d2f4b7a563b2a462d0cfb85c\": rpc error: code = NotFound desc = could not find container \"fcef7de8594370801cab2d19bd31b4103ebb0a23d2f4b7a563b2a462d0cfb85c\": container with ID starting with fcef7de8594370801cab2d19bd31b4103ebb0a23d2f4b7a563b2a462d0cfb85c not found: ID does not exist"
Sep 10 18:00:56.518538 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:56.518482    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-fc23cf/auth-test-model-fc23cf-kserve-957f7bf87-bb26m" podStartSLOduration=2.518459907 podStartE2EDuration="2.518459907s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 18:00:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 18:00:56.517050398 +0000 UTC m=+1192.278358465" watchObservedRunningTime="2026-09-10 18:00:56.518459907 +0000 UTC m=+1192.279767950"
Sep 10 18:00:56.519444 ip-10-0-136-161 kubenswrapper[2568]: E0910 18:00:56.519407    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7788-17982d\" is forbidden: User \"system:node:ip-10-0-136-161.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-161.ec2.internal' and this object" podUID="3dc419d5-640a-4087-a929-6e6f919ca746" pod="opendatahub/test-curl-7788-17982d"
Sep 10 18:00:56.771137 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:56.771043    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3dc419d5-640a-4087-a929-6e6f919ca746" path="/var/lib/kubelet/pods/3dc419d5-640a-4087-a929-6e6f919ca746/volumes"
Sep 10 18:00:57.506111 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:57.506081    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7788-729f63" podUID="01009f1d-5d45-4261-b0eb-48063841e35a" containerName="test-curl-7788-729f63" containerID="cri-o://3fe269ccec1b29fc7c77d2f78813c519c24a84e9dd1af09dfee679a9359f7d68" gracePeriod=2
Sep 10 18:00:57.679231 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:57.679190    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7788-f797d4"
Sep 10 18:00:57.715286 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:57.715243    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mmxv7\" (UniqueName: \"kubernetes.io/projected/eab7ba41-4950-4eb1-99ae-194045c21695-kube-api-access-mmxv7\") pod \"eab7ba41-4950-4eb1-99ae-194045c21695\" (UID: \"eab7ba41-4950-4eb1-99ae-194045c21695\") "
Sep 10 18:00:57.717581 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:57.717555    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eab7ba41-4950-4eb1-99ae-194045c21695-kube-api-access-mmxv7" (OuterVolumeSpecName: "kube-api-access-mmxv7") pod "eab7ba41-4950-4eb1-99ae-194045c21695" (UID: "eab7ba41-4950-4eb1-99ae-194045c21695"). InnerVolumeSpecName "kube-api-access-mmxv7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 18:00:57.816912 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:57.816818    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mmxv7\" (UniqueName: \"kubernetes.io/projected/eab7ba41-4950-4eb1-99ae-194045c21695-kube-api-access-mmxv7\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 18:00:58.513861 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:58.513820    2568 generic.go:356] "Generic (PLEG): container finished" podID="eab7ba41-4950-4eb1-99ae-194045c21695" containerID="996da1b24ea1fad6fe45ae0617f2d5b2ee6603fae9f2e030885243eb5b4472fa" exitCode=137
Sep 10 18:00:58.514386 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:58.513870    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7788-f797d4"
Sep 10 18:00:58.514386 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:58.513917    2568 scope.go:117] "RemoveContainer" containerID="996da1b24ea1fad6fe45ae0617f2d5b2ee6603fae9f2e030885243eb5b4472fa"
Sep 10 18:00:58.524184 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:58.524161    2568 scope.go:117] "RemoveContainer" containerID="996da1b24ea1fad6fe45ae0617f2d5b2ee6603fae9f2e030885243eb5b4472fa"
Sep 10 18:00:58.524576 ip-10-0-136-161 kubenswrapper[2568]: E0910 18:00:58.524553    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"996da1b24ea1fad6fe45ae0617f2d5b2ee6603fae9f2e030885243eb5b4472fa\": container with ID starting with 996da1b24ea1fad6fe45ae0617f2d5b2ee6603fae9f2e030885243eb5b4472fa not found: ID does not exist" containerID="996da1b24ea1fad6fe45ae0617f2d5b2ee6603fae9f2e030885243eb5b4472fa"
Sep 10 18:00:58.524660 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:58.524586    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"996da1b24ea1fad6fe45ae0617f2d5b2ee6603fae9f2e030885243eb5b4472fa"} err="failed to get container status \"996da1b24ea1fad6fe45ae0617f2d5b2ee6603fae9f2e030885243eb5b4472fa\": rpc error: code = NotFound desc = could not find container \"996da1b24ea1fad6fe45ae0617f2d5b2ee6603fae9f2e030885243eb5b4472fa\": container with ID starting with 996da1b24ea1fad6fe45ae0617f2d5b2ee6603fae9f2e030885243eb5b4472fa not found: ID does not exist"
Sep 10 18:00:58.524961 ip-10-0-136-161 kubenswrapper[2568]: E0910 18:00:58.524929    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7788-f797d4\" is forbidden: User \"system:node:ip-10-0-136-161.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-161.ec2.internal' and this object" podUID="eab7ba41-4950-4eb1-99ae-194045c21695" pod="opendatahub/test-curl-7788-f797d4"
Sep 10 18:00:58.772293 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:58.772204    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eab7ba41-4950-4eb1-99ae-194045c21695" path="/var/lib/kubelet/pods/eab7ba41-4950-4eb1-99ae-194045c21695/volumes"
Sep 10 18:00:59.683790 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:59.683750    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7788-729f63"
Sep 10 18:00:59.734476 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:59.734432    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vpm77\" (UniqueName: \"kubernetes.io/projected/01009f1d-5d45-4261-b0eb-48063841e35a-kube-api-access-vpm77\") pod \"01009f1d-5d45-4261-b0eb-48063841e35a\" (UID: \"01009f1d-5d45-4261-b0eb-48063841e35a\") "
Sep 10 18:00:59.736702 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:59.736664    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01009f1d-5d45-4261-b0eb-48063841e35a-kube-api-access-vpm77" (OuterVolumeSpecName: "kube-api-access-vpm77") pod "01009f1d-5d45-4261-b0eb-48063841e35a" (UID: "01009f1d-5d45-4261-b0eb-48063841e35a"). InnerVolumeSpecName "kube-api-access-vpm77". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 18:00:59.836066 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:00:59.835975    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vpm77\" (UniqueName: \"kubernetes.io/projected/01009f1d-5d45-4261-b0eb-48063841e35a-kube-api-access-vpm77\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 18:01:00.529585 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:01:00.529545    2568 generic.go:356] "Generic (PLEG): container finished" podID="01009f1d-5d45-4261-b0eb-48063841e35a" containerID="3fe269ccec1b29fc7c77d2f78813c519c24a84e9dd1af09dfee679a9359f7d68" exitCode=137
Sep 10 18:01:00.529799 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:01:00.529601    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7788-729f63"
Sep 10 18:01:00.529799 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:01:00.529635    2568 scope.go:117] "RemoveContainer" containerID="3fe269ccec1b29fc7c77d2f78813c519c24a84e9dd1af09dfee679a9359f7d68"
Sep 10 18:01:00.539677 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:01:00.539509    2568 scope.go:117] "RemoveContainer" containerID="3fe269ccec1b29fc7c77d2f78813c519c24a84e9dd1af09dfee679a9359f7d68"
Sep 10 18:01:00.539888 ip-10-0-136-161 kubenswrapper[2568]: E0910 18:01:00.539868    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3fe269ccec1b29fc7c77d2f78813c519c24a84e9dd1af09dfee679a9359f7d68\": container with ID starting with 3fe269ccec1b29fc7c77d2f78813c519c24a84e9dd1af09dfee679a9359f7d68 not found: ID does not exist" containerID="3fe269ccec1b29fc7c77d2f78813c519c24a84e9dd1af09dfee679a9359f7d68"
Sep 10 18:01:00.539934 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:01:00.539896    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3fe269ccec1b29fc7c77d2f78813c519c24a84e9dd1af09dfee679a9359f7d68"} err="failed to get container status \"3fe269ccec1b29fc7c77d2f78813c519c24a84e9dd1af09dfee679a9359f7d68\": rpc error: code = NotFound desc = could not find container \"3fe269ccec1b29fc7c77d2f78813c519c24a84e9dd1af09dfee679a9359f7d68\": container with ID starting with 3fe269ccec1b29fc7c77d2f78813c519c24a84e9dd1af09dfee679a9359f7d68 not found: ID does not exist"
Sep 10 18:01:00.540567 ip-10-0-136-161 kubenswrapper[2568]: E0910 18:01:00.540537    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7788-729f63\" is forbidden: User \"system:node:ip-10-0-136-161.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-161.ec2.internal' and this object" podUID="01009f1d-5d45-4261-b0eb-48063841e35a" pod="opendatahub/test-curl-7788-729f63"
Sep 10 18:01:00.781535 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:01:00.781443    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01009f1d-5d45-4261-b0eb-48063841e35a" path="/var/lib/kubelet/pods/01009f1d-5d45-4261-b0eb-48063841e35a/volumes"
Sep 10 18:01:01.463376 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:01:01.463339    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-be08bfb3-85bd59df54-j7qjr"]
Sep 10 18:01:01.463847 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:01:01.463827    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01009f1d-5d45-4261-b0eb-48063841e35a" containerName="test-curl-7788-729f63"
Sep 10 18:01:01.463938 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:01:01.463849    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="01009f1d-5d45-4261-b0eb-48063841e35a" containerName="test-curl-7788-729f63"
Sep 10 18:01:01.463989 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:01:01.463962    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="01009f1d-5d45-4261-b0eb-48063841e35a" containerName="test-curl-7788-729f63"
Sep 10 18:01:01.468568 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:01:01.468540    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-be08bfb3-85bd59df54-j7qjr"
Sep 10 18:01:01.471467 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:01:01.471439    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-be08bfb3-dockercfg-x4w2m\""
Sep 10 18:01:01.471746 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:01:01.471727    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-be08bfb3\""
Sep 10 18:01:01.478635 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:01:01.478605    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-be08bfb3-85bd59df54-j7qjr"]
Sep 10 18:01:01.553817 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:01:01.553778    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6t4qs\" (UniqueName: \"kubernetes.io/projected/94b0f585-46b5-4c95-ac40-e1016bf9e010-kube-api-access-6t4qs\") pod \"payload-pre-processing-e2e-mt-be08bfb3-85bd59df54-j7qjr\" (UID: \"94b0f585-46b5-4c95-ac40-e1016bf9e010\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-be08bfb3-85bd59df54-j7qjr"
Sep 10 18:01:01.554005 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:01:01.553888    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/94b0f585-46b5-4c95-ac40-e1016bf9e010-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-be08bfb3-85bd59df54-j7qjr\" (UID: \"94b0f585-46b5-4c95-ac40-e1016bf9e010\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-be08bfb3-85bd59df54-j7qjr"
Sep 10 18:01:01.654952 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:01:01.654909    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6t4qs\" (UniqueName: \"kubernetes.io/projected/94b0f585-46b5-4c95-ac40-e1016bf9e010-kube-api-access-6t4qs\") pod \"payload-pre-processing-e2e-mt-be08bfb3-85bd59df54-j7qjr\" (UID: \"94b0f585-46b5-4c95-ac40-e1016bf9e010\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-be08bfb3-85bd59df54-j7qjr"
Sep 10 18:01:01.655171 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:01:01.654993    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/94b0f585-46b5-4c95-ac40-e1016bf9e010-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-be08bfb3-85bd59df54-j7qjr\" (UID: \"94b0f585-46b5-4c95-ac40-e1016bf9e010\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-be08bfb3-85bd59df54-j7qjr"
Sep 10 18:01:01.655730 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:01:01.655707    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/94b0f585-46b5-4c95-ac40-e1016bf9e010-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-be08bfb3-85bd59df54-j7qjr\" (UID: \"94b0f585-46b5-4c95-ac40-e1016bf9e010\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-be08bfb3-85bd59df54-j7qjr"
Sep 10 18:01:01.665392 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:01:01.665358    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6t4qs\" (UniqueName: \"kubernetes.io/projected/94b0f585-46b5-4c95-ac40-e1016bf9e010-kube-api-access-6t4qs\") pod \"payload-pre-processing-e2e-mt-be08bfb3-85bd59df54-j7qjr\" (UID: \"94b0f585-46b5-4c95-ac40-e1016bf9e010\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-be08bfb3-85bd59df54-j7qjr"
Sep 10 18:01:01.780841 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:01:01.780791    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-be08bfb3-85bd59df54-j7qjr"
Sep 10 18:01:02.063389 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:01:02.063357    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-be08bfb3-85bd59df54-j7qjr"]
Sep 10 18:01:02.065196 ip-10-0-136-161 kubenswrapper[2568]: W0910 18:01:02.065169    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94b0f585_46b5_4c95_ac40_e1016bf9e010.slice/crio-19c7fb5ee7a4a65fc0ec5495c8be38051266e091244f0bf7585687d8b3593987 WatchSource:0}: Error finding container 19c7fb5ee7a4a65fc0ec5495c8be38051266e091244f0bf7585687d8b3593987: Status 404 returned error can't find the container with id 19c7fb5ee7a4a65fc0ec5495c8be38051266e091244f0bf7585687d8b3593987
Sep 10 18:01:02.547802 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:01:02.547746    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-be08bfb3-85bd59df54-j7qjr" event={"ID":"94b0f585-46b5-4c95-ac40-e1016bf9e010","Type":"ContainerStarted","Data":"713d74c1e33cc30b508a9660f37d23a1f142569e5db6250e121b407a0c18c3df"}
Sep 10 18:01:02.547991 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:01:02.547830    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-be08bfb3-85bd59df54-j7qjr" event={"ID":"94b0f585-46b5-4c95-ac40-e1016bf9e010","Type":"ContainerStarted","Data":"19c7fb5ee7a4a65fc0ec5495c8be38051266e091244f0bf7585687d8b3593987"}
Sep 10 18:01:02.548055 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:01:02.547989    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-be08bfb3-85bd59df54-j7qjr"
Sep 10 18:01:02.575061 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:01:02.575001    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-be08bfb3-85bd59df54-j7qjr" podStartSLOduration=1.574979785 podStartE2EDuration="1.574979785s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 18:01:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 18:01:02.574293733 +0000 UTC m=+1198.335601777" watchObservedRunningTime="2026-09-10 18:01:02.574979785 +0000 UTC m=+1198.336287894"
Sep 10 18:01:04.802615 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:01:04.802582    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-jwfnv_e90054ec-91dc-4cda-94a2-fbe7a2a1fff0/console-operator/1.log"
Sep 10 18:01:04.803022 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:01:04.802663    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-jwfnv_e90054ec-91dc-4cda-94a2-fbe7a2a1fff0/console-operator/1.log"
Sep 10 18:01:05.205880 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:01:05.205769    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-fc23cf/auth-test-model-fc23cf-kserve-957f7bf87-bb26m"
Sep 10 18:01:05.205880 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:01:05.205820    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-fc23cf/auth-test-model-fc23cf-kserve-957f7bf87-bb26m"
Sep 10 18:01:05.219416 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:01:05.219376    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-fc23cf/auth-test-model-fc23cf-kserve-957f7bf87-bb26m"
Sep 10 18:01:05.578829 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:01:05.578797    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-fc23cf/auth-test-model-fc23cf-kserve-957f7bf87-bb26m"
Sep 10 18:01:05.635185 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:01:05.635151    2568 scope.go:117] "RemoveContainer" containerID="487100d4178646f4682c4b205f0206dfda1ee4f8bea2b93a1f5160800e270171"
Sep 10 18:01:13.558501 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:01:13.558466    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-be08bfb3-85bd59df54-j7qjr"
Sep 10 18:01:29.504089 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:01:29.504053    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-be08bfb3/e2e-lifecycle-model-be08bfb3-kserve-5ff9b4979-w5rv9"]
Sep 10 18:01:29.509404 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:01:29.509375    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-be08bfb3/e2e-lifecycle-model-be08bfb3-kserve-5ff9b4979-w5rv9"
Sep 10 18:01:29.512861 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:01:29.512829    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-be08bfb3\"/\"kube-root-ca.crt\""
Sep 10 18:01:29.513039 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:01:29.512830    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-be08bfb3\"/\"default-dockercfg-pzkdr\""
Sep 10 18:01:29.513969 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:01:29.513934    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-be08bfb3\"/\"openshift-service-ca.crt\""
Sep 10 18:01:29.514222 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:01:29.514203    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-be08bfb3\"/\"e2e-lifecycle-model-be08bfb3-kserve-self-signed-certs\""
Sep 10 18:01:29.528757 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:01:29.528716    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-be08bfb3/e2e-lifecycle-model-be08bfb3-kserve-5ff9b4979-w5rv9"]
Sep 10 18:01:29.621542 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:01:29.621498    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/70225d5e-ecee-41dd-a6e4-826488323fdd-home\") pod \"e2e-lifecycle-model-be08bfb3-kserve-5ff9b4979-w5rv9\" (UID: \"70225d5e-ecee-41dd-a6e4-826488323fdd\") " pod="ai-tenant-e2e-mt-be08bfb3/e2e-lifecycle-model-be08bfb3-kserve-5ff9b4979-w5rv9"
Sep 10 18:01:29.621774 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:01:29.621581    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/70225d5e-ecee-41dd-a6e4-826488323fdd-model-cache\") pod \"e2e-lifecycle-model-be08bfb3-kserve-5ff9b4979-w5rv9\" (UID: \"70225d5e-ecee-41dd-a6e4-826488323fdd\") " pod="ai-tenant-e2e-mt-be08bfb3/e2e-lifecycle-model-be08bfb3-kserve-5ff9b4979-w5rv9"
Sep 10 18:01:29.621774 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:01:29.621652    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70225d5e-ecee-41dd-a6e4-826488323fdd-tls-certs\") pod \"e2e-lifecycle-model-be08bfb3-kserve-5ff9b4979-w5rv9\" (UID: \"70225d5e-ecee-41dd-a6e4-826488323fdd\") " pod="ai-tenant-e2e-mt-be08bfb3/e2e-lifecycle-model-be08bfb3-kserve-5ff9b4979-w5rv9"
Sep 10 18:01:29.621774 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:01:29.621717    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70225d5e-ecee-41dd-a6e4-826488323fdd-tmp-dir\") pod \"e2e-lifecycle-model-be08bfb3-kserve-5ff9b4979-w5rv9\" (UID: \"70225d5e-ecee-41dd-a6e4-826488323fdd\") " pod="ai-tenant-e2e-mt-be08bfb3/e2e-lifecycle-model-be08bfb3-kserve-5ff9b4979-w5rv9"
Sep 10 18:01:29.621774 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:01:29.621747    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/70225d5e-ecee-41dd-a6e4-826488323fdd-dshm\") pod \"e2e-lifecycle-model-be08bfb3-kserve-5ff9b4979-w5rv9\" (UID: \"70225d5e-ecee-41dd-a6e4-826488323fdd\") " pod="ai-tenant-e2e-mt-be08bfb3/e2e-lifecycle-model-be08bfb3-kserve-5ff9b4979-w5rv9"
Sep 10 18:01:29.621774 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:01:29.621771    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dhwf\" (UniqueName: \"kubernetes.io/projected/70225d5e-ecee-41dd-a6e4-826488323fdd-kube-api-access-9dhwf\") pod \"e2e-lifecycle-model-be08bfb3-kserve-5ff9b4979-w5rv9\" (UID: \"70225d5e-ecee-41dd-a6e4-826488323fdd\") " pod="ai-tenant-e2e-mt-be08bfb3/e2e-lifecycle-model-be08bfb3-kserve-5ff9b4979-w5rv9"
Sep 10 18:01:29.722740 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:01:29.722700    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/70225d5e-ecee-41dd-a6e4-826488323fdd-model-cache\") pod \"e2e-lifecycle-model-be08bfb3-kserve-5ff9b4979-w5rv9\" (UID: \"70225d5e-ecee-41dd-a6e4-826488323fdd\") " pod="ai-tenant-e2e-mt-be08bfb3/e2e-lifecycle-model-be08bfb3-kserve-5ff9b4979-w5rv9"
Sep 10 18:01:29.722740 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:01:29.722740    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70225d5e-ecee-41dd-a6e4-826488323fdd-tls-certs\") pod \"e2e-lifecycle-model-be08bfb3-kserve-5ff9b4979-w5rv9\" (UID: \"70225d5e-ecee-41dd-a6e4-826488323fdd\") " pod="ai-tenant-e2e-mt-be08bfb3/e2e-lifecycle-model-be08bfb3-kserve-5ff9b4979-w5rv9"
Sep 10 18:01:29.722967 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:01:29.722915    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70225d5e-ecee-41dd-a6e4-826488323fdd-tmp-dir\") pod \"e2e-lifecycle-model-be08bfb3-kserve-5ff9b4979-w5rv9\" (UID: \"70225d5e-ecee-41dd-a6e4-826488323fdd\") " pod="ai-tenant-e2e-mt-be08bfb3/e2e-lifecycle-model-be08bfb3-kserve-5ff9b4979-w5rv9"
Sep 10 18:01:29.722967 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:01:29.722934    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/70225d5e-ecee-41dd-a6e4-826488323fdd-dshm\") pod \"e2e-lifecycle-model-be08bfb3-kserve-5ff9b4979-w5rv9\" (UID: \"70225d5e-ecee-41dd-a6e4-826488323fdd\") " pod="ai-tenant-e2e-mt-be08bfb3/e2e-lifecycle-model-be08bfb3-kserve-5ff9b4979-w5rv9"
Sep 10 18:01:29.722967 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:01:29.722951    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dhwf\" (UniqueName: \"kubernetes.io/projected/70225d5e-ecee-41dd-a6e4-826488323fdd-kube-api-access-9dhwf\") pod \"e2e-lifecycle-model-be08bfb3-kserve-5ff9b4979-w5rv9\" (UID: \"70225d5e-ecee-41dd-a6e4-826488323fdd\") " pod="ai-tenant-e2e-mt-be08bfb3/e2e-lifecycle-model-be08bfb3-kserve-5ff9b4979-w5rv9"
Sep 10 18:01:29.723117 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:01:29.722992    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/70225d5e-ecee-41dd-a6e4-826488323fdd-home\") pod \"e2e-lifecycle-model-be08bfb3-kserve-5ff9b4979-w5rv9\" (UID: \"70225d5e-ecee-41dd-a6e4-826488323fdd\") " pod="ai-tenant-e2e-mt-be08bfb3/e2e-lifecycle-model-be08bfb3-kserve-5ff9b4979-w5rv9"
Sep 10 18:01:29.723171 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:01:29.723139    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/70225d5e-ecee-41dd-a6e4-826488323fdd-model-cache\") pod \"e2e-lifecycle-model-be08bfb3-kserve-5ff9b4979-w5rv9\" (UID: \"70225d5e-ecee-41dd-a6e4-826488323fdd\") " pod="ai-tenant-e2e-mt-be08bfb3/e2e-lifecycle-model-be08bfb3-kserve-5ff9b4979-w5rv9"
Sep 10 18:01:29.723403 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:01:29.723357    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70225d5e-ecee-41dd-a6e4-826488323fdd-tmp-dir\") pod \"e2e-lifecycle-model-be08bfb3-kserve-5ff9b4979-w5rv9\" (UID: \"70225d5e-ecee-41dd-a6e4-826488323fdd\") " pod="ai-tenant-e2e-mt-be08bfb3/e2e-lifecycle-model-be08bfb3-kserve-5ff9b4979-w5rv9"
Sep 10 18:01:29.723524 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:01:29.723402    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/70225d5e-ecee-41dd-a6e4-826488323fdd-home\") pod \"e2e-lifecycle-model-be08bfb3-kserve-5ff9b4979-w5rv9\" (UID: \"70225d5e-ecee-41dd-a6e4-826488323fdd\") " pod="ai-tenant-e2e-mt-be08bfb3/e2e-lifecycle-model-be08bfb3-kserve-5ff9b4979-w5rv9"
Sep 10 18:01:29.725104 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:01:29.725081    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/70225d5e-ecee-41dd-a6e4-826488323fdd-dshm\") pod \"e2e-lifecycle-model-be08bfb3-kserve-5ff9b4979-w5rv9\" (UID: \"70225d5e-ecee-41dd-a6e4-826488323fdd\") " pod="ai-tenant-e2e-mt-be08bfb3/e2e-lifecycle-model-be08bfb3-kserve-5ff9b4979-w5rv9"
Sep 10 18:01:29.725401 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:01:29.725383    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70225d5e-ecee-41dd-a6e4-826488323fdd-tls-certs\") pod \"e2e-lifecycle-model-be08bfb3-kserve-5ff9b4979-w5rv9\" (UID: \"70225d5e-ecee-41dd-a6e4-826488323fdd\") " pod="ai-tenant-e2e-mt-be08bfb3/e2e-lifecycle-model-be08bfb3-kserve-5ff9b4979-w5rv9"
Sep 10 18:01:29.732136 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:01:29.732106    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dhwf\" (UniqueName: \"kubernetes.io/projected/70225d5e-ecee-41dd-a6e4-826488323fdd-kube-api-access-9dhwf\") pod \"e2e-lifecycle-model-be08bfb3-kserve-5ff9b4979-w5rv9\" (UID: \"70225d5e-ecee-41dd-a6e4-826488323fdd\") " pod="ai-tenant-e2e-mt-be08bfb3/e2e-lifecycle-model-be08bfb3-kserve-5ff9b4979-w5rv9"
Sep 10 18:01:29.820406 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:01:29.820279    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-be08bfb3/e2e-lifecycle-model-be08bfb3-kserve-5ff9b4979-w5rv9"
Sep 10 18:01:30.105137 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:01:30.105101    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-be08bfb3/e2e-lifecycle-model-be08bfb3-kserve-5ff9b4979-w5rv9"]
Sep 10 18:01:30.106005 ip-10-0-136-161 kubenswrapper[2568]: W0910 18:01:30.105978    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod70225d5e_ecee_41dd_a6e4_826488323fdd.slice/crio-92a06ea559bb87435fe49c46d9020461cc5f5db93c00eb7393c141d7638aff34 WatchSource:0}: Error finding container 92a06ea559bb87435fe49c46d9020461cc5f5db93c00eb7393c141d7638aff34: Status 404 returned error can't find the container with id 92a06ea559bb87435fe49c46d9020461cc5f5db93c00eb7393c141d7638aff34
Sep 10 18:01:30.729549 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:01:30.729504    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-be08bfb3/e2e-lifecycle-model-be08bfb3-kserve-5ff9b4979-w5rv9" event={"ID":"70225d5e-ecee-41dd-a6e4-826488323fdd","Type":"ContainerStarted","Data":"4cfd78e6bd99f8471b29daaea7befa0ed6297664cffd2a3085f7d25ba3f14718"}
Sep 10 18:01:30.729549 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:01:30.729556    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-be08bfb3/e2e-lifecycle-model-be08bfb3-kserve-5ff9b4979-w5rv9" event={"ID":"70225d5e-ecee-41dd-a6e4-826488323fdd","Type":"ContainerStarted","Data":"92a06ea559bb87435fe49c46d9020461cc5f5db93c00eb7393c141d7638aff34"}
Sep 10 18:01:30.753952 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:01:30.753884    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-be08bfb3/e2e-lifecycle-model-be08bfb3-kserve-5ff9b4979-w5rv9" podStartSLOduration=1.75386359 podStartE2EDuration="1.75386359s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 18:01:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 18:01:30.750393787 +0000 UTC m=+1226.511701829" watchObservedRunningTime="2026-09-10 18:01:30.75386359 +0000 UTC m=+1226.515171632"
Sep 10 18:01:39.820951 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:01:39.820904    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-be08bfb3/e2e-lifecycle-model-be08bfb3-kserve-5ff9b4979-w5rv9"
Sep 10 18:01:39.821469 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:01:39.820968    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-be08bfb3/e2e-lifecycle-model-be08bfb3-kserve-5ff9b4979-w5rv9"
Sep 10 18:01:39.834094 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:01:39.834065    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-be08bfb3/e2e-lifecycle-model-be08bfb3-kserve-5ff9b4979-w5rv9"
Sep 10 18:01:40.804652 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:01:40.804619    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-be08bfb3/e2e-lifecycle-model-be08bfb3-kserve-5ff9b4979-w5rv9"
Sep 10 18:02:05.686212 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:02:05.686178    2568 scope.go:117] "RemoveContainer" containerID="d8786edb519faaadf58376d9df4d7a5faa7dd2fdb0c074ea91ed6229711b6cd8"
Sep 10 18:02:19.553412 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:02:19.553370    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-be08bfb3-85bd59df54-j7qjr"]
Sep 10 18:02:19.553974 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:02:19.553658    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-be08bfb3-85bd59df54-j7qjr" podUID="94b0f585-46b5-4c95-ac40-e1016bf9e010" containerName="payload-pre-processing" containerID="cri-o://713d74c1e33cc30b508a9660f37d23a1f142569e5db6250e121b407a0c18c3df" gracePeriod=30
Sep 10 18:02:19.821486 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:02:19.821448    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-be08bfb3-85bd59df54-j7qjr"
Sep 10 18:02:19.898702 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:02:19.898666    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/94b0f585-46b5-4c95-ac40-e1016bf9e010-plugins-config-volume\") pod \"94b0f585-46b5-4c95-ac40-e1016bf9e010\" (UID: \"94b0f585-46b5-4c95-ac40-e1016bf9e010\") "
Sep 10 18:02:19.898914 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:02:19.898815    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6t4qs\" (UniqueName: \"kubernetes.io/projected/94b0f585-46b5-4c95-ac40-e1016bf9e010-kube-api-access-6t4qs\") pod \"94b0f585-46b5-4c95-ac40-e1016bf9e010\" (UID: \"94b0f585-46b5-4c95-ac40-e1016bf9e010\") "
Sep 10 18:02:19.899083 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:02:19.899056    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94b0f585-46b5-4c95-ac40-e1016bf9e010-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "94b0f585-46b5-4c95-ac40-e1016bf9e010" (UID: "94b0f585-46b5-4c95-ac40-e1016bf9e010"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 18:02:19.901072 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:02:19.901040    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94b0f585-46b5-4c95-ac40-e1016bf9e010-kube-api-access-6t4qs" (OuterVolumeSpecName: "kube-api-access-6t4qs") pod "94b0f585-46b5-4c95-ac40-e1016bf9e010" (UID: "94b0f585-46b5-4c95-ac40-e1016bf9e010"). InnerVolumeSpecName "kube-api-access-6t4qs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 18:02:19.999479 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:02:19.999446    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6t4qs\" (UniqueName: \"kubernetes.io/projected/94b0f585-46b5-4c95-ac40-e1016bf9e010-kube-api-access-6t4qs\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 18:02:19.999479 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:02:19.999475    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/94b0f585-46b5-4c95-ac40-e1016bf9e010-plugins-config-volume\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 18:02:20.052775 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:02:20.052730    2568 generic.go:356] "Generic (PLEG): container finished" podID="94b0f585-46b5-4c95-ac40-e1016bf9e010" containerID="713d74c1e33cc30b508a9660f37d23a1f142569e5db6250e121b407a0c18c3df" exitCode=0
Sep 10 18:02:20.052945 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:02:20.052831    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-be08bfb3-85bd59df54-j7qjr"
Sep 10 18:02:20.052945 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:02:20.052865    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-be08bfb3-85bd59df54-j7qjr" event={"ID":"94b0f585-46b5-4c95-ac40-e1016bf9e010","Type":"ContainerDied","Data":"713d74c1e33cc30b508a9660f37d23a1f142569e5db6250e121b407a0c18c3df"}
Sep 10 18:02:20.052945 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:02:20.052920    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-be08bfb3-85bd59df54-j7qjr" event={"ID":"94b0f585-46b5-4c95-ac40-e1016bf9e010","Type":"ContainerDied","Data":"19c7fb5ee7a4a65fc0ec5495c8be38051266e091244f0bf7585687d8b3593987"}
Sep 10 18:02:20.052945 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:02:20.052943    2568 scope.go:117] "RemoveContainer" containerID="713d74c1e33cc30b508a9660f37d23a1f142569e5db6250e121b407a0c18c3df"
Sep 10 18:02:20.063389 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:02:20.063369    2568 scope.go:117] "RemoveContainer" containerID="713d74c1e33cc30b508a9660f37d23a1f142569e5db6250e121b407a0c18c3df"
Sep 10 18:02:20.063733 ip-10-0-136-161 kubenswrapper[2568]: E0910 18:02:20.063714    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"713d74c1e33cc30b508a9660f37d23a1f142569e5db6250e121b407a0c18c3df\": container with ID starting with 713d74c1e33cc30b508a9660f37d23a1f142569e5db6250e121b407a0c18c3df not found: ID does not exist" containerID="713d74c1e33cc30b508a9660f37d23a1f142569e5db6250e121b407a0c18c3df"
Sep 10 18:02:20.063809 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:02:20.063741    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"713d74c1e33cc30b508a9660f37d23a1f142569e5db6250e121b407a0c18c3df"} err="failed to get container status \"713d74c1e33cc30b508a9660f37d23a1f142569e5db6250e121b407a0c18c3df\": rpc error: code = NotFound desc = could not find container \"713d74c1e33cc30b508a9660f37d23a1f142569e5db6250e121b407a0c18c3df\": container with ID starting with 713d74c1e33cc30b508a9660f37d23a1f142569e5db6250e121b407a0c18c3df not found: ID does not exist"
Sep 10 18:02:20.081195 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:02:20.081158    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-be08bfb3-85bd59df54-j7qjr"]
Sep 10 18:02:20.083710 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:02:20.083680    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-be08bfb3-85bd59df54-j7qjr"]
Sep 10 18:02:20.771397 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:02:20.771365    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94b0f585-46b5-4c95-ac40-e1016bf9e010" path="/var/lib/kubelet/pods/94b0f585-46b5-4c95-ac40-e1016bf9e010/volumes"
Sep 10 18:02:27.810483 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:02:27.810443    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-be08bfb3/e2e-lifecycle-model-be08bfb3-kserve-5ff9b4979-w5rv9"]
Sep 10 18:02:42.831114 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:02:42.831055    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-be08bfb3/e2e-lifecycle-model-be08bfb3-kserve-5ff9b4979-w5rv9" podUID="70225d5e-ecee-41dd-a6e4-826488323fdd" containerName="main" containerID="cri-o://4cfd78e6bd99f8471b29daaea7befa0ed6297664cffd2a3085f7d25ba3f14718" gracePeriod=45
Sep 10 18:02:43.075451 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:02:43.075416    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-be08bfb3/e2e-lifecycle-model-be08bfb3-kserve-5ff9b4979-w5rv9"
Sep 10 18:02:43.198867 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:02:43.198775    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/70225d5e-ecee-41dd-a6e4-826488323fdd-dshm\") pod \"70225d5e-ecee-41dd-a6e4-826488323fdd\" (UID: \"70225d5e-ecee-41dd-a6e4-826488323fdd\") "
Sep 10 18:02:43.199095 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:02:43.198893    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70225d5e-ecee-41dd-a6e4-826488323fdd-tmp-dir\") pod \"70225d5e-ecee-41dd-a6e4-826488323fdd\" (UID: \"70225d5e-ecee-41dd-a6e4-826488323fdd\") "
Sep 10 18:02:43.199095 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:02:43.198927    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/70225d5e-ecee-41dd-a6e4-826488323fdd-model-cache\") pod \"70225d5e-ecee-41dd-a6e4-826488323fdd\" (UID: \"70225d5e-ecee-41dd-a6e4-826488323fdd\") "
Sep 10 18:02:43.199095 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:02:43.198963    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9dhwf\" (UniqueName: \"kubernetes.io/projected/70225d5e-ecee-41dd-a6e4-826488323fdd-kube-api-access-9dhwf\") pod \"70225d5e-ecee-41dd-a6e4-826488323fdd\" (UID: \"70225d5e-ecee-41dd-a6e4-826488323fdd\") "
Sep 10 18:02:43.199095 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:02:43.198982    2568 generic.go:356] "Generic (PLEG): container finished" podID="70225d5e-ecee-41dd-a6e4-826488323fdd" containerID="4cfd78e6bd99f8471b29daaea7befa0ed6297664cffd2a3085f7d25ba3f14718" exitCode=0
Sep 10 18:02:43.199095 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:02:43.199000    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70225d5e-ecee-41dd-a6e4-826488323fdd-tls-certs\") pod \"70225d5e-ecee-41dd-a6e4-826488323fdd\" (UID: \"70225d5e-ecee-41dd-a6e4-826488323fdd\") "
Sep 10 18:02:43.199095 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:02:43.199077    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-be08bfb3/e2e-lifecycle-model-be08bfb3-kserve-5ff9b4979-w5rv9"
Sep 10 18:02:43.199095 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:02:43.199091    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/70225d5e-ecee-41dd-a6e4-826488323fdd-home\") pod \"70225d5e-ecee-41dd-a6e4-826488323fdd\" (UID: \"70225d5e-ecee-41dd-a6e4-826488323fdd\") "
Sep 10 18:02:43.199529 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:02:43.199151    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-be08bfb3/e2e-lifecycle-model-be08bfb3-kserve-5ff9b4979-w5rv9" event={"ID":"70225d5e-ecee-41dd-a6e4-826488323fdd","Type":"ContainerDied","Data":"4cfd78e6bd99f8471b29daaea7befa0ed6297664cffd2a3085f7d25ba3f14718"}
Sep 10 18:02:43.199529 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:02:43.199187    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70225d5e-ecee-41dd-a6e4-826488323fdd-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "70225d5e-ecee-41dd-a6e4-826488323fdd" (UID: "70225d5e-ecee-41dd-a6e4-826488323fdd"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 18:02:43.199529 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:02:43.199199    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-be08bfb3/e2e-lifecycle-model-be08bfb3-kserve-5ff9b4979-w5rv9" event={"ID":"70225d5e-ecee-41dd-a6e4-826488323fdd","Type":"ContainerDied","Data":"92a06ea559bb87435fe49c46d9020461cc5f5db93c00eb7393c141d7638aff34"}
Sep 10 18:02:43.199529 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:02:43.199218    2568 scope.go:117] "RemoveContainer" containerID="4cfd78e6bd99f8471b29daaea7befa0ed6297664cffd2a3085f7d25ba3f14718"
Sep 10 18:02:43.199529 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:02:43.199393    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70225d5e-ecee-41dd-a6e4-826488323fdd-home" (OuterVolumeSpecName: "home") pod "70225d5e-ecee-41dd-a6e4-826488323fdd" (UID: "70225d5e-ecee-41dd-a6e4-826488323fdd"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 18:02:43.199529 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:02:43.199472    2568 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70225d5e-ecee-41dd-a6e4-826488323fdd-tmp-dir\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 18:02:43.199860 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:02:43.199764    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70225d5e-ecee-41dd-a6e4-826488323fdd-model-cache" (OuterVolumeSpecName: "model-cache") pod "70225d5e-ecee-41dd-a6e4-826488323fdd" (UID: "70225d5e-ecee-41dd-a6e4-826488323fdd"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 18:02:43.201434 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:02:43.201403    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70225d5e-ecee-41dd-a6e4-826488323fdd-dshm" (OuterVolumeSpecName: "dshm") pod "70225d5e-ecee-41dd-a6e4-826488323fdd" (UID: "70225d5e-ecee-41dd-a6e4-826488323fdd"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 18:02:43.201523 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:02:43.201432    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/70225d5e-ecee-41dd-a6e4-826488323fdd-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "70225d5e-ecee-41dd-a6e4-826488323fdd" (UID: "70225d5e-ecee-41dd-a6e4-826488323fdd"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 18:02:43.201573 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:02:43.201545    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70225d5e-ecee-41dd-a6e4-826488323fdd-kube-api-access-9dhwf" (OuterVolumeSpecName: "kube-api-access-9dhwf") pod "70225d5e-ecee-41dd-a6e4-826488323fdd" (UID: "70225d5e-ecee-41dd-a6e4-826488323fdd"). InnerVolumeSpecName "kube-api-access-9dhwf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 18:02:43.221160 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:02:43.221130    2568 scope.go:117] "RemoveContainer" containerID="4cfd78e6bd99f8471b29daaea7befa0ed6297664cffd2a3085f7d25ba3f14718"
Sep 10 18:02:43.221570 ip-10-0-136-161 kubenswrapper[2568]: E0910 18:02:43.221540    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4cfd78e6bd99f8471b29daaea7befa0ed6297664cffd2a3085f7d25ba3f14718\": container with ID starting with 4cfd78e6bd99f8471b29daaea7befa0ed6297664cffd2a3085f7d25ba3f14718 not found: ID does not exist" containerID="4cfd78e6bd99f8471b29daaea7befa0ed6297664cffd2a3085f7d25ba3f14718"
Sep 10 18:02:43.221672 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:02:43.221581    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4cfd78e6bd99f8471b29daaea7befa0ed6297664cffd2a3085f7d25ba3f14718"} err="failed to get container status \"4cfd78e6bd99f8471b29daaea7befa0ed6297664cffd2a3085f7d25ba3f14718\": rpc error: code = NotFound desc = could not find container \"4cfd78e6bd99f8471b29daaea7befa0ed6297664cffd2a3085f7d25ba3f14718\": container with ID starting with 4cfd78e6bd99f8471b29daaea7befa0ed6297664cffd2a3085f7d25ba3f14718 not found: ID does not exist"
Sep 10 18:02:43.300785 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:02:43.300748    2568 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/70225d5e-ecee-41dd-a6e4-826488323fdd-model-cache\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 18:02:43.300785 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:02:43.300784    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9dhwf\" (UniqueName: \"kubernetes.io/projected/70225d5e-ecee-41dd-a6e4-826488323fdd-kube-api-access-9dhwf\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 18:02:43.301006 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:02:43.300799    2568 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70225d5e-ecee-41dd-a6e4-826488323fdd-tls-certs\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 18:02:43.301006 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:02:43.300811    2568 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/70225d5e-ecee-41dd-a6e4-826488323fdd-home\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 18:02:43.301006 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:02:43.300821    2568 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/70225d5e-ecee-41dd-a6e4-826488323fdd-dshm\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 18:02:43.523035 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:02:43.522997    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-be08bfb3/e2e-lifecycle-model-be08bfb3-kserve-5ff9b4979-w5rv9"]
Sep 10 18:02:43.528469 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:02:43.528436    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-be08bfb3/e2e-lifecycle-model-be08bfb3-kserve-5ff9b4979-w5rv9"]
Sep 10 18:02:44.770195 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:02:44.770153    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="70225d5e-ecee-41dd-a6e4-826488323fdd" path="/var/lib/kubelet/pods/70225d5e-ecee-41dd-a6e4-826488323fdd/volumes"
Sep 10 18:03:05.713793 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:03:05.713755    2568 scope.go:117] "RemoveContainer" containerID="6360522d7bf02529b383a79ed594975952f114d85966627d88c5f5964fc731e5"
Sep 10 18:03:05.725758 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:03:05.725725    2568 scope.go:117] "RemoveContainer" containerID="3cd43badf9e4bf1a66de79a1e7adfb55e999d42ddf9c9d56ff898a05e236a673"
Sep 10 18:03:05.735208 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:03:05.735185    2568 scope.go:117] "RemoveContainer" containerID="6212b6561727f41cd20d50928ed8d0f4196aa49a64e9d49d608fe724c1feeff2"
Sep 10 18:03:20.340444 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:03:20.340401    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7791-08eff4"]
Sep 10 18:03:20.341092 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:03:20.341066    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94b0f585-46b5-4c95-ac40-e1016bf9e010" containerName="payload-pre-processing"
Sep 10 18:03:20.341180 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:03:20.341095    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="94b0f585-46b5-4c95-ac40-e1016bf9e010" containerName="payload-pre-processing"
Sep 10 18:03:20.341180 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:03:20.341112    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70225d5e-ecee-41dd-a6e4-826488323fdd" containerName="main"
Sep 10 18:03:20.341180 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:03:20.341124    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="70225d5e-ecee-41dd-a6e4-826488323fdd" containerName="main"
Sep 10 18:03:20.341354 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:03:20.341243    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="70225d5e-ecee-41dd-a6e4-826488323fdd" containerName="main"
Sep 10 18:03:20.341354 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:03:20.341259    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="94b0f585-46b5-4c95-ac40-e1016bf9e010" containerName="payload-pre-processing"
Sep 10 18:03:20.346527 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:03:20.346492    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7791-08eff4"
Sep 10 18:03:20.349788 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:03:20.349398    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7791-08eff4"]
Sep 10 18:03:20.349788 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:03:20.349660    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-r67rg\""
Sep 10 18:03:20.351101 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:03:20.351069    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvpd7\" (UniqueName: \"kubernetes.io/projected/edaba8c0-4825-4a66-b5f4-b6652fb52d46-kube-api-access-jvpd7\") pod \"test-curl-7791-08eff4\" (UID: \"edaba8c0-4825-4a66-b5f4-b6652fb52d46\") " pod="opendatahub/test-curl-7791-08eff4"
Sep 10 18:03:20.452010 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:03:20.451969    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvpd7\" (UniqueName: \"kubernetes.io/projected/edaba8c0-4825-4a66-b5f4-b6652fb52d46-kube-api-access-jvpd7\") pod \"test-curl-7791-08eff4\" (UID: \"edaba8c0-4825-4a66-b5f4-b6652fb52d46\") " pod="opendatahub/test-curl-7791-08eff4"
Sep 10 18:03:20.462085 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:03:20.462049    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvpd7\" (UniqueName: \"kubernetes.io/projected/edaba8c0-4825-4a66-b5f4-b6652fb52d46-kube-api-access-jvpd7\") pod \"test-curl-7791-08eff4\" (UID: \"edaba8c0-4825-4a66-b5f4-b6652fb52d46\") " pod="opendatahub/test-curl-7791-08eff4"
Sep 10 18:03:20.659584 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:03:20.659484    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7791-08eff4"
Sep 10 18:03:20.939186 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:03:20.939154    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7791-08eff4"]
Sep 10 18:03:20.941202 ip-10-0-136-161 kubenswrapper[2568]: W0910 18:03:20.941173    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podedaba8c0_4825_4a66_b5f4_b6652fb52d46.slice/crio-6c833048373b49fb43c16f9c9cfcb396f090889b30838414af09a1b7ff11b933 WatchSource:0}: Error finding container 6c833048373b49fb43c16f9c9cfcb396f090889b30838414af09a1b7ff11b933: Status 404 returned error can't find the container with id 6c833048373b49fb43c16f9c9cfcb396f090889b30838414af09a1b7ff11b933
Sep 10 18:03:21.450110 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:03:21.450061    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7791-08eff4" event={"ID":"edaba8c0-4825-4a66-b5f4-b6652fb52d46","Type":"ContainerStarted","Data":"ad428b9d53e86133887193bd46cb8c72383ad815f646a3295ea503642e539255"}
Sep 10 18:03:21.450110 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:03:21.450114    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7791-08eff4" event={"ID":"edaba8c0-4825-4a66-b5f4-b6652fb52d46","Type":"ContainerStarted","Data":"6c833048373b49fb43c16f9c9cfcb396f090889b30838414af09a1b7ff11b933"}
Sep 10 18:03:21.473277 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:03:21.473222    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7791-08eff4" podStartSLOduration=1.473204586 podStartE2EDuration="1.473204586s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 18:03:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 18:03:21.470601343 +0000 UTC m=+1337.231909387" watchObservedRunningTime="2026-09-10 18:03:21.473204586 +0000 UTC m=+1337.234512629"
Sep 10 18:03:22.061774 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:03:22.061700    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7791-08eff4"]
Sep 10 18:03:22.065066 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:03:22.064981    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7791-08eff4"]
Sep 10 18:03:22.455994 ip-10-0-136-161 kubenswrapper[2568]: E0910 18:03:22.455961    2568 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7791-08eff4" container="test-curl-7791-08eff4"
Sep 10 18:03:23.461467 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:03:23.461415    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7791-08eff4" podUID="edaba8c0-4825-4a66-b5f4-b6652fb52d46" containerName="test-curl-7791-08eff4" containerID="cri-o://ad428b9d53e86133887193bd46cb8c72383ad815f646a3295ea503642e539255" gracePeriod=2
Sep 10 18:03:24.454220 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:03:24.454174    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-fc23cf/auth-test-model-fc23cf-kserve-957f7bf87-bb26m"]
Sep 10 18:03:25.654346 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:03:25.654304    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7791-08eff4"
Sep 10 18:03:25.696627 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:03:25.696584    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jvpd7\" (UniqueName: \"kubernetes.io/projected/edaba8c0-4825-4a66-b5f4-b6652fb52d46-kube-api-access-jvpd7\") pod \"edaba8c0-4825-4a66-b5f4-b6652fb52d46\" (UID: \"edaba8c0-4825-4a66-b5f4-b6652fb52d46\") "
Sep 10 18:03:25.698778 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:03:25.698751    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/edaba8c0-4825-4a66-b5f4-b6652fb52d46-kube-api-access-jvpd7" (OuterVolumeSpecName: "kube-api-access-jvpd7") pod "edaba8c0-4825-4a66-b5f4-b6652fb52d46" (UID: "edaba8c0-4825-4a66-b5f4-b6652fb52d46"). InnerVolumeSpecName "kube-api-access-jvpd7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 18:03:25.797983 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:03:25.797937    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jvpd7\" (UniqueName: \"kubernetes.io/projected/edaba8c0-4825-4a66-b5f4-b6652fb52d46-kube-api-access-jvpd7\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 18:03:26.481633 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:03:26.481591    2568 generic.go:356] "Generic (PLEG): container finished" podID="edaba8c0-4825-4a66-b5f4-b6652fb52d46" containerID="ad428b9d53e86133887193bd46cb8c72383ad815f646a3295ea503642e539255" exitCode=137
Sep 10 18:03:26.481633 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:03:26.481633    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7791-08eff4"
Sep 10 18:03:26.481913 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:03:26.481644    2568 scope.go:117] "RemoveContainer" containerID="ad428b9d53e86133887193bd46cb8c72383ad815f646a3295ea503642e539255"
Sep 10 18:03:26.491586 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:03:26.491563    2568 scope.go:117] "RemoveContainer" containerID="ad428b9d53e86133887193bd46cb8c72383ad815f646a3295ea503642e539255"
Sep 10 18:03:26.498663 ip-10-0-136-161 kubenswrapper[2568]: E0910 18:03:26.498621    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad428b9d53e86133887193bd46cb8c72383ad815f646a3295ea503642e539255\": container with ID starting with ad428b9d53e86133887193bd46cb8c72383ad815f646a3295ea503642e539255 not found: ID does not exist" containerID="ad428b9d53e86133887193bd46cb8c72383ad815f646a3295ea503642e539255"
Sep 10 18:03:26.498850 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:03:26.498670    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad428b9d53e86133887193bd46cb8c72383ad815f646a3295ea503642e539255"} err="failed to get container status \"ad428b9d53e86133887193bd46cb8c72383ad815f646a3295ea503642e539255\": rpc error: code = NotFound desc = could not find container \"ad428b9d53e86133887193bd46cb8c72383ad815f646a3295ea503642e539255\": container with ID starting with ad428b9d53e86133887193bd46cb8c72383ad815f646a3295ea503642e539255 not found: ID does not exist"
Sep 10 18:03:26.498918 ip-10-0-136-161 kubenswrapper[2568]: E0910 18:03:26.498849    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7791-08eff4\" is forbidden: User \"system:node:ip-10-0-136-161.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-161.ec2.internal' and this object" podUID="edaba8c0-4825-4a66-b5f4-b6652fb52d46" pod="opendatahub/test-curl-7791-08eff4"
Sep 10 18:03:26.770903 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:03:26.770799    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="edaba8c0-4825-4a66-b5f4-b6652fb52d46" path="/var/lib/kubelet/pods/edaba8c0-4825-4a66-b5f4-b6652fb52d46/volumes"
Sep 10 18:03:39.475080 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:03:39.475009    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-fc23cf/auth-test-model-fc23cf-kserve-957f7bf87-bb26m" podUID="d8ba37b4-4658-4077-ad42-327a6454b02a" containerName="main" containerID="cri-o://e21975e3f3437a56e7cc7eecae78468151a01ed9106ed3728c8f4f4078654a1c" gracePeriod=45
Sep 10 18:03:39.739403 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:03:39.739312    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-fc23cf/auth-test-model-fc23cf-kserve-957f7bf87-bb26m"
Sep 10 18:03:39.824807 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:03:39.824761    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d8ba37b4-4658-4077-ad42-327a6454b02a-home\") pod \"d8ba37b4-4658-4077-ad42-327a6454b02a\" (UID: \"d8ba37b4-4658-4077-ad42-327a6454b02a\") "
Sep 10 18:03:39.824807 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:03:39.824805    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d8ba37b4-4658-4077-ad42-327a6454b02a-dshm\") pod \"d8ba37b4-4658-4077-ad42-327a6454b02a\" (UID: \"d8ba37b4-4658-4077-ad42-327a6454b02a\") "
Sep 10 18:03:39.825022 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:03:39.824833    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8ba37b4-4658-4077-ad42-327a6454b02a-tmp-dir\") pod \"d8ba37b4-4658-4077-ad42-327a6454b02a\" (UID: \"d8ba37b4-4658-4077-ad42-327a6454b02a\") "
Sep 10 18:03:39.825022 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:03:39.824856    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lssmh\" (UniqueName: \"kubernetes.io/projected/d8ba37b4-4658-4077-ad42-327a6454b02a-kube-api-access-lssmh\") pod \"d8ba37b4-4658-4077-ad42-327a6454b02a\" (UID: \"d8ba37b4-4658-4077-ad42-327a6454b02a\") "
Sep 10 18:03:39.825022 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:03:39.824914    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d8ba37b4-4658-4077-ad42-327a6454b02a-model-cache\") pod \"d8ba37b4-4658-4077-ad42-327a6454b02a\" (UID: \"d8ba37b4-4658-4077-ad42-327a6454b02a\") "
Sep 10 18:03:39.825022 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:03:39.824969    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d8ba37b4-4658-4077-ad42-327a6454b02a-tls-certs\") pod \"d8ba37b4-4658-4077-ad42-327a6454b02a\" (UID: \"d8ba37b4-4658-4077-ad42-327a6454b02a\") "
Sep 10 18:03:39.825215 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:03:39.825119    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8ba37b4-4658-4077-ad42-327a6454b02a-home" (OuterVolumeSpecName: "home") pod "d8ba37b4-4658-4077-ad42-327a6454b02a" (UID: "d8ba37b4-4658-4077-ad42-327a6454b02a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 18:03:39.825215 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:03:39.825153    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8ba37b4-4658-4077-ad42-327a6454b02a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d8ba37b4-4658-4077-ad42-327a6454b02a" (UID: "d8ba37b4-4658-4077-ad42-327a6454b02a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 18:03:39.825348 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:03:39.825257    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8ba37b4-4658-4077-ad42-327a6454b02a-model-cache" (OuterVolumeSpecName: "model-cache") pod "d8ba37b4-4658-4077-ad42-327a6454b02a" (UID: "d8ba37b4-4658-4077-ad42-327a6454b02a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 18:03:39.825348 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:03:39.825331    2568 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d8ba37b4-4658-4077-ad42-327a6454b02a-home\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 18:03:39.825462 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:03:39.825364    2568 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8ba37b4-4658-4077-ad42-327a6454b02a-tmp-dir\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 18:03:39.827224 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:03:39.827200    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d8ba37b4-4658-4077-ad42-327a6454b02a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d8ba37b4-4658-4077-ad42-327a6454b02a" (UID: "d8ba37b4-4658-4077-ad42-327a6454b02a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 18:03:39.827224 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:03:39.827208    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8ba37b4-4658-4077-ad42-327a6454b02a-dshm" (OuterVolumeSpecName: "dshm") pod "d8ba37b4-4658-4077-ad42-327a6454b02a" (UID: "d8ba37b4-4658-4077-ad42-327a6454b02a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 18:03:39.827385 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:03:39.827258    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8ba37b4-4658-4077-ad42-327a6454b02a-kube-api-access-lssmh" (OuterVolumeSpecName: "kube-api-access-lssmh") pod "d8ba37b4-4658-4077-ad42-327a6454b02a" (UID: "d8ba37b4-4658-4077-ad42-327a6454b02a"). InnerVolumeSpecName "kube-api-access-lssmh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 18:03:39.926579 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:03:39.926539    2568 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d8ba37b4-4658-4077-ad42-327a6454b02a-dshm\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 18:03:39.926579 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:03:39.926573    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lssmh\" (UniqueName: \"kubernetes.io/projected/d8ba37b4-4658-4077-ad42-327a6454b02a-kube-api-access-lssmh\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 18:03:39.926579 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:03:39.926584    2568 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d8ba37b4-4658-4077-ad42-327a6454b02a-model-cache\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 18:03:39.926834 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:03:39.926595    2568 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d8ba37b4-4658-4077-ad42-327a6454b02a-tls-certs\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 18:03:40.571741 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:03:40.571708    2568 generic.go:356] "Generic (PLEG): container finished" podID="d8ba37b4-4658-4077-ad42-327a6454b02a" containerID="e21975e3f3437a56e7cc7eecae78468151a01ed9106ed3728c8f4f4078654a1c" exitCode=0
Sep 10 18:03:40.572228 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:03:40.571762    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-fc23cf/auth-test-model-fc23cf-kserve-957f7bf87-bb26m"
Sep 10 18:03:40.572228 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:03:40.571779    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-fc23cf/auth-test-model-fc23cf-kserve-957f7bf87-bb26m" event={"ID":"d8ba37b4-4658-4077-ad42-327a6454b02a","Type":"ContainerDied","Data":"e21975e3f3437a56e7cc7eecae78468151a01ed9106ed3728c8f4f4078654a1c"}
Sep 10 18:03:40.572228 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:03:40.571815    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-fc23cf/auth-test-model-fc23cf-kserve-957f7bf87-bb26m" event={"ID":"d8ba37b4-4658-4077-ad42-327a6454b02a","Type":"ContainerDied","Data":"346f20a06ef68003711510c858054bebfb2709abe1b55b7d94303e6dceaf82dd"}
Sep 10 18:03:40.572228 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:03:40.571833    2568 scope.go:117] "RemoveContainer" containerID="e21975e3f3437a56e7cc7eecae78468151a01ed9106ed3728c8f4f4078654a1c"
Sep 10 18:03:40.581706 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:03:40.581685    2568 scope.go:117] "RemoveContainer" containerID="e21975e3f3437a56e7cc7eecae78468151a01ed9106ed3728c8f4f4078654a1c"
Sep 10 18:03:40.582057 ip-10-0-136-161 kubenswrapper[2568]: E0910 18:03:40.582035    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e21975e3f3437a56e7cc7eecae78468151a01ed9106ed3728c8f4f4078654a1c\": container with ID starting with e21975e3f3437a56e7cc7eecae78468151a01ed9106ed3728c8f4f4078654a1c not found: ID does not exist" containerID="e21975e3f3437a56e7cc7eecae78468151a01ed9106ed3728c8f4f4078654a1c"
Sep 10 18:03:40.582101 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:03:40.582069    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e21975e3f3437a56e7cc7eecae78468151a01ed9106ed3728c8f4f4078654a1c"} err="failed to get container status \"e21975e3f3437a56e7cc7eecae78468151a01ed9106ed3728c8f4f4078654a1c\": rpc error: code = NotFound desc = could not find container \"e21975e3f3437a56e7cc7eecae78468151a01ed9106ed3728c8f4f4078654a1c\": container with ID starting with e21975e3f3437a56e7cc7eecae78468151a01ed9106ed3728c8f4f4078654a1c not found: ID does not exist"
Sep 10 18:03:40.595833 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:03:40.595795    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-fc23cf/auth-test-model-fc23cf-kserve-957f7bf87-bb26m"]
Sep 10 18:03:40.603122 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:03:40.603084    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-fc23cf/auth-test-model-fc23cf-kserve-957f7bf87-bb26m"]
Sep 10 18:03:40.770829 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:03:40.770796    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d8ba37b4-4658-4077-ad42-327a6454b02a" path="/var/lib/kubelet/pods/d8ba37b4-4658-4077-ad42-327a6454b02a/volumes"
Sep 10 18:03:48.520537 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:03:48.520500    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-fc23cf/sub-test-model-fc23cf-kserve-56648c78f-qj9wz"]
Sep 10 18:03:48.521030 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:03:48.520907    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="edaba8c0-4825-4a66-b5f4-b6652fb52d46" containerName="test-curl-7791-08eff4"
Sep 10 18:03:48.521030 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:03:48.520921    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="edaba8c0-4825-4a66-b5f4-b6652fb52d46" containerName="test-curl-7791-08eff4"
Sep 10 18:03:48.521030 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:03:48.520944    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8ba37b4-4658-4077-ad42-327a6454b02a" containerName="main"
Sep 10 18:03:48.521030 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:03:48.520950    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8ba37b4-4658-4077-ad42-327a6454b02a" containerName="main"
Sep 10 18:03:48.521030 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:03:48.521011    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8ba37b4-4658-4077-ad42-327a6454b02a" containerName="main"
Sep 10 18:03:48.521030 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:03:48.521020    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="edaba8c0-4825-4a66-b5f4-b6652fb52d46" containerName="test-curl-7791-08eff4"
Sep 10 18:03:48.525710 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:03:48.525680    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-fc23cf/sub-test-model-fc23cf-kserve-56648c78f-qj9wz"
Sep 10 18:03:48.528630 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:03:48.528603    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-fc23cf\"/\"default-dockercfg-svv2h\""
Sep 10 18:03:48.529776 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:03:48.529751    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-fc23cf\"/\"kube-root-ca.crt\""
Sep 10 18:03:48.530257 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:03:48.530222    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-fc23cf\"/\"openshift-service-ca.crt\""
Sep 10 18:03:48.530845 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:03:48.530825    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-fc23cf\"/\"sub-test-model-fc23cf-kserve-self-signed-certs\""
Sep 10 18:03:48.535496 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:03:48.535469    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-fc23cf/sub-test-model-fc23cf-kserve-56648c78f-qj9wz"]
Sep 10 18:03:48.614055 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:03:48.614019    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d300b8de-df8b-4b1f-9c3d-bb9839515c5a-tmp-dir\") pod \"sub-test-model-fc23cf-kserve-56648c78f-qj9wz\" (UID: \"d300b8de-df8b-4b1f-9c3d-bb9839515c5a\") " pod="ai-tenant-e2e-shared-b-w3-fc23cf/sub-test-model-fc23cf-kserve-56648c78f-qj9wz"
Sep 10 18:03:48.614055 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:03:48.614057    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rl5ql\" (UniqueName: \"kubernetes.io/projected/d300b8de-df8b-4b1f-9c3d-bb9839515c5a-kube-api-access-rl5ql\") pod \"sub-test-model-fc23cf-kserve-56648c78f-qj9wz\" (UID: \"d300b8de-df8b-4b1f-9c3d-bb9839515c5a\") " pod="ai-tenant-e2e-shared-b-w3-fc23cf/sub-test-model-fc23cf-kserve-56648c78f-qj9wz"
Sep 10 18:03:48.614372 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:03:48.614085    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d300b8de-df8b-4b1f-9c3d-bb9839515c5a-model-cache\") pod \"sub-test-model-fc23cf-kserve-56648c78f-qj9wz\" (UID: \"d300b8de-df8b-4b1f-9c3d-bb9839515c5a\") " pod="ai-tenant-e2e-shared-b-w3-fc23cf/sub-test-model-fc23cf-kserve-56648c78f-qj9wz"
Sep 10 18:03:48.614372 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:03:48.614148    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d300b8de-df8b-4b1f-9c3d-bb9839515c5a-dshm\") pod \"sub-test-model-fc23cf-kserve-56648c78f-qj9wz\" (UID: \"d300b8de-df8b-4b1f-9c3d-bb9839515c5a\") " pod="ai-tenant-e2e-shared-b-w3-fc23cf/sub-test-model-fc23cf-kserve-56648c78f-qj9wz"
Sep 10 18:03:48.614372 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:03:48.614191    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d300b8de-df8b-4b1f-9c3d-bb9839515c5a-tls-certs\") pod \"sub-test-model-fc23cf-kserve-56648c78f-qj9wz\" (UID: \"d300b8de-df8b-4b1f-9c3d-bb9839515c5a\") " pod="ai-tenant-e2e-shared-b-w3-fc23cf/sub-test-model-fc23cf-kserve-56648c78f-qj9wz"
Sep 10 18:03:48.614372 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:03:48.614244    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d300b8de-df8b-4b1f-9c3d-bb9839515c5a-home\") pod \"sub-test-model-fc23cf-kserve-56648c78f-qj9wz\" (UID: \"d300b8de-df8b-4b1f-9c3d-bb9839515c5a\") " pod="ai-tenant-e2e-shared-b-w3-fc23cf/sub-test-model-fc23cf-kserve-56648c78f-qj9wz"
Sep 10 18:03:48.714983 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:03:48.714941    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d300b8de-df8b-4b1f-9c3d-bb9839515c5a-model-cache\") pod \"sub-test-model-fc23cf-kserve-56648c78f-qj9wz\" (UID: \"d300b8de-df8b-4b1f-9c3d-bb9839515c5a\") " pod="ai-tenant-e2e-shared-b-w3-fc23cf/sub-test-model-fc23cf-kserve-56648c78f-qj9wz"
Sep 10 18:03:48.714983 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:03:48.714987    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d300b8de-df8b-4b1f-9c3d-bb9839515c5a-dshm\") pod \"sub-test-model-fc23cf-kserve-56648c78f-qj9wz\" (UID: \"d300b8de-df8b-4b1f-9c3d-bb9839515c5a\") " pod="ai-tenant-e2e-shared-b-w3-fc23cf/sub-test-model-fc23cf-kserve-56648c78f-qj9wz"
Sep 10 18:03:48.715250 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:03:48.715013    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d300b8de-df8b-4b1f-9c3d-bb9839515c5a-tls-certs\") pod \"sub-test-model-fc23cf-kserve-56648c78f-qj9wz\" (UID: \"d300b8de-df8b-4b1f-9c3d-bb9839515c5a\") " pod="ai-tenant-e2e-shared-b-w3-fc23cf/sub-test-model-fc23cf-kserve-56648c78f-qj9wz"
Sep 10 18:03:48.715250 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:03:48.715069    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d300b8de-df8b-4b1f-9c3d-bb9839515c5a-home\") pod \"sub-test-model-fc23cf-kserve-56648c78f-qj9wz\" (UID: \"d300b8de-df8b-4b1f-9c3d-bb9839515c5a\") " pod="ai-tenant-e2e-shared-b-w3-fc23cf/sub-test-model-fc23cf-kserve-56648c78f-qj9wz"
Sep 10 18:03:48.715250 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:03:48.715161    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d300b8de-df8b-4b1f-9c3d-bb9839515c5a-tmp-dir\") pod \"sub-test-model-fc23cf-kserve-56648c78f-qj9wz\" (UID: \"d300b8de-df8b-4b1f-9c3d-bb9839515c5a\") " pod="ai-tenant-e2e-shared-b-w3-fc23cf/sub-test-model-fc23cf-kserve-56648c78f-qj9wz"
Sep 10 18:03:48.715480 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:03:48.715294    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rl5ql\" (UniqueName: \"kubernetes.io/projected/d300b8de-df8b-4b1f-9c3d-bb9839515c5a-kube-api-access-rl5ql\") pod \"sub-test-model-fc23cf-kserve-56648c78f-qj9wz\" (UID: \"d300b8de-df8b-4b1f-9c3d-bb9839515c5a\") " pod="ai-tenant-e2e-shared-b-w3-fc23cf/sub-test-model-fc23cf-kserve-56648c78f-qj9wz"
Sep 10 18:03:48.715480 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:03:48.715408    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d300b8de-df8b-4b1f-9c3d-bb9839515c5a-model-cache\") pod \"sub-test-model-fc23cf-kserve-56648c78f-qj9wz\" (UID: \"d300b8de-df8b-4b1f-9c3d-bb9839515c5a\") " pod="ai-tenant-e2e-shared-b-w3-fc23cf/sub-test-model-fc23cf-kserve-56648c78f-qj9wz"
Sep 10 18:03:48.715586 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:03:48.715567    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d300b8de-df8b-4b1f-9c3d-bb9839515c5a-tmp-dir\") pod \"sub-test-model-fc23cf-kserve-56648c78f-qj9wz\" (UID: \"d300b8de-df8b-4b1f-9c3d-bb9839515c5a\") " pod="ai-tenant-e2e-shared-b-w3-fc23cf/sub-test-model-fc23cf-kserve-56648c78f-qj9wz"
Sep 10 18:03:48.715641 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:03:48.715617    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d300b8de-df8b-4b1f-9c3d-bb9839515c5a-home\") pod \"sub-test-model-fc23cf-kserve-56648c78f-qj9wz\" (UID: \"d300b8de-df8b-4b1f-9c3d-bb9839515c5a\") " pod="ai-tenant-e2e-shared-b-w3-fc23cf/sub-test-model-fc23cf-kserve-56648c78f-qj9wz"
Sep 10 18:03:48.717533 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:03:48.717511    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d300b8de-df8b-4b1f-9c3d-bb9839515c5a-dshm\") pod \"sub-test-model-fc23cf-kserve-56648c78f-qj9wz\" (UID: \"d300b8de-df8b-4b1f-9c3d-bb9839515c5a\") " pod="ai-tenant-e2e-shared-b-w3-fc23cf/sub-test-model-fc23cf-kserve-56648c78f-qj9wz"
Sep 10 18:03:48.717796 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:03:48.717777    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d300b8de-df8b-4b1f-9c3d-bb9839515c5a-tls-certs\") pod \"sub-test-model-fc23cf-kserve-56648c78f-qj9wz\" (UID: \"d300b8de-df8b-4b1f-9c3d-bb9839515c5a\") " pod="ai-tenant-e2e-shared-b-w3-fc23cf/sub-test-model-fc23cf-kserve-56648c78f-qj9wz"
Sep 10 18:03:48.725203 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:03:48.725165    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rl5ql\" (UniqueName: \"kubernetes.io/projected/d300b8de-df8b-4b1f-9c3d-bb9839515c5a-kube-api-access-rl5ql\") pod \"sub-test-model-fc23cf-kserve-56648c78f-qj9wz\" (UID: \"d300b8de-df8b-4b1f-9c3d-bb9839515c5a\") " pod="ai-tenant-e2e-shared-b-w3-fc23cf/sub-test-model-fc23cf-kserve-56648c78f-qj9wz"
Sep 10 18:03:48.837300 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:03:48.837191    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-fc23cf/sub-test-model-fc23cf-kserve-56648c78f-qj9wz"
Sep 10 18:03:49.128236 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:03:49.128209    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-fc23cf/sub-test-model-fc23cf-kserve-56648c78f-qj9wz"]
Sep 10 18:03:49.129960 ip-10-0-136-161 kubenswrapper[2568]: W0910 18:03:49.129934    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd300b8de_df8b_4b1f_9c3d_bb9839515c5a.slice/crio-2268d4357a03c402ef4c70f19de895b94462213af18149a0a2c8dc1686b86cc2 WatchSource:0}: Error finding container 2268d4357a03c402ef4c70f19de895b94462213af18149a0a2c8dc1686b86cc2: Status 404 returned error can't find the container with id 2268d4357a03c402ef4c70f19de895b94462213af18149a0a2c8dc1686b86cc2
Sep 10 18:03:49.628971 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:03:49.628932    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-fc23cf/sub-test-model-fc23cf-kserve-56648c78f-qj9wz" event={"ID":"d300b8de-df8b-4b1f-9c3d-bb9839515c5a","Type":"ContainerStarted","Data":"4538a221eb2a82763ee2cfa0f51dfa9922be248cc94d4d50c46d34fd9e159913"}
Sep 10 18:03:49.628971 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:03:49.628978    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-fc23cf/sub-test-model-fc23cf-kserve-56648c78f-qj9wz" event={"ID":"d300b8de-df8b-4b1f-9c3d-bb9839515c5a","Type":"ContainerStarted","Data":"2268d4357a03c402ef4c70f19de895b94462213af18149a0a2c8dc1686b86cc2"}
Sep 10 18:03:49.652967 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:03:49.652900    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-fc23cf/sub-test-model-fc23cf-kserve-56648c78f-qj9wz" podStartSLOduration=1.652881309 podStartE2EDuration="1.652881309s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 18:03:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 18:03:49.650269217 +0000 UTC m=+1365.411577260" watchObservedRunningTime="2026-09-10 18:03:49.652881309 +0000 UTC m=+1365.414189398"
Sep 10 18:03:58.838025 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:03:58.837983    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-fc23cf/sub-test-model-fc23cf-kserve-56648c78f-qj9wz"
Sep 10 18:03:58.838555 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:03:58.838039    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-fc23cf/sub-test-model-fc23cf-kserve-56648c78f-qj9wz"
Sep 10 18:03:58.850949 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:03:58.850919    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-fc23cf/sub-test-model-fc23cf-kserve-56648c78f-qj9wz"
Sep 10 18:03:59.703652 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:03:59.703617    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-fc23cf/sub-test-model-fc23cf-kserve-56648c78f-qj9wz"
Sep 10 18:04:13.043266 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:04:13.043214    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-b38800-66f6848df7-zst89"]
Sep 10 18:04:13.048372 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:04:13.048341    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-b38800-66f6848df7-zst89"
Sep 10 18:04:13.051381 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:04:13.051350    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-b38800-dockercfg-t2tvg\""
Sep 10 18:04:13.051554 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:04:13.051350    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-b38800\""
Sep 10 18:04:13.059200 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:04:13.059171    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-b38800-66f6848df7-zst89"]
Sep 10 18:04:13.144931 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:04:13.144893    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d0caf2a7-157b-429c-b057-e77ee78b3510-plugins-config-volume\") pod \"payload-processing-e2e-api-a-b38800-66f6848df7-zst89\" (UID: \"d0caf2a7-157b-429c-b057-e77ee78b3510\") " pod="openshift-ingress/payload-processing-e2e-api-a-b38800-66f6848df7-zst89"
Sep 10 18:04:13.144931 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:04:13.144934    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nffvp\" (UniqueName: \"kubernetes.io/projected/d0caf2a7-157b-429c-b057-e77ee78b3510-kube-api-access-nffvp\") pod \"payload-processing-e2e-api-a-b38800-66f6848df7-zst89\" (UID: \"d0caf2a7-157b-429c-b057-e77ee78b3510\") " pod="openshift-ingress/payload-processing-e2e-api-a-b38800-66f6848df7-zst89"
Sep 10 18:04:13.246208 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:04:13.246165    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d0caf2a7-157b-429c-b057-e77ee78b3510-plugins-config-volume\") pod \"payload-processing-e2e-api-a-b38800-66f6848df7-zst89\" (UID: \"d0caf2a7-157b-429c-b057-e77ee78b3510\") " pod="openshift-ingress/payload-processing-e2e-api-a-b38800-66f6848df7-zst89"
Sep 10 18:04:13.246208 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:04:13.246213    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nffvp\" (UniqueName: \"kubernetes.io/projected/d0caf2a7-157b-429c-b057-e77ee78b3510-kube-api-access-nffvp\") pod \"payload-processing-e2e-api-a-b38800-66f6848df7-zst89\" (UID: \"d0caf2a7-157b-429c-b057-e77ee78b3510\") " pod="openshift-ingress/payload-processing-e2e-api-a-b38800-66f6848df7-zst89"
Sep 10 18:04:13.247162 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:04:13.247129    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d0caf2a7-157b-429c-b057-e77ee78b3510-plugins-config-volume\") pod \"payload-processing-e2e-api-a-b38800-66f6848df7-zst89\" (UID: \"d0caf2a7-157b-429c-b057-e77ee78b3510\") " pod="openshift-ingress/payload-processing-e2e-api-a-b38800-66f6848df7-zst89"
Sep 10 18:04:13.255235 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:04:13.255193    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nffvp\" (UniqueName: \"kubernetes.io/projected/d0caf2a7-157b-429c-b057-e77ee78b3510-kube-api-access-nffvp\") pod \"payload-processing-e2e-api-a-b38800-66f6848df7-zst89\" (UID: \"d0caf2a7-157b-429c-b057-e77ee78b3510\") " pod="openshift-ingress/payload-processing-e2e-api-a-b38800-66f6848df7-zst89"
Sep 10 18:04:13.361035 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:04:13.360939    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-b38800-66f6848df7-zst89"
Sep 10 18:04:13.642621 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:04:13.642591    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-b38800-66f6848df7-zst89"]
Sep 10 18:04:13.644736 ip-10-0-136-161 kubenswrapper[2568]: W0910 18:04:13.644697    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0caf2a7_157b_429c_b057_e77ee78b3510.slice/crio-2bbe22f8e9d89b144fb769b885355f9345a74eb5e44c0a4a776a51b0eff1a87f WatchSource:0}: Error finding container 2bbe22f8e9d89b144fb769b885355f9345a74eb5e44c0a4a776a51b0eff1a87f: Status 404 returned error can't find the container with id 2bbe22f8e9d89b144fb769b885355f9345a74eb5e44c0a4a776a51b0eff1a87f
Sep 10 18:04:13.784668 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:04:13.784625    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-b38800-66f6848df7-zst89" event={"ID":"d0caf2a7-157b-429c-b057-e77ee78b3510","Type":"ContainerStarted","Data":"9dd33043c4794067b393948ac498fbdb520af96f699236ba80595984ce6927dd"}
Sep 10 18:04:13.784907 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:04:13.784696    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-b38800-66f6848df7-zst89" event={"ID":"d0caf2a7-157b-429c-b057-e77ee78b3510","Type":"ContainerStarted","Data":"2bbe22f8e9d89b144fb769b885355f9345a74eb5e44c0a4a776a51b0eff1a87f"}
Sep 10 18:04:13.784907 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:04:13.784748    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-b38800-66f6848df7-zst89"
Sep 10 18:04:13.808651 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:04:13.808587    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-b38800-66f6848df7-zst89" podStartSLOduration=0.808570728 podStartE2EDuration="808.570728ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 18:04:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 18:04:13.807840946 +0000 UTC m=+1389.569148990" watchObservedRunningTime="2026-09-10 18:04:13.808570728 +0000 UTC m=+1389.569878833"
Sep 10 18:04:24.793468 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:04:24.793432    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-b38800-66f6848df7-zst89"
Sep 10 18:04:35.429215 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:04:35.429176    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-fc23cf/sub-test-model-fc23cf-kserve-56648c78f-qj9wz"]
Sep 10 18:04:42.418911 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:04:42.418874    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-d439f7-5fb7cd5f-ntspv"]
Sep 10 18:04:42.422396 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:04:42.422376    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-d439f7-5fb7cd5f-ntspv"
Sep 10 18:04:42.425636 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:04:42.425615    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-d439f7-dockercfg-lkgkq\""
Sep 10 18:04:42.426001 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:04:42.425980    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-d439f7\""
Sep 10 18:04:42.446440 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:04:42.446409    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-d439f7-5fb7cd5f-ntspv"]
Sep 10 18:04:42.509440 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:04:42.509404    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mcvn\" (UniqueName: \"kubernetes.io/projected/e20155d2-f26d-455b-9dad-4c56bb28e946-kube-api-access-6mcvn\") pod \"payload-processing-e2e-api-b-d439f7-5fb7cd5f-ntspv\" (UID: \"e20155d2-f26d-455b-9dad-4c56bb28e946\") " pod="openshift-ingress/payload-processing-e2e-api-b-d439f7-5fb7cd5f-ntspv"
Sep 10 18:04:42.509618 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:04:42.509457    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e20155d2-f26d-455b-9dad-4c56bb28e946-plugins-config-volume\") pod \"payload-processing-e2e-api-b-d439f7-5fb7cd5f-ntspv\" (UID: \"e20155d2-f26d-455b-9dad-4c56bb28e946\") " pod="openshift-ingress/payload-processing-e2e-api-b-d439f7-5fb7cd5f-ntspv"
Sep 10 18:04:42.610829 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:04:42.610792    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mcvn\" (UniqueName: \"kubernetes.io/projected/e20155d2-f26d-455b-9dad-4c56bb28e946-kube-api-access-6mcvn\") pod \"payload-processing-e2e-api-b-d439f7-5fb7cd5f-ntspv\" (UID: \"e20155d2-f26d-455b-9dad-4c56bb28e946\") " pod="openshift-ingress/payload-processing-e2e-api-b-d439f7-5fb7cd5f-ntspv"
Sep 10 18:04:42.611009 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:04:42.610845    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e20155d2-f26d-455b-9dad-4c56bb28e946-plugins-config-volume\") pod \"payload-processing-e2e-api-b-d439f7-5fb7cd5f-ntspv\" (UID: \"e20155d2-f26d-455b-9dad-4c56bb28e946\") " pod="openshift-ingress/payload-processing-e2e-api-b-d439f7-5fb7cd5f-ntspv"
Sep 10 18:04:42.611550 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:04:42.611530    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e20155d2-f26d-455b-9dad-4c56bb28e946-plugins-config-volume\") pod \"payload-processing-e2e-api-b-d439f7-5fb7cd5f-ntspv\" (UID: \"e20155d2-f26d-455b-9dad-4c56bb28e946\") " pod="openshift-ingress/payload-processing-e2e-api-b-d439f7-5fb7cd5f-ntspv"
Sep 10 18:04:42.620158 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:04:42.620133    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mcvn\" (UniqueName: \"kubernetes.io/projected/e20155d2-f26d-455b-9dad-4c56bb28e946-kube-api-access-6mcvn\") pod \"payload-processing-e2e-api-b-d439f7-5fb7cd5f-ntspv\" (UID: \"e20155d2-f26d-455b-9dad-4c56bb28e946\") " pod="openshift-ingress/payload-processing-e2e-api-b-d439f7-5fb7cd5f-ntspv"
Sep 10 18:04:42.733279 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:04:42.733239    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-d439f7-5fb7cd5f-ntspv"
Sep 10 18:04:43.021673 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:04:43.021643    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-d439f7-5fb7cd5f-ntspv"]
Sep 10 18:04:43.022374 ip-10-0-136-161 kubenswrapper[2568]: W0910 18:04:43.022344    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode20155d2_f26d_455b_9dad_4c56bb28e946.slice/crio-bbd963c26235853ae09214208c6fc7f53ef4e8b49af5203086e5149cb052a2e6 WatchSource:0}: Error finding container bbd963c26235853ae09214208c6fc7f53ef4e8b49af5203086e5149cb052a2e6: Status 404 returned error can't find the container with id bbd963c26235853ae09214208c6fc7f53ef4e8b49af5203086e5149cb052a2e6
Sep 10 18:04:43.962590 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:04:43.962540    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-d439f7-5fb7cd5f-ntspv" event={"ID":"e20155d2-f26d-455b-9dad-4c56bb28e946","Type":"ContainerStarted","Data":"90c86f75e13700cd22ad571b444d36ef3e560af6e0ecf4b740a00381b4ae4c10"}
Sep 10 18:04:43.962991 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:04:43.962615    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-d439f7-5fb7cd5f-ntspv" event={"ID":"e20155d2-f26d-455b-9dad-4c56bb28e946","Type":"ContainerStarted","Data":"bbd963c26235853ae09214208c6fc7f53ef4e8b49af5203086e5149cb052a2e6"}
Sep 10 18:04:43.962991 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:04:43.962643    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-d439f7-5fb7cd5f-ntspv"
Sep 10 18:04:43.990095 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:04:43.990044    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-d439f7-5fb7cd5f-ntspv" podStartSLOduration=1.990029799 podStartE2EDuration="1.990029799s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 18:04:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 18:04:43.989299315 +0000 UTC m=+1419.750607359" watchObservedRunningTime="2026-09-10 18:04:43.990029799 +0000 UTC m=+1419.751337865"
Sep 10 18:04:50.450278 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:04:50.450230    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-fc23cf/sub-test-model-fc23cf-kserve-56648c78f-qj9wz" podUID="d300b8de-df8b-4b1f-9c3d-bb9839515c5a" containerName="main" containerID="cri-o://4538a221eb2a82763ee2cfa0f51dfa9922be248cc94d4d50c46d34fd9e159913" gracePeriod=45
Sep 10 18:04:50.707404 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:04:50.707338    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-fc23cf/sub-test-model-fc23cf-kserve-56648c78f-qj9wz"
Sep 10 18:04:50.784425 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:04:50.784393    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d300b8de-df8b-4b1f-9c3d-bb9839515c5a-tmp-dir\") pod \"d300b8de-df8b-4b1f-9c3d-bb9839515c5a\" (UID: \"d300b8de-df8b-4b1f-9c3d-bb9839515c5a\") "
Sep 10 18:04:50.784425 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:04:50.784428    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d300b8de-df8b-4b1f-9c3d-bb9839515c5a-model-cache\") pod \"d300b8de-df8b-4b1f-9c3d-bb9839515c5a\" (UID: \"d300b8de-df8b-4b1f-9c3d-bb9839515c5a\") "
Sep 10 18:04:50.784667 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:04:50.784464    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d300b8de-df8b-4b1f-9c3d-bb9839515c5a-home\") pod \"d300b8de-df8b-4b1f-9c3d-bb9839515c5a\" (UID: \"d300b8de-df8b-4b1f-9c3d-bb9839515c5a\") "
Sep 10 18:04:50.784667 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:04:50.784500    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rl5ql\" (UniqueName: \"kubernetes.io/projected/d300b8de-df8b-4b1f-9c3d-bb9839515c5a-kube-api-access-rl5ql\") pod \"d300b8de-df8b-4b1f-9c3d-bb9839515c5a\" (UID: \"d300b8de-df8b-4b1f-9c3d-bb9839515c5a\") "
Sep 10 18:04:50.784667 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:04:50.784561    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d300b8de-df8b-4b1f-9c3d-bb9839515c5a-dshm\") pod \"d300b8de-df8b-4b1f-9c3d-bb9839515c5a\" (UID: \"d300b8de-df8b-4b1f-9c3d-bb9839515c5a\") "
Sep 10 18:04:50.784667 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:04:50.784584    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d300b8de-df8b-4b1f-9c3d-bb9839515c5a-tls-certs\") pod \"d300b8de-df8b-4b1f-9c3d-bb9839515c5a\" (UID: \"d300b8de-df8b-4b1f-9c3d-bb9839515c5a\") "
Sep 10 18:04:50.784854 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:04:50.784689    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d300b8de-df8b-4b1f-9c3d-bb9839515c5a-model-cache" (OuterVolumeSpecName: "model-cache") pod "d300b8de-df8b-4b1f-9c3d-bb9839515c5a" (UID: "d300b8de-df8b-4b1f-9c3d-bb9839515c5a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 18:04:50.784854 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:04:50.784705    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d300b8de-df8b-4b1f-9c3d-bb9839515c5a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d300b8de-df8b-4b1f-9c3d-bb9839515c5a" (UID: "d300b8de-df8b-4b1f-9c3d-bb9839515c5a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 18:04:50.784854 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:04:50.784778    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d300b8de-df8b-4b1f-9c3d-bb9839515c5a-home" (OuterVolumeSpecName: "home") pod "d300b8de-df8b-4b1f-9c3d-bb9839515c5a" (UID: "d300b8de-df8b-4b1f-9c3d-bb9839515c5a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 18:04:50.784990 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:04:50.784882    2568 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d300b8de-df8b-4b1f-9c3d-bb9839515c5a-home\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 18:04:50.784990 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:04:50.784893    2568 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d300b8de-df8b-4b1f-9c3d-bb9839515c5a-tmp-dir\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 18:04:50.784990 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:04:50.784902    2568 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d300b8de-df8b-4b1f-9c3d-bb9839515c5a-model-cache\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 18:04:50.786699 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:04:50.786672    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d300b8de-df8b-4b1f-9c3d-bb9839515c5a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d300b8de-df8b-4b1f-9c3d-bb9839515c5a" (UID: "d300b8de-df8b-4b1f-9c3d-bb9839515c5a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 18:04:50.786807 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:04:50.786784    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d300b8de-df8b-4b1f-9c3d-bb9839515c5a-kube-api-access-rl5ql" (OuterVolumeSpecName: "kube-api-access-rl5ql") pod "d300b8de-df8b-4b1f-9c3d-bb9839515c5a" (UID: "d300b8de-df8b-4b1f-9c3d-bb9839515c5a"). InnerVolumeSpecName "kube-api-access-rl5ql". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 18:04:50.786848 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:04:50.786792    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d300b8de-df8b-4b1f-9c3d-bb9839515c5a-dshm" (OuterVolumeSpecName: "dshm") pod "d300b8de-df8b-4b1f-9c3d-bb9839515c5a" (UID: "d300b8de-df8b-4b1f-9c3d-bb9839515c5a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 18:04:50.885435 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:04:50.885400    2568 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d300b8de-df8b-4b1f-9c3d-bb9839515c5a-dshm\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 18:04:50.885435 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:04:50.885427    2568 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d300b8de-df8b-4b1f-9c3d-bb9839515c5a-tls-certs\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 18:04:50.885435 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:04:50.885437    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rl5ql\" (UniqueName: \"kubernetes.io/projected/d300b8de-df8b-4b1f-9c3d-bb9839515c5a-kube-api-access-rl5ql\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 18:04:51.004799 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:04:51.004761    2568 generic.go:356] "Generic (PLEG): container finished" podID="d300b8de-df8b-4b1f-9c3d-bb9839515c5a" containerID="4538a221eb2a82763ee2cfa0f51dfa9922be248cc94d4d50c46d34fd9e159913" exitCode=0
Sep 10 18:04:51.004986 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:04:51.004802    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-fc23cf/sub-test-model-fc23cf-kserve-56648c78f-qj9wz"
Sep 10 18:04:51.004986 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:04:51.004840    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-fc23cf/sub-test-model-fc23cf-kserve-56648c78f-qj9wz" event={"ID":"d300b8de-df8b-4b1f-9c3d-bb9839515c5a","Type":"ContainerDied","Data":"4538a221eb2a82763ee2cfa0f51dfa9922be248cc94d4d50c46d34fd9e159913"}
Sep 10 18:04:51.004986 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:04:51.004881    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-fc23cf/sub-test-model-fc23cf-kserve-56648c78f-qj9wz" event={"ID":"d300b8de-df8b-4b1f-9c3d-bb9839515c5a","Type":"ContainerDied","Data":"2268d4357a03c402ef4c70f19de895b94462213af18149a0a2c8dc1686b86cc2"}
Sep 10 18:04:51.004986 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:04:51.004899    2568 scope.go:117] "RemoveContainer" containerID="4538a221eb2a82763ee2cfa0f51dfa9922be248cc94d4d50c46d34fd9e159913"
Sep 10 18:04:51.014488 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:04:51.014467    2568 scope.go:117] "RemoveContainer" containerID="4538a221eb2a82763ee2cfa0f51dfa9922be248cc94d4d50c46d34fd9e159913"
Sep 10 18:04:51.014774 ip-10-0-136-161 kubenswrapper[2568]: E0910 18:04:51.014755    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4538a221eb2a82763ee2cfa0f51dfa9922be248cc94d4d50c46d34fd9e159913\": container with ID starting with 4538a221eb2a82763ee2cfa0f51dfa9922be248cc94d4d50c46d34fd9e159913 not found: ID does not exist" containerID="4538a221eb2a82763ee2cfa0f51dfa9922be248cc94d4d50c46d34fd9e159913"
Sep 10 18:04:51.014827 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:04:51.014782    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4538a221eb2a82763ee2cfa0f51dfa9922be248cc94d4d50c46d34fd9e159913"} err="failed to get container status \"4538a221eb2a82763ee2cfa0f51dfa9922be248cc94d4d50c46d34fd9e159913\": rpc error: code = NotFound desc = could not find container \"4538a221eb2a82763ee2cfa0f51dfa9922be248cc94d4d50c46d34fd9e159913\": container with ID starting with 4538a221eb2a82763ee2cfa0f51dfa9922be248cc94d4d50c46d34fd9e159913 not found: ID does not exist"
Sep 10 18:04:51.036446 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:04:51.036417    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-fc23cf/sub-test-model-fc23cf-kserve-56648c78f-qj9wz"]
Sep 10 18:04:51.041383 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:04:51.041361    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-fc23cf/sub-test-model-fc23cf-kserve-56648c78f-qj9wz"]
Sep 10 18:04:52.320452 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:04:52.320418    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w3-6c9ffc/rate-test-model-6c9ffc-kserve-6454888f7f-zlszf"]
Sep 10 18:04:52.321044 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:04:52.321023    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d300b8de-df8b-4b1f-9c3d-bb9839515c5a" containerName="main"
Sep 10 18:04:52.321131 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:04:52.321048    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="d300b8de-df8b-4b1f-9c3d-bb9839515c5a" containerName="main"
Sep 10 18:04:52.321190 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:04:52.321160    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="d300b8de-df8b-4b1f-9c3d-bb9839515c5a" containerName="main"
Sep 10 18:04:52.324281 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:04:52.324260    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-6c9ffc/rate-test-model-6c9ffc-kserve-6454888f7f-zlszf"
Sep 10 18:04:52.328591 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:04:52.328564    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-6c9ffc\"/\"kube-root-ca.crt\""
Sep 10 18:04:52.329804 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:04:52.329783    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-6c9ffc\"/\"default-dockercfg-5b6b4\""
Sep 10 18:04:52.330077 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:04:52.330059    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-6c9ffc\"/\"rate-test-model-6c9ffc-kserve-self-signed-certs\""
Sep 10 18:04:52.330163 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:04:52.330105    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-6c9ffc\"/\"openshift-service-ca.crt\""
Sep 10 18:04:52.337616 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:04:52.337591    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-6c9ffc/rate-test-model-6c9ffc-kserve-6454888f7f-zlszf"]
Sep 10 18:04:52.500797 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:04:52.500758    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/13af3f93-61cf-4035-8ba2-affddfe52057-dshm\") pod \"rate-test-model-6c9ffc-kserve-6454888f7f-zlszf\" (UID: \"13af3f93-61cf-4035-8ba2-affddfe52057\") " pod="ai-tenant-e2e-shared-a-w3-6c9ffc/rate-test-model-6c9ffc-kserve-6454888f7f-zlszf"
Sep 10 18:04:52.500797 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:04:52.500799    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/13af3f93-61cf-4035-8ba2-affddfe52057-tls-certs\") pod \"rate-test-model-6c9ffc-kserve-6454888f7f-zlszf\" (UID: \"13af3f93-61cf-4035-8ba2-affddfe52057\") " pod="ai-tenant-e2e-shared-a-w3-6c9ffc/rate-test-model-6c9ffc-kserve-6454888f7f-zlszf"
Sep 10 18:04:52.501024 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:04:52.500829    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/13af3f93-61cf-4035-8ba2-affddfe52057-home\") pod \"rate-test-model-6c9ffc-kserve-6454888f7f-zlszf\" (UID: \"13af3f93-61cf-4035-8ba2-affddfe52057\") " pod="ai-tenant-e2e-shared-a-w3-6c9ffc/rate-test-model-6c9ffc-kserve-6454888f7f-zlszf"
Sep 10 18:04:52.501024 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:04:52.500893    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/13af3f93-61cf-4035-8ba2-affddfe52057-tmp-dir\") pod \"rate-test-model-6c9ffc-kserve-6454888f7f-zlszf\" (UID: \"13af3f93-61cf-4035-8ba2-affddfe52057\") " pod="ai-tenant-e2e-shared-a-w3-6c9ffc/rate-test-model-6c9ffc-kserve-6454888f7f-zlszf"
Sep 10 18:04:52.501024 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:04:52.500970    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6c6gp\" (UniqueName: \"kubernetes.io/projected/13af3f93-61cf-4035-8ba2-affddfe52057-kube-api-access-6c6gp\") pod \"rate-test-model-6c9ffc-kserve-6454888f7f-zlszf\" (UID: \"13af3f93-61cf-4035-8ba2-affddfe52057\") " pod="ai-tenant-e2e-shared-a-w3-6c9ffc/rate-test-model-6c9ffc-kserve-6454888f7f-zlszf"
Sep 10 18:04:52.501024 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:04:52.500993    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/13af3f93-61cf-4035-8ba2-affddfe52057-model-cache\") pod \"rate-test-model-6c9ffc-kserve-6454888f7f-zlszf\" (UID: \"13af3f93-61cf-4035-8ba2-affddfe52057\") " pod="ai-tenant-e2e-shared-a-w3-6c9ffc/rate-test-model-6c9ffc-kserve-6454888f7f-zlszf"
Sep 10 18:04:52.602164 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:04:52.602077    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6c6gp\" (UniqueName: \"kubernetes.io/projected/13af3f93-61cf-4035-8ba2-affddfe52057-kube-api-access-6c6gp\") pod \"rate-test-model-6c9ffc-kserve-6454888f7f-zlszf\" (UID: \"13af3f93-61cf-4035-8ba2-affddfe52057\") " pod="ai-tenant-e2e-shared-a-w3-6c9ffc/rate-test-model-6c9ffc-kserve-6454888f7f-zlszf"
Sep 10 18:04:52.602164 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:04:52.602118    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/13af3f93-61cf-4035-8ba2-affddfe52057-model-cache\") pod \"rate-test-model-6c9ffc-kserve-6454888f7f-zlszf\" (UID: \"13af3f93-61cf-4035-8ba2-affddfe52057\") " pod="ai-tenant-e2e-shared-a-w3-6c9ffc/rate-test-model-6c9ffc-kserve-6454888f7f-zlszf"
Sep 10 18:04:52.602426 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:04:52.602167    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/13af3f93-61cf-4035-8ba2-affddfe52057-dshm\") pod \"rate-test-model-6c9ffc-kserve-6454888f7f-zlszf\" (UID: \"13af3f93-61cf-4035-8ba2-affddfe52057\") " pod="ai-tenant-e2e-shared-a-w3-6c9ffc/rate-test-model-6c9ffc-kserve-6454888f7f-zlszf"
Sep 10 18:04:52.602426 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:04:52.602186    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/13af3f93-61cf-4035-8ba2-affddfe52057-tls-certs\") pod \"rate-test-model-6c9ffc-kserve-6454888f7f-zlszf\" (UID: \"13af3f93-61cf-4035-8ba2-affddfe52057\") " pod="ai-tenant-e2e-shared-a-w3-6c9ffc/rate-test-model-6c9ffc-kserve-6454888f7f-zlszf"
Sep 10 18:04:52.602426 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:04:52.602212    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/13af3f93-61cf-4035-8ba2-affddfe52057-home\") pod \"rate-test-model-6c9ffc-kserve-6454888f7f-zlszf\" (UID: \"13af3f93-61cf-4035-8ba2-affddfe52057\") " pod="ai-tenant-e2e-shared-a-w3-6c9ffc/rate-test-model-6c9ffc-kserve-6454888f7f-zlszf"
Sep 10 18:04:52.602426 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:04:52.602228    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/13af3f93-61cf-4035-8ba2-affddfe52057-tmp-dir\") pod \"rate-test-model-6c9ffc-kserve-6454888f7f-zlszf\" (UID: \"13af3f93-61cf-4035-8ba2-affddfe52057\") " pod="ai-tenant-e2e-shared-a-w3-6c9ffc/rate-test-model-6c9ffc-kserve-6454888f7f-zlszf"
Sep 10 18:04:52.602680 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:04:52.602657    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/13af3f93-61cf-4035-8ba2-affddfe52057-model-cache\") pod \"rate-test-model-6c9ffc-kserve-6454888f7f-zlszf\" (UID: \"13af3f93-61cf-4035-8ba2-affddfe52057\") " pod="ai-tenant-e2e-shared-a-w3-6c9ffc/rate-test-model-6c9ffc-kserve-6454888f7f-zlszf"
Sep 10 18:04:52.602740 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:04:52.602689    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/13af3f93-61cf-4035-8ba2-affddfe52057-tmp-dir\") pod \"rate-test-model-6c9ffc-kserve-6454888f7f-zlszf\" (UID: \"13af3f93-61cf-4035-8ba2-affddfe52057\") " pod="ai-tenant-e2e-shared-a-w3-6c9ffc/rate-test-model-6c9ffc-kserve-6454888f7f-zlszf"
Sep 10 18:04:52.602740 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:04:52.602716    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/13af3f93-61cf-4035-8ba2-affddfe52057-home\") pod \"rate-test-model-6c9ffc-kserve-6454888f7f-zlszf\" (UID: \"13af3f93-61cf-4035-8ba2-affddfe52057\") " pod="ai-tenant-e2e-shared-a-w3-6c9ffc/rate-test-model-6c9ffc-kserve-6454888f7f-zlszf"
Sep 10 18:04:52.604609 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:04:52.604579    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/13af3f93-61cf-4035-8ba2-affddfe52057-dshm\") pod \"rate-test-model-6c9ffc-kserve-6454888f7f-zlszf\" (UID: \"13af3f93-61cf-4035-8ba2-affddfe52057\") " pod="ai-tenant-e2e-shared-a-w3-6c9ffc/rate-test-model-6c9ffc-kserve-6454888f7f-zlszf"
Sep 10 18:04:52.604803 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:04:52.604786    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/13af3f93-61cf-4035-8ba2-affddfe52057-tls-certs\") pod \"rate-test-model-6c9ffc-kserve-6454888f7f-zlszf\" (UID: \"13af3f93-61cf-4035-8ba2-affddfe52057\") " pod="ai-tenant-e2e-shared-a-w3-6c9ffc/rate-test-model-6c9ffc-kserve-6454888f7f-zlszf"
Sep 10 18:04:52.613712 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:04:52.613688    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6c6gp\" (UniqueName: \"kubernetes.io/projected/13af3f93-61cf-4035-8ba2-affddfe52057-kube-api-access-6c6gp\") pod \"rate-test-model-6c9ffc-kserve-6454888f7f-zlszf\" (UID: \"13af3f93-61cf-4035-8ba2-affddfe52057\") " pod="ai-tenant-e2e-shared-a-w3-6c9ffc/rate-test-model-6c9ffc-kserve-6454888f7f-zlszf"
Sep 10 18:04:52.633683 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:04:52.633656    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-6c9ffc/rate-test-model-6c9ffc-kserve-6454888f7f-zlszf"
Sep 10 18:04:52.770925 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:04:52.770891    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d300b8de-df8b-4b1f-9c3d-bb9839515c5a" path="/var/lib/kubelet/pods/d300b8de-df8b-4b1f-9c3d-bb9839515c5a/volumes"
Sep 10 18:04:52.920826 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:04:52.920751    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-6c9ffc/rate-test-model-6c9ffc-kserve-6454888f7f-zlszf"]
Sep 10 18:04:52.923695 ip-10-0-136-161 kubenswrapper[2568]: W0910 18:04:52.923659    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod13af3f93_61cf_4035_8ba2_affddfe52057.slice/crio-c30ad6f38eaa91f37343ac57343563b19e14acceb51dd97f2ba9d4f9e0c724f7 WatchSource:0}: Error finding container c30ad6f38eaa91f37343ac57343563b19e14acceb51dd97f2ba9d4f9e0c724f7: Status 404 returned error can't find the container with id c30ad6f38eaa91f37343ac57343563b19e14acceb51dd97f2ba9d4f9e0c724f7
Sep 10 18:04:53.020087 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:04:53.020046    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-6c9ffc/rate-test-model-6c9ffc-kserve-6454888f7f-zlszf" event={"ID":"13af3f93-61cf-4035-8ba2-affddfe52057","Type":"ContainerStarted","Data":"649a91cd95a7e7c326bed31d8b8d70a6158187504bb4d54e1e557d76c54b0388"}
Sep 10 18:04:53.020253 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:04:53.020100    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-6c9ffc/rate-test-model-6c9ffc-kserve-6454888f7f-zlszf" event={"ID":"13af3f93-61cf-4035-8ba2-affddfe52057","Type":"ContainerStarted","Data":"c30ad6f38eaa91f37343ac57343563b19e14acceb51dd97f2ba9d4f9e0c724f7"}
Sep 10 18:04:53.048300 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:04:53.048221    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w3-6c9ffc/rate-test-model-6c9ffc-kserve-6454888f7f-zlszf" podStartSLOduration=1.048199505 podStartE2EDuration="1.048199505s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 18:04:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 18:04:53.047492974 +0000 UTC m=+1428.808801017" watchObservedRunningTime="2026-09-10 18:04:53.048199505 +0000 UTC m=+1428.809507550"
Sep 10 18:04:54.972056 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:04:54.972024    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-d439f7-5fb7cd5f-ntspv"
Sep 10 18:05:02.634521 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:05:02.634412    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w3-6c9ffc/rate-test-model-6c9ffc-kserve-6454888f7f-zlszf"
Sep 10 18:05:02.634521 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:05:02.634515    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w3-6c9ffc/rate-test-model-6c9ffc-kserve-6454888f7f-zlszf"
Sep 10 18:05:02.650832 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:05:02.650792    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w3-6c9ffc/rate-test-model-6c9ffc-kserve-6454888f7f-zlszf"
Sep 10 18:05:03.097311 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:05:03.097278    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w3-6c9ffc/rate-test-model-6c9ffc-kserve-6454888f7f-zlszf"
Sep 10 18:05:05.796787 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:05:05.796746    2568 scope.go:117] "RemoveContainer" containerID="82a66a12d4ae2b8dbadda6fde69741c5794c3626acd23f86dea10bc0a9613aad"
Sep 10 18:05:23.374190 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:05:23.374149    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-b38800-66f6848df7-zst89"]
Sep 10 18:05:23.374834 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:05:23.374436    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-b38800-66f6848df7-zst89" podUID="d0caf2a7-157b-429c-b057-e77ee78b3510" containerName="payload-processing" containerID="cri-o://9dd33043c4794067b393948ac498fbdb520af96f699236ba80595984ce6927dd" gracePeriod=30
Sep 10 18:05:23.627961 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:05:23.627887    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-b38800-66f6848df7-zst89"
Sep 10 18:05:23.688288 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:05:23.688256    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d0caf2a7-157b-429c-b057-e77ee78b3510-plugins-config-volume\") pod \"d0caf2a7-157b-429c-b057-e77ee78b3510\" (UID: \"d0caf2a7-157b-429c-b057-e77ee78b3510\") "
Sep 10 18:05:23.688528 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:05:23.688367    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nffvp\" (UniqueName: \"kubernetes.io/projected/d0caf2a7-157b-429c-b057-e77ee78b3510-kube-api-access-nffvp\") pod \"d0caf2a7-157b-429c-b057-e77ee78b3510\" (UID: \"d0caf2a7-157b-429c-b057-e77ee78b3510\") "
Sep 10 18:05:23.688758 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:05:23.688714    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0caf2a7-157b-429c-b057-e77ee78b3510-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d0caf2a7-157b-429c-b057-e77ee78b3510" (UID: "d0caf2a7-157b-429c-b057-e77ee78b3510"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 18:05:23.690575 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:05:23.690547    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0caf2a7-157b-429c-b057-e77ee78b3510-kube-api-access-nffvp" (OuterVolumeSpecName: "kube-api-access-nffvp") pod "d0caf2a7-157b-429c-b057-e77ee78b3510" (UID: "d0caf2a7-157b-429c-b057-e77ee78b3510"). InnerVolumeSpecName "kube-api-access-nffvp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 18:05:23.789644 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:05:23.789605    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d0caf2a7-157b-429c-b057-e77ee78b3510-plugins-config-volume\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 18:05:23.789644 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:05:23.789641    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nffvp\" (UniqueName: \"kubernetes.io/projected/d0caf2a7-157b-429c-b057-e77ee78b3510-kube-api-access-nffvp\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 18:05:24.219874 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:05:24.219838    2568 generic.go:356] "Generic (PLEG): container finished" podID="d0caf2a7-157b-429c-b057-e77ee78b3510" containerID="9dd33043c4794067b393948ac498fbdb520af96f699236ba80595984ce6927dd" exitCode=0
Sep 10 18:05:24.220078 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:05:24.219884    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-b38800-66f6848df7-zst89"
Sep 10 18:05:24.220078 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:05:24.219925    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-b38800-66f6848df7-zst89" event={"ID":"d0caf2a7-157b-429c-b057-e77ee78b3510","Type":"ContainerDied","Data":"9dd33043c4794067b393948ac498fbdb520af96f699236ba80595984ce6927dd"}
Sep 10 18:05:24.220078 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:05:24.219983    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-b38800-66f6848df7-zst89" event={"ID":"d0caf2a7-157b-429c-b057-e77ee78b3510","Type":"ContainerDied","Data":"2bbe22f8e9d89b144fb769b885355f9345a74eb5e44c0a4a776a51b0eff1a87f"}
Sep 10 18:05:24.220078 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:05:24.220007    2568 scope.go:117] "RemoveContainer" containerID="9dd33043c4794067b393948ac498fbdb520af96f699236ba80595984ce6927dd"
Sep 10 18:05:24.230527 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:05:24.230508    2568 scope.go:117] "RemoveContainer" containerID="9dd33043c4794067b393948ac498fbdb520af96f699236ba80595984ce6927dd"
Sep 10 18:05:24.230821 ip-10-0-136-161 kubenswrapper[2568]: E0910 18:05:24.230799    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9dd33043c4794067b393948ac498fbdb520af96f699236ba80595984ce6927dd\": container with ID starting with 9dd33043c4794067b393948ac498fbdb520af96f699236ba80595984ce6927dd not found: ID does not exist" containerID="9dd33043c4794067b393948ac498fbdb520af96f699236ba80595984ce6927dd"
Sep 10 18:05:24.230866 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:05:24.230831    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9dd33043c4794067b393948ac498fbdb520af96f699236ba80595984ce6927dd"} err="failed to get container status \"9dd33043c4794067b393948ac498fbdb520af96f699236ba80595984ce6927dd\": rpc error: code = NotFound desc = could not find container \"9dd33043c4794067b393948ac498fbdb520af96f699236ba80595984ce6927dd\": container with ID starting with 9dd33043c4794067b393948ac498fbdb520af96f699236ba80595984ce6927dd not found: ID does not exist"
Sep 10 18:05:24.254647 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:05:24.254616    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-b38800-66f6848df7-zst89"]
Sep 10 18:05:24.259559 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:05:24.259524    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-b38800-66f6848df7-zst89"]
Sep 10 18:05:24.770637 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:05:24.770598    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0caf2a7-157b-429c-b057-e77ee78b3510" path="/var/lib/kubelet/pods/d0caf2a7-157b-429c-b057-e77ee78b3510/volumes"
Sep 10 18:05:46.918981 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:05:46.918936    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-d439f7-5fb7cd5f-ntspv"]
Sep 10 18:05:46.919540 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:05:46.919269    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-d439f7-5fb7cd5f-ntspv" podUID="e20155d2-f26d-455b-9dad-4c56bb28e946" containerName="payload-processing" containerID="cri-o://90c86f75e13700cd22ad571b444d36ef3e560af6e0ecf4b740a00381b4ae4c10" gracePeriod=30
Sep 10 18:05:47.185247 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:05:47.185174    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-d439f7-5fb7cd5f-ntspv"
Sep 10 18:05:47.321429 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:05:47.321390    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e20155d2-f26d-455b-9dad-4c56bb28e946-plugins-config-volume\") pod \"e20155d2-f26d-455b-9dad-4c56bb28e946\" (UID: \"e20155d2-f26d-455b-9dad-4c56bb28e946\") "
Sep 10 18:05:47.321636 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:05:47.321512    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6mcvn\" (UniqueName: \"kubernetes.io/projected/e20155d2-f26d-455b-9dad-4c56bb28e946-kube-api-access-6mcvn\") pod \"e20155d2-f26d-455b-9dad-4c56bb28e946\" (UID: \"e20155d2-f26d-455b-9dad-4c56bb28e946\") "
Sep 10 18:05:47.321853 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:05:47.321823    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e20155d2-f26d-455b-9dad-4c56bb28e946-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e20155d2-f26d-455b-9dad-4c56bb28e946" (UID: "e20155d2-f26d-455b-9dad-4c56bb28e946"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 18:05:47.323614 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:05:47.323585    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e20155d2-f26d-455b-9dad-4c56bb28e946-kube-api-access-6mcvn" (OuterVolumeSpecName: "kube-api-access-6mcvn") pod "e20155d2-f26d-455b-9dad-4c56bb28e946" (UID: "e20155d2-f26d-455b-9dad-4c56bb28e946"). InnerVolumeSpecName "kube-api-access-6mcvn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 18:05:47.373785 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:05:47.373743    2568 generic.go:356] "Generic (PLEG): container finished" podID="e20155d2-f26d-455b-9dad-4c56bb28e946" containerID="90c86f75e13700cd22ad571b444d36ef3e560af6e0ecf4b740a00381b4ae4c10" exitCode=0
Sep 10 18:05:47.373957 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:05:47.373793    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-d439f7-5fb7cd5f-ntspv"
Sep 10 18:05:47.373957 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:05:47.373829    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-d439f7-5fb7cd5f-ntspv" event={"ID":"e20155d2-f26d-455b-9dad-4c56bb28e946","Type":"ContainerDied","Data":"90c86f75e13700cd22ad571b444d36ef3e560af6e0ecf4b740a00381b4ae4c10"}
Sep 10 18:05:47.373957 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:05:47.373887    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-d439f7-5fb7cd5f-ntspv" event={"ID":"e20155d2-f26d-455b-9dad-4c56bb28e946","Type":"ContainerDied","Data":"bbd963c26235853ae09214208c6fc7f53ef4e8b49af5203086e5149cb052a2e6"}
Sep 10 18:05:47.373957 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:05:47.373914    2568 scope.go:117] "RemoveContainer" containerID="90c86f75e13700cd22ad571b444d36ef3e560af6e0ecf4b740a00381b4ae4c10"
Sep 10 18:05:47.386872 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:05:47.386821    2568 scope.go:117] "RemoveContainer" containerID="90c86f75e13700cd22ad571b444d36ef3e560af6e0ecf4b740a00381b4ae4c10"
Sep 10 18:05:47.387702 ip-10-0-136-161 kubenswrapper[2568]: E0910 18:05:47.387670    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90c86f75e13700cd22ad571b444d36ef3e560af6e0ecf4b740a00381b4ae4c10\": container with ID starting with 90c86f75e13700cd22ad571b444d36ef3e560af6e0ecf4b740a00381b4ae4c10 not found: ID does not exist" containerID="90c86f75e13700cd22ad571b444d36ef3e560af6e0ecf4b740a00381b4ae4c10"
Sep 10 18:05:47.387826 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:05:47.387715    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90c86f75e13700cd22ad571b444d36ef3e560af6e0ecf4b740a00381b4ae4c10"} err="failed to get container status \"90c86f75e13700cd22ad571b444d36ef3e560af6e0ecf4b740a00381b4ae4c10\": rpc error: code = NotFound desc = could not find container \"90c86f75e13700cd22ad571b444d36ef3e560af6e0ecf4b740a00381b4ae4c10\": container with ID starting with 90c86f75e13700cd22ad571b444d36ef3e560af6e0ecf4b740a00381b4ae4c10 not found: ID does not exist"
Sep 10 18:05:47.401210 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:05:47.401172    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-d439f7-5fb7cd5f-ntspv"]
Sep 10 18:05:47.403979 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:05:47.403953    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-d439f7-5fb7cd5f-ntspv"]
Sep 10 18:05:47.422524 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:05:47.422484    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6mcvn\" (UniqueName: \"kubernetes.io/projected/e20155d2-f26d-455b-9dad-4c56bb28e946-kube-api-access-6mcvn\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 18:05:47.422524 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:05:47.422514    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e20155d2-f26d-455b-9dad-4c56bb28e946-plugins-config-volume\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 18:05:48.770059 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:05:48.770015    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e20155d2-f26d-455b-9dad-4c56bb28e946" path="/var/lib/kubelet/pods/e20155d2-f26d-455b-9dad-4c56bb28e946/volumes"
Sep 10 18:06:04.851242 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:06:04.851208    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-jwfnv_e90054ec-91dc-4cda-94a2-fbe7a2a1fff0/console-operator/1.log"
Sep 10 18:06:04.853995 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:06:04.853970    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-jwfnv_e90054ec-91dc-4cda-94a2-fbe7a2a1fff0/console-operator/1.log"
Sep 10 18:06:05.274195 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:06:05.274155    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-971a94-75b8ddcdff-jt78p"]
Sep 10 18:06:05.274520 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:06:05.274463    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-971a94-75b8ddcdff-jt78p" podUID="44ceb0c8-2217-44ea-aabe-b21dc399bb50" containerName="payload-processing" containerID="cri-o://4010912fd9088bb3a7f0a9a2422977fcbaa7db774531ecd97637ce7719a52455" gracePeriod=30
Sep 10 18:06:05.493442 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:06:05.493387    2568 generic.go:356] "Generic (PLEG): container finished" podID="44ceb0c8-2217-44ea-aabe-b21dc399bb50" containerID="4010912fd9088bb3a7f0a9a2422977fcbaa7db774531ecd97637ce7719a52455" exitCode=0
Sep 10 18:06:05.493678 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:06:05.493459    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-971a94-75b8ddcdff-jt78p" event={"ID":"44ceb0c8-2217-44ea-aabe-b21dc399bb50","Type":"ContainerDied","Data":"4010912fd9088bb3a7f0a9a2422977fcbaa7db774531ecd97637ce7719a52455"}
Sep 10 18:06:05.553542 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:06:05.553507    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-971a94-75b8ddcdff-jt78p"
Sep 10 18:06:05.576893 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:06:05.576860    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-872gp\" (UniqueName: \"kubernetes.io/projected/44ceb0c8-2217-44ea-aabe-b21dc399bb50-kube-api-access-872gp\") pod \"44ceb0c8-2217-44ea-aabe-b21dc399bb50\" (UID: \"44ceb0c8-2217-44ea-aabe-b21dc399bb50\") "
Sep 10 18:06:05.577092 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:06:05.576934    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/44ceb0c8-2217-44ea-aabe-b21dc399bb50-plugins-config-volume\") pod \"44ceb0c8-2217-44ea-aabe-b21dc399bb50\" (UID: \"44ceb0c8-2217-44ea-aabe-b21dc399bb50\") "
Sep 10 18:06:05.577450 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:06:05.577415    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/44ceb0c8-2217-44ea-aabe-b21dc399bb50-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "44ceb0c8-2217-44ea-aabe-b21dc399bb50" (UID: "44ceb0c8-2217-44ea-aabe-b21dc399bb50"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 18:06:05.579775 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:06:05.579732    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44ceb0c8-2217-44ea-aabe-b21dc399bb50-kube-api-access-872gp" (OuterVolumeSpecName: "kube-api-access-872gp") pod "44ceb0c8-2217-44ea-aabe-b21dc399bb50" (UID: "44ceb0c8-2217-44ea-aabe-b21dc399bb50"). InnerVolumeSpecName "kube-api-access-872gp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 18:06:05.677931 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:06:05.677893    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-872gp\" (UniqueName: \"kubernetes.io/projected/44ceb0c8-2217-44ea-aabe-b21dc399bb50-kube-api-access-872gp\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 18:06:05.677931 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:06:05.677928    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/44ceb0c8-2217-44ea-aabe-b21dc399bb50-plugins-config-volume\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 18:06:05.823742 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:06:05.823652    2568 scope.go:117] "RemoveContainer" containerID="4010912fd9088bb3a7f0a9a2422977fcbaa7db774531ecd97637ce7719a52455"
Sep 10 18:06:05.833712 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:06:05.833679    2568 scope.go:117] "RemoveContainer" containerID="828678434e9cba0740ddbdaf644c658e3e4486d93c98785394dfdf255c56c131"
Sep 10 18:06:06.499110 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:06:06.499068    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-971a94-75b8ddcdff-jt78p" event={"ID":"44ceb0c8-2217-44ea-aabe-b21dc399bb50","Type":"ContainerDied","Data":"9b248aeed7164455f308498e9f26457b959da073dc35c2f1966e72b61dacea82"}
Sep 10 18:06:06.499110 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:06:06.499099    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-971a94-75b8ddcdff-jt78p"
Sep 10 18:06:06.532784 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:06:06.532746    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-971a94-75b8ddcdff-jt78p"]
Sep 10 18:06:06.536572 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:06:06.536531    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-971a94-75b8ddcdff-jt78p"]
Sep 10 18:06:06.772044 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:06:06.771940    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="44ceb0c8-2217-44ea-aabe-b21dc399bb50" path="/var/lib/kubelet/pods/44ceb0c8-2217-44ea-aabe-b21dc399bb50/volumes"
Sep 10 18:06:23.281959 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:06:23.281921    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-09fbb5-6786594459-n5znm"]
Sep 10 18:06:23.282540 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:06:23.282164    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-09fbb5-6786594459-n5znm" podUID="0fd929f6-4ff9-40bb-97d8-90faf4b50b9e" containerName="payload-processing" containerID="cri-o://b325941eccb4a3ddfdc25edc739f3d83350311d4719dc810732a3d2a5584a167" gracePeriod=30
Sep 10 18:06:23.551979 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:06:23.551944    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-09fbb5-6786594459-n5znm"
Sep 10 18:06:23.605485 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:06:23.605444    2568 generic.go:356] "Generic (PLEG): container finished" podID="0fd929f6-4ff9-40bb-97d8-90faf4b50b9e" containerID="b325941eccb4a3ddfdc25edc739f3d83350311d4719dc810732a3d2a5584a167" exitCode=0
Sep 10 18:06:23.605671 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:06:23.605493    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-09fbb5-6786594459-n5znm"
Sep 10 18:06:23.605671 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:06:23.605530    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-09fbb5-6786594459-n5znm" event={"ID":"0fd929f6-4ff9-40bb-97d8-90faf4b50b9e","Type":"ContainerDied","Data":"b325941eccb4a3ddfdc25edc739f3d83350311d4719dc810732a3d2a5584a167"}
Sep 10 18:06:23.605671 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:06:23.605589    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-09fbb5-6786594459-n5znm" event={"ID":"0fd929f6-4ff9-40bb-97d8-90faf4b50b9e","Type":"ContainerDied","Data":"ea4b632382ccbe154da93087ed479704e0d0bdaccbc1dff837a597e868737cd3"}
Sep 10 18:06:23.605671 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:06:23.605619    2568 scope.go:117] "RemoveContainer" containerID="b325941eccb4a3ddfdc25edc739f3d83350311d4719dc810732a3d2a5584a167"
Sep 10 18:06:23.615799 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:06:23.615779    2568 scope.go:117] "RemoveContainer" containerID="b325941eccb4a3ddfdc25edc739f3d83350311d4719dc810732a3d2a5584a167"
Sep 10 18:06:23.616140 ip-10-0-136-161 kubenswrapper[2568]: E0910 18:06:23.616118    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b325941eccb4a3ddfdc25edc739f3d83350311d4719dc810732a3d2a5584a167\": container with ID starting with b325941eccb4a3ddfdc25edc739f3d83350311d4719dc810732a3d2a5584a167 not found: ID does not exist" containerID="b325941eccb4a3ddfdc25edc739f3d83350311d4719dc810732a3d2a5584a167"
Sep 10 18:06:23.616188 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:06:23.616149    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b325941eccb4a3ddfdc25edc739f3d83350311d4719dc810732a3d2a5584a167"} err="failed to get container status \"b325941eccb4a3ddfdc25edc739f3d83350311d4719dc810732a3d2a5584a167\": rpc error: code = NotFound desc = could not find container \"b325941eccb4a3ddfdc25edc739f3d83350311d4719dc810732a3d2a5584a167\": container with ID starting with b325941eccb4a3ddfdc25edc739f3d83350311d4719dc810732a3d2a5584a167 not found: ID does not exist"
Sep 10 18:06:23.643902 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:06:23.643859    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0fd929f6-4ff9-40bb-97d8-90faf4b50b9e-plugins-config-volume\") pod \"0fd929f6-4ff9-40bb-97d8-90faf4b50b9e\" (UID: \"0fd929f6-4ff9-40bb-97d8-90faf4b50b9e\") "
Sep 10 18:06:23.644096 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:06:23.643925    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jmjx9\" (UniqueName: \"kubernetes.io/projected/0fd929f6-4ff9-40bb-97d8-90faf4b50b9e-kube-api-access-jmjx9\") pod \"0fd929f6-4ff9-40bb-97d8-90faf4b50b9e\" (UID: \"0fd929f6-4ff9-40bb-97d8-90faf4b50b9e\") "
Sep 10 18:06:23.644364 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:06:23.644308    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0fd929f6-4ff9-40bb-97d8-90faf4b50b9e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0fd929f6-4ff9-40bb-97d8-90faf4b50b9e" (UID: "0fd929f6-4ff9-40bb-97d8-90faf4b50b9e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 18:06:23.646406 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:06:23.646370    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0fd929f6-4ff9-40bb-97d8-90faf4b50b9e-kube-api-access-jmjx9" (OuterVolumeSpecName: "kube-api-access-jmjx9") pod "0fd929f6-4ff9-40bb-97d8-90faf4b50b9e" (UID: "0fd929f6-4ff9-40bb-97d8-90faf4b50b9e"). InnerVolumeSpecName "kube-api-access-jmjx9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 18:06:23.745019 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:06:23.744975    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0fd929f6-4ff9-40bb-97d8-90faf4b50b9e-plugins-config-volume\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 18:06:23.745019 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:06:23.745020    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jmjx9\" (UniqueName: \"kubernetes.io/projected/0fd929f6-4ff9-40bb-97d8-90faf4b50b9e-kube-api-access-jmjx9\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 18:06:23.930774 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:06:23.930738    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-09fbb5-6786594459-n5znm"]
Sep 10 18:06:23.934573 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:06:23.934540    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-09fbb5-6786594459-n5znm"]
Sep 10 18:06:24.770167 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:06:24.770131    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0fd929f6-4ff9-40bb-97d8-90faf4b50b9e" path="/var/lib/kubelet/pods/0fd929f6-4ff9-40bb-97d8-90faf4b50b9e/volumes"
Sep 10 18:06:39.839062 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:06:39.838973    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-6c9ffc/rate-test-model-6c9ffc-kserve-6454888f7f-zlszf"]
Sep 10 18:06:54.861089 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:06:54.861038    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w3-6c9ffc/rate-test-model-6c9ffc-kserve-6454888f7f-zlszf" podUID="13af3f93-61cf-4035-8ba2-affddfe52057" containerName="main" containerID="cri-o://649a91cd95a7e7c326bed31d8b8d70a6158187504bb4d54e1e557d76c54b0388" gracePeriod=45
Sep 10 18:06:55.120143 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:06:55.120070    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-6c9ffc/rate-test-model-6c9ffc-kserve-6454888f7f-zlszf"
Sep 10 18:06:55.137691 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:06:55.137653    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/13af3f93-61cf-4035-8ba2-affddfe52057-tls-certs\") pod \"13af3f93-61cf-4035-8ba2-affddfe52057\" (UID: \"13af3f93-61cf-4035-8ba2-affddfe52057\") "
Sep 10 18:06:55.137859 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:06:55.137704    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/13af3f93-61cf-4035-8ba2-affddfe52057-tmp-dir\") pod \"13af3f93-61cf-4035-8ba2-affddfe52057\" (UID: \"13af3f93-61cf-4035-8ba2-affddfe52057\") "
Sep 10 18:06:55.137859 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:06:55.137739    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6c6gp\" (UniqueName: \"kubernetes.io/projected/13af3f93-61cf-4035-8ba2-affddfe52057-kube-api-access-6c6gp\") pod \"13af3f93-61cf-4035-8ba2-affddfe52057\" (UID: \"13af3f93-61cf-4035-8ba2-affddfe52057\") "
Sep 10 18:06:55.137859 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:06:55.137765    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/13af3f93-61cf-4035-8ba2-affddfe52057-home\") pod \"13af3f93-61cf-4035-8ba2-affddfe52057\" (UID: \"13af3f93-61cf-4035-8ba2-affddfe52057\") "
Sep 10 18:06:55.137859 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:06:55.137791    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/13af3f93-61cf-4035-8ba2-affddfe52057-dshm\") pod \"13af3f93-61cf-4035-8ba2-affddfe52057\" (UID: \"13af3f93-61cf-4035-8ba2-affddfe52057\") "
Sep 10 18:06:55.137859 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:06:55.137821    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/13af3f93-61cf-4035-8ba2-affddfe52057-model-cache\") pod \"13af3f93-61cf-4035-8ba2-affddfe52057\" (UID: \"13af3f93-61cf-4035-8ba2-affddfe52057\") "
Sep 10 18:06:55.138136 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:06:55.138029    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13af3f93-61cf-4035-8ba2-affddfe52057-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "13af3f93-61cf-4035-8ba2-affddfe52057" (UID: "13af3f93-61cf-4035-8ba2-affddfe52057"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 18:06:55.138136 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:06:55.138079    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13af3f93-61cf-4035-8ba2-affddfe52057-home" (OuterVolumeSpecName: "home") pod "13af3f93-61cf-4035-8ba2-affddfe52057" (UID: "13af3f93-61cf-4035-8ba2-affddfe52057"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 18:06:55.138217 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:06:55.138135    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13af3f93-61cf-4035-8ba2-affddfe52057-model-cache" (OuterVolumeSpecName: "model-cache") pod "13af3f93-61cf-4035-8ba2-affddfe52057" (UID: "13af3f93-61cf-4035-8ba2-affddfe52057"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 18:06:55.140224 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:06:55.140188    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/13af3f93-61cf-4035-8ba2-affddfe52057-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "13af3f93-61cf-4035-8ba2-affddfe52057" (UID: "13af3f93-61cf-4035-8ba2-affddfe52057"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 18:06:55.140387 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:06:55.140222    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13af3f93-61cf-4035-8ba2-affddfe52057-dshm" (OuterVolumeSpecName: "dshm") pod "13af3f93-61cf-4035-8ba2-affddfe52057" (UID: "13af3f93-61cf-4035-8ba2-affddfe52057"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 18:06:55.140387 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:06:55.140235    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13af3f93-61cf-4035-8ba2-affddfe52057-kube-api-access-6c6gp" (OuterVolumeSpecName: "kube-api-access-6c6gp") pod "13af3f93-61cf-4035-8ba2-affddfe52057" (UID: "13af3f93-61cf-4035-8ba2-affddfe52057"). InnerVolumeSpecName "kube-api-access-6c6gp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 18:06:55.239184 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:06:55.239141    2568 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/13af3f93-61cf-4035-8ba2-affddfe52057-tls-certs\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 18:06:55.239184 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:06:55.239176    2568 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/13af3f93-61cf-4035-8ba2-affddfe52057-tmp-dir\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 18:06:55.239184 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:06:55.239185    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6c6gp\" (UniqueName: \"kubernetes.io/projected/13af3f93-61cf-4035-8ba2-affddfe52057-kube-api-access-6c6gp\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 18:06:55.239184 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:06:55.239194    2568 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/13af3f93-61cf-4035-8ba2-affddfe52057-home\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 18:06:55.239520 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:06:55.239203    2568 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/13af3f93-61cf-4035-8ba2-affddfe52057-dshm\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 18:06:55.239520 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:06:55.239213    2568 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/13af3f93-61cf-4035-8ba2-affddfe52057-model-cache\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 18:06:55.808446 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:06:55.808406    2568 generic.go:356] "Generic (PLEG): container finished" podID="13af3f93-61cf-4035-8ba2-affddfe52057" containerID="649a91cd95a7e7c326bed31d8b8d70a6158187504bb4d54e1e557d76c54b0388" exitCode=0
Sep 10 18:06:55.808647 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:06:55.808452    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-6c9ffc/rate-test-model-6c9ffc-kserve-6454888f7f-zlszf"
Sep 10 18:06:55.808647 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:06:55.808495    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-6c9ffc/rate-test-model-6c9ffc-kserve-6454888f7f-zlszf" event={"ID":"13af3f93-61cf-4035-8ba2-affddfe52057","Type":"ContainerDied","Data":"649a91cd95a7e7c326bed31d8b8d70a6158187504bb4d54e1e557d76c54b0388"}
Sep 10 18:06:55.808647 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:06:55.808541    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-6c9ffc/rate-test-model-6c9ffc-kserve-6454888f7f-zlszf" event={"ID":"13af3f93-61cf-4035-8ba2-affddfe52057","Type":"ContainerDied","Data":"c30ad6f38eaa91f37343ac57343563b19e14acceb51dd97f2ba9d4f9e0c724f7"}
Sep 10 18:06:55.808647 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:06:55.808559    2568 scope.go:117] "RemoveContainer" containerID="649a91cd95a7e7c326bed31d8b8d70a6158187504bb4d54e1e557d76c54b0388"
Sep 10 18:06:55.819058 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:06:55.819038    2568 scope.go:117] "RemoveContainer" containerID="649a91cd95a7e7c326bed31d8b8d70a6158187504bb4d54e1e557d76c54b0388"
Sep 10 18:06:55.819435 ip-10-0-136-161 kubenswrapper[2568]: E0910 18:06:55.819414    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"649a91cd95a7e7c326bed31d8b8d70a6158187504bb4d54e1e557d76c54b0388\": container with ID starting with 649a91cd95a7e7c326bed31d8b8d70a6158187504bb4d54e1e557d76c54b0388 not found: ID does not exist" containerID="649a91cd95a7e7c326bed31d8b8d70a6158187504bb4d54e1e557d76c54b0388"
Sep 10 18:06:55.819498 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:06:55.819445    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"649a91cd95a7e7c326bed31d8b8d70a6158187504bb4d54e1e557d76c54b0388"} err="failed to get container status \"649a91cd95a7e7c326bed31d8b8d70a6158187504bb4d54e1e557d76c54b0388\": rpc error: code = NotFound desc = could not find container \"649a91cd95a7e7c326bed31d8b8d70a6158187504bb4d54e1e557d76c54b0388\": container with ID starting with 649a91cd95a7e7c326bed31d8b8d70a6158187504bb4d54e1e557d76c54b0388 not found: ID does not exist"
Sep 10 18:06:55.834178 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:06:55.834141    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-6c9ffc/rate-test-model-6c9ffc-kserve-6454888f7f-zlszf"]
Sep 10 18:06:55.839398 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:06:55.839363    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w3-6c9ffc/rate-test-model-6c9ffc-kserve-6454888f7f-zlszf"]
Sep 10 18:06:56.770742 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:06:56.770707    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="13af3f93-61cf-4035-8ba2-affddfe52057" path="/var/lib/kubelet/pods/13af3f93-61cf-4035-8ba2-affddfe52057/volumes"
Sep 10 18:07:05.872241 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:05.872204    2568 scope.go:117] "RemoveContainer" containerID="e73a054d0dadef93575cb001fb341568815089187a69da221606540b7491623f"
Sep 10 18:07:10.662245 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:10.662202    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-4d9405-openshift-default-8c7884b44-zd87s"]
Sep 10 18:07:10.662906 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:10.662884    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13af3f93-61cf-4035-8ba2-affddfe52057" containerName="main"
Sep 10 18:07:10.663086 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:10.663068    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="13af3f93-61cf-4035-8ba2-affddfe52057" containerName="main"
Sep 10 18:07:10.663196 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:10.663095    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44ceb0c8-2217-44ea-aabe-b21dc399bb50" containerName="payload-processing"
Sep 10 18:07:10.663196 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:10.663104    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="44ceb0c8-2217-44ea-aabe-b21dc399bb50" containerName="payload-processing"
Sep 10 18:07:10.663196 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:10.663118    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0caf2a7-157b-429c-b057-e77ee78b3510" containerName="payload-processing"
Sep 10 18:07:10.663196 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:10.663128    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0caf2a7-157b-429c-b057-e77ee78b3510" containerName="payload-processing"
Sep 10 18:07:10.663196 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:10.663145    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0fd929f6-4ff9-40bb-97d8-90faf4b50b9e" containerName="payload-processing"
Sep 10 18:07:10.663196 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:10.663153    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="0fd929f6-4ff9-40bb-97d8-90faf4b50b9e" containerName="payload-processing"
Sep 10 18:07:10.663196 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:10.663182    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e20155d2-f26d-455b-9dad-4c56bb28e946" containerName="payload-processing"
Sep 10 18:07:10.663196 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:10.663190    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="e20155d2-f26d-455b-9dad-4c56bb28e946" containerName="payload-processing"
Sep 10 18:07:10.663571 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:10.663280    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="e20155d2-f26d-455b-9dad-4c56bb28e946" containerName="payload-processing"
Sep 10 18:07:10.663571 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:10.663292    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="44ceb0c8-2217-44ea-aabe-b21dc399bb50" containerName="payload-processing"
Sep 10 18:07:10.663571 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:10.663304    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0caf2a7-157b-429c-b057-e77ee78b3510" containerName="payload-processing"
Sep 10 18:07:10.663571 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:10.663314    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="0fd929f6-4ff9-40bb-97d8-90faf4b50b9e" containerName="payload-processing"
Sep 10 18:07:10.663571 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:10.663336    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="13af3f93-61cf-4035-8ba2-affddfe52057" containerName="main"
Sep 10 18:07:10.668021 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:10.667996    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-4d9405-openshift-default-8c7884b44-zd87s"
Sep 10 18:07:10.670855 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:10.670829    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-4d9405-openshift-default-dockercfg-s8gl8\""
Sep 10 18:07:10.678203 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:10.678172    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-4d9405-openshift-default-8c7884b44-zd87s"]
Sep 10 18:07:10.784968 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:10.784932    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/04abb636-a812-4242-b932-4414f0bb256c-istio-envoy\") pod \"e2e-ipp-b-4d9405-openshift-default-8c7884b44-zd87s\" (UID: \"04abb636-a812-4242-b932-4414f0bb256c\") " pod="openshift-ingress/e2e-ipp-b-4d9405-openshift-default-8c7884b44-zd87s"
Sep 10 18:07:10.785193 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:10.784976    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/04abb636-a812-4242-b932-4414f0bb256c-workload-certs\") pod \"e2e-ipp-b-4d9405-openshift-default-8c7884b44-zd87s\" (UID: \"04abb636-a812-4242-b932-4414f0bb256c\") " pod="openshift-ingress/e2e-ipp-b-4d9405-openshift-default-8c7884b44-zd87s"
Sep 10 18:07:10.785193 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:10.785009    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/04abb636-a812-4242-b932-4414f0bb256c-istio-data\") pod \"e2e-ipp-b-4d9405-openshift-default-8c7884b44-zd87s\" (UID: \"04abb636-a812-4242-b932-4414f0bb256c\") " pod="openshift-ingress/e2e-ipp-b-4d9405-openshift-default-8c7884b44-zd87s"
Sep 10 18:07:10.785193 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:10.785094    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04abb636-a812-4242-b932-4414f0bb256c-istio-token\") pod \"e2e-ipp-b-4d9405-openshift-default-8c7884b44-zd87s\" (UID: \"04abb636-a812-4242-b932-4414f0bb256c\") " pod="openshift-ingress/e2e-ipp-b-4d9405-openshift-default-8c7884b44-zd87s"
Sep 10 18:07:10.785193 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:10.785135    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/04abb636-a812-4242-b932-4414f0bb256c-istio-podinfo\") pod \"e2e-ipp-b-4d9405-openshift-default-8c7884b44-zd87s\" (UID: \"04abb636-a812-4242-b932-4414f0bb256c\") " pod="openshift-ingress/e2e-ipp-b-4d9405-openshift-default-8c7884b44-zd87s"
Sep 10 18:07:10.785432 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:10.785195    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/04abb636-a812-4242-b932-4414f0bb256c-credential-socket\") pod \"e2e-ipp-b-4d9405-openshift-default-8c7884b44-zd87s\" (UID: \"04abb636-a812-4242-b932-4414f0bb256c\") " pod="openshift-ingress/e2e-ipp-b-4d9405-openshift-default-8c7884b44-zd87s"
Sep 10 18:07:10.785432 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:10.785233    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/04abb636-a812-4242-b932-4414f0bb256c-workload-socket\") pod \"e2e-ipp-b-4d9405-openshift-default-8c7884b44-zd87s\" (UID: \"04abb636-a812-4242-b932-4414f0bb256c\") " pod="openshift-ingress/e2e-ipp-b-4d9405-openshift-default-8c7884b44-zd87s"
Sep 10 18:07:10.785432 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:10.785264    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsx8j\" (UniqueName: \"kubernetes.io/projected/04abb636-a812-4242-b932-4414f0bb256c-kube-api-access-hsx8j\") pod \"e2e-ipp-b-4d9405-openshift-default-8c7884b44-zd87s\" (UID: \"04abb636-a812-4242-b932-4414f0bb256c\") " pod="openshift-ingress/e2e-ipp-b-4d9405-openshift-default-8c7884b44-zd87s"
Sep 10 18:07:10.785432 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:10.785296    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/04abb636-a812-4242-b932-4414f0bb256c-istiod-ca-cert\") pod \"e2e-ipp-b-4d9405-openshift-default-8c7884b44-zd87s\" (UID: \"04abb636-a812-4242-b932-4414f0bb256c\") " pod="openshift-ingress/e2e-ipp-b-4d9405-openshift-default-8c7884b44-zd87s"
Sep 10 18:07:10.886140 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:10.886096    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/04abb636-a812-4242-b932-4414f0bb256c-credential-socket\") pod \"e2e-ipp-b-4d9405-openshift-default-8c7884b44-zd87s\" (UID: \"04abb636-a812-4242-b932-4414f0bb256c\") " pod="openshift-ingress/e2e-ipp-b-4d9405-openshift-default-8c7884b44-zd87s"
Sep 10 18:07:10.886140 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:10.886148    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/04abb636-a812-4242-b932-4414f0bb256c-workload-socket\") pod \"e2e-ipp-b-4d9405-openshift-default-8c7884b44-zd87s\" (UID: \"04abb636-a812-4242-b932-4414f0bb256c\") " pod="openshift-ingress/e2e-ipp-b-4d9405-openshift-default-8c7884b44-zd87s"
Sep 10 18:07:10.886480 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:10.886174    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsx8j\" (UniqueName: \"kubernetes.io/projected/04abb636-a812-4242-b932-4414f0bb256c-kube-api-access-hsx8j\") pod \"e2e-ipp-b-4d9405-openshift-default-8c7884b44-zd87s\" (UID: \"04abb636-a812-4242-b932-4414f0bb256c\") " pod="openshift-ingress/e2e-ipp-b-4d9405-openshift-default-8c7884b44-zd87s"
Sep 10 18:07:10.886480 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:10.886221    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/04abb636-a812-4242-b932-4414f0bb256c-istiod-ca-cert\") pod \"e2e-ipp-b-4d9405-openshift-default-8c7884b44-zd87s\" (UID: \"04abb636-a812-4242-b932-4414f0bb256c\") " pod="openshift-ingress/e2e-ipp-b-4d9405-openshift-default-8c7884b44-zd87s"
Sep 10 18:07:10.886480 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:10.886284    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/04abb636-a812-4242-b932-4414f0bb256c-istio-envoy\") pod \"e2e-ipp-b-4d9405-openshift-default-8c7884b44-zd87s\" (UID: \"04abb636-a812-4242-b932-4414f0bb256c\") " pod="openshift-ingress/e2e-ipp-b-4d9405-openshift-default-8c7884b44-zd87s"
Sep 10 18:07:10.886480 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:10.886314    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/04abb636-a812-4242-b932-4414f0bb256c-workload-certs\") pod \"e2e-ipp-b-4d9405-openshift-default-8c7884b44-zd87s\" (UID: \"04abb636-a812-4242-b932-4414f0bb256c\") " pod="openshift-ingress/e2e-ipp-b-4d9405-openshift-default-8c7884b44-zd87s"
Sep 10 18:07:10.886480 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:10.886427    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/04abb636-a812-4242-b932-4414f0bb256c-istio-data\") pod \"e2e-ipp-b-4d9405-openshift-default-8c7884b44-zd87s\" (UID: \"04abb636-a812-4242-b932-4414f0bb256c\") " pod="openshift-ingress/e2e-ipp-b-4d9405-openshift-default-8c7884b44-zd87s"
Sep 10 18:07:10.886756 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:10.886490    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04abb636-a812-4242-b932-4414f0bb256c-istio-token\") pod \"e2e-ipp-b-4d9405-openshift-default-8c7884b44-zd87s\" (UID: \"04abb636-a812-4242-b932-4414f0bb256c\") " pod="openshift-ingress/e2e-ipp-b-4d9405-openshift-default-8c7884b44-zd87s"
Sep 10 18:07:10.886756 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:10.886521    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/04abb636-a812-4242-b932-4414f0bb256c-istio-podinfo\") pod \"e2e-ipp-b-4d9405-openshift-default-8c7884b44-zd87s\" (UID: \"04abb636-a812-4242-b932-4414f0bb256c\") " pod="openshift-ingress/e2e-ipp-b-4d9405-openshift-default-8c7884b44-zd87s"
Sep 10 18:07:10.886756 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:10.886634    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/04abb636-a812-4242-b932-4414f0bb256c-credential-socket\") pod \"e2e-ipp-b-4d9405-openshift-default-8c7884b44-zd87s\" (UID: \"04abb636-a812-4242-b932-4414f0bb256c\") " pod="openshift-ingress/e2e-ipp-b-4d9405-openshift-default-8c7884b44-zd87s"
Sep 10 18:07:10.886916 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:10.886815    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/04abb636-a812-4242-b932-4414f0bb256c-workload-socket\") pod \"e2e-ipp-b-4d9405-openshift-default-8c7884b44-zd87s\" (UID: \"04abb636-a812-4242-b932-4414f0bb256c\") " pod="openshift-ingress/e2e-ipp-b-4d9405-openshift-default-8c7884b44-zd87s"
Sep 10 18:07:10.887008 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:10.886967    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/04abb636-a812-4242-b932-4414f0bb256c-istio-data\") pod \"e2e-ipp-b-4d9405-openshift-default-8c7884b44-zd87s\" (UID: \"04abb636-a812-4242-b932-4414f0bb256c\") " pod="openshift-ingress/e2e-ipp-b-4d9405-openshift-default-8c7884b44-zd87s"
Sep 10 18:07:10.887187 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:10.887155    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/04abb636-a812-4242-b932-4414f0bb256c-istiod-ca-cert\") pod \"e2e-ipp-b-4d9405-openshift-default-8c7884b44-zd87s\" (UID: \"04abb636-a812-4242-b932-4414f0bb256c\") " pod="openshift-ingress/e2e-ipp-b-4d9405-openshift-default-8c7884b44-zd87s"
Sep 10 18:07:10.887567 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:10.887541    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/04abb636-a812-4242-b932-4414f0bb256c-workload-certs\") pod \"e2e-ipp-b-4d9405-openshift-default-8c7884b44-zd87s\" (UID: \"04abb636-a812-4242-b932-4414f0bb256c\") " pod="openshift-ingress/e2e-ipp-b-4d9405-openshift-default-8c7884b44-zd87s"
Sep 10 18:07:10.889341 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:10.889281    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/04abb636-a812-4242-b932-4414f0bb256c-istio-envoy\") pod \"e2e-ipp-b-4d9405-openshift-default-8c7884b44-zd87s\" (UID: \"04abb636-a812-4242-b932-4414f0bb256c\") " pod="openshift-ingress/e2e-ipp-b-4d9405-openshift-default-8c7884b44-zd87s"
Sep 10 18:07:10.889486 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:10.889428    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/04abb636-a812-4242-b932-4414f0bb256c-istio-podinfo\") pod \"e2e-ipp-b-4d9405-openshift-default-8c7884b44-zd87s\" (UID: \"04abb636-a812-4242-b932-4414f0bb256c\") " pod="openshift-ingress/e2e-ipp-b-4d9405-openshift-default-8c7884b44-zd87s"
Sep 10 18:07:10.895214 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:10.895183    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04abb636-a812-4242-b932-4414f0bb256c-istio-token\") pod \"e2e-ipp-b-4d9405-openshift-default-8c7884b44-zd87s\" (UID: \"04abb636-a812-4242-b932-4414f0bb256c\") " pod="openshift-ingress/e2e-ipp-b-4d9405-openshift-default-8c7884b44-zd87s"
Sep 10 18:07:10.895390 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:10.895294    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsx8j\" (UniqueName: \"kubernetes.io/projected/04abb636-a812-4242-b932-4414f0bb256c-kube-api-access-hsx8j\") pod \"e2e-ipp-b-4d9405-openshift-default-8c7884b44-zd87s\" (UID: \"04abb636-a812-4242-b932-4414f0bb256c\") " pod="openshift-ingress/e2e-ipp-b-4d9405-openshift-default-8c7884b44-zd87s"
Sep 10 18:07:10.981617 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:10.981583    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-4d9405-openshift-default-8c7884b44-zd87s"
Sep 10 18:07:11.274942 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:11.274906    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-4d9405-openshift-default-8c7884b44-zd87s"]
Sep 10 18:07:11.275127 ip-10-0-136-161 kubenswrapper[2568]: W0910 18:07:11.275060    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04abb636_a812_4242_b932_4414f0bb256c.slice/crio-cdec4797a5efb1bca7f74bc3dc67e849f3c7626fc2c1d022c2e11d34a08faa10 WatchSource:0}: Error finding container cdec4797a5efb1bca7f74bc3dc67e849f3c7626fc2c1d022c2e11d34a08faa10: Status 404 returned error can't find the container with id cdec4797a5efb1bca7f74bc3dc67e849f3c7626fc2c1d022c2e11d34a08faa10
Sep 10 18:07:11.277971 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:11.277925    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 18:07:11.278078 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:11.278024    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 18:07:11.278078 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:11.278064    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 18:07:11.904824 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:11.904784    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-4d9405-openshift-default-8c7884b44-zd87s" event={"ID":"04abb636-a812-4242-b932-4414f0bb256c","Type":"ContainerStarted","Data":"917061cee55d51769642d9088c3cf7e5faa37843688ea48f50d03cfe767bf983"}
Sep 10 18:07:11.905228 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:11.904846    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-4d9405-openshift-default-8c7884b44-zd87s" event={"ID":"04abb636-a812-4242-b932-4414f0bb256c","Type":"ContainerStarted","Data":"cdec4797a5efb1bca7f74bc3dc67e849f3c7626fc2c1d022c2e11d34a08faa10"}
Sep 10 18:07:11.930825 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:11.930765    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-4d9405-openshift-default-8c7884b44-zd87s" podStartSLOduration=1.930744495 podStartE2EDuration="1.930744495s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 18:07:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 18:07:11.928626956 +0000 UTC m=+1567.689934999" watchObservedRunningTime="2026-09-10 18:07:11.930744495 +0000 UTC m=+1567.692052537"
Sep 10 18:07:11.981941 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:11.981886    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-4d9405-openshift-default-8c7884b44-zd87s"
Sep 10 18:07:12.987107 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:12.987075    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-4d9405-openshift-default-8c7884b44-zd87s"
Sep 10 18:07:13.916894 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:13.916851    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-4d9405-openshift-default-8c7884b44-zd87s"
Sep 10 18:07:13.918079 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:13.918054    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-4d9405-openshift-default-8c7884b44-zd87s"
Sep 10 18:07:15.812460 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:15.812421    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-4d9405-c559f5fcd-ldr2t"]
Sep 10 18:07:15.816092 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:15.816068    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-4d9405-c559f5fcd-ldr2t"
Sep 10 18:07:15.819244 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:15.819216    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-4d9405\""
Sep 10 18:07:15.832382 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:15.832347    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-4d9405-c559f5fcd-ldr2t"]
Sep 10 18:07:15.931707 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:15.931670    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3760d0bc-2aa7-4718-bbba-d809f5cf36ca-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-4d9405-c559f5fcd-ldr2t\" (UID: \"3760d0bc-2aa7-4718-bbba-d809f5cf36ca\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-4d9405-c559f5fcd-ldr2t"
Sep 10 18:07:15.931877 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:15.931732    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nnv8\" (UniqueName: \"kubernetes.io/projected/3760d0bc-2aa7-4718-bbba-d809f5cf36ca-kube-api-access-2nnv8\") pod \"payload-pre-processing-e2e-ipp-b-4d9405-c559f5fcd-ldr2t\" (UID: \"3760d0bc-2aa7-4718-bbba-d809f5cf36ca\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-4d9405-c559f5fcd-ldr2t"
Sep 10 18:07:16.032726 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:16.032686    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3760d0bc-2aa7-4718-bbba-d809f5cf36ca-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-4d9405-c559f5fcd-ldr2t\" (UID: \"3760d0bc-2aa7-4718-bbba-d809f5cf36ca\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-4d9405-c559f5fcd-ldr2t"
Sep 10 18:07:16.032943 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:16.032782    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nnv8\" (UniqueName: \"kubernetes.io/projected/3760d0bc-2aa7-4718-bbba-d809f5cf36ca-kube-api-access-2nnv8\") pod \"payload-pre-processing-e2e-ipp-b-4d9405-c559f5fcd-ldr2t\" (UID: \"3760d0bc-2aa7-4718-bbba-d809f5cf36ca\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-4d9405-c559f5fcd-ldr2t"
Sep 10 18:07:16.033477 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:16.033455    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3760d0bc-2aa7-4718-bbba-d809f5cf36ca-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-4d9405-c559f5fcd-ldr2t\" (UID: \"3760d0bc-2aa7-4718-bbba-d809f5cf36ca\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-4d9405-c559f5fcd-ldr2t"
Sep 10 18:07:16.048116 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:16.048076    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nnv8\" (UniqueName: \"kubernetes.io/projected/3760d0bc-2aa7-4718-bbba-d809f5cf36ca-kube-api-access-2nnv8\") pod \"payload-pre-processing-e2e-ipp-b-4d9405-c559f5fcd-ldr2t\" (UID: \"3760d0bc-2aa7-4718-bbba-d809f5cf36ca\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-4d9405-c559f5fcd-ldr2t"
Sep 10 18:07:16.127649 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:16.127505    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-4d9405-c559f5fcd-ldr2t"
Sep 10 18:07:16.408827 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:16.408795    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-4d9405-c559f5fcd-ldr2t"]
Sep 10 18:07:16.410354 ip-10-0-136-161 kubenswrapper[2568]: W0910 18:07:16.410312    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3760d0bc_2aa7_4718_bbba_d809f5cf36ca.slice/crio-f6119fb6eccb0a8e3f421c288aa5f3239431f701fed5413caddd0312c79fc4e2 WatchSource:0}: Error finding container f6119fb6eccb0a8e3f421c288aa5f3239431f701fed5413caddd0312c79fc4e2: Status 404 returned error can't find the container with id f6119fb6eccb0a8e3f421c288aa5f3239431f701fed5413caddd0312c79fc4e2
Sep 10 18:07:16.935639 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:16.935599    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-4d9405-c559f5fcd-ldr2t" event={"ID":"3760d0bc-2aa7-4718-bbba-d809f5cf36ca","Type":"ContainerStarted","Data":"44ca9c42427c2b0b816a83ad4942e336c4672dffd7beecf8c2a63b6119c42307"}
Sep 10 18:07:16.936079 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:16.935661    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-4d9405-c559f5fcd-ldr2t" event={"ID":"3760d0bc-2aa7-4718-bbba-d809f5cf36ca","Type":"ContainerStarted","Data":"f6119fb6eccb0a8e3f421c288aa5f3239431f701fed5413caddd0312c79fc4e2"}
Sep 10 18:07:16.936079 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:16.935686    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-4d9405-c559f5fcd-ldr2t"
Sep 10 18:07:16.954908 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:16.954841    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-4d9405-c559f5fcd-ldr2t" podStartSLOduration=1.9548213159999999 podStartE2EDuration="1.954821316s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 18:07:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 18:07:16.953365573 +0000 UTC m=+1572.714673617" watchObservedRunningTime="2026-09-10 18:07:16.954821316 +0000 UTC m=+1572.716129418"
Sep 10 18:07:27.944600 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:27.944562    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-4d9405-c559f5fcd-ldr2t"
Sep 10 18:07:33.030051 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:33.030005    2568 generic.go:356] "Generic (PLEG): container finished" podID="04abb636-a812-4242-b932-4414f0bb256c" containerID="917061cee55d51769642d9088c3cf7e5faa37843688ea48f50d03cfe767bf983" exitCode=0
Sep 10 18:07:33.030051 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:33.030052    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-4d9405-openshift-default-8c7884b44-zd87s" event={"ID":"04abb636-a812-4242-b932-4414f0bb256c","Type":"ContainerDied","Data":"917061cee55d51769642d9088c3cf7e5faa37843688ea48f50d03cfe767bf983"}
Sep 10 18:07:33.030572 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:33.030467    2568 scope.go:117] "RemoveContainer" containerID="917061cee55d51769642d9088c3cf7e5faa37843688ea48f50d03cfe767bf983"
Sep 10 18:07:33.031635 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:33.031592    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 18:07:33.031754 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:33.031671    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 18:07:33.031754 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:33.031705    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 18:07:34.038162 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:34.038110    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-4d9405-openshift-default-8c7884b44-zd87s" event={"ID":"04abb636-a812-4242-b932-4414f0bb256c","Type":"ContainerStarted","Data":"d5777f3e4f224b3168a88e223e240a55cd8f250626ccff25d6de409d9e635956"}
Sep 10 18:07:34.982522 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:34.982475    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-4d9405-openshift-default-8c7884b44-zd87s"
Sep 10 18:07:34.982782 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:34.982758    2568 patch_prober.go:28] interesting pod/e2e-ipp-b-4d9405-openshift-default-8c7884b44-zd87s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused" start-of-body=
Sep 10 18:07:34.982836 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:34.982815    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-4d9405-openshift-default-8c7884b44-zd87s" podUID="04abb636-a812-4242-b932-4414f0bb256c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused"
Sep 10 18:07:35.982568 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:35.982529    2568 patch_prober.go:28] interesting pod/e2e-ipp-b-4d9405-openshift-default-8c7884b44-zd87s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused" start-of-body=
Sep 10 18:07:35.982986 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:35.982586    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-4d9405-openshift-default-8c7884b44-zd87s" podUID="04abb636-a812-4242-b932-4414f0bb256c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused"
Sep 10 18:07:36.982566 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:36.982526    2568 patch_prober.go:28] interesting pod/e2e-ipp-b-4d9405-openshift-default-8c7884b44-zd87s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused" start-of-body=
Sep 10 18:07:36.982755 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:36.982589    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-4d9405-openshift-default-8c7884b44-zd87s" podUID="04abb636-a812-4242-b932-4414f0bb256c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused"
Sep 10 18:07:37.982937 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:37.982900    2568 patch_prober.go:28] interesting pod/e2e-ipp-b-4d9405-openshift-default-8c7884b44-zd87s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused" start-of-body=
Sep 10 18:07:37.983387 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:37.982971    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-4d9405-openshift-default-8c7884b44-zd87s" podUID="04abb636-a812-4242-b932-4414f0bb256c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused"
Sep 10 18:07:38.982791 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:38.982749    2568 patch_prober.go:28] interesting pod/e2e-ipp-b-4d9405-openshift-default-8c7884b44-zd87s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused" start-of-body=
Sep 10 18:07:38.982986 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:38.982825    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-4d9405-openshift-default-8c7884b44-zd87s" podUID="04abb636-a812-4242-b932-4414f0bb256c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused"
Sep 10 18:07:39.986941 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:39.986908    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-4d9405-openshift-default-8c7884b44-zd87s"
Sep 10 18:07:39.987414 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:39.987194    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-4d9405-openshift-default-8c7884b44-zd87s"
Sep 10 18:07:39.987919 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:39.987901    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-4d9405-openshift-default-8c7884b44-zd87s"
Sep 10 18:07:43.823337 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:43.823298    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-vqpk8_5b4bc747-b99d-4bf5-b1ac-4a60ca137839/payload-processing/0.log"
Sep 10 18:07:58.902576 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:58.902492    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-ipp-a-732455/ipp-route-732455-kserve-687fbd9f8c-qngnw"]
Sep 10 18:07:58.906218 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:58.906197    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-732455/ipp-route-732455-kserve-687fbd9f8c-qngnw"
Sep 10 18:07:58.910524 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:58.910488    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-732455\"/\"openshift-service-ca.crt\""
Sep 10 18:07:58.910524 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:58.910508    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-732455\"/\"ipp-route-732455-kserve-self-signed-certs\""
Sep 10 18:07:58.910736 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:58.910488    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-732455\"/\"default-dockercfg-dztf4\""
Sep 10 18:07:58.910736 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:58.910494    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-732455\"/\"kube-root-ca.crt\""
Sep 10 18:07:58.917462 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:58.917433    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-732455/ipp-route-732455-kserve-687fbd9f8c-qngnw"]
Sep 10 18:07:59.020664 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:59.020628    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0cc8d85f-f074-494e-b8f9-9b08cbffedbc-dshm\") pod \"ipp-route-732455-kserve-687fbd9f8c-qngnw\" (UID: \"0cc8d85f-f074-494e-b8f9-9b08cbffedbc\") " pod="ai-tenant-e2e-ipp-a-732455/ipp-route-732455-kserve-687fbd9f8c-qngnw"
Sep 10 18:07:59.020843 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:59.020670    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0cc8d85f-f074-494e-b8f9-9b08cbffedbc-tmp-dir\") pod \"ipp-route-732455-kserve-687fbd9f8c-qngnw\" (UID: \"0cc8d85f-f074-494e-b8f9-9b08cbffedbc\") " pod="ai-tenant-e2e-ipp-a-732455/ipp-route-732455-kserve-687fbd9f8c-qngnw"
Sep 10 18:07:59.020843 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:59.020700    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hj595\" (UniqueName: \"kubernetes.io/projected/0cc8d85f-f074-494e-b8f9-9b08cbffedbc-kube-api-access-hj595\") pod \"ipp-route-732455-kserve-687fbd9f8c-qngnw\" (UID: \"0cc8d85f-f074-494e-b8f9-9b08cbffedbc\") " pod="ai-tenant-e2e-ipp-a-732455/ipp-route-732455-kserve-687fbd9f8c-qngnw"
Sep 10 18:07:59.020926 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:59.020833    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0cc8d85f-f074-494e-b8f9-9b08cbffedbc-model-cache\") pod \"ipp-route-732455-kserve-687fbd9f8c-qngnw\" (UID: \"0cc8d85f-f074-494e-b8f9-9b08cbffedbc\") " pod="ai-tenant-e2e-ipp-a-732455/ipp-route-732455-kserve-687fbd9f8c-qngnw"
Sep 10 18:07:59.020926 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:59.020862    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0cc8d85f-f074-494e-b8f9-9b08cbffedbc-tls-certs\") pod \"ipp-route-732455-kserve-687fbd9f8c-qngnw\" (UID: \"0cc8d85f-f074-494e-b8f9-9b08cbffedbc\") " pod="ai-tenant-e2e-ipp-a-732455/ipp-route-732455-kserve-687fbd9f8c-qngnw"
Sep 10 18:07:59.020993 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:59.020944    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0cc8d85f-f074-494e-b8f9-9b08cbffedbc-home\") pod \"ipp-route-732455-kserve-687fbd9f8c-qngnw\" (UID: \"0cc8d85f-f074-494e-b8f9-9b08cbffedbc\") " pod="ai-tenant-e2e-ipp-a-732455/ipp-route-732455-kserve-687fbd9f8c-qngnw"
Sep 10 18:07:59.121437 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:59.121391    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hj595\" (UniqueName: \"kubernetes.io/projected/0cc8d85f-f074-494e-b8f9-9b08cbffedbc-kube-api-access-hj595\") pod \"ipp-route-732455-kserve-687fbd9f8c-qngnw\" (UID: \"0cc8d85f-f074-494e-b8f9-9b08cbffedbc\") " pod="ai-tenant-e2e-ipp-a-732455/ipp-route-732455-kserve-687fbd9f8c-qngnw"
Sep 10 18:07:59.121637 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:59.121479    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0cc8d85f-f074-494e-b8f9-9b08cbffedbc-model-cache\") pod \"ipp-route-732455-kserve-687fbd9f8c-qngnw\" (UID: \"0cc8d85f-f074-494e-b8f9-9b08cbffedbc\") " pod="ai-tenant-e2e-ipp-a-732455/ipp-route-732455-kserve-687fbd9f8c-qngnw"
Sep 10 18:07:59.121637 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:59.121497    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0cc8d85f-f074-494e-b8f9-9b08cbffedbc-tls-certs\") pod \"ipp-route-732455-kserve-687fbd9f8c-qngnw\" (UID: \"0cc8d85f-f074-494e-b8f9-9b08cbffedbc\") " pod="ai-tenant-e2e-ipp-a-732455/ipp-route-732455-kserve-687fbd9f8c-qngnw"
Sep 10 18:07:59.121637 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:59.121544    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0cc8d85f-f074-494e-b8f9-9b08cbffedbc-home\") pod \"ipp-route-732455-kserve-687fbd9f8c-qngnw\" (UID: \"0cc8d85f-f074-494e-b8f9-9b08cbffedbc\") " pod="ai-tenant-e2e-ipp-a-732455/ipp-route-732455-kserve-687fbd9f8c-qngnw"
Sep 10 18:07:59.121637 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:59.121559    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0cc8d85f-f074-494e-b8f9-9b08cbffedbc-dshm\") pod \"ipp-route-732455-kserve-687fbd9f8c-qngnw\" (UID: \"0cc8d85f-f074-494e-b8f9-9b08cbffedbc\") " pod="ai-tenant-e2e-ipp-a-732455/ipp-route-732455-kserve-687fbd9f8c-qngnw"
Sep 10 18:07:59.121637 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:59.121576    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0cc8d85f-f074-494e-b8f9-9b08cbffedbc-tmp-dir\") pod \"ipp-route-732455-kserve-687fbd9f8c-qngnw\" (UID: \"0cc8d85f-f074-494e-b8f9-9b08cbffedbc\") " pod="ai-tenant-e2e-ipp-a-732455/ipp-route-732455-kserve-687fbd9f8c-qngnw"
Sep 10 18:07:59.121900 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:59.121875    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0cc8d85f-f074-494e-b8f9-9b08cbffedbc-model-cache\") pod \"ipp-route-732455-kserve-687fbd9f8c-qngnw\" (UID: \"0cc8d85f-f074-494e-b8f9-9b08cbffedbc\") " pod="ai-tenant-e2e-ipp-a-732455/ipp-route-732455-kserve-687fbd9f8c-qngnw"
Sep 10 18:07:59.121966 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:59.121940    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0cc8d85f-f074-494e-b8f9-9b08cbffedbc-tmp-dir\") pod \"ipp-route-732455-kserve-687fbd9f8c-qngnw\" (UID: \"0cc8d85f-f074-494e-b8f9-9b08cbffedbc\") " pod="ai-tenant-e2e-ipp-a-732455/ipp-route-732455-kserve-687fbd9f8c-qngnw"
Sep 10 18:07:59.122071 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:59.122050    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0cc8d85f-f074-494e-b8f9-9b08cbffedbc-home\") pod \"ipp-route-732455-kserve-687fbd9f8c-qngnw\" (UID: \"0cc8d85f-f074-494e-b8f9-9b08cbffedbc\") " pod="ai-tenant-e2e-ipp-a-732455/ipp-route-732455-kserve-687fbd9f8c-qngnw"
Sep 10 18:07:59.124103 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:59.124080    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0cc8d85f-f074-494e-b8f9-9b08cbffedbc-dshm\") pod \"ipp-route-732455-kserve-687fbd9f8c-qngnw\" (UID: \"0cc8d85f-f074-494e-b8f9-9b08cbffedbc\") " pod="ai-tenant-e2e-ipp-a-732455/ipp-route-732455-kserve-687fbd9f8c-qngnw"
Sep 10 18:07:59.124216 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:59.124197    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0cc8d85f-f074-494e-b8f9-9b08cbffedbc-tls-certs\") pod \"ipp-route-732455-kserve-687fbd9f8c-qngnw\" (UID: \"0cc8d85f-f074-494e-b8f9-9b08cbffedbc\") " pod="ai-tenant-e2e-ipp-a-732455/ipp-route-732455-kserve-687fbd9f8c-qngnw"
Sep 10 18:07:59.131029 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:59.130993    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hj595\" (UniqueName: \"kubernetes.io/projected/0cc8d85f-f074-494e-b8f9-9b08cbffedbc-kube-api-access-hj595\") pod \"ipp-route-732455-kserve-687fbd9f8c-qngnw\" (UID: \"0cc8d85f-f074-494e-b8f9-9b08cbffedbc\") " pod="ai-tenant-e2e-ipp-a-732455/ipp-route-732455-kserve-687fbd9f8c-qngnw"
Sep 10 18:07:59.219527 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:59.219430    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-732455/ipp-route-732455-kserve-687fbd9f8c-qngnw"
Sep 10 18:07:59.500127 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:07:59.500094    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-732455/ipp-route-732455-kserve-687fbd9f8c-qngnw"]
Sep 10 18:07:59.500940 ip-10-0-136-161 kubenswrapper[2568]: W0910 18:07:59.500916    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0cc8d85f_f074_494e_b8f9_9b08cbffedbc.slice/crio-d87e6de6f5d6bfc92a93a5e14961dd4632376b13867409c9cae57708984e8d98 WatchSource:0}: Error finding container d87e6de6f5d6bfc92a93a5e14961dd4632376b13867409c9cae57708984e8d98: Status 404 returned error can't find the container with id d87e6de6f5d6bfc92a93a5e14961dd4632376b13867409c9cae57708984e8d98
Sep 10 18:08:00.218289 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:08:00.218251    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-732455/ipp-route-732455-kserve-687fbd9f8c-qngnw" event={"ID":"0cc8d85f-f074-494e-b8f9-9b08cbffedbc","Type":"ContainerStarted","Data":"9e588f71be9194a411138db79082b5bebb84f5a9e993df59eea7280e36c57e8a"}
Sep 10 18:08:00.218744 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:08:00.218305    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-732455/ipp-route-732455-kserve-687fbd9f8c-qngnw" event={"ID":"0cc8d85f-f074-494e-b8f9-9b08cbffedbc","Type":"ContainerStarted","Data":"d87e6de6f5d6bfc92a93a5e14961dd4632376b13867409c9cae57708984e8d98"}
Sep 10 18:08:00.238179 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:08:00.238122    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-ipp-a-732455/ipp-route-732455-kserve-687fbd9f8c-qngnw" podStartSLOduration=2.238104223 podStartE2EDuration="2.238104223s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 18:07:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 18:08:00.237459271 +0000 UTC m=+1615.998767315" watchObservedRunningTime="2026-09-10 18:08:00.238104223 +0000 UTC m=+1615.999412266"
Sep 10 18:08:09.220442 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:08:09.220392    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-ipp-a-732455/ipp-route-732455-kserve-687fbd9f8c-qngnw"
Sep 10 18:08:09.220442 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:08:09.220455    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-ipp-a-732455/ipp-route-732455-kserve-687fbd9f8c-qngnw"
Sep 10 18:08:09.233424 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:08:09.233385    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-ipp-a-732455/ipp-route-732455-kserve-687fbd9f8c-qngnw"
Sep 10 18:08:09.284975 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:08:09.284942    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-ipp-a-732455/ipp-route-732455-kserve-687fbd9f8c-qngnw"
Sep 10 18:08:19.564917 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:08:19.564882    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-vqpk8_5b4bc747-b99d-4bf5-b1ac-4a60ca137839/payload-processing/0.log"
Sep 10 18:08:25.594055 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:08:25.594007    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3b8881-54fc766c9d-9v7w9"]
Sep 10 18:08:25.597994 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:08:25.597967    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3b8881-54fc766c9d-9v7w9"
Sep 10 18:08:25.601664 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:08:25.601638    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-3b8881-dockercfg-m7ndm\""
Sep 10 18:08:25.601832 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:08:25.601640    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-3b8881\""
Sep 10 18:08:25.615926 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:08:25.615894    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3b8881-54fc766c9d-9v7w9"]
Sep 10 18:08:25.673087 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:08:25.673051    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zc6j\" (UniqueName: \"kubernetes.io/projected/b3286eba-465f-44b8-8294-3b0d326e3dc0-kube-api-access-2zc6j\") pod \"payload-pre-processing-e2e-ipp-cleanup-3b8881-54fc766c9d-9v7w9\" (UID: \"b3286eba-465f-44b8-8294-3b0d326e3dc0\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3b8881-54fc766c9d-9v7w9"
Sep 10 18:08:25.673270 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:08:25.673124    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b3286eba-465f-44b8-8294-3b0d326e3dc0-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-3b8881-54fc766c9d-9v7w9\" (UID: \"b3286eba-465f-44b8-8294-3b0d326e3dc0\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3b8881-54fc766c9d-9v7w9"
Sep 10 18:08:25.774239 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:08:25.774201    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zc6j\" (UniqueName: \"kubernetes.io/projected/b3286eba-465f-44b8-8294-3b0d326e3dc0-kube-api-access-2zc6j\") pod \"payload-pre-processing-e2e-ipp-cleanup-3b8881-54fc766c9d-9v7w9\" (UID: \"b3286eba-465f-44b8-8294-3b0d326e3dc0\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3b8881-54fc766c9d-9v7w9"
Sep 10 18:08:25.774446 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:08:25.774252    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b3286eba-465f-44b8-8294-3b0d326e3dc0-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-3b8881-54fc766c9d-9v7w9\" (UID: \"b3286eba-465f-44b8-8294-3b0d326e3dc0\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3b8881-54fc766c9d-9v7w9"
Sep 10 18:08:25.774953 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:08:25.774931    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b3286eba-465f-44b8-8294-3b0d326e3dc0-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-3b8881-54fc766c9d-9v7w9\" (UID: \"b3286eba-465f-44b8-8294-3b0d326e3dc0\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3b8881-54fc766c9d-9v7w9"
Sep 10 18:08:25.793853 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:08:25.793819    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zc6j\" (UniqueName: \"kubernetes.io/projected/b3286eba-465f-44b8-8294-3b0d326e3dc0-kube-api-access-2zc6j\") pod \"payload-pre-processing-e2e-ipp-cleanup-3b8881-54fc766c9d-9v7w9\" (UID: \"b3286eba-465f-44b8-8294-3b0d326e3dc0\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3b8881-54fc766c9d-9v7w9"
Sep 10 18:08:25.909682 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:08:25.909580    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3b8881-54fc766c9d-9v7w9"
Sep 10 18:08:26.194007 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:08:26.193977    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3b8881-54fc766c9d-9v7w9"]
Sep 10 18:08:26.195264 ip-10-0-136-161 kubenswrapper[2568]: W0910 18:08:26.195239    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3286eba_465f_44b8_8294_3b0d326e3dc0.slice/crio-30f3dea59b49e34a6d4e2097e51fb1f581413a3225f428a40fea837d72d4d7a2 WatchSource:0}: Error finding container 30f3dea59b49e34a6d4e2097e51fb1f581413a3225f428a40fea837d72d4d7a2: Status 404 returned error can't find the container with id 30f3dea59b49e34a6d4e2097e51fb1f581413a3225f428a40fea837d72d4d7a2
Sep 10 18:08:26.378050 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:08:26.378002    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3b8881-54fc766c9d-9v7w9" event={"ID":"b3286eba-465f-44b8-8294-3b0d326e3dc0","Type":"ContainerStarted","Data":"e412cf8d49d6fec086b696292aab7b3072edc87925327c802dc446d8e04760c7"}
Sep 10 18:08:26.378279 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:08:26.378080    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3b8881-54fc766c9d-9v7w9" event={"ID":"b3286eba-465f-44b8-8294-3b0d326e3dc0","Type":"ContainerStarted","Data":"30f3dea59b49e34a6d4e2097e51fb1f581413a3225f428a40fea837d72d4d7a2"}
Sep 10 18:08:26.378279 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:08:26.378214    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3b8881-54fc766c9d-9v7w9"
Sep 10 18:08:26.406234 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:08:26.406159    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3b8881-54fc766c9d-9v7w9" podStartSLOduration=1.4061393899999999 podStartE2EDuration="1.40613939s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 18:08:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 18:08:26.403826546 +0000 UTC m=+1642.165134588" watchObservedRunningTime="2026-09-10 18:08:26.40613939 +0000 UTC m=+1642.167447432"
Sep 10 18:08:37.386841 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:08:37.386806    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3b8881-54fc766c9d-9v7w9"
Sep 10 18:08:55.209258 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:08:55.209219    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3b8881-54fc766c9d-9v7w9"]
Sep 10 18:08:55.209905 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:08:55.209465    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3b8881-54fc766c9d-9v7w9" podUID="b3286eba-465f-44b8-8294-3b0d326e3dc0" containerName="payload-pre-processing" containerID="cri-o://e412cf8d49d6fec086b696292aab7b3072edc87925327c802dc446d8e04760c7" gracePeriod=30
Sep 10 18:08:55.491807 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:08:55.491763    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3b8881-54fc766c9d-9v7w9"
Sep 10 18:08:55.558938 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:08:55.558889    2568 generic.go:356] "Generic (PLEG): container finished" podID="b3286eba-465f-44b8-8294-3b0d326e3dc0" containerID="e412cf8d49d6fec086b696292aab7b3072edc87925327c802dc446d8e04760c7" exitCode=0
Sep 10 18:08:55.559127 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:08:55.559005    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3b8881-54fc766c9d-9v7w9"
Sep 10 18:08:55.559127 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:08:55.559032    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3b8881-54fc766c9d-9v7w9" event={"ID":"b3286eba-465f-44b8-8294-3b0d326e3dc0","Type":"ContainerDied","Data":"e412cf8d49d6fec086b696292aab7b3072edc87925327c802dc446d8e04760c7"}
Sep 10 18:08:55.559127 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:08:55.559102    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3b8881-54fc766c9d-9v7w9" event={"ID":"b3286eba-465f-44b8-8294-3b0d326e3dc0","Type":"ContainerDied","Data":"30f3dea59b49e34a6d4e2097e51fb1f581413a3225f428a40fea837d72d4d7a2"}
Sep 10 18:08:55.559245 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:08:55.559129    2568 scope.go:117] "RemoveContainer" containerID="e412cf8d49d6fec086b696292aab7b3072edc87925327c802dc446d8e04760c7"
Sep 10 18:08:55.561500 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:08:55.561477    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b3286eba-465f-44b8-8294-3b0d326e3dc0-plugins-config-volume\") pod \"b3286eba-465f-44b8-8294-3b0d326e3dc0\" (UID: \"b3286eba-465f-44b8-8294-3b0d326e3dc0\") "
Sep 10 18:08:55.561598 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:08:55.561544    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2zc6j\" (UniqueName: \"kubernetes.io/projected/b3286eba-465f-44b8-8294-3b0d326e3dc0-kube-api-access-2zc6j\") pod \"b3286eba-465f-44b8-8294-3b0d326e3dc0\" (UID: \"b3286eba-465f-44b8-8294-3b0d326e3dc0\") "
Sep 10 18:08:55.561918 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:08:55.561893    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3286eba-465f-44b8-8294-3b0d326e3dc0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b3286eba-465f-44b8-8294-3b0d326e3dc0" (UID: "b3286eba-465f-44b8-8294-3b0d326e3dc0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 18:08:55.563854 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:08:55.563821    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3286eba-465f-44b8-8294-3b0d326e3dc0-kube-api-access-2zc6j" (OuterVolumeSpecName: "kube-api-access-2zc6j") pod "b3286eba-465f-44b8-8294-3b0d326e3dc0" (UID: "b3286eba-465f-44b8-8294-3b0d326e3dc0"). InnerVolumeSpecName "kube-api-access-2zc6j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 18:08:55.570473 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:08:55.570449    2568 scope.go:117] "RemoveContainer" containerID="e412cf8d49d6fec086b696292aab7b3072edc87925327c802dc446d8e04760c7"
Sep 10 18:08:55.570948 ip-10-0-136-161 kubenswrapper[2568]: E0910 18:08:55.570918    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e412cf8d49d6fec086b696292aab7b3072edc87925327c802dc446d8e04760c7\": container with ID starting with e412cf8d49d6fec086b696292aab7b3072edc87925327c802dc446d8e04760c7 not found: ID does not exist" containerID="e412cf8d49d6fec086b696292aab7b3072edc87925327c802dc446d8e04760c7"
Sep 10 18:08:55.571003 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:08:55.570967    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e412cf8d49d6fec086b696292aab7b3072edc87925327c802dc446d8e04760c7"} err="failed to get container status \"e412cf8d49d6fec086b696292aab7b3072edc87925327c802dc446d8e04760c7\": rpc error: code = NotFound desc = could not find container \"e412cf8d49d6fec086b696292aab7b3072edc87925327c802dc446d8e04760c7\": container with ID starting with e412cf8d49d6fec086b696292aab7b3072edc87925327c802dc446d8e04760c7 not found: ID does not exist"
Sep 10 18:08:55.663170 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:08:55.663124    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b3286eba-465f-44b8-8294-3b0d326e3dc0-plugins-config-volume\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 18:08:55.663170 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:08:55.663166    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2zc6j\" (UniqueName: \"kubernetes.io/projected/b3286eba-465f-44b8-8294-3b0d326e3dc0-kube-api-access-2zc6j\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 18:08:55.888302 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:08:55.888253    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3b8881-54fc766c9d-9v7w9"]
Sep 10 18:08:55.890783 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:08:55.890756    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3b8881-54fc766c9d-9v7w9"]
Sep 10 18:08:56.775978 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:08:56.775935    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b3286eba-465f-44b8-8294-3b0d326e3dc0" path="/var/lib/kubelet/pods/b3286eba-465f-44b8-8294-3b0d326e3dc0/volumes"
Sep 10 18:09:26.625425 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:09:26.625373    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-732455/ipp-route-732455-kserve-687fbd9f8c-qngnw"]
Sep 10 18:09:41.646940 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:09:41.646891    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-ipp-a-732455/ipp-route-732455-kserve-687fbd9f8c-qngnw" podUID="0cc8d85f-f074-494e-b8f9-9b08cbffedbc" containerName="main" containerID="cri-o://9e588f71be9194a411138db79082b5bebb84f5a9e993df59eea7280e36c57e8a" gracePeriod=45
Sep 10 18:09:41.848542 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:09:41.848503    2568 generic.go:356] "Generic (PLEG): container finished" podID="0cc8d85f-f074-494e-b8f9-9b08cbffedbc" containerID="9e588f71be9194a411138db79082b5bebb84f5a9e993df59eea7280e36c57e8a" exitCode=0
Sep 10 18:09:41.848714 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:09:41.848581    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-732455/ipp-route-732455-kserve-687fbd9f8c-qngnw" event={"ID":"0cc8d85f-f074-494e-b8f9-9b08cbffedbc","Type":"ContainerDied","Data":"9e588f71be9194a411138db79082b5bebb84f5a9e993df59eea7280e36c57e8a"}
Sep 10 18:09:41.909491 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:09:41.909403    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-732455/ipp-route-732455-kserve-687fbd9f8c-qngnw"
Sep 10 18:09:41.990790 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:09:41.990752    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0cc8d85f-f074-494e-b8f9-9b08cbffedbc-dshm\") pod \"0cc8d85f-f074-494e-b8f9-9b08cbffedbc\" (UID: \"0cc8d85f-f074-494e-b8f9-9b08cbffedbc\") "
Sep 10 18:09:41.991026 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:09:41.990861    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0cc8d85f-f074-494e-b8f9-9b08cbffedbc-model-cache\") pod \"0cc8d85f-f074-494e-b8f9-9b08cbffedbc\" (UID: \"0cc8d85f-f074-494e-b8f9-9b08cbffedbc\") "
Sep 10 18:09:41.991026 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:09:41.990892    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0cc8d85f-f074-494e-b8f9-9b08cbffedbc-tmp-dir\") pod \"0cc8d85f-f074-494e-b8f9-9b08cbffedbc\" (UID: \"0cc8d85f-f074-494e-b8f9-9b08cbffedbc\") "
Sep 10 18:09:41.991026 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:09:41.990916    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0cc8d85f-f074-494e-b8f9-9b08cbffedbc-home\") pod \"0cc8d85f-f074-494e-b8f9-9b08cbffedbc\" (UID: \"0cc8d85f-f074-494e-b8f9-9b08cbffedbc\") "
Sep 10 18:09:41.991026 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:09:41.990957    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hj595\" (UniqueName: \"kubernetes.io/projected/0cc8d85f-f074-494e-b8f9-9b08cbffedbc-kube-api-access-hj595\") pod \"0cc8d85f-f074-494e-b8f9-9b08cbffedbc\" (UID: \"0cc8d85f-f074-494e-b8f9-9b08cbffedbc\") "
Sep 10 18:09:41.991026 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:09:41.990997    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0cc8d85f-f074-494e-b8f9-9b08cbffedbc-tls-certs\") pod \"0cc8d85f-f074-494e-b8f9-9b08cbffedbc\" (UID: \"0cc8d85f-f074-494e-b8f9-9b08cbffedbc\") "
Sep 10 18:09:41.991311 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:09:41.991173    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0cc8d85f-f074-494e-b8f9-9b08cbffedbc-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "0cc8d85f-f074-494e-b8f9-9b08cbffedbc" (UID: "0cc8d85f-f074-494e-b8f9-9b08cbffedbc"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 18:09:41.991311 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:09:41.991184    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0cc8d85f-f074-494e-b8f9-9b08cbffedbc-model-cache" (OuterVolumeSpecName: "model-cache") pod "0cc8d85f-f074-494e-b8f9-9b08cbffedbc" (UID: "0cc8d85f-f074-494e-b8f9-9b08cbffedbc"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 18:09:41.991311 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:09:41.991206    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0cc8d85f-f074-494e-b8f9-9b08cbffedbc-home" (OuterVolumeSpecName: "home") pod "0cc8d85f-f074-494e-b8f9-9b08cbffedbc" (UID: "0cc8d85f-f074-494e-b8f9-9b08cbffedbc"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 18:09:41.991488 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:09:41.991379    2568 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0cc8d85f-f074-494e-b8f9-9b08cbffedbc-model-cache\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 18:09:41.991488 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:09:41.991401    2568 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0cc8d85f-f074-494e-b8f9-9b08cbffedbc-tmp-dir\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 18:09:41.991488 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:09:41.991414    2568 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0cc8d85f-f074-494e-b8f9-9b08cbffedbc-home\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 18:09:41.993392 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:09:41.993285    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0cc8d85f-f074-494e-b8f9-9b08cbffedbc-dshm" (OuterVolumeSpecName: "dshm") pod "0cc8d85f-f074-494e-b8f9-9b08cbffedbc" (UID: "0cc8d85f-f074-494e-b8f9-9b08cbffedbc"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 18:09:41.993392 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:09:41.993340    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0cc8d85f-f074-494e-b8f9-9b08cbffedbc-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "0cc8d85f-f074-494e-b8f9-9b08cbffedbc" (UID: "0cc8d85f-f074-494e-b8f9-9b08cbffedbc"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 18:09:41.993629 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:09:41.993429    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0cc8d85f-f074-494e-b8f9-9b08cbffedbc-kube-api-access-hj595" (OuterVolumeSpecName: "kube-api-access-hj595") pod "0cc8d85f-f074-494e-b8f9-9b08cbffedbc" (UID: "0cc8d85f-f074-494e-b8f9-9b08cbffedbc"). InnerVolumeSpecName "kube-api-access-hj595". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 18:09:42.092822 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:09:42.092781    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hj595\" (UniqueName: \"kubernetes.io/projected/0cc8d85f-f074-494e-b8f9-9b08cbffedbc-kube-api-access-hj595\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 18:09:42.092822 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:09:42.092817    2568 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0cc8d85f-f074-494e-b8f9-9b08cbffedbc-tls-certs\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 18:09:42.092822 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:09:42.092827    2568 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0cc8d85f-f074-494e-b8f9-9b08cbffedbc-dshm\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 18:09:42.856221 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:09:42.856190    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-732455/ipp-route-732455-kserve-687fbd9f8c-qngnw"
Sep 10 18:09:42.856221 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:09:42.856215    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-732455/ipp-route-732455-kserve-687fbd9f8c-qngnw" event={"ID":"0cc8d85f-f074-494e-b8f9-9b08cbffedbc","Type":"ContainerDied","Data":"d87e6de6f5d6bfc92a93a5e14961dd4632376b13867409c9cae57708984e8d98"}
Sep 10 18:09:42.856754 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:09:42.856263    2568 scope.go:117] "RemoveContainer" containerID="9e588f71be9194a411138db79082b5bebb84f5a9e993df59eea7280e36c57e8a"
Sep 10 18:09:42.873716 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:09:42.873609    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-732455/ipp-route-732455-kserve-687fbd9f8c-qngnw"]
Sep 10 18:09:42.876466 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:09:42.876435    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-ipp-a-732455/ipp-route-732455-kserve-687fbd9f8c-qngnw"]
Sep 10 18:09:44.771410 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:09:44.771366    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0cc8d85f-f074-494e-b8f9-9b08cbffedbc" path="/var/lib/kubelet/pods/0cc8d85f-f074-494e-b8f9-9b08cbffedbc/volumes"
Sep 10 18:10:20.745497 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:20.744393    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-4d9405-c559f5fcd-ldr2t"]
Sep 10 18:10:20.745497 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:20.744675    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-4d9405-c559f5fcd-ldr2t" podUID="3760d0bc-2aa7-4718-bbba-d809f5cf36ca" containerName="payload-pre-processing" containerID="cri-o://44ca9c42427c2b0b816a83ad4942e336c4672dffd7beecf8c2a63b6119c42307" gracePeriod=30
Sep 10 18:10:21.044151 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:21.044111    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-4d9405-c559f5fcd-ldr2t"
Sep 10 18:10:21.083661 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:21.083620    2568 generic.go:356] "Generic (PLEG): container finished" podID="3760d0bc-2aa7-4718-bbba-d809f5cf36ca" containerID="44ca9c42427c2b0b816a83ad4942e336c4672dffd7beecf8c2a63b6119c42307" exitCode=0
Sep 10 18:10:21.083893 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:21.083677    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-4d9405-c559f5fcd-ldr2t"
Sep 10 18:10:21.083893 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:21.083723    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-4d9405-c559f5fcd-ldr2t" event={"ID":"3760d0bc-2aa7-4718-bbba-d809f5cf36ca","Type":"ContainerDied","Data":"44ca9c42427c2b0b816a83ad4942e336c4672dffd7beecf8c2a63b6119c42307"}
Sep 10 18:10:21.083893 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:21.083812    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-4d9405-c559f5fcd-ldr2t" event={"ID":"3760d0bc-2aa7-4718-bbba-d809f5cf36ca","Type":"ContainerDied","Data":"f6119fb6eccb0a8e3f421c288aa5f3239431f701fed5413caddd0312c79fc4e2"}
Sep 10 18:10:21.083893 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:21.083878    2568 scope.go:117] "RemoveContainer" containerID="44ca9c42427c2b0b816a83ad4942e336c4672dffd7beecf8c2a63b6119c42307"
Sep 10 18:10:21.094423 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:21.094396    2568 scope.go:117] "RemoveContainer" containerID="44ca9c42427c2b0b816a83ad4942e336c4672dffd7beecf8c2a63b6119c42307"
Sep 10 18:10:21.094827 ip-10-0-136-161 kubenswrapper[2568]: E0910 18:10:21.094798    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44ca9c42427c2b0b816a83ad4942e336c4672dffd7beecf8c2a63b6119c42307\": container with ID starting with 44ca9c42427c2b0b816a83ad4942e336c4672dffd7beecf8c2a63b6119c42307 not found: ID does not exist" containerID="44ca9c42427c2b0b816a83ad4942e336c4672dffd7beecf8c2a63b6119c42307"
Sep 10 18:10:21.094886 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:21.094842    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44ca9c42427c2b0b816a83ad4942e336c4672dffd7beecf8c2a63b6119c42307"} err="failed to get container status \"44ca9c42427c2b0b816a83ad4942e336c4672dffd7beecf8c2a63b6119c42307\": rpc error: code = NotFound desc = could not find container \"44ca9c42427c2b0b816a83ad4942e336c4672dffd7beecf8c2a63b6119c42307\": container with ID starting with 44ca9c42427c2b0b816a83ad4942e336c4672dffd7beecf8c2a63b6119c42307 not found: ID does not exist"
Sep 10 18:10:21.170223 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:21.170179    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3760d0bc-2aa7-4718-bbba-d809f5cf36ca-plugins-config-volume\") pod \"3760d0bc-2aa7-4718-bbba-d809f5cf36ca\" (UID: \"3760d0bc-2aa7-4718-bbba-d809f5cf36ca\") "
Sep 10 18:10:21.170480 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:21.170263    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2nnv8\" (UniqueName: \"kubernetes.io/projected/3760d0bc-2aa7-4718-bbba-d809f5cf36ca-kube-api-access-2nnv8\") pod \"3760d0bc-2aa7-4718-bbba-d809f5cf36ca\" (UID: \"3760d0bc-2aa7-4718-bbba-d809f5cf36ca\") "
Sep 10 18:10:21.170649 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:21.170623    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3760d0bc-2aa7-4718-bbba-d809f5cf36ca-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3760d0bc-2aa7-4718-bbba-d809f5cf36ca" (UID: "3760d0bc-2aa7-4718-bbba-d809f5cf36ca"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 18:10:21.172634 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:21.172610    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3760d0bc-2aa7-4718-bbba-d809f5cf36ca-kube-api-access-2nnv8" (OuterVolumeSpecName: "kube-api-access-2nnv8") pod "3760d0bc-2aa7-4718-bbba-d809f5cf36ca" (UID: "3760d0bc-2aa7-4718-bbba-d809f5cf36ca"). InnerVolumeSpecName "kube-api-access-2nnv8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 18:10:21.271886 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:21.271734    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2nnv8\" (UniqueName: \"kubernetes.io/projected/3760d0bc-2aa7-4718-bbba-d809f5cf36ca-kube-api-access-2nnv8\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 18:10:21.271886 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:21.271772    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3760d0bc-2aa7-4718-bbba-d809f5cf36ca-plugins-config-volume\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 18:10:21.406509 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:21.406476    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-4d9405-c559f5fcd-ldr2t"]
Sep 10 18:10:21.410339 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:21.410292    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-4d9405-c559f5fcd-ldr2t"]
Sep 10 18:10:22.770393 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:22.770352    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3760d0bc-2aa7-4718-bbba-d809f5cf36ca" path="/var/lib/kubelet/pods/3760d0bc-2aa7-4718-bbba-d809f5cf36ca/volumes"
Sep 10 18:10:27.472116 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:27.472077    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-4d9405-openshift-default-8c7884b44-zd87s"]
Sep 10 18:10:27.472621 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:27.472306    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-4d9405-openshift-default-8c7884b44-zd87s" podUID="04abb636-a812-4242-b932-4414f0bb256c" containerName="istio-proxy" containerID="cri-o://d5777f3e4f224b3168a88e223e240a55cd8f250626ccff25d6de409d9e635956" gracePeriod=30
Sep 10 18:10:32.740396 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:32.740300    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-4d9405-openshift-default-8c7884b44-zd87s"
Sep 10 18:10:32.882621 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:32.882575    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/04abb636-a812-4242-b932-4414f0bb256c-istio-podinfo\") pod \"04abb636-a812-4242-b932-4414f0bb256c\" (UID: \"04abb636-a812-4242-b932-4414f0bb256c\") "
Sep 10 18:10:32.882621 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:32.882627    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/04abb636-a812-4242-b932-4414f0bb256c-credential-socket\") pod \"04abb636-a812-4242-b932-4414f0bb256c\" (UID: \"04abb636-a812-4242-b932-4414f0bb256c\") "
Sep 10 18:10:32.882844 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:32.882660    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/04abb636-a812-4242-b932-4414f0bb256c-istio-envoy\") pod \"04abb636-a812-4242-b932-4414f0bb256c\" (UID: \"04abb636-a812-4242-b932-4414f0bb256c\") "
Sep 10 18:10:32.882844 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:32.882775    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/04abb636-a812-4242-b932-4414f0bb256c-istio-data\") pod \"04abb636-a812-4242-b932-4414f0bb256c\" (UID: \"04abb636-a812-4242-b932-4414f0bb256c\") "
Sep 10 18:10:32.882919 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:32.882860    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/04abb636-a812-4242-b932-4414f0bb256c-workload-socket\") pod \"04abb636-a812-4242-b932-4414f0bb256c\" (UID: \"04abb636-a812-4242-b932-4414f0bb256c\") "
Sep 10 18:10:32.882919 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:32.882890    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/04abb636-a812-4242-b932-4414f0bb256c-workload-certs\") pod \"04abb636-a812-4242-b932-4414f0bb256c\" (UID: \"04abb636-a812-4242-b932-4414f0bb256c\") "
Sep 10 18:10:32.883036 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:32.882929    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hsx8j\" (UniqueName: \"kubernetes.io/projected/04abb636-a812-4242-b932-4414f0bb256c-kube-api-access-hsx8j\") pod \"04abb636-a812-4242-b932-4414f0bb256c\" (UID: \"04abb636-a812-4242-b932-4414f0bb256c\") "
Sep 10 18:10:32.883036 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:32.882967    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04abb636-a812-4242-b932-4414f0bb256c-istio-token\") pod \"04abb636-a812-4242-b932-4414f0bb256c\" (UID: \"04abb636-a812-4242-b932-4414f0bb256c\") "
Sep 10 18:10:32.883036 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:32.882991    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04abb636-a812-4242-b932-4414f0bb256c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "04abb636-a812-4242-b932-4414f0bb256c" (UID: "04abb636-a812-4242-b932-4414f0bb256c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 18:10:32.883036 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:32.883010    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/04abb636-a812-4242-b932-4414f0bb256c-istiod-ca-cert\") pod \"04abb636-a812-4242-b932-4414f0bb256c\" (UID: \"04abb636-a812-4242-b932-4414f0bb256c\") "
Sep 10 18:10:32.883239 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:32.883168    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04abb636-a812-4242-b932-4414f0bb256c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "04abb636-a812-4242-b932-4414f0bb256c" (UID: "04abb636-a812-4242-b932-4414f0bb256c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 18:10:32.883296 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:32.883154    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04abb636-a812-4242-b932-4414f0bb256c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "04abb636-a812-4242-b932-4414f0bb256c" (UID: "04abb636-a812-4242-b932-4414f0bb256c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 18:10:32.883471 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:32.883447    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04abb636-a812-4242-b932-4414f0bb256c-istio-data" (OuterVolumeSpecName: "istio-data") pod "04abb636-a812-4242-b932-4414f0bb256c" (UID: "04abb636-a812-4242-b932-4414f0bb256c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 18:10:32.883556 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:32.883364    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/04abb636-a812-4242-b932-4414f0bb256c-credential-socket\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 18:10:32.883556 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:32.883492    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/04abb636-a812-4242-b932-4414f0bb256c-workload-socket\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 18:10:32.883556 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:32.883507    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/04abb636-a812-4242-b932-4414f0bb256c-workload-certs\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 18:10:32.883556 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:32.883528    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/04abb636-a812-4242-b932-4414f0bb256c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "04abb636-a812-4242-b932-4414f0bb256c" (UID: "04abb636-a812-4242-b932-4414f0bb256c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 18:10:32.885167 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:32.885130    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04abb636-a812-4242-b932-4414f0bb256c-kube-api-access-hsx8j" (OuterVolumeSpecName: "kube-api-access-hsx8j") pod "04abb636-a812-4242-b932-4414f0bb256c" (UID: "04abb636-a812-4242-b932-4414f0bb256c"). InnerVolumeSpecName "kube-api-access-hsx8j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 18:10:32.885301 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:32.885185    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/04abb636-a812-4242-b932-4414f0bb256c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "04abb636-a812-4242-b932-4414f0bb256c" (UID: "04abb636-a812-4242-b932-4414f0bb256c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 18:10:32.885301 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:32.885216    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04abb636-a812-4242-b932-4414f0bb256c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "04abb636-a812-4242-b932-4414f0bb256c" (UID: "04abb636-a812-4242-b932-4414f0bb256c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 18:10:32.885301 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:32.885237    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04abb636-a812-4242-b932-4414f0bb256c-istio-token" (OuterVolumeSpecName: "istio-token") pod "04abb636-a812-4242-b932-4414f0bb256c" (UID: "04abb636-a812-4242-b932-4414f0bb256c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 18:10:32.984708 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:32.984666    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hsx8j\" (UniqueName: \"kubernetes.io/projected/04abb636-a812-4242-b932-4414f0bb256c-kube-api-access-hsx8j\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 18:10:32.984708 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:32.984700    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04abb636-a812-4242-b932-4414f0bb256c-istio-token\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 18:10:32.984708 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:32.984710    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/04abb636-a812-4242-b932-4414f0bb256c-istiod-ca-cert\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 18:10:32.984708 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:32.984719    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/04abb636-a812-4242-b932-4414f0bb256c-istio-podinfo\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 18:10:32.984994 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:32.984728    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/04abb636-a812-4242-b932-4414f0bb256c-istio-envoy\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 18:10:32.984994 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:32.984735    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/04abb636-a812-4242-b932-4414f0bb256c-istio-data\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 18:10:33.163964 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:33.163861    2568 generic.go:356] "Generic (PLEG): container finished" podID="04abb636-a812-4242-b932-4414f0bb256c" containerID="d5777f3e4f224b3168a88e223e240a55cd8f250626ccff25d6de409d9e635956" exitCode=0
Sep 10 18:10:33.163964 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:33.163916    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-4d9405-openshift-default-8c7884b44-zd87s"
Sep 10 18:10:33.163964 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:33.163946    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-4d9405-openshift-default-8c7884b44-zd87s" event={"ID":"04abb636-a812-4242-b932-4414f0bb256c","Type":"ContainerDied","Data":"d5777f3e4f224b3168a88e223e240a55cd8f250626ccff25d6de409d9e635956"}
Sep 10 18:10:33.164246 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:33.164003    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-4d9405-openshift-default-8c7884b44-zd87s" event={"ID":"04abb636-a812-4242-b932-4414f0bb256c","Type":"ContainerDied","Data":"cdec4797a5efb1bca7f74bc3dc67e849f3c7626fc2c1d022c2e11d34a08faa10"}
Sep 10 18:10:33.164246 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:33.164028    2568 scope.go:117] "RemoveContainer" containerID="d5777f3e4f224b3168a88e223e240a55cd8f250626ccff25d6de409d9e635956"
Sep 10 18:10:33.174730 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:33.174706    2568 scope.go:117] "RemoveContainer" containerID="917061cee55d51769642d9088c3cf7e5faa37843688ea48f50d03cfe767bf983"
Sep 10 18:10:33.184997 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:33.184969    2568 scope.go:117] "RemoveContainer" containerID="d5777f3e4f224b3168a88e223e240a55cd8f250626ccff25d6de409d9e635956"
Sep 10 18:10:33.185407 ip-10-0-136-161 kubenswrapper[2568]: E0910 18:10:33.185382    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5777f3e4f224b3168a88e223e240a55cd8f250626ccff25d6de409d9e635956\": container with ID starting with d5777f3e4f224b3168a88e223e240a55cd8f250626ccff25d6de409d9e635956 not found: ID does not exist" containerID="d5777f3e4f224b3168a88e223e240a55cd8f250626ccff25d6de409d9e635956"
Sep 10 18:10:33.185508 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:33.185419    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5777f3e4f224b3168a88e223e240a55cd8f250626ccff25d6de409d9e635956"} err="failed to get container status \"d5777f3e4f224b3168a88e223e240a55cd8f250626ccff25d6de409d9e635956\": rpc error: code = NotFound desc = could not find container \"d5777f3e4f224b3168a88e223e240a55cd8f250626ccff25d6de409d9e635956\": container with ID starting with d5777f3e4f224b3168a88e223e240a55cd8f250626ccff25d6de409d9e635956 not found: ID does not exist"
Sep 10 18:10:33.185508 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:33.185450    2568 scope.go:117] "RemoveContainer" containerID="917061cee55d51769642d9088c3cf7e5faa37843688ea48f50d03cfe767bf983"
Sep 10 18:10:33.185781 ip-10-0-136-161 kubenswrapper[2568]: E0910 18:10:33.185761    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"917061cee55d51769642d9088c3cf7e5faa37843688ea48f50d03cfe767bf983\": container with ID starting with 917061cee55d51769642d9088c3cf7e5faa37843688ea48f50d03cfe767bf983 not found: ID does not exist" containerID="917061cee55d51769642d9088c3cf7e5faa37843688ea48f50d03cfe767bf983"
Sep 10 18:10:33.185837 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:33.185789    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"917061cee55d51769642d9088c3cf7e5faa37843688ea48f50d03cfe767bf983"} err="failed to get container status \"917061cee55d51769642d9088c3cf7e5faa37843688ea48f50d03cfe767bf983\": rpc error: code = NotFound desc = could not find container \"917061cee55d51769642d9088c3cf7e5faa37843688ea48f50d03cfe767bf983\": container with ID starting with 917061cee55d51769642d9088c3cf7e5faa37843688ea48f50d03cfe767bf983 not found: ID does not exist"
Sep 10 18:10:33.187828 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:33.187797    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-4d9405-openshift-default-8c7884b44-zd87s"]
Sep 10 18:10:33.193032 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:33.192995    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-4d9405-openshift-default-8c7884b44-zd87s"]
Sep 10 18:10:34.770731 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:34.770688    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="04abb636-a812-4242-b932-4414f0bb256c" path="/var/lib/kubelet/pods/04abb636-a812-4242-b932-4414f0bb256c/volumes"
Sep 10 18:10:38.302763 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:38.302729    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-6c9ffc-754bb5cd5c-jhvhf"]
Sep 10 18:10:38.303406 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:38.302967    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-6c9ffc-754bb5cd5c-jhvhf" podUID="02ccd568-8956-4999-8c64-25178aca3987" containerName="payload-processing" containerID="cri-o://1ba0be31cd4e5dbad0a4ccb17008d475d55666464c3fbdc82a03592c79e2a087" gracePeriod=30
Sep 10 18:10:38.311782 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:38.311733    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-6c9ffc-69db85767d-5wt7r"]
Sep 10 18:10:38.312266 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:38.312233    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-6c9ffc-69db85767d-5wt7r" podUID="358112e2-56a1-4a2c-b3e1-086d2b79af21" containerName="payload-pre-processing" containerID="cri-o://2544486ae9af24737b69c76195a67d3d20ad13e12736fbba4966ee4ea03bea04" gracePeriod=30
Sep 10 18:10:38.572704 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:38.572673    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-6c9ffc-754bb5cd5c-jhvhf"
Sep 10 18:10:38.604147 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:38.604114    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-6c9ffc-69db85767d-5wt7r"
Sep 10 18:10:38.738574 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:38.738535    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/358112e2-56a1-4a2c-b3e1-086d2b79af21-plugins-config-volume\") pod \"358112e2-56a1-4a2c-b3e1-086d2b79af21\" (UID: \"358112e2-56a1-4a2c-b3e1-086d2b79af21\") "
Sep 10 18:10:38.738778 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:38.738624    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d22xg\" (UniqueName: \"kubernetes.io/projected/02ccd568-8956-4999-8c64-25178aca3987-kube-api-access-d22xg\") pod \"02ccd568-8956-4999-8c64-25178aca3987\" (UID: \"02ccd568-8956-4999-8c64-25178aca3987\") "
Sep 10 18:10:38.738778 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:38.738665    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kz5sd\" (UniqueName: \"kubernetes.io/projected/358112e2-56a1-4a2c-b3e1-086d2b79af21-kube-api-access-kz5sd\") pod \"358112e2-56a1-4a2c-b3e1-086d2b79af21\" (UID: \"358112e2-56a1-4a2c-b3e1-086d2b79af21\") "
Sep 10 18:10:38.738778 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:38.738687    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/02ccd568-8956-4999-8c64-25178aca3987-plugins-config-volume\") pod \"02ccd568-8956-4999-8c64-25178aca3987\" (UID: \"02ccd568-8956-4999-8c64-25178aca3987\") "
Sep 10 18:10:38.738942 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:38.738876    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/358112e2-56a1-4a2c-b3e1-086d2b79af21-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "358112e2-56a1-4a2c-b3e1-086d2b79af21" (UID: "358112e2-56a1-4a2c-b3e1-086d2b79af21"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 18:10:38.738991 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:38.738973    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/358112e2-56a1-4a2c-b3e1-086d2b79af21-plugins-config-volume\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 18:10:38.739129 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:38.739107    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02ccd568-8956-4999-8c64-25178aca3987-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "02ccd568-8956-4999-8c64-25178aca3987" (UID: "02ccd568-8956-4999-8c64-25178aca3987"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 18:10:38.740783 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:38.740757    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/358112e2-56a1-4a2c-b3e1-086d2b79af21-kube-api-access-kz5sd" (OuterVolumeSpecName: "kube-api-access-kz5sd") pod "358112e2-56a1-4a2c-b3e1-086d2b79af21" (UID: "358112e2-56a1-4a2c-b3e1-086d2b79af21"). InnerVolumeSpecName "kube-api-access-kz5sd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 18:10:38.740895 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:38.740791    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02ccd568-8956-4999-8c64-25178aca3987-kube-api-access-d22xg" (OuterVolumeSpecName: "kube-api-access-d22xg") pod "02ccd568-8956-4999-8c64-25178aca3987" (UID: "02ccd568-8956-4999-8c64-25178aca3987"). InnerVolumeSpecName "kube-api-access-d22xg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 18:10:38.840014 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:38.839918    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d22xg\" (UniqueName: \"kubernetes.io/projected/02ccd568-8956-4999-8c64-25178aca3987-kube-api-access-d22xg\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 18:10:38.840014 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:38.839951    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kz5sd\" (UniqueName: \"kubernetes.io/projected/358112e2-56a1-4a2c-b3e1-086d2b79af21-kube-api-access-kz5sd\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 18:10:38.840014 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:38.839961    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/02ccd568-8956-4999-8c64-25178aca3987-plugins-config-volume\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 18:10:39.202710 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:39.202612    2568 generic.go:356] "Generic (PLEG): container finished" podID="358112e2-56a1-4a2c-b3e1-086d2b79af21" containerID="2544486ae9af24737b69c76195a67d3d20ad13e12736fbba4966ee4ea03bea04" exitCode=0
Sep 10 18:10:39.202710 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:39.202660    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-6c9ffc-69db85767d-5wt7r"
Sep 10 18:10:39.203046 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:39.202696    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-6c9ffc-69db85767d-5wt7r" event={"ID":"358112e2-56a1-4a2c-b3e1-086d2b79af21","Type":"ContainerDied","Data":"2544486ae9af24737b69c76195a67d3d20ad13e12736fbba4966ee4ea03bea04"}
Sep 10 18:10:39.203046 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:39.202768    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-6c9ffc-69db85767d-5wt7r" event={"ID":"358112e2-56a1-4a2c-b3e1-086d2b79af21","Type":"ContainerDied","Data":"abb9d6c9b94a367e16186824434313e56e0054628aa528c098067b846bec1d99"}
Sep 10 18:10:39.203046 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:39.202799    2568 scope.go:117] "RemoveContainer" containerID="2544486ae9af24737b69c76195a67d3d20ad13e12736fbba4966ee4ea03bea04"
Sep 10 18:10:39.204621 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:39.204590    2568 generic.go:356] "Generic (PLEG): container finished" podID="02ccd568-8956-4999-8c64-25178aca3987" containerID="1ba0be31cd4e5dbad0a4ccb17008d475d55666464c3fbdc82a03592c79e2a087" exitCode=0
Sep 10 18:10:39.204779 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:39.204633    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-6c9ffc-754bb5cd5c-jhvhf"
Sep 10 18:10:39.204779 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:39.204639    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-6c9ffc-754bb5cd5c-jhvhf" event={"ID":"02ccd568-8956-4999-8c64-25178aca3987","Type":"ContainerDied","Data":"1ba0be31cd4e5dbad0a4ccb17008d475d55666464c3fbdc82a03592c79e2a087"}
Sep 10 18:10:39.204932 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:39.204818    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-6c9ffc-754bb5cd5c-jhvhf" event={"ID":"02ccd568-8956-4999-8c64-25178aca3987","Type":"ContainerDied","Data":"f7bdbc139c6894bd536142929c67e6a3c36f8b3550531fea18f6dfe5ba8f0bd4"}
Sep 10 18:10:39.213717 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:39.213696    2568 scope.go:117] "RemoveContainer" containerID="2544486ae9af24737b69c76195a67d3d20ad13e12736fbba4966ee4ea03bea04"
Sep 10 18:10:39.214085 ip-10-0-136-161 kubenswrapper[2568]: E0910 18:10:39.214064    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2544486ae9af24737b69c76195a67d3d20ad13e12736fbba4966ee4ea03bea04\": container with ID starting with 2544486ae9af24737b69c76195a67d3d20ad13e12736fbba4966ee4ea03bea04 not found: ID does not exist" containerID="2544486ae9af24737b69c76195a67d3d20ad13e12736fbba4966ee4ea03bea04"
Sep 10 18:10:39.214136 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:39.214094    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2544486ae9af24737b69c76195a67d3d20ad13e12736fbba4966ee4ea03bea04"} err="failed to get container status \"2544486ae9af24737b69c76195a67d3d20ad13e12736fbba4966ee4ea03bea04\": rpc error: code = NotFound desc = could not find container \"2544486ae9af24737b69c76195a67d3d20ad13e12736fbba4966ee4ea03bea04\": container with ID starting with 2544486ae9af24737b69c76195a67d3d20ad13e12736fbba4966ee4ea03bea04 not found: ID does not exist"
Sep 10 18:10:39.214136 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:39.214111    2568 scope.go:117] "RemoveContainer" containerID="1ba0be31cd4e5dbad0a4ccb17008d475d55666464c3fbdc82a03592c79e2a087"
Sep 10 18:10:39.222898 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:39.222872    2568 scope.go:117] "RemoveContainer" containerID="1ba0be31cd4e5dbad0a4ccb17008d475d55666464c3fbdc82a03592c79e2a087"
Sep 10 18:10:39.223284 ip-10-0-136-161 kubenswrapper[2568]: E0910 18:10:39.223260    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ba0be31cd4e5dbad0a4ccb17008d475d55666464c3fbdc82a03592c79e2a087\": container with ID starting with 1ba0be31cd4e5dbad0a4ccb17008d475d55666464c3fbdc82a03592c79e2a087 not found: ID does not exist" containerID="1ba0be31cd4e5dbad0a4ccb17008d475d55666464c3fbdc82a03592c79e2a087"
Sep 10 18:10:39.223355 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:39.223293    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ba0be31cd4e5dbad0a4ccb17008d475d55666464c3fbdc82a03592c79e2a087"} err="failed to get container status \"1ba0be31cd4e5dbad0a4ccb17008d475d55666464c3fbdc82a03592c79e2a087\": rpc error: code = NotFound desc = could not find container \"1ba0be31cd4e5dbad0a4ccb17008d475d55666464c3fbdc82a03592c79e2a087\": container with ID starting with 1ba0be31cd4e5dbad0a4ccb17008d475d55666464c3fbdc82a03592c79e2a087 not found: ID does not exist"
Sep 10 18:10:39.228007 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:39.227974    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-6c9ffc-754bb5cd5c-jhvhf"]
Sep 10 18:10:39.231965 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:39.231931    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-6c9ffc-754bb5cd5c-jhvhf"]
Sep 10 18:10:39.246806 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:39.246763    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-6c9ffc-69db85767d-5wt7r"]
Sep 10 18:10:39.250675 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:39.250632    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-6c9ffc-69db85767d-5wt7r"]
Sep 10 18:10:40.770126 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:40.770087    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="02ccd568-8956-4999-8c64-25178aca3987" path="/var/lib/kubelet/pods/02ccd568-8956-4999-8c64-25178aca3987/volumes"
Sep 10 18:10:40.770625 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:40.770485    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="358112e2-56a1-4a2c-b3e1-086d2b79af21" path="/var/lib/kubelet/pods/358112e2-56a1-4a2c-b3e1-086d2b79af21/volumes"
Sep 10 18:10:45.337922 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:45.337871    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-6c9ffc-openshift-default-78b8c7fd54-6dkkf"]
Sep 10 18:10:45.338439 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:45.338089    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w3-6c9ffc-openshift-default-78b8c7fd54-6dkkf" podUID="19fbb3af-82ca-4d1f-82fe-f8a5756a5dff" containerName="istio-proxy" containerID="cri-o://2699718f6304b46ae2f1fd9e3cf783137ddd277a722ab2621289f5876670d15c" gracePeriod=30
Sep 10 18:10:47.049004 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:47.048963    2568 patch_prober.go:28] interesting pod/e2e-shared-a-w3-6c9ffc-openshift-default-78b8c7fd54-6dkkf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 18:10:47.049434 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:47.049058    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w3-6c9ffc-openshift-default-78b8c7fd54-6dkkf" podUID="19fbb3af-82ca-4d1f-82fe-f8a5756a5dff" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 18:10:50.603814 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:50.603736    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-6c9ffc-openshift-default-78b8c7fd54-6dkkf"
Sep 10 18:10:50.649257 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:50.649222    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19fbb3af-82ca-4d1f-82fe-f8a5756a5dff-istio-podinfo\") pod \"19fbb3af-82ca-4d1f-82fe-f8a5756a5dff\" (UID: \"19fbb3af-82ca-4d1f-82fe-f8a5756a5dff\") "
Sep 10 18:10:50.649466 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:50.649263    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19fbb3af-82ca-4d1f-82fe-f8a5756a5dff-credential-socket\") pod \"19fbb3af-82ca-4d1f-82fe-f8a5756a5dff\" (UID: \"19fbb3af-82ca-4d1f-82fe-f8a5756a5dff\") "
Sep 10 18:10:50.649466 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:50.649305    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19fbb3af-82ca-4d1f-82fe-f8a5756a5dff-istio-envoy\") pod \"19fbb3af-82ca-4d1f-82fe-f8a5756a5dff\" (UID: \"19fbb3af-82ca-4d1f-82fe-f8a5756a5dff\") "
Sep 10 18:10:50.649466 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:50.649343    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19fbb3af-82ca-4d1f-82fe-f8a5756a5dff-istiod-ca-cert\") pod \"19fbb3af-82ca-4d1f-82fe-f8a5756a5dff\" (UID: \"19fbb3af-82ca-4d1f-82fe-f8a5756a5dff\") "
Sep 10 18:10:50.649466 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:50.649391    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19fbb3af-82ca-4d1f-82fe-f8a5756a5dff-workload-certs\") pod \"19fbb3af-82ca-4d1f-82fe-f8a5756a5dff\" (UID: \"19fbb3af-82ca-4d1f-82fe-f8a5756a5dff\") "
Sep 10 18:10:50.649466 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:50.649415    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6gk9x\" (UniqueName: \"kubernetes.io/projected/19fbb3af-82ca-4d1f-82fe-f8a5756a5dff-kube-api-access-6gk9x\") pod \"19fbb3af-82ca-4d1f-82fe-f8a5756a5dff\" (UID: \"19fbb3af-82ca-4d1f-82fe-f8a5756a5dff\") "
Sep 10 18:10:50.649466 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:50.649458    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19fbb3af-82ca-4d1f-82fe-f8a5756a5dff-istio-data\") pod \"19fbb3af-82ca-4d1f-82fe-f8a5756a5dff\" (UID: \"19fbb3af-82ca-4d1f-82fe-f8a5756a5dff\") "
Sep 10 18:10:50.649795 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:50.649479    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19fbb3af-82ca-4d1f-82fe-f8a5756a5dff-workload-socket\") pod \"19fbb3af-82ca-4d1f-82fe-f8a5756a5dff\" (UID: \"19fbb3af-82ca-4d1f-82fe-f8a5756a5dff\") "
Sep 10 18:10:50.649795 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:50.649517    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19fbb3af-82ca-4d1f-82fe-f8a5756a5dff-istio-token\") pod \"19fbb3af-82ca-4d1f-82fe-f8a5756a5dff\" (UID: \"19fbb3af-82ca-4d1f-82fe-f8a5756a5dff\") "
Sep 10 18:10:50.649795 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:50.649602    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19fbb3af-82ca-4d1f-82fe-f8a5756a5dff-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "19fbb3af-82ca-4d1f-82fe-f8a5756a5dff" (UID: "19fbb3af-82ca-4d1f-82fe-f8a5756a5dff"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 18:10:50.649947 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:50.649821    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19fbb3af-82ca-4d1f-82fe-f8a5756a5dff-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "19fbb3af-82ca-4d1f-82fe-f8a5756a5dff" (UID: "19fbb3af-82ca-4d1f-82fe-f8a5756a5dff"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 18:10:50.649947 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:50.649832    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19fbb3af-82ca-4d1f-82fe-f8a5756a5dff-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "19fbb3af-82ca-4d1f-82fe-f8a5756a5dff" (UID: "19fbb3af-82ca-4d1f-82fe-f8a5756a5dff"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 18:10:50.649947 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:50.649882    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19fbb3af-82ca-4d1f-82fe-f8a5756a5dff-credential-socket\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 18:10:50.650143 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:50.650091    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19fbb3af-82ca-4d1f-82fe-f8a5756a5dff-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "19fbb3af-82ca-4d1f-82fe-f8a5756a5dff" (UID: "19fbb3af-82ca-4d1f-82fe-f8a5756a5dff"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 18:10:50.650143 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:50.650126    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19fbb3af-82ca-4d1f-82fe-f8a5756a5dff-istio-data" (OuterVolumeSpecName: "istio-data") pod "19fbb3af-82ca-4d1f-82fe-f8a5756a5dff" (UID: "19fbb3af-82ca-4d1f-82fe-f8a5756a5dff"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 18:10:50.651662 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:50.651631    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/19fbb3af-82ca-4d1f-82fe-f8a5756a5dff-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "19fbb3af-82ca-4d1f-82fe-f8a5756a5dff" (UID: "19fbb3af-82ca-4d1f-82fe-f8a5756a5dff"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 18:10:50.651949 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:50.651907    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19fbb3af-82ca-4d1f-82fe-f8a5756a5dff-kube-api-access-6gk9x" (OuterVolumeSpecName: "kube-api-access-6gk9x") pod "19fbb3af-82ca-4d1f-82fe-f8a5756a5dff" (UID: "19fbb3af-82ca-4d1f-82fe-f8a5756a5dff"). InnerVolumeSpecName "kube-api-access-6gk9x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 18:10:50.652071 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:50.651967    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19fbb3af-82ca-4d1f-82fe-f8a5756a5dff-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "19fbb3af-82ca-4d1f-82fe-f8a5756a5dff" (UID: "19fbb3af-82ca-4d1f-82fe-f8a5756a5dff"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 18:10:50.652071 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:50.652067    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19fbb3af-82ca-4d1f-82fe-f8a5756a5dff-istio-token" (OuterVolumeSpecName: "istio-token") pod "19fbb3af-82ca-4d1f-82fe-f8a5756a5dff" (UID: "19fbb3af-82ca-4d1f-82fe-f8a5756a5dff"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 18:10:50.751072 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:50.751016    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19fbb3af-82ca-4d1f-82fe-f8a5756a5dff-istio-envoy\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 18:10:50.751072 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:50.751067    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19fbb3af-82ca-4d1f-82fe-f8a5756a5dff-istiod-ca-cert\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 18:10:50.751072 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:50.751078    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19fbb3af-82ca-4d1f-82fe-f8a5756a5dff-workload-certs\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 18:10:50.751072 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:50.751087    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6gk9x\" (UniqueName: \"kubernetes.io/projected/19fbb3af-82ca-4d1f-82fe-f8a5756a5dff-kube-api-access-6gk9x\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 18:10:50.751402 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:50.751096    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19fbb3af-82ca-4d1f-82fe-f8a5756a5dff-istio-data\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 18:10:50.751402 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:50.751105    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19fbb3af-82ca-4d1f-82fe-f8a5756a5dff-workload-socket\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 18:10:50.751402 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:50.751113    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19fbb3af-82ca-4d1f-82fe-f8a5756a5dff-istio-token\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 18:10:50.751402 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:50.751121    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19fbb3af-82ca-4d1f-82fe-f8a5756a5dff-istio-podinfo\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 18:10:51.288691 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:51.288653    2568 generic.go:356] "Generic (PLEG): container finished" podID="19fbb3af-82ca-4d1f-82fe-f8a5756a5dff" containerID="2699718f6304b46ae2f1fd9e3cf783137ddd277a722ab2621289f5876670d15c" exitCode=0
Sep 10 18:10:51.288917 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:51.288705    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-6c9ffc-openshift-default-78b8c7fd54-6dkkf"
Sep 10 18:10:51.288917 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:51.288728    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-6c9ffc-openshift-default-78b8c7fd54-6dkkf" event={"ID":"19fbb3af-82ca-4d1f-82fe-f8a5756a5dff","Type":"ContainerDied","Data":"2699718f6304b46ae2f1fd9e3cf783137ddd277a722ab2621289f5876670d15c"}
Sep 10 18:10:51.288917 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:51.288776    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-6c9ffc-openshift-default-78b8c7fd54-6dkkf" event={"ID":"19fbb3af-82ca-4d1f-82fe-f8a5756a5dff","Type":"ContainerDied","Data":"9dbe7443f032e5ce039e578b93727a116b08bbb140cd86f88b42a7978718c154"}
Sep 10 18:10:51.288917 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:51.288797    2568 scope.go:117] "RemoveContainer" containerID="2699718f6304b46ae2f1fd9e3cf783137ddd277a722ab2621289f5876670d15c"
Sep 10 18:10:51.298389 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:51.298357    2568 scope.go:117] "RemoveContainer" containerID="ea529c7b6556e3fc99a943e337b733f2f386fcb0465c81d9326979dcf61967d8"
Sep 10 18:10:51.307999 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:51.307972    2568 scope.go:117] "RemoveContainer" containerID="2699718f6304b46ae2f1fd9e3cf783137ddd277a722ab2621289f5876670d15c"
Sep 10 18:10:51.308470 ip-10-0-136-161 kubenswrapper[2568]: E0910 18:10:51.308438    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2699718f6304b46ae2f1fd9e3cf783137ddd277a722ab2621289f5876670d15c\": container with ID starting with 2699718f6304b46ae2f1fd9e3cf783137ddd277a722ab2621289f5876670d15c not found: ID does not exist" containerID="2699718f6304b46ae2f1fd9e3cf783137ddd277a722ab2621289f5876670d15c"
Sep 10 18:10:51.308609 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:51.308483    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2699718f6304b46ae2f1fd9e3cf783137ddd277a722ab2621289f5876670d15c"} err="failed to get container status \"2699718f6304b46ae2f1fd9e3cf783137ddd277a722ab2621289f5876670d15c\": rpc error: code = NotFound desc = could not find container \"2699718f6304b46ae2f1fd9e3cf783137ddd277a722ab2621289f5876670d15c\": container with ID starting with 2699718f6304b46ae2f1fd9e3cf783137ddd277a722ab2621289f5876670d15c not found: ID does not exist"
Sep 10 18:10:51.308609 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:51.308511    2568 scope.go:117] "RemoveContainer" containerID="ea529c7b6556e3fc99a943e337b733f2f386fcb0465c81d9326979dcf61967d8"
Sep 10 18:10:51.308959 ip-10-0-136-161 kubenswrapper[2568]: E0910 18:10:51.308939    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea529c7b6556e3fc99a943e337b733f2f386fcb0465c81d9326979dcf61967d8\": container with ID starting with ea529c7b6556e3fc99a943e337b733f2f386fcb0465c81d9326979dcf61967d8 not found: ID does not exist" containerID="ea529c7b6556e3fc99a943e337b733f2f386fcb0465c81d9326979dcf61967d8"
Sep 10 18:10:51.309026 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:51.308969    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea529c7b6556e3fc99a943e337b733f2f386fcb0465c81d9326979dcf61967d8"} err="failed to get container status \"ea529c7b6556e3fc99a943e337b733f2f386fcb0465c81d9326979dcf61967d8\": rpc error: code = NotFound desc = could not find container \"ea529c7b6556e3fc99a943e337b733f2f386fcb0465c81d9326979dcf61967d8\": container with ID starting with ea529c7b6556e3fc99a943e337b733f2f386fcb0465c81d9326979dcf61967d8 not found: ID does not exist"
Sep 10 18:10:51.310116 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:51.310094    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-6c9ffc-openshift-default-78b8c7fd54-6dkkf"]
Sep 10 18:10:51.314662 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:51.314635    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-6c9ffc-openshift-default-78b8c7fd54-6dkkf"]
Sep 10 18:10:52.776075 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:52.776032    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="19fbb3af-82ca-4d1f-82fe-f8a5756a5dff" path="/var/lib/kubelet/pods/19fbb3af-82ca-4d1f-82fe-f8a5756a5dff/volumes"
Sep 10 18:10:56.271195 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:56.271151    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-fc23cf-585697849f-2mmq2"]
Sep 10 18:10:56.271666 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:56.271463    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-fc23cf-585697849f-2mmq2" podUID="e747ffbe-0da4-4505-81cd-c795aec590fa" containerName="payload-processing" containerID="cri-o://f92bf18bff9058fa230f729136a98a75913f6db56a30024e7c83700c47ae5477" gracePeriod=30
Sep 10 18:10:56.276348 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:56.276281    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-fc23cf-85b74d754-qf7x8"]
Sep 10 18:10:56.276771 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:56.276739    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-fc23cf-85b74d754-qf7x8" podUID="8a608ca7-db3e-4def-9081-0c34e9c3e6ba" containerName="payload-pre-processing" containerID="cri-o://3f69980e045e94ea1290c5dfd2248f15bcd90faea4a202d40503fa9a4f43f698" gracePeriod=30
Sep 10 18:10:56.559142 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:56.559110    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-fc23cf-585697849f-2mmq2"
Sep 10 18:10:56.562271 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:56.562243    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-fc23cf-85b74d754-qf7x8"
Sep 10 18:10:56.707993 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:56.707956    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8a608ca7-db3e-4def-9081-0c34e9c3e6ba-plugins-config-volume\") pod \"8a608ca7-db3e-4def-9081-0c34e9c3e6ba\" (UID: \"8a608ca7-db3e-4def-9081-0c34e9c3e6ba\") "
Sep 10 18:10:56.707993 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:56.708003    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e747ffbe-0da4-4505-81cd-c795aec590fa-plugins-config-volume\") pod \"e747ffbe-0da4-4505-81cd-c795aec590fa\" (UID: \"e747ffbe-0da4-4505-81cd-c795aec590fa\") "
Sep 10 18:10:56.708267 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:56.708039    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nbvvw\" (UniqueName: \"kubernetes.io/projected/8a608ca7-db3e-4def-9081-0c34e9c3e6ba-kube-api-access-nbvvw\") pod \"8a608ca7-db3e-4def-9081-0c34e9c3e6ba\" (UID: \"8a608ca7-db3e-4def-9081-0c34e9c3e6ba\") "
Sep 10 18:10:56.708267 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:56.708174    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vkgg4\" (UniqueName: \"kubernetes.io/projected/e747ffbe-0da4-4505-81cd-c795aec590fa-kube-api-access-vkgg4\") pod \"e747ffbe-0da4-4505-81cd-c795aec590fa\" (UID: \"e747ffbe-0da4-4505-81cd-c795aec590fa\") "
Sep 10 18:10:56.708459 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:56.708431    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e747ffbe-0da4-4505-81cd-c795aec590fa-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e747ffbe-0da4-4505-81cd-c795aec590fa" (UID: "e747ffbe-0da4-4505-81cd-c795aec590fa"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 18:10:56.708558 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:56.708531    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a608ca7-db3e-4def-9081-0c34e9c3e6ba-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8a608ca7-db3e-4def-9081-0c34e9c3e6ba" (UID: "8a608ca7-db3e-4def-9081-0c34e9c3e6ba"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 18:10:56.710431 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:56.710396    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a608ca7-db3e-4def-9081-0c34e9c3e6ba-kube-api-access-nbvvw" (OuterVolumeSpecName: "kube-api-access-nbvvw") pod "8a608ca7-db3e-4def-9081-0c34e9c3e6ba" (UID: "8a608ca7-db3e-4def-9081-0c34e9c3e6ba"). InnerVolumeSpecName "kube-api-access-nbvvw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 18:10:56.710544 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:56.710442    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e747ffbe-0da4-4505-81cd-c795aec590fa-kube-api-access-vkgg4" (OuterVolumeSpecName: "kube-api-access-vkgg4") pod "e747ffbe-0da4-4505-81cd-c795aec590fa" (UID: "e747ffbe-0da4-4505-81cd-c795aec590fa"). InnerVolumeSpecName "kube-api-access-vkgg4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 18:10:56.809781 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:56.809693    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vkgg4\" (UniqueName: \"kubernetes.io/projected/e747ffbe-0da4-4505-81cd-c795aec590fa-kube-api-access-vkgg4\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 18:10:56.809781 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:56.809729    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8a608ca7-db3e-4def-9081-0c34e9c3e6ba-plugins-config-volume\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 18:10:56.809781 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:56.809739    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e747ffbe-0da4-4505-81cd-c795aec590fa-plugins-config-volume\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 18:10:56.809781 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:56.809748    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nbvvw\" (UniqueName: \"kubernetes.io/projected/8a608ca7-db3e-4def-9081-0c34e9c3e6ba-kube-api-access-nbvvw\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 18:10:57.328161 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:57.328123    2568 generic.go:356] "Generic (PLEG): container finished" podID="8a608ca7-db3e-4def-9081-0c34e9c3e6ba" containerID="3f69980e045e94ea1290c5dfd2248f15bcd90faea4a202d40503fa9a4f43f698" exitCode=0
Sep 10 18:10:57.328634 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:57.328171    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-fc23cf-85b74d754-qf7x8"
Sep 10 18:10:57.328634 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:57.328201    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-fc23cf-85b74d754-qf7x8" event={"ID":"8a608ca7-db3e-4def-9081-0c34e9c3e6ba","Type":"ContainerDied","Data":"3f69980e045e94ea1290c5dfd2248f15bcd90faea4a202d40503fa9a4f43f698"}
Sep 10 18:10:57.328634 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:57.328260    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-fc23cf-85b74d754-qf7x8" event={"ID":"8a608ca7-db3e-4def-9081-0c34e9c3e6ba","Type":"ContainerDied","Data":"c32d5bd154f1675fa86d67af4acb14ec09fb0228d5c1acf15c9f81b6fe7a20bd"}
Sep 10 18:10:57.328634 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:57.328290    2568 scope.go:117] "RemoveContainer" containerID="3f69980e045e94ea1290c5dfd2248f15bcd90faea4a202d40503fa9a4f43f698"
Sep 10 18:10:57.330010 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:57.329979    2568 generic.go:356] "Generic (PLEG): container finished" podID="e747ffbe-0da4-4505-81cd-c795aec590fa" containerID="f92bf18bff9058fa230f729136a98a75913f6db56a30024e7c83700c47ae5477" exitCode=0
Sep 10 18:10:57.330131 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:57.330028    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-fc23cf-585697849f-2mmq2"
Sep 10 18:10:57.330131 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:57.330032    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-fc23cf-585697849f-2mmq2" event={"ID":"e747ffbe-0da4-4505-81cd-c795aec590fa","Type":"ContainerDied","Data":"f92bf18bff9058fa230f729136a98a75913f6db56a30024e7c83700c47ae5477"}
Sep 10 18:10:57.330256 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:57.330158    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-fc23cf-585697849f-2mmq2" event={"ID":"e747ffbe-0da4-4505-81cd-c795aec590fa","Type":"ContainerDied","Data":"a3e9b2b08e78f41e30823a4e8b8d7d660dfe5f6f1e70acaf162d0ca550470a4d"}
Sep 10 18:10:57.339100 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:57.339077    2568 scope.go:117] "RemoveContainer" containerID="3f69980e045e94ea1290c5dfd2248f15bcd90faea4a202d40503fa9a4f43f698"
Sep 10 18:10:57.339457 ip-10-0-136-161 kubenswrapper[2568]: E0910 18:10:57.339432    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f69980e045e94ea1290c5dfd2248f15bcd90faea4a202d40503fa9a4f43f698\": container with ID starting with 3f69980e045e94ea1290c5dfd2248f15bcd90faea4a202d40503fa9a4f43f698 not found: ID does not exist" containerID="3f69980e045e94ea1290c5dfd2248f15bcd90faea4a202d40503fa9a4f43f698"
Sep 10 18:10:57.339524 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:57.339464    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f69980e045e94ea1290c5dfd2248f15bcd90faea4a202d40503fa9a4f43f698"} err="failed to get container status \"3f69980e045e94ea1290c5dfd2248f15bcd90faea4a202d40503fa9a4f43f698\": rpc error: code = NotFound desc = could not find container \"3f69980e045e94ea1290c5dfd2248f15bcd90faea4a202d40503fa9a4f43f698\": container with ID starting with 3f69980e045e94ea1290c5dfd2248f15bcd90faea4a202d40503fa9a4f43f698 not found: ID does not exist"
Sep 10 18:10:57.339524 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:57.339482    2568 scope.go:117] "RemoveContainer" containerID="f92bf18bff9058fa230f729136a98a75913f6db56a30024e7c83700c47ae5477"
Sep 10 18:10:57.345917 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:57.345891    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-fc23cf-85b74d754-qf7x8"]
Sep 10 18:10:57.349420 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:57.349402    2568 scope.go:117] "RemoveContainer" containerID="f92bf18bff9058fa230f729136a98a75913f6db56a30024e7c83700c47ae5477"
Sep 10 18:10:57.349795 ip-10-0-136-161 kubenswrapper[2568]: E0910 18:10:57.349774    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f92bf18bff9058fa230f729136a98a75913f6db56a30024e7c83700c47ae5477\": container with ID starting with f92bf18bff9058fa230f729136a98a75913f6db56a30024e7c83700c47ae5477 not found: ID does not exist" containerID="f92bf18bff9058fa230f729136a98a75913f6db56a30024e7c83700c47ae5477"
Sep 10 18:10:57.349866 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:57.349808    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f92bf18bff9058fa230f729136a98a75913f6db56a30024e7c83700c47ae5477"} err="failed to get container status \"f92bf18bff9058fa230f729136a98a75913f6db56a30024e7c83700c47ae5477\": rpc error: code = NotFound desc = could not find container \"f92bf18bff9058fa230f729136a98a75913f6db56a30024e7c83700c47ae5477\": container with ID starting with f92bf18bff9058fa230f729136a98a75913f6db56a30024e7c83700c47ae5477 not found: ID does not exist"
Sep 10 18:10:57.350034 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:57.350016    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-fc23cf-85b74d754-qf7x8"]
Sep 10 18:10:57.375841 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:57.375803    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-fc23cf-585697849f-2mmq2"]
Sep 10 18:10:57.378787 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:57.378761    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-fc23cf-585697849f-2mmq2"]
Sep 10 18:10:58.770621 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:58.770584    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a608ca7-db3e-4def-9081-0c34e9c3e6ba" path="/var/lib/kubelet/pods/8a608ca7-db3e-4def-9081-0c34e9c3e6ba/volumes"
Sep 10 18:10:58.770996 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:10:58.770958    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e747ffbe-0da4-4505-81cd-c795aec590fa" path="/var/lib/kubelet/pods/e747ffbe-0da4-4505-81cd-c795aec590fa/volumes"
Sep 10 18:11:04.886873 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:11:04.886832    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-jwfnv_e90054ec-91dc-4cda-94a2-fbe7a2a1fff0/console-operator/1.log"
Sep 10 18:11:04.891895 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:11:04.891868    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-jwfnv_e90054ec-91dc-4cda-94a2-fbe7a2a1fff0/console-operator/1.log"
Sep 10 18:11:05.892896 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:11:05.892852    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7df97ff6cc-6mcjz"]
Sep 10 18:11:05.893346 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:11:05.893062    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7df97ff6cc-6mcjz" podUID="411c224a-8c1e-4ff1-9e83-de0aa2e907f3" containerName="manager" containerID="cri-o://ed28df7f97ce05b8c4d4ea2a0d650ba6aa7f4093c57b20c68a6f8b7a8a8a1e60" gracePeriod=30
Sep 10 18:11:06.159029 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:11:06.158939    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7df97ff6cc-6mcjz"
Sep 10 18:11:06.293301 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:11:06.293256    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/411c224a-8c1e-4ff1-9e83-de0aa2e907f3-metrics-certs\") pod \"411c224a-8c1e-4ff1-9e83-de0aa2e907f3\" (UID: \"411c224a-8c1e-4ff1-9e83-de0aa2e907f3\") "
Sep 10 18:11:06.293301 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:11:06.293303    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-crsmh\" (UniqueName: \"kubernetes.io/projected/411c224a-8c1e-4ff1-9e83-de0aa2e907f3-kube-api-access-crsmh\") pod \"411c224a-8c1e-4ff1-9e83-de0aa2e907f3\" (UID: \"411c224a-8c1e-4ff1-9e83-de0aa2e907f3\") "
Sep 10 18:11:06.293537 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:11:06.293365    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/411c224a-8c1e-4ff1-9e83-de0aa2e907f3-webhook-cert\") pod \"411c224a-8c1e-4ff1-9e83-de0aa2e907f3\" (UID: \"411c224a-8c1e-4ff1-9e83-de0aa2e907f3\") "
Sep 10 18:11:06.295592 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:11:06.295552    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/411c224a-8c1e-4ff1-9e83-de0aa2e907f3-kube-api-access-crsmh" (OuterVolumeSpecName: "kube-api-access-crsmh") pod "411c224a-8c1e-4ff1-9e83-de0aa2e907f3" (UID: "411c224a-8c1e-4ff1-9e83-de0aa2e907f3"). InnerVolumeSpecName "kube-api-access-crsmh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 18:11:06.295740 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:11:06.295599    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/411c224a-8c1e-4ff1-9e83-de0aa2e907f3-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "411c224a-8c1e-4ff1-9e83-de0aa2e907f3" (UID: "411c224a-8c1e-4ff1-9e83-de0aa2e907f3"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 18:11:06.295740 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:11:06.295617    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/411c224a-8c1e-4ff1-9e83-de0aa2e907f3-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "411c224a-8c1e-4ff1-9e83-de0aa2e907f3" (UID: "411c224a-8c1e-4ff1-9e83-de0aa2e907f3"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 18:11:06.383639 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:11:06.383597    2568 generic.go:356] "Generic (PLEG): container finished" podID="411c224a-8c1e-4ff1-9e83-de0aa2e907f3" containerID="ed28df7f97ce05b8c4d4ea2a0d650ba6aa7f4093c57b20c68a6f8b7a8a8a1e60" exitCode=0
Sep 10 18:11:06.383852 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:11:06.383644    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7df97ff6cc-6mcjz"
Sep 10 18:11:06.383852 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:11:06.383678    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7df97ff6cc-6mcjz" event={"ID":"411c224a-8c1e-4ff1-9e83-de0aa2e907f3","Type":"ContainerDied","Data":"ed28df7f97ce05b8c4d4ea2a0d650ba6aa7f4093c57b20c68a6f8b7a8a8a1e60"}
Sep 10 18:11:06.383852 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:11:06.383734    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7df97ff6cc-6mcjz" event={"ID":"411c224a-8c1e-4ff1-9e83-de0aa2e907f3","Type":"ContainerDied","Data":"d4244acf6a85cfc9919f112cb93192b45ff0171ed9c1500effcefb5c6a1e148e"}
Sep 10 18:11:06.383852 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:11:06.383769    2568 scope.go:117] "RemoveContainer" containerID="ed28df7f97ce05b8c4d4ea2a0d650ba6aa7f4093c57b20c68a6f8b7a8a8a1e60"
Sep 10 18:11:06.393412 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:11:06.393391    2568 scope.go:117] "RemoveContainer" containerID="ed28df7f97ce05b8c4d4ea2a0d650ba6aa7f4093c57b20c68a6f8b7a8a8a1e60"
Sep 10 18:11:06.393759 ip-10-0-136-161 kubenswrapper[2568]: E0910 18:11:06.393740    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ed28df7f97ce05b8c4d4ea2a0d650ba6aa7f4093c57b20c68a6f8b7a8a8a1e60\": container with ID starting with ed28df7f97ce05b8c4d4ea2a0d650ba6aa7f4093c57b20c68a6f8b7a8a8a1e60 not found: ID does not exist" containerID="ed28df7f97ce05b8c4d4ea2a0d650ba6aa7f4093c57b20c68a6f8b7a8a8a1e60"
Sep 10 18:11:06.393845 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:11:06.393771    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed28df7f97ce05b8c4d4ea2a0d650ba6aa7f4093c57b20c68a6f8b7a8a8a1e60"} err="failed to get container status \"ed28df7f97ce05b8c4d4ea2a0d650ba6aa7f4093c57b20c68a6f8b7a8a8a1e60\": rpc error: code = NotFound desc = could not find container \"ed28df7f97ce05b8c4d4ea2a0d650ba6aa7f4093c57b20c68a6f8b7a8a8a1e60\": container with ID starting with ed28df7f97ce05b8c4d4ea2a0d650ba6aa7f4093c57b20c68a6f8b7a8a8a1e60 not found: ID does not exist"
Sep 10 18:11:06.393891 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:11:06.393860    2568 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/411c224a-8c1e-4ff1-9e83-de0aa2e907f3-metrics-certs\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 18:11:06.393891 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:11:06.393879    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-crsmh\" (UniqueName: \"kubernetes.io/projected/411c224a-8c1e-4ff1-9e83-de0aa2e907f3-kube-api-access-crsmh\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 18:11:06.393958 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:11:06.393890    2568 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/411c224a-8c1e-4ff1-9e83-de0aa2e907f3-webhook-cert\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 18:11:06.406999 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:11:06.406969    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7df97ff6cc-6mcjz"]
Sep 10 18:11:06.412103 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:11:06.412037    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7df97ff6cc-6mcjz"]
Sep 10 18:11:06.770294 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:11:06.770255    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="411c224a-8c1e-4ff1-9e83-de0aa2e907f3" path="/var/lib/kubelet/pods/411c224a-8c1e-4ff1-9e83-de0aa2e907f3/volumes"
Sep 10 18:12:07.210593 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:07.210552    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7df97ff6cc-bb42m"]
Sep 10 18:12:07.211042 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:07.210930    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="411c224a-8c1e-4ff1-9e83-de0aa2e907f3" containerName="manager"
Sep 10 18:12:07.211042 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:07.210944    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="411c224a-8c1e-4ff1-9e83-de0aa2e907f3" containerName="manager"
Sep 10 18:12:07.211042 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:07.210961    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a608ca7-db3e-4def-9081-0c34e9c3e6ba" containerName="payload-pre-processing"
Sep 10 18:12:07.211042 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:07.210970    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a608ca7-db3e-4def-9081-0c34e9c3e6ba" containerName="payload-pre-processing"
Sep 10 18:12:07.211042 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:07.210981    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04abb636-a812-4242-b932-4414f0bb256c" containerName="istio-proxy"
Sep 10 18:12:07.211042 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:07.210987    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="04abb636-a812-4242-b932-4414f0bb256c" containerName="istio-proxy"
Sep 10 18:12:07.211042 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:07.210995    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3286eba-465f-44b8-8294-3b0d326e3dc0" containerName="payload-pre-processing"
Sep 10 18:12:07.211042 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:07.211001    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3286eba-465f-44b8-8294-3b0d326e3dc0" containerName="payload-pre-processing"
Sep 10 18:12:07.211042 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:07.211008    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3760d0bc-2aa7-4718-bbba-d809f5cf36ca" containerName="payload-pre-processing"
Sep 10 18:12:07.211042 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:07.211013    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="3760d0bc-2aa7-4718-bbba-d809f5cf36ca" containerName="payload-pre-processing"
Sep 10 18:12:07.211042 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:07.211020    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19fbb3af-82ca-4d1f-82fe-f8a5756a5dff" containerName="istio-proxy"
Sep 10 18:12:07.211042 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:07.211025    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="19fbb3af-82ca-4d1f-82fe-f8a5756a5dff" containerName="istio-proxy"
Sep 10 18:12:07.211042 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:07.211030    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0cc8d85f-f074-494e-b8f9-9b08cbffedbc" containerName="main"
Sep 10 18:12:07.211042 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:07.211035    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="0cc8d85f-f074-494e-b8f9-9b08cbffedbc" containerName="main"
Sep 10 18:12:07.211042 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:07.211043    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02ccd568-8956-4999-8c64-25178aca3987" containerName="payload-processing"
Sep 10 18:12:07.211042 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:07.211051    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="02ccd568-8956-4999-8c64-25178aca3987" containerName="payload-processing"
Sep 10 18:12:07.211835 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:07.211061    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="358112e2-56a1-4a2c-b3e1-086d2b79af21" containerName="payload-pre-processing"
Sep 10 18:12:07.211835 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:07.211067    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="358112e2-56a1-4a2c-b3e1-086d2b79af21" containerName="payload-pre-processing"
Sep 10 18:12:07.211835 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:07.211074    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e747ffbe-0da4-4505-81cd-c795aec590fa" containerName="payload-processing"
Sep 10 18:12:07.211835 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:07.211079    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="e747ffbe-0da4-4505-81cd-c795aec590fa" containerName="payload-processing"
Sep 10 18:12:07.211835 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:07.211084    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04abb636-a812-4242-b932-4414f0bb256c" containerName="istio-proxy"
Sep 10 18:12:07.211835 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:07.211089    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="04abb636-a812-4242-b932-4414f0bb256c" containerName="istio-proxy"
Sep 10 18:12:07.211835 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:07.211164    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="358112e2-56a1-4a2c-b3e1-086d2b79af21" containerName="payload-pre-processing"
Sep 10 18:12:07.211835 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:07.211174    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a608ca7-db3e-4def-9081-0c34e9c3e6ba" containerName="payload-pre-processing"
Sep 10 18:12:07.211835 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:07.211192    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="04abb636-a812-4242-b932-4414f0bb256c" containerName="istio-proxy"
Sep 10 18:12:07.211835 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:07.211198    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="02ccd568-8956-4999-8c64-25178aca3987" containerName="payload-processing"
Sep 10 18:12:07.211835 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:07.211204    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="19fbb3af-82ca-4d1f-82fe-f8a5756a5dff" containerName="istio-proxy"
Sep 10 18:12:07.211835 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:07.211209    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="0cc8d85f-f074-494e-b8f9-9b08cbffedbc" containerName="main"
Sep 10 18:12:07.211835 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:07.211216    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="04abb636-a812-4242-b932-4414f0bb256c" containerName="istio-proxy"
Sep 10 18:12:07.211835 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:07.211224    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="3760d0bc-2aa7-4718-bbba-d809f5cf36ca" containerName="payload-pre-processing"
Sep 10 18:12:07.211835 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:07.211232    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="411c224a-8c1e-4ff1-9e83-de0aa2e907f3" containerName="manager"
Sep 10 18:12:07.211835 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:07.211239    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="e747ffbe-0da4-4505-81cd-c795aec590fa" containerName="payload-processing"
Sep 10 18:12:07.211835 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:07.211245    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3286eba-465f-44b8-8294-3b0d326e3dc0" containerName="payload-pre-processing"
Sep 10 18:12:07.215685 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:07.215665    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7df97ff6cc-bb42m"
Sep 10 18:12:07.220091 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:07.220062    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 10 18:12:07.220235 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:07.220091    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-kqhz6\""
Sep 10 18:12:07.220235 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:07.220091    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 10 18:12:07.220235 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:07.220110    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 10 18:12:07.225959 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:07.225933    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7df97ff6cc-bb42m"]
Sep 10 18:12:07.295109 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:07.295060    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r22cs\" (UniqueName: \"kubernetes.io/projected/d3fa06ef-7d65-4f33-bc3e-ee2559593b4b-kube-api-access-r22cs\") pod \"maas-controller-7df97ff6cc-bb42m\" (UID: \"d3fa06ef-7d65-4f33-bc3e-ee2559593b4b\") " pod="opendatahub/maas-controller-7df97ff6cc-bb42m"
Sep 10 18:12:07.295109 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:07.295113    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d3fa06ef-7d65-4f33-bc3e-ee2559593b4b-metrics-certs\") pod \"maas-controller-7df97ff6cc-bb42m\" (UID: \"d3fa06ef-7d65-4f33-bc3e-ee2559593b4b\") " pod="opendatahub/maas-controller-7df97ff6cc-bb42m"
Sep 10 18:12:07.295387 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:07.295172    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d3fa06ef-7d65-4f33-bc3e-ee2559593b4b-webhook-cert\") pod \"maas-controller-7df97ff6cc-bb42m\" (UID: \"d3fa06ef-7d65-4f33-bc3e-ee2559593b4b\") " pod="opendatahub/maas-controller-7df97ff6cc-bb42m"
Sep 10 18:12:07.395991 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:07.395950    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r22cs\" (UniqueName: \"kubernetes.io/projected/d3fa06ef-7d65-4f33-bc3e-ee2559593b4b-kube-api-access-r22cs\") pod \"maas-controller-7df97ff6cc-bb42m\" (UID: \"d3fa06ef-7d65-4f33-bc3e-ee2559593b4b\") " pod="opendatahub/maas-controller-7df97ff6cc-bb42m"
Sep 10 18:12:07.395991 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:07.395994    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d3fa06ef-7d65-4f33-bc3e-ee2559593b4b-metrics-certs\") pod \"maas-controller-7df97ff6cc-bb42m\" (UID: \"d3fa06ef-7d65-4f33-bc3e-ee2559593b4b\") " pod="opendatahub/maas-controller-7df97ff6cc-bb42m"
Sep 10 18:12:07.396204 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:07.396120    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d3fa06ef-7d65-4f33-bc3e-ee2559593b4b-webhook-cert\") pod \"maas-controller-7df97ff6cc-bb42m\" (UID: \"d3fa06ef-7d65-4f33-bc3e-ee2559593b4b\") " pod="opendatahub/maas-controller-7df97ff6cc-bb42m"
Sep 10 18:12:07.398657 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:07.398634    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d3fa06ef-7d65-4f33-bc3e-ee2559593b4b-webhook-cert\") pod \"maas-controller-7df97ff6cc-bb42m\" (UID: \"d3fa06ef-7d65-4f33-bc3e-ee2559593b4b\") " pod="opendatahub/maas-controller-7df97ff6cc-bb42m"
Sep 10 18:12:07.398782 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:07.398679    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d3fa06ef-7d65-4f33-bc3e-ee2559593b4b-metrics-certs\") pod \"maas-controller-7df97ff6cc-bb42m\" (UID: \"d3fa06ef-7d65-4f33-bc3e-ee2559593b4b\") " pod="opendatahub/maas-controller-7df97ff6cc-bb42m"
Sep 10 18:12:07.403875 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:07.403852    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r22cs\" (UniqueName: \"kubernetes.io/projected/d3fa06ef-7d65-4f33-bc3e-ee2559593b4b-kube-api-access-r22cs\") pod \"maas-controller-7df97ff6cc-bb42m\" (UID: \"d3fa06ef-7d65-4f33-bc3e-ee2559593b4b\") " pod="opendatahub/maas-controller-7df97ff6cc-bb42m"
Sep 10 18:12:07.526848 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:07.526810    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7df97ff6cc-bb42m"
Sep 10 18:12:07.800610 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:07.800578    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7df97ff6cc-bb42m"]
Sep 10 18:12:07.802826 ip-10-0-136-161 kubenswrapper[2568]: W0910 18:12:07.802793    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3fa06ef_7d65_4f33_bc3e_ee2559593b4b.slice/crio-aa56d4602bf8f6215eeac98b1f366d18ec547eeb52c687eaafd550023de027ef WatchSource:0}: Error finding container aa56d4602bf8f6215eeac98b1f366d18ec547eeb52c687eaafd550023de027ef: Status 404 returned error can't find the container with id aa56d4602bf8f6215eeac98b1f366d18ec547eeb52c687eaafd550023de027ef
Sep 10 18:12:07.804114 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:07.804093    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 18:12:08.730784 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:08.730746    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7df97ff6cc-bb42m" event={"ID":"d3fa06ef-7d65-4f33-bc3e-ee2559593b4b","Type":"ContainerStarted","Data":"03c7b673c83ed8afbccf40f80d3cf792e524cc2a1d7034bc90ddd6b6e979c310"}
Sep 10 18:12:08.731176 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:08.730809    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7df97ff6cc-bb42m" event={"ID":"d3fa06ef-7d65-4f33-bc3e-ee2559593b4b","Type":"ContainerStarted","Data":"aa56d4602bf8f6215eeac98b1f366d18ec547eeb52c687eaafd550023de027ef"}
Sep 10 18:12:08.731176 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:08.730927    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7df97ff6cc-bb42m"
Sep 10 18:12:08.750668 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:08.750595    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7df97ff6cc-bb42m" podStartSLOduration=1.325935064 podStartE2EDuration="1.750571549s" totalImagesPullingTime="424.636485ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 18:12:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 18:12:08.747752857 +0000 UTC m=+1864.509060901" watchObservedRunningTime="2026-09-10 18:12:08.750571549 +0000 UTC m=+1864.511879594"
Sep 10 18:12:19.738626 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:19.738591    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7df97ff6cc-bb42m"
Sep 10 18:12:31.169343 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:31.169230    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7df97ff6cc-bb42m"]
Sep 10 18:12:31.170111 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:31.170048    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7df97ff6cc-bb42m" podUID="d3fa06ef-7d65-4f33-bc3e-ee2559593b4b" containerName="manager" containerID="cri-o://03c7b673c83ed8afbccf40f80d3cf792e524cc2a1d7034bc90ddd6b6e979c310" gracePeriod=30
Sep 10 18:12:31.425207 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:31.425127    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7df97ff6cc-bb42m"
Sep 10 18:12:31.510413 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:31.510369    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r22cs\" (UniqueName: \"kubernetes.io/projected/d3fa06ef-7d65-4f33-bc3e-ee2559593b4b-kube-api-access-r22cs\") pod \"d3fa06ef-7d65-4f33-bc3e-ee2559593b4b\" (UID: \"d3fa06ef-7d65-4f33-bc3e-ee2559593b4b\") "
Sep 10 18:12:31.510413 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:31.510421    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d3fa06ef-7d65-4f33-bc3e-ee2559593b4b-metrics-certs\") pod \"d3fa06ef-7d65-4f33-bc3e-ee2559593b4b\" (UID: \"d3fa06ef-7d65-4f33-bc3e-ee2559593b4b\") "
Sep 10 18:12:31.510641 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:31.510539    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d3fa06ef-7d65-4f33-bc3e-ee2559593b4b-webhook-cert\") pod \"d3fa06ef-7d65-4f33-bc3e-ee2559593b4b\" (UID: \"d3fa06ef-7d65-4f33-bc3e-ee2559593b4b\") "
Sep 10 18:12:31.512723 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:31.512682    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d3fa06ef-7d65-4f33-bc3e-ee2559593b4b-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "d3fa06ef-7d65-4f33-bc3e-ee2559593b4b" (UID: "d3fa06ef-7d65-4f33-bc3e-ee2559593b4b"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 18:12:31.512723 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:31.512674    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3fa06ef-7d65-4f33-bc3e-ee2559593b4b-kube-api-access-r22cs" (OuterVolumeSpecName: "kube-api-access-r22cs") pod "d3fa06ef-7d65-4f33-bc3e-ee2559593b4b" (UID: "d3fa06ef-7d65-4f33-bc3e-ee2559593b4b"). InnerVolumeSpecName "kube-api-access-r22cs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 18:12:31.512909 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:31.512759    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d3fa06ef-7d65-4f33-bc3e-ee2559593b4b-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "d3fa06ef-7d65-4f33-bc3e-ee2559593b4b" (UID: "d3fa06ef-7d65-4f33-bc3e-ee2559593b4b"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 18:12:31.611721 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:31.611675    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r22cs\" (UniqueName: \"kubernetes.io/projected/d3fa06ef-7d65-4f33-bc3e-ee2559593b4b-kube-api-access-r22cs\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 18:12:31.611721 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:31.611710    2568 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d3fa06ef-7d65-4f33-bc3e-ee2559593b4b-metrics-certs\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 18:12:31.611721 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:31.611720    2568 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d3fa06ef-7d65-4f33-bc3e-ee2559593b4b-webhook-cert\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 18:12:31.856264 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:31.856221    2568 generic.go:356] "Generic (PLEG): container finished" podID="d3fa06ef-7d65-4f33-bc3e-ee2559593b4b" containerID="03c7b673c83ed8afbccf40f80d3cf792e524cc2a1d7034bc90ddd6b6e979c310" exitCode=0
Sep 10 18:12:31.856470 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:31.856274    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7df97ff6cc-bb42m"
Sep 10 18:12:31.856470 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:31.856311    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7df97ff6cc-bb42m" event={"ID":"d3fa06ef-7d65-4f33-bc3e-ee2559593b4b","Type":"ContainerDied","Data":"03c7b673c83ed8afbccf40f80d3cf792e524cc2a1d7034bc90ddd6b6e979c310"}
Sep 10 18:12:31.856470 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:31.856386    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7df97ff6cc-bb42m" event={"ID":"d3fa06ef-7d65-4f33-bc3e-ee2559593b4b","Type":"ContainerDied","Data":"aa56d4602bf8f6215eeac98b1f366d18ec547eeb52c687eaafd550023de027ef"}
Sep 10 18:12:31.856470 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:31.856413    2568 scope.go:117] "RemoveContainer" containerID="03c7b673c83ed8afbccf40f80d3cf792e524cc2a1d7034bc90ddd6b6e979c310"
Sep 10 18:12:31.866903 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:31.866880    2568 scope.go:117] "RemoveContainer" containerID="03c7b673c83ed8afbccf40f80d3cf792e524cc2a1d7034bc90ddd6b6e979c310"
Sep 10 18:12:31.867267 ip-10-0-136-161 kubenswrapper[2568]: E0910 18:12:31.867246    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"03c7b673c83ed8afbccf40f80d3cf792e524cc2a1d7034bc90ddd6b6e979c310\": container with ID starting with 03c7b673c83ed8afbccf40f80d3cf792e524cc2a1d7034bc90ddd6b6e979c310 not found: ID does not exist" containerID="03c7b673c83ed8afbccf40f80d3cf792e524cc2a1d7034bc90ddd6b6e979c310"
Sep 10 18:12:31.867331 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:31.867279    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03c7b673c83ed8afbccf40f80d3cf792e524cc2a1d7034bc90ddd6b6e979c310"} err="failed to get container status \"03c7b673c83ed8afbccf40f80d3cf792e524cc2a1d7034bc90ddd6b6e979c310\": rpc error: code = NotFound desc = could not find container \"03c7b673c83ed8afbccf40f80d3cf792e524cc2a1d7034bc90ddd6b6e979c310\": container with ID starting with 03c7b673c83ed8afbccf40f80d3cf792e524cc2a1d7034bc90ddd6b6e979c310 not found: ID does not exist"
Sep 10 18:12:31.897088 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:31.897044    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7df97ff6cc-bb42m"]
Sep 10 18:12:31.905960 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:31.905924    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7df97ff6cc-bb42m"]
Sep 10 18:12:32.691813 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:32.691756    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7df97ff6cc-2n9ct"]
Sep 10 18:12:32.694399 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:32.692843    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19fbb3af-82ca-4d1f-82fe-f8a5756a5dff" containerName="istio-proxy"
Sep 10 18:12:32.694399 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:32.692870    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="19fbb3af-82ca-4d1f-82fe-f8a5756a5dff" containerName="istio-proxy"
Sep 10 18:12:32.694399 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:32.692893    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3fa06ef-7d65-4f33-bc3e-ee2559593b4b" containerName="manager"
Sep 10 18:12:32.694399 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:32.692901    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3fa06ef-7d65-4f33-bc3e-ee2559593b4b" containerName="manager"
Sep 10 18:12:32.694399 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:32.692975    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="19fbb3af-82ca-4d1f-82fe-f8a5756a5dff" containerName="istio-proxy"
Sep 10 18:12:32.694399 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:32.692988    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3fa06ef-7d65-4f33-bc3e-ee2559593b4b" containerName="manager"
Sep 10 18:12:32.696233 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:32.696212    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7df97ff6cc-2n9ct"
Sep 10 18:12:32.700418 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:32.700391    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 10 18:12:32.700418 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:32.700389    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-kqhz6\""
Sep 10 18:12:32.700662 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:32.700391    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 10 18:12:32.700662 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:32.700456    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 10 18:12:32.706360 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:32.706313    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7df97ff6cc-2n9ct"]
Sep 10 18:12:32.720558 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:32.720517    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g67z2\" (UniqueName: \"kubernetes.io/projected/bde0667b-c953-4fed-83b4-5f0b37be3063-kube-api-access-g67z2\") pod \"maas-controller-7df97ff6cc-2n9ct\" (UID: \"bde0667b-c953-4fed-83b4-5f0b37be3063\") " pod="opendatahub/maas-controller-7df97ff6cc-2n9ct"
Sep 10 18:12:32.720749 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:32.720594    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bde0667b-c953-4fed-83b4-5f0b37be3063-metrics-certs\") pod \"maas-controller-7df97ff6cc-2n9ct\" (UID: \"bde0667b-c953-4fed-83b4-5f0b37be3063\") " pod="opendatahub/maas-controller-7df97ff6cc-2n9ct"
Sep 10 18:12:32.720749 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:32.720632    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bde0667b-c953-4fed-83b4-5f0b37be3063-webhook-cert\") pod \"maas-controller-7df97ff6cc-2n9ct\" (UID: \"bde0667b-c953-4fed-83b4-5f0b37be3063\") " pod="opendatahub/maas-controller-7df97ff6cc-2n9ct"
Sep 10 18:12:32.769710 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:32.769674    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d3fa06ef-7d65-4f33-bc3e-ee2559593b4b" path="/var/lib/kubelet/pods/d3fa06ef-7d65-4f33-bc3e-ee2559593b4b/volumes"
Sep 10 18:12:32.821297 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:32.821261    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bde0667b-c953-4fed-83b4-5f0b37be3063-metrics-certs\") pod \"maas-controller-7df97ff6cc-2n9ct\" (UID: \"bde0667b-c953-4fed-83b4-5f0b37be3063\") " pod="opendatahub/maas-controller-7df97ff6cc-2n9ct"
Sep 10 18:12:32.821297 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:32.821300    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bde0667b-c953-4fed-83b4-5f0b37be3063-webhook-cert\") pod \"maas-controller-7df97ff6cc-2n9ct\" (UID: \"bde0667b-c953-4fed-83b4-5f0b37be3063\") " pod="opendatahub/maas-controller-7df97ff6cc-2n9ct"
Sep 10 18:12:32.821600 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:32.821382    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g67z2\" (UniqueName: \"kubernetes.io/projected/bde0667b-c953-4fed-83b4-5f0b37be3063-kube-api-access-g67z2\") pod \"maas-controller-7df97ff6cc-2n9ct\" (UID: \"bde0667b-c953-4fed-83b4-5f0b37be3063\") " pod="opendatahub/maas-controller-7df97ff6cc-2n9ct"
Sep 10 18:12:32.823899 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:32.823870    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bde0667b-c953-4fed-83b4-5f0b37be3063-webhook-cert\") pod \"maas-controller-7df97ff6cc-2n9ct\" (UID: \"bde0667b-c953-4fed-83b4-5f0b37be3063\") " pod="opendatahub/maas-controller-7df97ff6cc-2n9ct"
Sep 10 18:12:32.824036 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:32.823914    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bde0667b-c953-4fed-83b4-5f0b37be3063-metrics-certs\") pod \"maas-controller-7df97ff6cc-2n9ct\" (UID: \"bde0667b-c953-4fed-83b4-5f0b37be3063\") " pod="opendatahub/maas-controller-7df97ff6cc-2n9ct"
Sep 10 18:12:32.829954 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:32.829926    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g67z2\" (UniqueName: \"kubernetes.io/projected/bde0667b-c953-4fed-83b4-5f0b37be3063-kube-api-access-g67z2\") pod \"maas-controller-7df97ff6cc-2n9ct\" (UID: \"bde0667b-c953-4fed-83b4-5f0b37be3063\") " pod="opendatahub/maas-controller-7df97ff6cc-2n9ct"
Sep 10 18:12:33.008713 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:33.008679    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7df97ff6cc-2n9ct"
Sep 10 18:12:33.288160 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:33.288118    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7df97ff6cc-2n9ct"]
Sep 10 18:12:33.289793 ip-10-0-136-161 kubenswrapper[2568]: W0910 18:12:33.289764    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbde0667b_c953_4fed_83b4_5f0b37be3063.slice/crio-06f18f90a23c78ad7b297db9194d6a06290c271bfff6f99542ad650411bf905b WatchSource:0}: Error finding container 06f18f90a23c78ad7b297db9194d6a06290c271bfff6f99542ad650411bf905b: Status 404 returned error can't find the container with id 06f18f90a23c78ad7b297db9194d6a06290c271bfff6f99542ad650411bf905b
Sep 10 18:12:33.869469 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:33.869363    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7df97ff6cc-2n9ct" event={"ID":"bde0667b-c953-4fed-83b4-5f0b37be3063","Type":"ContainerStarted","Data":"6805ca52ab81e95fcc541048d47d590e51efcddf8312b9755561f8804f0a3761"}
Sep 10 18:12:33.869469 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:33.869426    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7df97ff6cc-2n9ct" event={"ID":"bde0667b-c953-4fed-83b4-5f0b37be3063","Type":"ContainerStarted","Data":"06f18f90a23c78ad7b297db9194d6a06290c271bfff6f99542ad650411bf905b"}
Sep 10 18:12:33.869469 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:33.869455    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7df97ff6cc-2n9ct"
Sep 10 18:12:33.889231 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:33.889031    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7df97ff6cc-2n9ct" podStartSLOduration=1.612946869 podStartE2EDuration="1.889010816s" totalImagesPullingTime="276.063947ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 18:12:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 18:12:33.888815358 +0000 UTC m=+1889.650123402" watchObservedRunningTime="2026-09-10 18:12:33.889010816 +0000 UTC m=+1889.650318863"
Sep 10 18:12:44.877560 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:12:44.877518    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7df97ff6cc-2n9ct"
Sep 10 18:13:43.824268 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:13:43.824231    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-wqxjz"]
Sep 10 18:13:43.824790 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:13:43.824479    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-wqxjz" podUID="22d7835f-6d49-4c74-a74b-12d29c2a63ef" containerName="manager" containerID="cri-o://43e77ab706e3e2c5ae926111441af9b91eee0340bada2a205b954c45c8fb469c" gracePeriod=10
Sep 10 18:13:45.184019 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:13:45.183983    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-wqxjz"
Sep 10 18:13:45.224360 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:13:45.224218    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tmqq4\" (UniqueName: \"kubernetes.io/projected/22d7835f-6d49-4c74-a74b-12d29c2a63ef-kube-api-access-tmqq4\") pod \"22d7835f-6d49-4c74-a74b-12d29c2a63ef\" (UID: \"22d7835f-6d49-4c74-a74b-12d29c2a63ef\") "
Sep 10 18:13:45.224360 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:13:45.224313    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/22d7835f-6d49-4c74-a74b-12d29c2a63ef-extensions-socket-volume\") pod \"22d7835f-6d49-4c74-a74b-12d29c2a63ef\" (UID: \"22d7835f-6d49-4c74-a74b-12d29c2a63ef\") "
Sep 10 18:13:45.224807 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:13:45.224769    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22d7835f-6d49-4c74-a74b-12d29c2a63ef-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "22d7835f-6d49-4c74-a74b-12d29c2a63ef" (UID: "22d7835f-6d49-4c74-a74b-12d29c2a63ef"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 18:13:45.226685 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:13:45.226651    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22d7835f-6d49-4c74-a74b-12d29c2a63ef-kube-api-access-tmqq4" (OuterVolumeSpecName: "kube-api-access-tmqq4") pod "22d7835f-6d49-4c74-a74b-12d29c2a63ef" (UID: "22d7835f-6d49-4c74-a74b-12d29c2a63ef"). InnerVolumeSpecName "kube-api-access-tmqq4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 18:13:45.280055 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:13:45.280020    2568 generic.go:356] "Generic (PLEG): container finished" podID="22d7835f-6d49-4c74-a74b-12d29c2a63ef" containerID="43e77ab706e3e2c5ae926111441af9b91eee0340bada2a205b954c45c8fb469c" exitCode=0
Sep 10 18:13:45.280255 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:13:45.280064    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-wqxjz"
Sep 10 18:13:45.280255 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:13:45.280099    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-wqxjz" event={"ID":"22d7835f-6d49-4c74-a74b-12d29c2a63ef","Type":"ContainerDied","Data":"43e77ab706e3e2c5ae926111441af9b91eee0340bada2a205b954c45c8fb469c"}
Sep 10 18:13:45.280255 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:13:45.280153    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-wqxjz" event={"ID":"22d7835f-6d49-4c74-a74b-12d29c2a63ef","Type":"ContainerDied","Data":"769143c0da1bdd3ad7197890ddd3436b047d073354f79d6372e431e0510a191e"}
Sep 10 18:13:45.280255 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:13:45.280175    2568 scope.go:117] "RemoveContainer" containerID="43e77ab706e3e2c5ae926111441af9b91eee0340bada2a205b954c45c8fb469c"
Sep 10 18:13:45.290039 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:13:45.290018    2568 scope.go:117] "RemoveContainer" containerID="43e77ab706e3e2c5ae926111441af9b91eee0340bada2a205b954c45c8fb469c"
Sep 10 18:13:45.290499 ip-10-0-136-161 kubenswrapper[2568]: E0910 18:13:45.290477    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"43e77ab706e3e2c5ae926111441af9b91eee0340bada2a205b954c45c8fb469c\": container with ID starting with 43e77ab706e3e2c5ae926111441af9b91eee0340bada2a205b954c45c8fb469c not found: ID does not exist" containerID="43e77ab706e3e2c5ae926111441af9b91eee0340bada2a205b954c45c8fb469c"
Sep 10 18:13:45.290556 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:13:45.290511    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43e77ab706e3e2c5ae926111441af9b91eee0340bada2a205b954c45c8fb469c"} err="failed to get container status \"43e77ab706e3e2c5ae926111441af9b91eee0340bada2a205b954c45c8fb469c\": rpc error: code = NotFound desc = could not find container \"43e77ab706e3e2c5ae926111441af9b91eee0340bada2a205b954c45c8fb469c\": container with ID starting with 43e77ab706e3e2c5ae926111441af9b91eee0340bada2a205b954c45c8fb469c not found: ID does not exist"
Sep 10 18:13:45.304369 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:13:45.304334    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-wqxjz"]
Sep 10 18:13:45.310465 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:13:45.310431    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-wqxjz"]
Sep 10 18:13:45.325238 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:13:45.325209    2568 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/22d7835f-6d49-4c74-a74b-12d29c2a63ef-extensions-socket-volume\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 18:13:45.325238 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:13:45.325238    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tmqq4\" (UniqueName: \"kubernetes.io/projected/22d7835f-6d49-4c74-a74b-12d29c2a63ef-kube-api-access-tmqq4\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 18:13:46.770159 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:13:46.770125    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="22d7835f-6d49-4c74-a74b-12d29c2a63ef" path="/var/lib/kubelet/pods/22d7835f-6d49-4c74-a74b-12d29c2a63ef/volumes"
Sep 10 18:14:44.513052 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:14:44.513012    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6xt4v"]
Sep 10 18:14:44.513522 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:14:44.513410    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22d7835f-6d49-4c74-a74b-12d29c2a63ef" containerName="manager"
Sep 10 18:14:44.513522 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:14:44.513423    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="22d7835f-6d49-4c74-a74b-12d29c2a63ef" containerName="manager"
Sep 10 18:14:44.513522 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:14:44.513479    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="22d7835f-6d49-4c74-a74b-12d29c2a63ef" containerName="manager"
Sep 10 18:14:44.516412 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:14:44.516392    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6xt4v"
Sep 10 18:14:44.518991 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:14:44.518970    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-gs9tl\""
Sep 10 18:14:44.527419 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:14:44.527177    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7b44a982-9281-45a8-9017-c5e645fb3a89-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-6xt4v\" (UID: \"7b44a982-9281-45a8-9017-c5e645fb3a89\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6xt4v"
Sep 10 18:14:44.527419 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:14:44.527243    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6d2t\" (UniqueName: \"kubernetes.io/projected/7b44a982-9281-45a8-9017-c5e645fb3a89-kube-api-access-n6d2t\") pod \"kuadrant-operator-controller-manager-5769f99d9f-6xt4v\" (UID: \"7b44a982-9281-45a8-9017-c5e645fb3a89\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6xt4v"
Sep 10 18:14:44.528580 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:14:44.528560    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6xt4v"]
Sep 10 18:14:44.628705 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:14:44.628665    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6d2t\" (UniqueName: \"kubernetes.io/projected/7b44a982-9281-45a8-9017-c5e645fb3a89-kube-api-access-n6d2t\") pod \"kuadrant-operator-controller-manager-5769f99d9f-6xt4v\" (UID: \"7b44a982-9281-45a8-9017-c5e645fb3a89\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6xt4v"
Sep 10 18:14:44.628908 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:14:44.628791    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7b44a982-9281-45a8-9017-c5e645fb3a89-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-6xt4v\" (UID: \"7b44a982-9281-45a8-9017-c5e645fb3a89\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6xt4v"
Sep 10 18:14:44.629125 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:14:44.629108    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7b44a982-9281-45a8-9017-c5e645fb3a89-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-6xt4v\" (UID: \"7b44a982-9281-45a8-9017-c5e645fb3a89\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6xt4v"
Sep 10 18:14:44.636981 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:14:44.636950    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6d2t\" (UniqueName: \"kubernetes.io/projected/7b44a982-9281-45a8-9017-c5e645fb3a89-kube-api-access-n6d2t\") pod \"kuadrant-operator-controller-manager-5769f99d9f-6xt4v\" (UID: \"7b44a982-9281-45a8-9017-c5e645fb3a89\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6xt4v"
Sep 10 18:14:44.827145 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:14:44.827046    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6xt4v"
Sep 10 18:14:45.118420 ip-10-0-136-161 kubenswrapper[2568]: W0910 18:14:45.118383    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b44a982_9281_45a8_9017_c5e645fb3a89.slice/crio-320958a81ae99297cdd025da79d81cf93c6731397aafe9f5f8a6c94e82cc302a WatchSource:0}: Error finding container 320958a81ae99297cdd025da79d81cf93c6731397aafe9f5f8a6c94e82cc302a: Status 404 returned error can't find the container with id 320958a81ae99297cdd025da79d81cf93c6731397aafe9f5f8a6c94e82cc302a
Sep 10 18:14:45.119480 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:14:45.119453    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6xt4v"]
Sep 10 18:14:45.610002 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:14:45.609956    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6xt4v" event={"ID":"7b44a982-9281-45a8-9017-c5e645fb3a89","Type":"ContainerStarted","Data":"0ef937e22f9bf155fc44cb1ec6391aa646b9177ba25a2444cd5caffb2b4b3bb2"}
Sep 10 18:14:45.610438 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:14:45.610044    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6xt4v" event={"ID":"7b44a982-9281-45a8-9017-c5e645fb3a89","Type":"ContainerStarted","Data":"320958a81ae99297cdd025da79d81cf93c6731397aafe9f5f8a6c94e82cc302a"}
Sep 10 18:14:45.610438 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:14:45.610074    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6xt4v"
Sep 10 18:14:45.633352 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:14:45.633271    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6xt4v" podStartSLOduration=1.633251487 podStartE2EDuration="1.633251487s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 18:14:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 18:14:45.630675897 +0000 UTC m=+2021.391983940" watchObservedRunningTime="2026-09-10 18:14:45.633251487 +0000 UTC m=+2021.394559530"
Sep 10 18:14:56.617716 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:14:56.617681    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6xt4v"
Sep 10 18:15:00.130509 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:15:00.130467    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29817735-7cxsz"]
Sep 10 18:15:00.133795 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:15:00.133772    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817735-7cxsz"
Sep 10 18:15:00.136142 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:15:00.136118    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-22shs\""
Sep 10 18:15:00.139933 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:15:00.139900    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29817735-7cxsz"]
Sep 10 18:15:00.146623 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:15:00.146590    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817735-7cxsz"
Sep 10 18:15:00.417822 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:15:00.417794    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29817735-7cxsz"]
Sep 10 18:15:00.419818 ip-10-0-136-161 kubenswrapper[2568]: W0910 18:15:00.419784    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40f33186_2c30_4018_9162_50ac92dee749.slice/crio-1b55d34c71096ee9e8f0a6ac0392a8528347c91b7bae225a71a414d9936c64d1 WatchSource:0}: Error finding container 1b55d34c71096ee9e8f0a6ac0392a8528347c91b7bae225a71a414d9936c64d1: Status 404 returned error can't find the container with id 1b55d34c71096ee9e8f0a6ac0392a8528347c91b7bae225a71a414d9936c64d1
Sep 10 18:15:00.697859 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:15:00.697762    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817735-7cxsz" event={"ID":"40f33186-2c30-4018-9162-50ac92dee749","Type":"ContainerStarted","Data":"ad873b95257270de69fc97aab8892b35e7a0c3c3e3db2f40495f9dc12bb90902"}
Sep 10 18:15:00.697859 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:15:00.697850    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817735-7cxsz" event={"ID":"40f33186-2c30-4018-9162-50ac92dee749","Type":"ContainerStarted","Data":"1b55d34c71096ee9e8f0a6ac0392a8528347c91b7bae225a71a414d9936c64d1"}
Sep 10 18:15:00.711789 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:15:00.711724    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817735-7cxsz" podStartSLOduration=0.71170855 podStartE2EDuration="711.70855ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 18:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 18:15:00.710657683 +0000 UTC m=+2036.471965727" watchObservedRunningTime="2026-09-10 18:15:00.71170855 +0000 UTC m=+2036.473016591"
Sep 10 18:15:01.705115 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:15:01.705022    2568 generic.go:356] "Generic (PLEG): container finished" podID="40f33186-2c30-4018-9162-50ac92dee749" containerID="ad873b95257270de69fc97aab8892b35e7a0c3c3e3db2f40495f9dc12bb90902" exitCode=0
Sep 10 18:15:01.705514 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:15:01.705112    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817735-7cxsz" event={"ID":"40f33186-2c30-4018-9162-50ac92dee749","Type":"ContainerDied","Data":"ad873b95257270de69fc97aab8892b35e7a0c3c3e3db2f40495f9dc12bb90902"}
Sep 10 18:15:02.846003 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:15:02.845973    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817735-7cxsz"
Sep 10 18:15:03.717909 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:15:03.717878    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817735-7cxsz"
Sep 10 18:15:03.718097 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:15:03.717914    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817735-7cxsz" event={"ID":"40f33186-2c30-4018-9162-50ac92dee749","Type":"ContainerDied","Data":"1b55d34c71096ee9e8f0a6ac0392a8528347c91b7bae225a71a414d9936c64d1"}
Sep 10 18:15:03.718097 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:15:03.717967    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1b55d34c71096ee9e8f0a6ac0392a8528347c91b7bae225a71a414d9936c64d1"
Sep 10 18:15:26.294889 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:15:26.294853    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-269c88c6-kserve-7cb65f9f5-7cnfk"]
Sep 10 18:15:26.295413 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:15:26.295220    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40f33186-2c30-4018-9162-50ac92dee749" containerName="cleanup"
Sep 10 18:15:26.295413 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:15:26.295233    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="40f33186-2c30-4018-9162-50ac92dee749" containerName="cleanup"
Sep 10 18:15:26.295413 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:15:26.295294    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="40f33186-2c30-4018-9162-50ac92dee749" containerName="cleanup"
Sep 10 18:15:26.298687 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:15:26.298663    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-269c88c6-kserve-7cb65f9f5-7cnfk"
Sep 10 18:15:26.301509 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:15:26.301476    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-269c88c6-kserve-self-signed-certs\""
Sep 10 18:15:26.306788 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:15:26.306762    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-269c88c6-kserve-7cb65f9f5-7cnfk"]
Sep 10 18:15:26.406584 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:15:26.406542    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7a78d214-20ed-43a5-811f-4021e67cbb4d-home\") pod \"e2e-same-id-a-269c88c6-kserve-7cb65f9f5-7cnfk\" (UID: \"7a78d214-20ed-43a5-811f-4021e67cbb4d\") " pod="llm/e2e-same-id-a-269c88c6-kserve-7cb65f9f5-7cnfk"
Sep 10 18:15:26.406784 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:15:26.406604    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcbd4\" (UniqueName: \"kubernetes.io/projected/7a78d214-20ed-43a5-811f-4021e67cbb4d-kube-api-access-mcbd4\") pod \"e2e-same-id-a-269c88c6-kserve-7cb65f9f5-7cnfk\" (UID: \"7a78d214-20ed-43a5-811f-4021e67cbb4d\") " pod="llm/e2e-same-id-a-269c88c6-kserve-7cb65f9f5-7cnfk"
Sep 10 18:15:26.406784 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:15:26.406663    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7a78d214-20ed-43a5-811f-4021e67cbb4d-tls-certs\") pod \"e2e-same-id-a-269c88c6-kserve-7cb65f9f5-7cnfk\" (UID: \"7a78d214-20ed-43a5-811f-4021e67cbb4d\") " pod="llm/e2e-same-id-a-269c88c6-kserve-7cb65f9f5-7cnfk"
Sep 10 18:15:26.406784 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:15:26.406747    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7a78d214-20ed-43a5-811f-4021e67cbb4d-tmp-dir\") pod \"e2e-same-id-a-269c88c6-kserve-7cb65f9f5-7cnfk\" (UID: \"7a78d214-20ed-43a5-811f-4021e67cbb4d\") " pod="llm/e2e-same-id-a-269c88c6-kserve-7cb65f9f5-7cnfk"
Sep 10 18:15:26.406784 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:15:26.406778    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7a78d214-20ed-43a5-811f-4021e67cbb4d-dshm\") pod \"e2e-same-id-a-269c88c6-kserve-7cb65f9f5-7cnfk\" (UID: \"7a78d214-20ed-43a5-811f-4021e67cbb4d\") " pod="llm/e2e-same-id-a-269c88c6-kserve-7cb65f9f5-7cnfk"
Sep 10 18:15:26.406933 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:15:26.406811    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7a78d214-20ed-43a5-811f-4021e67cbb4d-model-cache\") pod \"e2e-same-id-a-269c88c6-kserve-7cb65f9f5-7cnfk\" (UID: \"7a78d214-20ed-43a5-811f-4021e67cbb4d\") " pod="llm/e2e-same-id-a-269c88c6-kserve-7cb65f9f5-7cnfk"
Sep 10 18:15:26.507243 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:15:26.507203    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7a78d214-20ed-43a5-811f-4021e67cbb4d-home\") pod \"e2e-same-id-a-269c88c6-kserve-7cb65f9f5-7cnfk\" (UID: \"7a78d214-20ed-43a5-811f-4021e67cbb4d\") " pod="llm/e2e-same-id-a-269c88c6-kserve-7cb65f9f5-7cnfk"
Sep 10 18:15:26.507467 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:15:26.507251    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcbd4\" (UniqueName: \"kubernetes.io/projected/7a78d214-20ed-43a5-811f-4021e67cbb4d-kube-api-access-mcbd4\") pod \"e2e-same-id-a-269c88c6-kserve-7cb65f9f5-7cnfk\" (UID: \"7a78d214-20ed-43a5-811f-4021e67cbb4d\") " pod="llm/e2e-same-id-a-269c88c6-kserve-7cb65f9f5-7cnfk"
Sep 10 18:15:26.507467 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:15:26.507276    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7a78d214-20ed-43a5-811f-4021e67cbb4d-tls-certs\") pod \"e2e-same-id-a-269c88c6-kserve-7cb65f9f5-7cnfk\" (UID: \"7a78d214-20ed-43a5-811f-4021e67cbb4d\") " pod="llm/e2e-same-id-a-269c88c6-kserve-7cb65f9f5-7cnfk"
Sep 10 18:15:26.507467 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:15:26.507304    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7a78d214-20ed-43a5-811f-4021e67cbb4d-tmp-dir\") pod \"e2e-same-id-a-269c88c6-kserve-7cb65f9f5-7cnfk\" (UID: \"7a78d214-20ed-43a5-811f-4021e67cbb4d\") " pod="llm/e2e-same-id-a-269c88c6-kserve-7cb65f9f5-7cnfk"
Sep 10 18:15:26.507467 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:15:26.507337    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7a78d214-20ed-43a5-811f-4021e67cbb4d-dshm\") pod \"e2e-same-id-a-269c88c6-kserve-7cb65f9f5-7cnfk\" (UID: \"7a78d214-20ed-43a5-811f-4021e67cbb4d\") " pod="llm/e2e-same-id-a-269c88c6-kserve-7cb65f9f5-7cnfk"
Sep 10 18:15:26.507467 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:15:26.507375    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7a78d214-20ed-43a5-811f-4021e67cbb4d-model-cache\") pod \"e2e-same-id-a-269c88c6-kserve-7cb65f9f5-7cnfk\" (UID: \"7a78d214-20ed-43a5-811f-4021e67cbb4d\") " pod="llm/e2e-same-id-a-269c88c6-kserve-7cb65f9f5-7cnfk"
Sep 10 18:15:26.507738 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:15:26.507661    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7a78d214-20ed-43a5-811f-4021e67cbb4d-home\") pod \"e2e-same-id-a-269c88c6-kserve-7cb65f9f5-7cnfk\" (UID: \"7a78d214-20ed-43a5-811f-4021e67cbb4d\") " pod="llm/e2e-same-id-a-269c88c6-kserve-7cb65f9f5-7cnfk"
Sep 10 18:15:26.507738 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:15:26.507704    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7a78d214-20ed-43a5-811f-4021e67cbb4d-model-cache\") pod \"e2e-same-id-a-269c88c6-kserve-7cb65f9f5-7cnfk\" (UID: \"7a78d214-20ed-43a5-811f-4021e67cbb4d\") " pod="llm/e2e-same-id-a-269c88c6-kserve-7cb65f9f5-7cnfk"
Sep 10 18:15:26.507854 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:15:26.507738    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7a78d214-20ed-43a5-811f-4021e67cbb4d-tmp-dir\") pod \"e2e-same-id-a-269c88c6-kserve-7cb65f9f5-7cnfk\" (UID: \"7a78d214-20ed-43a5-811f-4021e67cbb4d\") " pod="llm/e2e-same-id-a-269c88c6-kserve-7cb65f9f5-7cnfk"
Sep 10 18:15:26.509718 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:15:26.509685    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7a78d214-20ed-43a5-811f-4021e67cbb4d-dshm\") pod \"e2e-same-id-a-269c88c6-kserve-7cb65f9f5-7cnfk\" (UID: \"7a78d214-20ed-43a5-811f-4021e67cbb4d\") " pod="llm/e2e-same-id-a-269c88c6-kserve-7cb65f9f5-7cnfk"
Sep 10 18:15:26.509913 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:15:26.509895    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7a78d214-20ed-43a5-811f-4021e67cbb4d-tls-certs\") pod \"e2e-same-id-a-269c88c6-kserve-7cb65f9f5-7cnfk\" (UID: \"7a78d214-20ed-43a5-811f-4021e67cbb4d\") " pod="llm/e2e-same-id-a-269c88c6-kserve-7cb65f9f5-7cnfk"
Sep 10 18:15:26.514899 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:15:26.514871    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcbd4\" (UniqueName: \"kubernetes.io/projected/7a78d214-20ed-43a5-811f-4021e67cbb4d-kube-api-access-mcbd4\") pod \"e2e-same-id-a-269c88c6-kserve-7cb65f9f5-7cnfk\" (UID: \"7a78d214-20ed-43a5-811f-4021e67cbb4d\") " pod="llm/e2e-same-id-a-269c88c6-kserve-7cb65f9f5-7cnfk"
Sep 10 18:15:26.609831 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:15:26.609734    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-269c88c6-kserve-7cb65f9f5-7cnfk"
Sep 10 18:15:26.885288 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:15:26.885246    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-269c88c6-kserve-7cb65f9f5-7cnfk"]
Sep 10 18:15:26.886474 ip-10-0-136-161 kubenswrapper[2568]: W0910 18:15:26.886447    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7a78d214_20ed_43a5_811f_4021e67cbb4d.slice/crio-7dd216d0e4229c52f898ab7b0cdefa79b4816156dcda87ef41b4406e2e11ad03 WatchSource:0}: Error finding container 7dd216d0e4229c52f898ab7b0cdefa79b4816156dcda87ef41b4406e2e11ad03: Status 404 returned error can't find the container with id 7dd216d0e4229c52f898ab7b0cdefa79b4816156dcda87ef41b4406e2e11ad03
Sep 10 18:15:27.857074 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:15:27.857037    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-269c88c6-kserve-7cb65f9f5-7cnfk" event={"ID":"7a78d214-20ed-43a5-811f-4021e67cbb4d","Type":"ContainerStarted","Data":"c1d9d39e4992118d332dd1b9586e462fdd1e673f1f9841bfa54df8c21c7434e0"}
Sep 10 18:15:27.857074 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:15:27.857080    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-269c88c6-kserve-7cb65f9f5-7cnfk" event={"ID":"7a78d214-20ed-43a5-811f-4021e67cbb4d","Type":"ContainerStarted","Data":"7dd216d0e4229c52f898ab7b0cdefa79b4816156dcda87ef41b4406e2e11ad03"}
Sep 10 18:15:27.873310 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:15:27.873259    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-269c88c6-kserve-7cb65f9f5-7cnfk" podStartSLOduration=1.873244565 podStartE2EDuration="1.873244565s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 18:15:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 18:15:27.872255865 +0000 UTC m=+2063.633563908" watchObservedRunningTime="2026-09-10 18:15:27.873244565 +0000 UTC m=+2063.634552610"
Sep 10 18:15:31.682337 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:15:31.682286    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-269c88c6-kserve-7f447df7f9-qmssl"]
Sep 10 18:15:31.686626 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:15:31.686600    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-269c88c6-kserve-7f447df7f9-qmssl"
Sep 10 18:15:31.689120 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:15:31.689088    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-269c88c6-kserve-self-signed-certs\""
Sep 10 18:15:31.694984 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:15:31.694952    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-269c88c6-kserve-7f447df7f9-qmssl"]
Sep 10 18:15:31.752881 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:15:31.752843    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6ngh\" (UniqueName: \"kubernetes.io/projected/2b6d6fad-1470-49f6-8197-731d9d237b7c-kube-api-access-q6ngh\") pod \"e2e-same-id-b-269c88c6-kserve-7f447df7f9-qmssl\" (UID: \"2b6d6fad-1470-49f6-8197-731d9d237b7c\") " pod="llm/e2e-same-id-b-269c88c6-kserve-7f447df7f9-qmssl"
Sep 10 18:15:31.752881 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:15:31.752881    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b6d6fad-1470-49f6-8197-731d9d237b7c-home\") pod \"e2e-same-id-b-269c88c6-kserve-7f447df7f9-qmssl\" (UID: \"2b6d6fad-1470-49f6-8197-731d9d237b7c\") " pod="llm/e2e-same-id-b-269c88c6-kserve-7f447df7f9-qmssl"
Sep 10 18:15:31.753107 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:15:31.752900    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b6d6fad-1470-49f6-8197-731d9d237b7c-dshm\") pod \"e2e-same-id-b-269c88c6-kserve-7f447df7f9-qmssl\" (UID: \"2b6d6fad-1470-49f6-8197-731d9d237b7c\") " pod="llm/e2e-same-id-b-269c88c6-kserve-7f447df7f9-qmssl"
Sep 10 18:15:31.753107 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:15:31.752940    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b6d6fad-1470-49f6-8197-731d9d237b7c-model-cache\") pod \"e2e-same-id-b-269c88c6-kserve-7f447df7f9-qmssl\" (UID: \"2b6d6fad-1470-49f6-8197-731d9d237b7c\") " pod="llm/e2e-same-id-b-269c88c6-kserve-7f447df7f9-qmssl"
Sep 10 18:15:31.753107 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:15:31.752957    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b6d6fad-1470-49f6-8197-731d9d237b7c-tmp-dir\") pod \"e2e-same-id-b-269c88c6-kserve-7f447df7f9-qmssl\" (UID: \"2b6d6fad-1470-49f6-8197-731d9d237b7c\") " pod="llm/e2e-same-id-b-269c88c6-kserve-7f447df7f9-qmssl"
Sep 10 18:15:31.753107 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:15:31.752979    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b6d6fad-1470-49f6-8197-731d9d237b7c-tls-certs\") pod \"e2e-same-id-b-269c88c6-kserve-7f447df7f9-qmssl\" (UID: \"2b6d6fad-1470-49f6-8197-731d9d237b7c\") " pod="llm/e2e-same-id-b-269c88c6-kserve-7f447df7f9-qmssl"
Sep 10 18:15:31.854183 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:15:31.854143    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b6d6fad-1470-49f6-8197-731d9d237b7c-tls-certs\") pod \"e2e-same-id-b-269c88c6-kserve-7f447df7f9-qmssl\" (UID: \"2b6d6fad-1470-49f6-8197-731d9d237b7c\") " pod="llm/e2e-same-id-b-269c88c6-kserve-7f447df7f9-qmssl"
Sep 10 18:15:31.854505 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:15:31.854216    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6ngh\" (UniqueName: \"kubernetes.io/projected/2b6d6fad-1470-49f6-8197-731d9d237b7c-kube-api-access-q6ngh\") pod \"e2e-same-id-b-269c88c6-kserve-7f447df7f9-qmssl\" (UID: \"2b6d6fad-1470-49f6-8197-731d9d237b7c\") " pod="llm/e2e-same-id-b-269c88c6-kserve-7f447df7f9-qmssl"
Sep 10 18:15:31.854505 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:15:31.854241    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b6d6fad-1470-49f6-8197-731d9d237b7c-home\") pod \"e2e-same-id-b-269c88c6-kserve-7f447df7f9-qmssl\" (UID: \"2b6d6fad-1470-49f6-8197-731d9d237b7c\") " pod="llm/e2e-same-id-b-269c88c6-kserve-7f447df7f9-qmssl"
Sep 10 18:15:31.854505 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:15:31.854260    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b6d6fad-1470-49f6-8197-731d9d237b7c-dshm\") pod \"e2e-same-id-b-269c88c6-kserve-7f447df7f9-qmssl\" (UID: \"2b6d6fad-1470-49f6-8197-731d9d237b7c\") " pod="llm/e2e-same-id-b-269c88c6-kserve-7f447df7f9-qmssl"
Sep 10 18:15:31.854505 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:15:31.854294    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b6d6fad-1470-49f6-8197-731d9d237b7c-model-cache\") pod \"e2e-same-id-b-269c88c6-kserve-7f447df7f9-qmssl\" (UID: \"2b6d6fad-1470-49f6-8197-731d9d237b7c\") " pod="llm/e2e-same-id-b-269c88c6-kserve-7f447df7f9-qmssl"
Sep 10 18:15:31.854505 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:15:31.854432    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b6d6fad-1470-49f6-8197-731d9d237b7c-tmp-dir\") pod \"e2e-same-id-b-269c88c6-kserve-7f447df7f9-qmssl\" (UID: \"2b6d6fad-1470-49f6-8197-731d9d237b7c\") " pod="llm/e2e-same-id-b-269c88c6-kserve-7f447df7f9-qmssl"
Sep 10 18:15:31.854846 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:15:31.854824    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b6d6fad-1470-49f6-8197-731d9d237b7c-home\") pod \"e2e-same-id-b-269c88c6-kserve-7f447df7f9-qmssl\" (UID: \"2b6d6fad-1470-49f6-8197-731d9d237b7c\") " pod="llm/e2e-same-id-b-269c88c6-kserve-7f447df7f9-qmssl"
Sep 10 18:15:31.854910 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:15:31.854864    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b6d6fad-1470-49f6-8197-731d9d237b7c-model-cache\") pod \"e2e-same-id-b-269c88c6-kserve-7f447df7f9-qmssl\" (UID: \"2b6d6fad-1470-49f6-8197-731d9d237b7c\") " pod="llm/e2e-same-id-b-269c88c6-kserve-7f447df7f9-qmssl"
Sep 10 18:15:31.854910 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:15:31.854898    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b6d6fad-1470-49f6-8197-731d9d237b7c-tmp-dir\") pod \"e2e-same-id-b-269c88c6-kserve-7f447df7f9-qmssl\" (UID: \"2b6d6fad-1470-49f6-8197-731d9d237b7c\") " pod="llm/e2e-same-id-b-269c88c6-kserve-7f447df7f9-qmssl"
Sep 10 18:15:31.856686 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:15:31.856666    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b6d6fad-1470-49f6-8197-731d9d237b7c-dshm\") pod \"e2e-same-id-b-269c88c6-kserve-7f447df7f9-qmssl\" (UID: \"2b6d6fad-1470-49f6-8197-731d9d237b7c\") " pod="llm/e2e-same-id-b-269c88c6-kserve-7f447df7f9-qmssl"
Sep 10 18:15:31.857061 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:15:31.857042    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b6d6fad-1470-49f6-8197-731d9d237b7c-tls-certs\") pod \"e2e-same-id-b-269c88c6-kserve-7f447df7f9-qmssl\" (UID: \"2b6d6fad-1470-49f6-8197-731d9d237b7c\") " pod="llm/e2e-same-id-b-269c88c6-kserve-7f447df7f9-qmssl"
Sep 10 18:15:31.861987 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:15:31.861962    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6ngh\" (UniqueName: \"kubernetes.io/projected/2b6d6fad-1470-49f6-8197-731d9d237b7c-kube-api-access-q6ngh\") pod \"e2e-same-id-b-269c88c6-kserve-7f447df7f9-qmssl\" (UID: \"2b6d6fad-1470-49f6-8197-731d9d237b7c\") " pod="llm/e2e-same-id-b-269c88c6-kserve-7f447df7f9-qmssl"
Sep 10 18:15:32.000122 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:15:32.000089    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-269c88c6-kserve-7f447df7f9-qmssl"
Sep 10 18:15:32.277715 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:15:32.277682    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-269c88c6-kserve-7f447df7f9-qmssl"]
Sep 10 18:15:32.279491 ip-10-0-136-161 kubenswrapper[2568]: W0910 18:15:32.279463    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2b6d6fad_1470_49f6_8197_731d9d237b7c.slice/crio-757500bf7c9304f05e213a6629df6c4ba9a6f0abd3d0bd06ef1df59db84359d7 WatchSource:0}: Error finding container 757500bf7c9304f05e213a6629df6c4ba9a6f0abd3d0bd06ef1df59db84359d7: Status 404 returned error can't find the container with id 757500bf7c9304f05e213a6629df6c4ba9a6f0abd3d0bd06ef1df59db84359d7
Sep 10 18:15:32.886502 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:15:32.886465    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-269c88c6-kserve-7f447df7f9-qmssl" event={"ID":"2b6d6fad-1470-49f6-8197-731d9d237b7c","Type":"ContainerStarted","Data":"f10aeb9e99dce86d25366c52f04f5a6b5882a94fcba18d33f7803e8a1b22c821"}
Sep 10 18:15:32.886903 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:15:32.886508    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-269c88c6-kserve-7f447df7f9-qmssl" event={"ID":"2b6d6fad-1470-49f6-8197-731d9d237b7c","Type":"ContainerStarted","Data":"757500bf7c9304f05e213a6629df6c4ba9a6f0abd3d0bd06ef1df59db84359d7"}
Sep 10 18:15:32.902714 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:15:32.902653    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-269c88c6-kserve-7f447df7f9-qmssl" podStartSLOduration=1.902636507 podStartE2EDuration="1.902636507s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 18:15:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 18:15:32.900800867 +0000 UTC m=+2068.662108922" watchObservedRunningTime="2026-09-10 18:15:32.902636507 +0000 UTC m=+2068.663944603"
Sep 10 18:15:36.610391 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:15:36.610316    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-269c88c6-kserve-7cb65f9f5-7cnfk"
Sep 10 18:15:36.610809 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:15:36.610407    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-269c88c6-kserve-7cb65f9f5-7cnfk"
Sep 10 18:15:36.623120 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:15:36.623085    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-269c88c6-kserve-7cb65f9f5-7cnfk"
Sep 10 18:15:36.919509 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:15:36.919417    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-269c88c6-kserve-7cb65f9f5-7cnfk"
Sep 10 18:15:42.000874 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:15:42.000841    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-269c88c6-kserve-7f447df7f9-qmssl"
Sep 10 18:15:42.001380 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:15:42.001097    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-269c88c6-kserve-7f447df7f9-qmssl"
Sep 10 18:15:42.014272 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:15:42.014239    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-269c88c6-kserve-7f447df7f9-qmssl"
Sep 10 18:15:42.951049 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:15:42.951014    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-269c88c6-kserve-7f447df7f9-qmssl"
Sep 10 18:15:56.536663 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:15:56.536563    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-269c88c6-kserve-7cb65f9f5-7cnfk"]
Sep 10 18:15:57.980071 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:15:57.980034    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-269c88c6-kserve-7f447df7f9-qmssl"]
Sep 10 18:16:04.922831 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:04.922796    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-jwfnv_e90054ec-91dc-4cda-94a2-fbe7a2a1fff0/console-operator/1.log"
Sep 10 18:16:04.933614 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:04.933584    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-jwfnv_e90054ec-91dc-4cda-94a2-fbe7a2a1fff0/console-operator/1.log"
Sep 10 18:16:11.562041 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:11.561969    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-269c88c6-kserve-7cb65f9f5-7cnfk" podUID="7a78d214-20ed-43a5-811f-4021e67cbb4d" containerName="main" containerID="cri-o://c1d9d39e4992118d332dd1b9586e462fdd1e673f1f9841bfa54df8c21c7434e0" gracePeriod=45
Sep 10 18:16:11.820159 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:11.820082    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-269c88c6-kserve-7cb65f9f5-7cnfk"
Sep 10 18:16:11.926475 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:11.926437    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mcbd4\" (UniqueName: \"kubernetes.io/projected/7a78d214-20ed-43a5-811f-4021e67cbb4d-kube-api-access-mcbd4\") pod \"7a78d214-20ed-43a5-811f-4021e67cbb4d\" (UID: \"7a78d214-20ed-43a5-811f-4021e67cbb4d\") "
Sep 10 18:16:11.926475 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:11.926492    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7a78d214-20ed-43a5-811f-4021e67cbb4d-dshm\") pod \"7a78d214-20ed-43a5-811f-4021e67cbb4d\" (UID: \"7a78d214-20ed-43a5-811f-4021e67cbb4d\") "
Sep 10 18:16:11.926766 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:11.926513    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7a78d214-20ed-43a5-811f-4021e67cbb4d-tls-certs\") pod \"7a78d214-20ed-43a5-811f-4021e67cbb4d\" (UID: \"7a78d214-20ed-43a5-811f-4021e67cbb4d\") "
Sep 10 18:16:11.926766 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:11.926553    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7a78d214-20ed-43a5-811f-4021e67cbb4d-tmp-dir\") pod \"7a78d214-20ed-43a5-811f-4021e67cbb4d\" (UID: \"7a78d214-20ed-43a5-811f-4021e67cbb4d\") "
Sep 10 18:16:11.926766 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:11.926570    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7a78d214-20ed-43a5-811f-4021e67cbb4d-model-cache\") pod \"7a78d214-20ed-43a5-811f-4021e67cbb4d\" (UID: \"7a78d214-20ed-43a5-811f-4021e67cbb4d\") "
Sep 10 18:16:11.926766 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:11.926600    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7a78d214-20ed-43a5-811f-4021e67cbb4d-home\") pod \"7a78d214-20ed-43a5-811f-4021e67cbb4d\" (UID: \"7a78d214-20ed-43a5-811f-4021e67cbb4d\") "
Sep 10 18:16:11.926972 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:11.926846    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a78d214-20ed-43a5-811f-4021e67cbb4d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7a78d214-20ed-43a5-811f-4021e67cbb4d" (UID: "7a78d214-20ed-43a5-811f-4021e67cbb4d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 18:16:11.926972 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:11.926868    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a78d214-20ed-43a5-811f-4021e67cbb4d-model-cache" (OuterVolumeSpecName: "model-cache") pod "7a78d214-20ed-43a5-811f-4021e67cbb4d" (UID: "7a78d214-20ed-43a5-811f-4021e67cbb4d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 18:16:11.927046 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:11.926985    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a78d214-20ed-43a5-811f-4021e67cbb4d-home" (OuterVolumeSpecName: "home") pod "7a78d214-20ed-43a5-811f-4021e67cbb4d" (UID: "7a78d214-20ed-43a5-811f-4021e67cbb4d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 18:16:11.928959 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:11.928922    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a78d214-20ed-43a5-811f-4021e67cbb4d-dshm" (OuterVolumeSpecName: "dshm") pod "7a78d214-20ed-43a5-811f-4021e67cbb4d" (UID: "7a78d214-20ed-43a5-811f-4021e67cbb4d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 18:16:11.928959 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:11.928941    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a78d214-20ed-43a5-811f-4021e67cbb4d-kube-api-access-mcbd4" (OuterVolumeSpecName: "kube-api-access-mcbd4") pod "7a78d214-20ed-43a5-811f-4021e67cbb4d" (UID: "7a78d214-20ed-43a5-811f-4021e67cbb4d"). InnerVolumeSpecName "kube-api-access-mcbd4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 18:16:11.928959 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:11.928921    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7a78d214-20ed-43a5-811f-4021e67cbb4d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7a78d214-20ed-43a5-811f-4021e67cbb4d" (UID: "7a78d214-20ed-43a5-811f-4021e67cbb4d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 18:16:12.028257 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:12.028213    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mcbd4\" (UniqueName: \"kubernetes.io/projected/7a78d214-20ed-43a5-811f-4021e67cbb4d-kube-api-access-mcbd4\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 18:16:12.028257 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:12.028249    2568 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7a78d214-20ed-43a5-811f-4021e67cbb4d-dshm\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 18:16:12.028257 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:12.028263    2568 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7a78d214-20ed-43a5-811f-4021e67cbb4d-tls-certs\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 18:16:12.028543 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:12.028275    2568 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7a78d214-20ed-43a5-811f-4021e67cbb4d-tmp-dir\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 18:16:12.028543 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:12.028286    2568 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7a78d214-20ed-43a5-811f-4021e67cbb4d-model-cache\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 18:16:12.028543 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:12.028297    2568 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7a78d214-20ed-43a5-811f-4021e67cbb4d-home\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 18:16:12.109965 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:12.109865    2568 generic.go:356] "Generic (PLEG): container finished" podID="7a78d214-20ed-43a5-811f-4021e67cbb4d" containerID="c1d9d39e4992118d332dd1b9586e462fdd1e673f1f9841bfa54df8c21c7434e0" exitCode=0
Sep 10 18:16:12.109965 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:12.109910    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-269c88c6-kserve-7cb65f9f5-7cnfk"
Sep 10 18:16:12.109965 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:12.109953    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-269c88c6-kserve-7cb65f9f5-7cnfk" event={"ID":"7a78d214-20ed-43a5-811f-4021e67cbb4d","Type":"ContainerDied","Data":"c1d9d39e4992118d332dd1b9586e462fdd1e673f1f9841bfa54df8c21c7434e0"}
Sep 10 18:16:12.110254 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:12.110001    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-269c88c6-kserve-7cb65f9f5-7cnfk" event={"ID":"7a78d214-20ed-43a5-811f-4021e67cbb4d","Type":"ContainerDied","Data":"7dd216d0e4229c52f898ab7b0cdefa79b4816156dcda87ef41b4406e2e11ad03"}
Sep 10 18:16:12.110254 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:12.110022    2568 scope.go:117] "RemoveContainer" containerID="c1d9d39e4992118d332dd1b9586e462fdd1e673f1f9841bfa54df8c21c7434e0"
Sep 10 18:16:12.122266 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:12.122199    2568 scope.go:117] "RemoveContainer" containerID="c1d9d39e4992118d332dd1b9586e462fdd1e673f1f9841bfa54df8c21c7434e0"
Sep 10 18:16:12.122829 ip-10-0-136-161 kubenswrapper[2568]: E0910 18:16:12.122807    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1d9d39e4992118d332dd1b9586e462fdd1e673f1f9841bfa54df8c21c7434e0\": container with ID starting with c1d9d39e4992118d332dd1b9586e462fdd1e673f1f9841bfa54df8c21c7434e0 not found: ID does not exist" containerID="c1d9d39e4992118d332dd1b9586e462fdd1e673f1f9841bfa54df8c21c7434e0"
Sep 10 18:16:12.122910 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:12.122840    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1d9d39e4992118d332dd1b9586e462fdd1e673f1f9841bfa54df8c21c7434e0"} err="failed to get container status \"c1d9d39e4992118d332dd1b9586e462fdd1e673f1f9841bfa54df8c21c7434e0\": rpc error: code = NotFound desc = could not find container \"c1d9d39e4992118d332dd1b9586e462fdd1e673f1f9841bfa54df8c21c7434e0\": container with ID starting with c1d9d39e4992118d332dd1b9586e462fdd1e673f1f9841bfa54df8c21c7434e0 not found: ID does not exist"
Sep 10 18:16:12.134469 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:12.134430    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-269c88c6-kserve-7cb65f9f5-7cnfk"]
Sep 10 18:16:12.138258 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:12.138216    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-269c88c6-kserve-7cb65f9f5-7cnfk"]
Sep 10 18:16:12.770701 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:12.770659    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a78d214-20ed-43a5-811f-4021e67cbb4d" path="/var/lib/kubelet/pods/7a78d214-20ed-43a5-811f-4021e67cbb4d/volumes"
Sep 10 18:16:13.000623 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:13.000576    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-269c88c6-kserve-7f447df7f9-qmssl" podUID="2b6d6fad-1470-49f6-8197-731d9d237b7c" containerName="main" containerID="cri-o://f10aeb9e99dce86d25366c52f04f5a6b5882a94fcba18d33f7803e8a1b22c821" gracePeriod=45
Sep 10 18:16:13.268457 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:13.268428    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-269c88c6-kserve-7f447df7f9-qmssl"
Sep 10 18:16:13.339429 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:13.339396    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b6d6fad-1470-49f6-8197-731d9d237b7c-dshm\") pod \"2b6d6fad-1470-49f6-8197-731d9d237b7c\" (UID: \"2b6d6fad-1470-49f6-8197-731d9d237b7c\") "
Sep 10 18:16:13.339625 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:13.339451    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b6d6fad-1470-49f6-8197-731d9d237b7c-tls-certs\") pod \"2b6d6fad-1470-49f6-8197-731d9d237b7c\" (UID: \"2b6d6fad-1470-49f6-8197-731d9d237b7c\") "
Sep 10 18:16:13.339625 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:13.339485    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q6ngh\" (UniqueName: \"kubernetes.io/projected/2b6d6fad-1470-49f6-8197-731d9d237b7c-kube-api-access-q6ngh\") pod \"2b6d6fad-1470-49f6-8197-731d9d237b7c\" (UID: \"2b6d6fad-1470-49f6-8197-731d9d237b7c\") "
Sep 10 18:16:13.339625 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:13.339532    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b6d6fad-1470-49f6-8197-731d9d237b7c-model-cache\") pod \"2b6d6fad-1470-49f6-8197-731d9d237b7c\" (UID: \"2b6d6fad-1470-49f6-8197-731d9d237b7c\") "
Sep 10 18:16:13.339625 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:13.339557    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b6d6fad-1470-49f6-8197-731d9d237b7c-home\") pod \"2b6d6fad-1470-49f6-8197-731d9d237b7c\" (UID: \"2b6d6fad-1470-49f6-8197-731d9d237b7c\") "
Sep 10 18:16:13.339888 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:13.339834    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b6d6fad-1470-49f6-8197-731d9d237b7c-model-cache" (OuterVolumeSpecName: "model-cache") pod "2b6d6fad-1470-49f6-8197-731d9d237b7c" (UID: "2b6d6fad-1470-49f6-8197-731d9d237b7c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 18:16:13.339935 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:13.339911    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b6d6fad-1470-49f6-8197-731d9d237b7c-home" (OuterVolumeSpecName: "home") pod "2b6d6fad-1470-49f6-8197-731d9d237b7c" (UID: "2b6d6fad-1470-49f6-8197-731d9d237b7c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 18:16:13.341761 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:13.341727    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b6d6fad-1470-49f6-8197-731d9d237b7c-dshm" (OuterVolumeSpecName: "dshm") pod "2b6d6fad-1470-49f6-8197-731d9d237b7c" (UID: "2b6d6fad-1470-49f6-8197-731d9d237b7c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 18:16:13.341877 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:13.341760    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b6d6fad-1470-49f6-8197-731d9d237b7c-kube-api-access-q6ngh" (OuterVolumeSpecName: "kube-api-access-q6ngh") pod "2b6d6fad-1470-49f6-8197-731d9d237b7c" (UID: "2b6d6fad-1470-49f6-8197-731d9d237b7c"). InnerVolumeSpecName "kube-api-access-q6ngh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 18:16:13.341877 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:13.341769    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b6d6fad-1470-49f6-8197-731d9d237b7c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2b6d6fad-1470-49f6-8197-731d9d237b7c" (UID: "2b6d6fad-1470-49f6-8197-731d9d237b7c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 18:16:13.440128 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:13.440030    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b6d6fad-1470-49f6-8197-731d9d237b7c-tmp-dir\") pod \"2b6d6fad-1470-49f6-8197-731d9d237b7c\" (UID: \"2b6d6fad-1470-49f6-8197-731d9d237b7c\") "
Sep 10 18:16:13.440335 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:13.440299    2568 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b6d6fad-1470-49f6-8197-731d9d237b7c-model-cache\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 18:16:13.440378 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:13.440355    2568 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b6d6fad-1470-49f6-8197-731d9d237b7c-home\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 18:16:13.440378 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:13.440356    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b6d6fad-1470-49f6-8197-731d9d237b7c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2b6d6fad-1470-49f6-8197-731d9d237b7c" (UID: "2b6d6fad-1470-49f6-8197-731d9d237b7c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 18:16:13.440378 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:13.440368    2568 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b6d6fad-1470-49f6-8197-731d9d237b7c-dshm\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 18:16:13.440489 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:13.440380    2568 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b6d6fad-1470-49f6-8197-731d9d237b7c-tls-certs\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 18:16:13.440489 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:13.440391    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q6ngh\" (UniqueName: \"kubernetes.io/projected/2b6d6fad-1470-49f6-8197-731d9d237b7c-kube-api-access-q6ngh\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 18:16:13.541053 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:13.541014    2568 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b6d6fad-1470-49f6-8197-731d9d237b7c-tmp-dir\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 18:16:14.123533 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:14.123496    2568 generic.go:356] "Generic (PLEG): container finished" podID="2b6d6fad-1470-49f6-8197-731d9d237b7c" containerID="f10aeb9e99dce86d25366c52f04f5a6b5882a94fcba18d33f7803e8a1b22c821" exitCode=0
Sep 10 18:16:14.124023 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:14.123548    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-269c88c6-kserve-7f447df7f9-qmssl"
Sep 10 18:16:14.124023 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:14.123582    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-269c88c6-kserve-7f447df7f9-qmssl" event={"ID":"2b6d6fad-1470-49f6-8197-731d9d237b7c","Type":"ContainerDied","Data":"f10aeb9e99dce86d25366c52f04f5a6b5882a94fcba18d33f7803e8a1b22c821"}
Sep 10 18:16:14.124023 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:14.123627    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-269c88c6-kserve-7f447df7f9-qmssl" event={"ID":"2b6d6fad-1470-49f6-8197-731d9d237b7c","Type":"ContainerDied","Data":"757500bf7c9304f05e213a6629df6c4ba9a6f0abd3d0bd06ef1df59db84359d7"}
Sep 10 18:16:14.124023 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:14.123646    2568 scope.go:117] "RemoveContainer" containerID="f10aeb9e99dce86d25366c52f04f5a6b5882a94fcba18d33f7803e8a1b22c821"
Sep 10 18:16:14.133334 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:14.133292    2568 scope.go:117] "RemoveContainer" containerID="f10aeb9e99dce86d25366c52f04f5a6b5882a94fcba18d33f7803e8a1b22c821"
Sep 10 18:16:14.133713 ip-10-0-136-161 kubenswrapper[2568]: E0910 18:16:14.133692    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f10aeb9e99dce86d25366c52f04f5a6b5882a94fcba18d33f7803e8a1b22c821\": container with ID starting with f10aeb9e99dce86d25366c52f04f5a6b5882a94fcba18d33f7803e8a1b22c821 not found: ID does not exist" containerID="f10aeb9e99dce86d25366c52f04f5a6b5882a94fcba18d33f7803e8a1b22c821"
Sep 10 18:16:14.133788 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:14.133724    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f10aeb9e99dce86d25366c52f04f5a6b5882a94fcba18d33f7803e8a1b22c821"} err="failed to get container status \"f10aeb9e99dce86d25366c52f04f5a6b5882a94fcba18d33f7803e8a1b22c821\": rpc error: code = NotFound desc = could not find container \"f10aeb9e99dce86d25366c52f04f5a6b5882a94fcba18d33f7803e8a1b22c821\": container with ID starting with f10aeb9e99dce86d25366c52f04f5a6b5882a94fcba18d33f7803e8a1b22c821 not found: ID does not exist"
Sep 10 18:16:14.145462 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:14.145425    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-269c88c6-kserve-7f447df7f9-qmssl"]
Sep 10 18:16:14.149717 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:14.149683    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-269c88c6-kserve-7f447df7f9-qmssl"]
Sep 10 18:16:14.770179 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:14.770147    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b6d6fad-1470-49f6-8197-731d9d237b7c" path="/var/lib/kubelet/pods/2b6d6fad-1470-49f6-8197-731d9d237b7c/volumes"
Sep 10 18:16:16.010618 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:16.010575    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-54b46465b9-jc5jd"]
Sep 10 18:16:16.011010 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:16.010949    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a78d214-20ed-43a5-811f-4021e67cbb4d" containerName="main"
Sep 10 18:16:16.011010 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:16.010962    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a78d214-20ed-43a5-811f-4021e67cbb4d" containerName="main"
Sep 10 18:16:16.011010 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:16.010977    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b6d6fad-1470-49f6-8197-731d9d237b7c" containerName="main"
Sep 10 18:16:16.011010 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:16.010982    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b6d6fad-1470-49f6-8197-731d9d237b7c" containerName="main"
Sep 10 18:16:16.011148 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:16.011045    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a78d214-20ed-43a5-811f-4021e67cbb4d" containerName="main"
Sep 10 18:16:16.011148 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:16.011055    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b6d6fad-1470-49f6-8197-731d9d237b7c" containerName="main"
Sep 10 18:16:16.015827 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:16.015803    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-54b46465b9-jc5jd"
Sep 10 18:16:16.019624 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:16.019596    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 10 18:16:16.019777 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:16.019657    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-n56s4\""
Sep 10 18:16:16.019777 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:16.019658    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 10 18:16:16.025239 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:16.025206    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-54b46465b9-jc5jd"]
Sep 10 18:16:16.063250 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:16.063197    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57dqn\" (UniqueName: \"kubernetes.io/projected/c99430ab-c479-450d-83f5-f5087b93f993-kube-api-access-57dqn\") pod \"maas-api-54b46465b9-jc5jd\" (UID: \"c99430ab-c479-450d-83f5-f5087b93f993\") " pod="odh-ai-gateway-infra/maas-api-54b46465b9-jc5jd"
Sep 10 18:16:16.063250 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:16.063251    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c99430ab-c479-450d-83f5-f5087b93f993-maas-api-tls\") pod \"maas-api-54b46465b9-jc5jd\" (UID: \"c99430ab-c479-450d-83f5-f5087b93f993\") " pod="odh-ai-gateway-infra/maas-api-54b46465b9-jc5jd"
Sep 10 18:16:16.063544 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:16.063380    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c99430ab-c479-450d-83f5-f5087b93f993-metrics-certs\") pod \"maas-api-54b46465b9-jc5jd\" (UID: \"c99430ab-c479-450d-83f5-f5087b93f993\") " pod="odh-ai-gateway-infra/maas-api-54b46465b9-jc5jd"
Sep 10 18:16:16.063544 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:16.063465    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c99430ab-c479-450d-83f5-f5087b93f993-openshift-service-ca\") pod \"maas-api-54b46465b9-jc5jd\" (UID: \"c99430ab-c479-450d-83f5-f5087b93f993\") " pod="odh-ai-gateway-infra/maas-api-54b46465b9-jc5jd"
Sep 10 18:16:16.164555 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:16.164509    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57dqn\" (UniqueName: \"kubernetes.io/projected/c99430ab-c479-450d-83f5-f5087b93f993-kube-api-access-57dqn\") pod \"maas-api-54b46465b9-jc5jd\" (UID: \"c99430ab-c479-450d-83f5-f5087b93f993\") " pod="odh-ai-gateway-infra/maas-api-54b46465b9-jc5jd"
Sep 10 18:16:16.164555 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:16.164559    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c99430ab-c479-450d-83f5-f5087b93f993-maas-api-tls\") pod \"maas-api-54b46465b9-jc5jd\" (UID: \"c99430ab-c479-450d-83f5-f5087b93f993\") " pod="odh-ai-gateway-infra/maas-api-54b46465b9-jc5jd"
Sep 10 18:16:16.164838 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:16.164599    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c99430ab-c479-450d-83f5-f5087b93f993-metrics-certs\") pod \"maas-api-54b46465b9-jc5jd\" (UID: \"c99430ab-c479-450d-83f5-f5087b93f993\") " pod="odh-ai-gateway-infra/maas-api-54b46465b9-jc5jd"
Sep 10 18:16:16.164838 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:16.164660    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c99430ab-c479-450d-83f5-f5087b93f993-openshift-service-ca\") pod \"maas-api-54b46465b9-jc5jd\" (UID: \"c99430ab-c479-450d-83f5-f5087b93f993\") " pod="odh-ai-gateway-infra/maas-api-54b46465b9-jc5jd"
Sep 10 18:16:16.165454 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:16.165427    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c99430ab-c479-450d-83f5-f5087b93f993-openshift-service-ca\") pod \"maas-api-54b46465b9-jc5jd\" (UID: \"c99430ab-c479-450d-83f5-f5087b93f993\") " pod="odh-ai-gateway-infra/maas-api-54b46465b9-jc5jd"
Sep 10 18:16:16.167308 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:16.167285    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c99430ab-c479-450d-83f5-f5087b93f993-metrics-certs\") pod \"maas-api-54b46465b9-jc5jd\" (UID: \"c99430ab-c479-450d-83f5-f5087b93f993\") " pod="odh-ai-gateway-infra/maas-api-54b46465b9-jc5jd"
Sep 10 18:16:16.167428 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:16.167404    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c99430ab-c479-450d-83f5-f5087b93f993-maas-api-tls\") pod \"maas-api-54b46465b9-jc5jd\" (UID: \"c99430ab-c479-450d-83f5-f5087b93f993\") " pod="odh-ai-gateway-infra/maas-api-54b46465b9-jc5jd"
Sep 10 18:16:16.172432 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:16.172406    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-57dqn\" (UniqueName: \"kubernetes.io/projected/c99430ab-c479-450d-83f5-f5087b93f993-kube-api-access-57dqn\") pod \"maas-api-54b46465b9-jc5jd\" (UID: \"c99430ab-c479-450d-83f5-f5087b93f993\") " pod="odh-ai-gateway-infra/maas-api-54b46465b9-jc5jd"
Sep 10 18:16:16.328481 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:16.328376    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-54b46465b9-jc5jd"
Sep 10 18:16:16.607971 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:16.607934    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-54b46465b9-jc5jd"]
Sep 10 18:16:16.609969 ip-10-0-136-161 kubenswrapper[2568]: W0910 18:16:16.609937    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc99430ab_c479_450d_83f5_f5087b93f993.slice/crio-07d747347e34937c20e4515103bf435f2bd089000dc696458f3cb25fcc50fcfd WatchSource:0}: Error finding container 07d747347e34937c20e4515103bf435f2bd089000dc696458f3cb25fcc50fcfd: Status 404 returned error can't find the container with id 07d747347e34937c20e4515103bf435f2bd089000dc696458f3cb25fcc50fcfd
Sep 10 18:16:17.143623 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:17.143580    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-54b46465b9-jc5jd" event={"ID":"c99430ab-c479-450d-83f5-f5087b93f993","Type":"ContainerStarted","Data":"07d747347e34937c20e4515103bf435f2bd089000dc696458f3cb25fcc50fcfd"}
Sep 10 18:16:19.157386 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:19.157350    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-54b46465b9-jc5jd" event={"ID":"c99430ab-c479-450d-83f5-f5087b93f993","Type":"ContainerStarted","Data":"9d8849675fcc4fdf85692661c941764fd172f9e47d747b3942ecb0f13c23f145"}
Sep 10 18:16:19.157845 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:19.157442    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-54b46465b9-jc5jd"
Sep 10 18:16:19.176501 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:19.176424    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-54b46465b9-jc5jd" podStartSLOduration=2.416643893 podStartE2EDuration="4.176402914s" totalImagesPullingTime="1.759759021s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 18:16:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 18:16:19.173370407 +0000 UTC m=+2114.934678451" watchObservedRunningTime="2026-09-10 18:16:19.176402914 +0000 UTC m=+2114.937710965"
Sep 10 18:16:23.868594 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:23.868553    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-54b46465b9-jc5jd"]
Sep 10 18:16:23.869059 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:23.868759    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-54b46465b9-jc5jd" podUID="c99430ab-c479-450d-83f5-f5087b93f993" containerName="maas-api" containerID="cri-o://9d8849675fcc4fdf85692661c941764fd172f9e47d747b3942ecb0f13c23f145" gracePeriod=30
Sep 10 18:16:23.874657 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:23.874632    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-54b46465b9-jc5jd"
Sep 10 18:16:23.903255 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:23.903218    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-698bfd7f85-8nzqw"]
Sep 10 18:16:23.906916 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:23.906894    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-698bfd7f85-8nzqw"
Sep 10 18:16:23.919562 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:23.919526    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-698bfd7f85-8nzqw"]
Sep 10 18:16:23.937553 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:23.937511    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/85adcf85-238e-41ba-b1f0-d51064acd5ae-maas-api-tls\") pod \"maas-api-698bfd7f85-8nzqw\" (UID: \"85adcf85-238e-41ba-b1f0-d51064acd5ae\") " pod="odh-ai-gateway-infra/maas-api-698bfd7f85-8nzqw"
Sep 10 18:16:23.937720 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:23.937563    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/85adcf85-238e-41ba-b1f0-d51064acd5ae-openshift-service-ca\") pod \"maas-api-698bfd7f85-8nzqw\" (UID: \"85adcf85-238e-41ba-b1f0-d51064acd5ae\") " pod="odh-ai-gateway-infra/maas-api-698bfd7f85-8nzqw"
Sep 10 18:16:23.937720 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:23.937683    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wg2cs\" (UniqueName: \"kubernetes.io/projected/85adcf85-238e-41ba-b1f0-d51064acd5ae-kube-api-access-wg2cs\") pod \"maas-api-698bfd7f85-8nzqw\" (UID: \"85adcf85-238e-41ba-b1f0-d51064acd5ae\") " pod="odh-ai-gateway-infra/maas-api-698bfd7f85-8nzqw"
Sep 10 18:16:23.937801 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:23.937732    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/85adcf85-238e-41ba-b1f0-d51064acd5ae-metrics-certs\") pod \"maas-api-698bfd7f85-8nzqw\" (UID: \"85adcf85-238e-41ba-b1f0-d51064acd5ae\") " pod="odh-ai-gateway-infra/maas-api-698bfd7f85-8nzqw"
Sep 10 18:16:24.038485 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:24.038438    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/85adcf85-238e-41ba-b1f0-d51064acd5ae-maas-api-tls\") pod \"maas-api-698bfd7f85-8nzqw\" (UID: \"85adcf85-238e-41ba-b1f0-d51064acd5ae\") " pod="odh-ai-gateway-infra/maas-api-698bfd7f85-8nzqw"
Sep 10 18:16:24.038485 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:24.038487    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/85adcf85-238e-41ba-b1f0-d51064acd5ae-openshift-service-ca\") pod \"maas-api-698bfd7f85-8nzqw\" (UID: \"85adcf85-238e-41ba-b1f0-d51064acd5ae\") " pod="odh-ai-gateway-infra/maas-api-698bfd7f85-8nzqw"
Sep 10 18:16:24.038749 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:24.038563    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wg2cs\" (UniqueName: \"kubernetes.io/projected/85adcf85-238e-41ba-b1f0-d51064acd5ae-kube-api-access-wg2cs\") pod \"maas-api-698bfd7f85-8nzqw\" (UID: \"85adcf85-238e-41ba-b1f0-d51064acd5ae\") " pod="odh-ai-gateway-infra/maas-api-698bfd7f85-8nzqw"
Sep 10 18:16:24.038749 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:24.038606    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/85adcf85-238e-41ba-b1f0-d51064acd5ae-metrics-certs\") pod \"maas-api-698bfd7f85-8nzqw\" (UID: \"85adcf85-238e-41ba-b1f0-d51064acd5ae\") " pod="odh-ai-gateway-infra/maas-api-698bfd7f85-8nzqw"
Sep 10 18:16:24.039685 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:24.039654    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/85adcf85-238e-41ba-b1f0-d51064acd5ae-openshift-service-ca\") pod \"maas-api-698bfd7f85-8nzqw\" (UID: \"85adcf85-238e-41ba-b1f0-d51064acd5ae\") " pod="odh-ai-gateway-infra/maas-api-698bfd7f85-8nzqw"
Sep 10 18:16:24.042712 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:24.042646    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/85adcf85-238e-41ba-b1f0-d51064acd5ae-maas-api-tls\") pod \"maas-api-698bfd7f85-8nzqw\" (UID: \"85adcf85-238e-41ba-b1f0-d51064acd5ae\") " pod="odh-ai-gateway-infra/maas-api-698bfd7f85-8nzqw"
Sep 10 18:16:24.043753 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:24.043690    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/85adcf85-238e-41ba-b1f0-d51064acd5ae-metrics-certs\") pod \"maas-api-698bfd7f85-8nzqw\" (UID: \"85adcf85-238e-41ba-b1f0-d51064acd5ae\") " pod="odh-ai-gateway-infra/maas-api-698bfd7f85-8nzqw"
Sep 10 18:16:24.048584 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:24.048552    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wg2cs\" (UniqueName: \"kubernetes.io/projected/85adcf85-238e-41ba-b1f0-d51064acd5ae-kube-api-access-wg2cs\") pod \"maas-api-698bfd7f85-8nzqw\" (UID: \"85adcf85-238e-41ba-b1f0-d51064acd5ae\") " pod="odh-ai-gateway-infra/maas-api-698bfd7f85-8nzqw"
Sep 10 18:16:24.123525 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:24.123445    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-54b46465b9-jc5jd"
Sep 10 18:16:24.189065 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:24.189022    2568 generic.go:356] "Generic (PLEG): container finished" podID="c99430ab-c479-450d-83f5-f5087b93f993" containerID="9d8849675fcc4fdf85692661c941764fd172f9e47d747b3942ecb0f13c23f145" exitCode=0
Sep 10 18:16:24.189250 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:24.189068    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-54b46465b9-jc5jd" event={"ID":"c99430ab-c479-450d-83f5-f5087b93f993","Type":"ContainerDied","Data":"9d8849675fcc4fdf85692661c941764fd172f9e47d747b3942ecb0f13c23f145"}
Sep 10 18:16:24.189250 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:24.189135    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-54b46465b9-jc5jd" event={"ID":"c99430ab-c479-450d-83f5-f5087b93f993","Type":"ContainerDied","Data":"07d747347e34937c20e4515103bf435f2bd089000dc696458f3cb25fcc50fcfd"}
Sep 10 18:16:24.189250 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:24.189161    2568 scope.go:117] "RemoveContainer" containerID="9d8849675fcc4fdf85692661c941764fd172f9e47d747b3942ecb0f13c23f145"
Sep 10 18:16:24.189250 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:24.189080    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-54b46465b9-jc5jd"
Sep 10 18:16:24.199103 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:24.199079    2568 scope.go:117] "RemoveContainer" containerID="9d8849675fcc4fdf85692661c941764fd172f9e47d747b3942ecb0f13c23f145"
Sep 10 18:16:24.199496 ip-10-0-136-161 kubenswrapper[2568]: E0910 18:16:24.199469    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d8849675fcc4fdf85692661c941764fd172f9e47d747b3942ecb0f13c23f145\": container with ID starting with 9d8849675fcc4fdf85692661c941764fd172f9e47d747b3942ecb0f13c23f145 not found: ID does not exist" containerID="9d8849675fcc4fdf85692661c941764fd172f9e47d747b3942ecb0f13c23f145"
Sep 10 18:16:24.199596 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:24.199504    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d8849675fcc4fdf85692661c941764fd172f9e47d747b3942ecb0f13c23f145"} err="failed to get container status \"9d8849675fcc4fdf85692661c941764fd172f9e47d747b3942ecb0f13c23f145\": rpc error: code = NotFound desc = could not find container \"9d8849675fcc4fdf85692661c941764fd172f9e47d747b3942ecb0f13c23f145\": container with ID starting with 9d8849675fcc4fdf85692661c941764fd172f9e47d747b3942ecb0f13c23f145 not found: ID does not exist"
Sep 10 18:16:24.240979 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:24.240935    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-57dqn\" (UniqueName: \"kubernetes.io/projected/c99430ab-c479-450d-83f5-f5087b93f993-kube-api-access-57dqn\") pod \"c99430ab-c479-450d-83f5-f5087b93f993\" (UID: \"c99430ab-c479-450d-83f5-f5087b93f993\") "
Sep 10 18:16:24.241144 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:24.241000    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c99430ab-c479-450d-83f5-f5087b93f993-metrics-certs\") pod \"c99430ab-c479-450d-83f5-f5087b93f993\" (UID: \"c99430ab-c479-450d-83f5-f5087b93f993\") "
Sep 10 18:16:24.241144 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:24.241030    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c99430ab-c479-450d-83f5-f5087b93f993-openshift-service-ca\") pod \"c99430ab-c479-450d-83f5-f5087b93f993\" (UID: \"c99430ab-c479-450d-83f5-f5087b93f993\") "
Sep 10 18:16:24.241144 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:24.241064    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c99430ab-c479-450d-83f5-f5087b93f993-maas-api-tls\") pod \"c99430ab-c479-450d-83f5-f5087b93f993\" (UID: \"c99430ab-c479-450d-83f5-f5087b93f993\") "
Sep 10 18:16:24.241619 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:24.241578    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c99430ab-c479-450d-83f5-f5087b93f993-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c99430ab-c479-450d-83f5-f5087b93f993" (UID: "c99430ab-c479-450d-83f5-f5087b93f993"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 18:16:24.243997 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:24.243966    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c99430ab-c479-450d-83f5-f5087b93f993-kube-api-access-57dqn" (OuterVolumeSpecName: "kube-api-access-57dqn") pod "c99430ab-c479-450d-83f5-f5087b93f993" (UID: "c99430ab-c479-450d-83f5-f5087b93f993"). InnerVolumeSpecName "kube-api-access-57dqn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 18:16:24.243997 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:24.243966    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c99430ab-c479-450d-83f5-f5087b93f993-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "c99430ab-c479-450d-83f5-f5087b93f993" (UID: "c99430ab-c479-450d-83f5-f5087b93f993"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 18:16:24.243997 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:24.243979    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c99430ab-c479-450d-83f5-f5087b93f993-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c99430ab-c479-450d-83f5-f5087b93f993" (UID: "c99430ab-c479-450d-83f5-f5087b93f993"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 18:16:24.252208 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:24.252174    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-698bfd7f85-8nzqw"
Sep 10 18:16:24.341746 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:24.341707    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-57dqn\" (UniqueName: \"kubernetes.io/projected/c99430ab-c479-450d-83f5-f5087b93f993-kube-api-access-57dqn\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 18:16:24.341746 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:24.341734    2568 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c99430ab-c479-450d-83f5-f5087b93f993-metrics-certs\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 18:16:24.341746 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:24.341746    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c99430ab-c479-450d-83f5-f5087b93f993-openshift-service-ca\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 18:16:24.341746 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:24.341756    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c99430ab-c479-450d-83f5-f5087b93f993-maas-api-tls\") on node \"ip-10-0-136-161.ec2.internal\" DevicePath \"\""
Sep 10 18:16:24.512182 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:24.512145    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-54b46465b9-jc5jd"]
Sep 10 18:16:24.515115 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:24.515081    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-54b46465b9-jc5jd"]
Sep 10 18:16:24.527076 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:24.527049    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-698bfd7f85-8nzqw"]
Sep 10 18:16:24.528930 ip-10-0-136-161 kubenswrapper[2568]: W0910 18:16:24.528904    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85adcf85_238e_41ba_b1f0_d51064acd5ae.slice/crio-2ee7d21bc47e16f7a50b68b3b31317590a8bca75e17df84c81846a5eb3ce85a1 WatchSource:0}: Error finding container 2ee7d21bc47e16f7a50b68b3b31317590a8bca75e17df84c81846a5eb3ce85a1: Status 404 returned error can't find the container with id 2ee7d21bc47e16f7a50b68b3b31317590a8bca75e17df84c81846a5eb3ce85a1
Sep 10 18:16:24.770216 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:24.770132    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c99430ab-c479-450d-83f5-f5087b93f993" path="/var/lib/kubelet/pods/c99430ab-c479-450d-83f5-f5087b93f993/volumes"
Sep 10 18:16:25.197591 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:25.197497    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-698bfd7f85-8nzqw" event={"ID":"85adcf85-238e-41ba-b1f0-d51064acd5ae","Type":"ContainerStarted","Data":"95ade31d955a513469287024dddb400f9bf664c69780bcaa33159afd28d47c9f"}
Sep 10 18:16:25.197591 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:25.197549    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-698bfd7f85-8nzqw" event={"ID":"85adcf85-238e-41ba-b1f0-d51064acd5ae","Type":"ContainerStarted","Data":"2ee7d21bc47e16f7a50b68b3b31317590a8bca75e17df84c81846a5eb3ce85a1"}
Sep 10 18:16:25.198013 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:25.197626    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-698bfd7f85-8nzqw"
Sep 10 18:16:25.214817 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:25.214765    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-698bfd7f85-8nzqw" podStartSLOduration=1.8582164030000001 podStartE2EDuration="2.214744966s" totalImagesPullingTime="356.528563ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 18:16:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 18:16:25.212685898 +0000 UTC m=+2120.973993941" watchObservedRunningTime="2026-09-10 18:16:25.214744966 +0000 UTC m=+2120.976053009"
Sep 10 18:16:31.207993 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:31.207960    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-698bfd7f85-8nzqw"
Sep 10 18:16:55.251524 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:55.251491    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-x2fbn_0b1d6d50-f875-46b9-b2fc-9343c7c5d49d/manager/0.log"
Sep 10 18:16:55.366246 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:55.366209    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-d7nb8_c732730f-9840-4992-b47d-54405558d7fc/manager/0.log"
Sep 10 18:16:55.484131 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:55.484099    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7df97ff6cc-2n9ct_bde0667b-c953-4fed-83b4-5f0b37be3063/manager/0.log"
Sep 10 18:16:55.594844 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:55.594766    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-92bvc_aaf8f3ee-7c51-4d32-9920-0cd5b198f4e9/server/0.log"
Sep 10 18:16:55.830768 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:55.830740    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-556447cf57-6zckr_46182237-0b16-4545-be26-ea43a91fd9ee/copy-manifests/0.log"
Sep 10 18:16:55.844023 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:55.843984    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-556447cf57-6zckr_46182237-0b16-4545-be26-ea43a91fd9ee/manager/0.log"
Sep 10 18:16:56.546718 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:56.546684    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-698bfd7f85-8nzqw_85adcf85-238e-41ba-b1f0-d51064acd5ae/maas-api/0.log"
Sep 10 18:16:56.659175 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:56.659139    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29817720-4fstp_ba692344-381a-4c8e-ae90-55301e1a987c/cleanup/0.log"
Sep 10 18:16:56.773797 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:56.773770    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29817735-7cxsz_40f33186-2c30-4018-9162-50ac92dee749/cleanup/0.log"
Sep 10 18:16:56.887924 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:56.887814    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-q5h5n_7c8bd3c5-efe6-4fdb-b6ff-4955854c3da0/postgres/0.log"
Sep 10 18:16:57.770898 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:57.770859    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-bddkx_a44b3f30-f474-4486-949c-fc0753c6339a/manager/0.log"
Sep 10 18:16:57.882180 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:57.882150    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-27s46_dfc3f07e-b209-4135-8a50-418754e2aa56/manager/0.log"
Sep 10 18:16:57.990070 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:57.990045    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-4x2vt_b580d504-b549-49ab-824f-368794761193/kuadrant-console-plugin/0.log"
Sep 10 18:16:58.112304 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:58.112216    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-6xt4v_7b44a982-9281-45a8-9017-c5e645fb3a89/manager/0.log"
Sep 10 18:16:58.363119 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:58.363034    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-rqdc8_1c6b43c8-ded5-4f31-ba6d-26403175fbfb/manager/0.log"
Sep 10 18:16:58.965052 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:58.965021    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5c775fbbf-sbr8v_87b9586a-ebc1-451b-829b-896d50a75b34/kube-auth-proxy/0.log"
Sep 10 18:16:59.452032 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:16:59.451993    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-vqpk8_5b4bc747-b99d-4bf5-b1ac-4a60ca137839/payload-processing/0.log"
Sep 10 18:17:00.140391 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:17:00.140355    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-bcc9ff8d8-9w6r5_4c1a6955-fcc1-4cce-9d04-6d333ff6d0da/main/0.log"
Sep 10 18:17:00.250733 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:17:00.250702    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-829cl_8ff35a61-46cf-482e-b409-12afdaaca041/main/0.log"
Sep 10 18:17:06.370812 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:17:06.370721    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-h9jz8/must-gather-t9jm8"]
Sep 10 18:17:06.371216 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:17:06.371139    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c99430ab-c479-450d-83f5-f5087b93f993" containerName="maas-api"
Sep 10 18:17:06.371216 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:17:06.371154    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="c99430ab-c479-450d-83f5-f5087b93f993" containerName="maas-api"
Sep 10 18:17:06.371288 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:17:06.371229    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="c99430ab-c479-450d-83f5-f5087b93f993" containerName="maas-api"
Sep 10 18:17:06.376014 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:17:06.375994    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-h9jz8/must-gather-t9jm8"
Sep 10 18:17:06.378740 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:17:06.378712    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-h9jz8\"/\"kube-root-ca.crt\""
Sep 10 18:17:06.378911 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:17:06.378790    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-h9jz8\"/\"openshift-service-ca.crt\""
Sep 10 18:17:06.379963 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:17:06.379921    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-h9jz8\"/\"default-dockercfg-zgjz4\""
Sep 10 18:17:06.382620 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:17:06.382593    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-h9jz8/must-gather-t9jm8"]
Sep 10 18:17:06.411164 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:17:06.411126    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztlmb\" (UniqueName: \"kubernetes.io/projected/86322b8f-f399-42e5-8149-b783b468c22a-kube-api-access-ztlmb\") pod \"must-gather-t9jm8\" (UID: \"86322b8f-f399-42e5-8149-b783b468c22a\") " pod="openshift-must-gather-h9jz8/must-gather-t9jm8"
Sep 10 18:17:06.411164 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:17:06.411168    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/86322b8f-f399-42e5-8149-b783b468c22a-must-gather-output\") pod \"must-gather-t9jm8\" (UID: \"86322b8f-f399-42e5-8149-b783b468c22a\") " pod="openshift-must-gather-h9jz8/must-gather-t9jm8"
Sep 10 18:17:06.512427 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:17:06.512388    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztlmb\" (UniqueName: \"kubernetes.io/projected/86322b8f-f399-42e5-8149-b783b468c22a-kube-api-access-ztlmb\") pod \"must-gather-t9jm8\" (UID: \"86322b8f-f399-42e5-8149-b783b468c22a\") " pod="openshift-must-gather-h9jz8/must-gather-t9jm8"
Sep 10 18:17:06.512644 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:17:06.512443    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/86322b8f-f399-42e5-8149-b783b468c22a-must-gather-output\") pod \"must-gather-t9jm8\" (UID: \"86322b8f-f399-42e5-8149-b783b468c22a\") " pod="openshift-must-gather-h9jz8/must-gather-t9jm8"
Sep 10 18:17:06.512831 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:17:06.512808    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/86322b8f-f399-42e5-8149-b783b468c22a-must-gather-output\") pod \"must-gather-t9jm8\" (UID: \"86322b8f-f399-42e5-8149-b783b468c22a\") " pod="openshift-must-gather-h9jz8/must-gather-t9jm8"
Sep 10 18:17:06.520099 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:17:06.520071    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztlmb\" (UniqueName: \"kubernetes.io/projected/86322b8f-f399-42e5-8149-b783b468c22a-kube-api-access-ztlmb\") pod \"must-gather-t9jm8\" (UID: \"86322b8f-f399-42e5-8149-b783b468c22a\") " pod="openshift-must-gather-h9jz8/must-gather-t9jm8"
Sep 10 18:17:06.686887 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:17:06.686798    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-h9jz8/must-gather-t9jm8"
Sep 10 18:17:06.961843 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:17:06.961678    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-h9jz8/must-gather-t9jm8"]
Sep 10 18:17:06.964149 ip-10-0-136-161 kubenswrapper[2568]: W0910 18:17:06.964122    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod86322b8f_f399_42e5_8149_b783b468c22a.slice/crio-64aeb37f2ede282222fc15da35c6548333b0537b4d57442a8650f5169720ed9f WatchSource:0}: Error finding container 64aeb37f2ede282222fc15da35c6548333b0537b4d57442a8650f5169720ed9f: Status 404 returned error can't find the container with id 64aeb37f2ede282222fc15da35c6548333b0537b4d57442a8650f5169720ed9f
Sep 10 18:17:07.442534 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:17:07.442487    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-h9jz8/must-gather-t9jm8" event={"ID":"86322b8f-f399-42e5-8149-b783b468c22a","Type":"ContainerStarted","Data":"64aeb37f2ede282222fc15da35c6548333b0537b4d57442a8650f5169720ed9f"}
Sep 10 18:17:08.454967 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:17:08.454923    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-h9jz8/must-gather-t9jm8" event={"ID":"86322b8f-f399-42e5-8149-b783b468c22a","Type":"ContainerStarted","Data":"edd6446c840456ef19af96068065476c55885c62f50fbb3cf3457ea35f9021ae"}
Sep 10 18:17:08.455414 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:17:08.454985    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-h9jz8/must-gather-t9jm8" event={"ID":"86322b8f-f399-42e5-8149-b783b468c22a","Type":"ContainerStarted","Data":"c899a11bfa2af631b87d4fb9b20c7a7a106696fe14722b0332c2c09c6f1db00b"}
Sep 10 18:17:08.472537 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:17:08.472454    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-h9jz8/must-gather-t9jm8" podStartSLOduration=1.586080103 podStartE2EDuration="2.472429461s" totalImagesPullingTime="886.349358ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 18:17:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 18:17:08.46914559 +0000 UTC m=+2164.230453634" watchObservedRunningTime="2026-09-10 18:17:08.472429461 +0000 UTC m=+2164.233737506"
Sep 10 18:17:09.338733 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:17:09.338701    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-gqqkd_1df8c233-a191-43e9-9d86-4a191bd54b1e/global-pull-secret-syncer/0.log"
Sep 10 18:17:09.499105 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:17:09.499072    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-t9bvv_bdb7b7f1-3f2e-4c52-917e-c428b50fcbcf/konnectivity-agent/0.log"
Sep 10 18:17:09.572437 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:17:09.572396    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-161.ec2.internal_14fa913fd221d63bd218ae72b03b88e8/haproxy/0.log"
Sep 10 18:17:14.872203 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:17:14.872156    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-bddkx_a44b3f30-f474-4486-949c-fc0753c6339a/manager/0.log"
Sep 10 18:17:14.896555 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:17:14.896517    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-27s46_dfc3f07e-b209-4135-8a50-418754e2aa56/manager/0.log"
Sep 10 18:17:14.918910 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:17:14.918871    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-4x2vt_b580d504-b549-49ab-824f-368794761193/kuadrant-console-plugin/0.log"
Sep 10 18:17:14.960034 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:17:14.959992    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-6xt4v_7b44a982-9281-45a8-9017-c5e645fb3a89/manager/0.log"
Sep 10 18:17:15.046601 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:17:15.046563    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-rqdc8_1c6b43c8-ded5-4f31-ba6d-26403175fbfb/manager/0.log"
Sep 10 18:17:16.681029 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:17:16.681001    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hsfv6_012c8a9c-a3fd-4e5e-bb99-d116da21f74f/node-exporter/0.log"
Sep 10 18:17:16.697590 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:17:16.697564    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hsfv6_012c8a9c-a3fd-4e5e-bb99-d116da21f74f/kube-rbac-proxy/0.log"
Sep 10 18:17:16.717842 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:17:16.717739    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hsfv6_012c8a9c-a3fd-4e5e-bb99-d116da21f74f/init-textfile/0.log"
Sep 10 18:17:19.358159 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:17:19.358116    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-jwfnv_e90054ec-91dc-4cda-94a2-fbe7a2a1fff0/console-operator/1.log"
Sep 10 18:17:19.365871 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:17:19.365828    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-jwfnv_e90054ec-91dc-4cda-94a2-fbe7a2a1fff0/console-operator/2.log"
Sep 10 18:17:20.133990 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:17:20.133949    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-h9jz8/perf-node-gather-daemonset-whcln"]
Sep 10 18:17:20.142218 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:17:20.142178    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-h9jz8/perf-node-gather-daemonset-whcln"
Sep 10 18:17:20.147007 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:17:20.146968    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-h9jz8/perf-node-gather-daemonset-whcln"]
Sep 10 18:17:20.250063 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:17:20.250023    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/826a9481-ae6f-4fc3-ab3d-cb95cc0818a9-proc\") pod \"perf-node-gather-daemonset-whcln\" (UID: \"826a9481-ae6f-4fc3-ab3d-cb95cc0818a9\") " pod="openshift-must-gather-h9jz8/perf-node-gather-daemonset-whcln"
Sep 10 18:17:20.250280 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:17:20.250086    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7wmv\" (UniqueName: \"kubernetes.io/projected/826a9481-ae6f-4fc3-ab3d-cb95cc0818a9-kube-api-access-c7wmv\") pod \"perf-node-gather-daemonset-whcln\" (UID: \"826a9481-ae6f-4fc3-ab3d-cb95cc0818a9\") " pod="openshift-must-gather-h9jz8/perf-node-gather-daemonset-whcln"
Sep 10 18:17:20.250280 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:17:20.250120    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/826a9481-ae6f-4fc3-ab3d-cb95cc0818a9-sys\") pod \"perf-node-gather-daemonset-whcln\" (UID: \"826a9481-ae6f-4fc3-ab3d-cb95cc0818a9\") " pod="openshift-must-gather-h9jz8/perf-node-gather-daemonset-whcln"
Sep 10 18:17:20.250280 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:17:20.250169    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/826a9481-ae6f-4fc3-ab3d-cb95cc0818a9-lib-modules\") pod \"perf-node-gather-daemonset-whcln\" (UID: \"826a9481-ae6f-4fc3-ab3d-cb95cc0818a9\") " pod="openshift-must-gather-h9jz8/perf-node-gather-daemonset-whcln"
Sep 10 18:17:20.250280 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:17:20.250196    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/826a9481-ae6f-4fc3-ab3d-cb95cc0818a9-podres\") pod \"perf-node-gather-daemonset-whcln\" (UID: \"826a9481-ae6f-4fc3-ab3d-cb95cc0818a9\") " pod="openshift-must-gather-h9jz8/perf-node-gather-daemonset-whcln"
Sep 10 18:17:20.351792 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:17:20.351750    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/826a9481-ae6f-4fc3-ab3d-cb95cc0818a9-proc\") pod \"perf-node-gather-daemonset-whcln\" (UID: \"826a9481-ae6f-4fc3-ab3d-cb95cc0818a9\") " pod="openshift-must-gather-h9jz8/perf-node-gather-daemonset-whcln"
Sep 10 18:17:20.351997 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:17:20.351817    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7wmv\" (UniqueName: \"kubernetes.io/projected/826a9481-ae6f-4fc3-ab3d-cb95cc0818a9-kube-api-access-c7wmv\") pod \"perf-node-gather-daemonset-whcln\" (UID: \"826a9481-ae6f-4fc3-ab3d-cb95cc0818a9\") " pod="openshift-must-gather-h9jz8/perf-node-gather-daemonset-whcln"
Sep 10 18:17:20.351997 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:17:20.351845    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/826a9481-ae6f-4fc3-ab3d-cb95cc0818a9-sys\") pod \"perf-node-gather-daemonset-whcln\" (UID: \"826a9481-ae6f-4fc3-ab3d-cb95cc0818a9\") " pod="openshift-must-gather-h9jz8/perf-node-gather-daemonset-whcln"
Sep 10 18:17:20.351997 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:17:20.351889    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/826a9481-ae6f-4fc3-ab3d-cb95cc0818a9-lib-modules\") pod \"perf-node-gather-daemonset-whcln\" (UID: \"826a9481-ae6f-4fc3-ab3d-cb95cc0818a9\") " pod="openshift-must-gather-h9jz8/perf-node-gather-daemonset-whcln"
Sep 10 18:17:20.351997 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:17:20.351894    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/826a9481-ae6f-4fc3-ab3d-cb95cc0818a9-proc\") pod \"perf-node-gather-daemonset-whcln\" (UID: \"826a9481-ae6f-4fc3-ab3d-cb95cc0818a9\") " pod="openshift-must-gather-h9jz8/perf-node-gather-daemonset-whcln"
Sep 10 18:17:20.351997 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:17:20.351917    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/826a9481-ae6f-4fc3-ab3d-cb95cc0818a9-podres\") pod \"perf-node-gather-daemonset-whcln\" (UID: \"826a9481-ae6f-4fc3-ab3d-cb95cc0818a9\") " pod="openshift-must-gather-h9jz8/perf-node-gather-daemonset-whcln"
Sep 10 18:17:20.352260 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:17:20.352031    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/826a9481-ae6f-4fc3-ab3d-cb95cc0818a9-sys\") pod \"perf-node-gather-daemonset-whcln\" (UID: \"826a9481-ae6f-4fc3-ab3d-cb95cc0818a9\") " pod="openshift-must-gather-h9jz8/perf-node-gather-daemonset-whcln"
Sep 10 18:17:20.352260 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:17:20.352042    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/826a9481-ae6f-4fc3-ab3d-cb95cc0818a9-podres\") pod \"perf-node-gather-daemonset-whcln\" (UID: \"826a9481-ae6f-4fc3-ab3d-cb95cc0818a9\") " pod="openshift-must-gather-h9jz8/perf-node-gather-daemonset-whcln"
Sep 10 18:17:20.352260 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:17:20.352152    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/826a9481-ae6f-4fc3-ab3d-cb95cc0818a9-lib-modules\") pod \"perf-node-gather-daemonset-whcln\" (UID: \"826a9481-ae6f-4fc3-ab3d-cb95cc0818a9\") " pod="openshift-must-gather-h9jz8/perf-node-gather-daemonset-whcln"
Sep 10 18:17:20.360422 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:17:20.360388    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7wmv\" (UniqueName: \"kubernetes.io/projected/826a9481-ae6f-4fc3-ab3d-cb95cc0818a9-kube-api-access-c7wmv\") pod \"perf-node-gather-daemonset-whcln\" (UID: \"826a9481-ae6f-4fc3-ab3d-cb95cc0818a9\") " pod="openshift-must-gather-h9jz8/perf-node-gather-daemonset-whcln"
Sep 10 18:17:20.458840 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:17:20.458747    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-h9jz8/perf-node-gather-daemonset-whcln"
Sep 10 18:17:20.775743 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:17:20.775125    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-h9jz8/perf-node-gather-daemonset-whcln"]
Sep 10 18:17:20.776534 ip-10-0-136-161 kubenswrapper[2568]: W0910 18:17:20.776496    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod826a9481_ae6f_4fc3_ab3d_cb95cc0818a9.slice/crio-52d4d685a22c7f27ac4d2bdc98eae3222b3c4a47332f40ddc2aa79956881281e WatchSource:0}: Error finding container 52d4d685a22c7f27ac4d2bdc98eae3222b3c4a47332f40ddc2aa79956881281e: Status 404 returned error can't find the container with id 52d4d685a22c7f27ac4d2bdc98eae3222b3c4a47332f40ddc2aa79956881281e
Sep 10 18:17:21.563464 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:17:21.563409    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-h9jz8/perf-node-gather-daemonset-whcln" event={"ID":"826a9481-ae6f-4fc3-ab3d-cb95cc0818a9","Type":"ContainerStarted","Data":"4c2ed3d8ea4fd2a53f3fa1f846c36719ae9a20eb537c9583d00d65de7283983b"}
Sep 10 18:17:21.563936 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:17:21.563474    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-h9jz8/perf-node-gather-daemonset-whcln" event={"ID":"826a9481-ae6f-4fc3-ab3d-cb95cc0818a9","Type":"ContainerStarted","Data":"52d4d685a22c7f27ac4d2bdc98eae3222b3c4a47332f40ddc2aa79956881281e"}
Sep 10 18:17:21.563936 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:17:21.563538    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-h9jz8/perf-node-gather-daemonset-whcln"
Sep 10 18:17:21.582343 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:17:21.582258    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-h9jz8/perf-node-gather-daemonset-whcln" podStartSLOduration=1.5822405659999998 podStartE2EDuration="1.582240566s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 18:17:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 18:17:21.577781332 +0000 UTC m=+2177.339089376" watchObservedRunningTime="2026-09-10 18:17:21.582240566 +0000 UTC m=+2177.343548609"
Sep 10 18:17:21.888845 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:17:21.888769    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-n64rx_3a37cb7c-2638-48d0-83c2-d039ac7b6771/dns/0.log"
Sep 10 18:17:21.907207 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:17:21.907175    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-n64rx_3a37cb7c-2638-48d0-83c2-d039ac7b6771/kube-rbac-proxy/0.log"
Sep 10 18:17:21.944561 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:17:21.944532    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dwtws_01467fcf-2ddb-42da-812a-964dc8a1504f/dns-node-resolver/0.log"
Sep 10 18:17:22.486749 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:17:22.486711    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7jrjh_f45056e2-bd13-4829-a897-7cd4a829af0e/node-ca/0.log"
Sep 10 18:17:23.639457 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:17:23.639424    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5c775fbbf-sbr8v_87b9586a-ebc1-451b-829b-896d50a75b34/kube-auth-proxy/0.log"
Sep 10 18:17:23.763164 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:17:23.763121    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-vqpk8_5b4bc747-b99d-4bf5-b1ac-4a60ca137839/payload-processing/0.log"
Sep 10 18:17:24.655853 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:17:24.655816    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-n8gr2_77340c83-f0c1-4617-a0df-dc686674f941/serve-healthcheck-canary/0.log"
Sep 10 18:17:25.110011 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:17:25.109979    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-8hhtb_50081a35-70d7-41dd-88af-176fb4aca5d6/insights-operator/0.log"
Sep 10 18:17:25.110330 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:17:25.110303    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-8hhtb_50081a35-70d7-41dd-88af-176fb4aca5d6/insights-operator/1.log"
Sep 10 18:17:25.127191 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:17:25.127159    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7tjtv_a2e1b47d-cb55-4328-bbb6-4bd6d5424abf/kube-rbac-proxy/0.log"
Sep 10 18:17:25.146036 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:17:25.146011    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7tjtv_a2e1b47d-cb55-4328-bbb6-4bd6d5424abf/exporter/0.log"
Sep 10 18:17:25.163470 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:17:25.163439    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7tjtv_a2e1b47d-cb55-4328-bbb6-4bd6d5424abf/extractor/0.log"
Sep 10 18:17:27.321238 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:17:27.321205    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-x2fbn_0b1d6d50-f875-46b9-b2fc-9343c7c5d49d/manager/0.log"
Sep 10 18:17:27.547548 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:17:27.547510    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-d7nb8_c732730f-9840-4992-b47d-54405558d7fc/manager/0.log"
Sep 10 18:17:27.587998 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:17:27.587907    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-h9jz8/perf-node-gather-daemonset-whcln"
Sep 10 18:17:27.600372 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:17:27.600340    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7df97ff6cc-2n9ct_bde0667b-c953-4fed-83b4-5f0b37be3063/manager/0.log"
Sep 10 18:17:27.619215 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:17:27.619189    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-92bvc_aaf8f3ee-7c51-4d32-9920-0cd5b198f4e9/server/0.log"
Sep 10 18:17:27.773811 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:17:27.773772    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-556447cf57-6zckr_46182237-0b16-4545-be26-ea43a91fd9ee/manager/0.log"
Sep 10 18:17:27.788026 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:17:27.787999    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-556447cf57-6zckr_46182237-0b16-4545-be26-ea43a91fd9ee/copy-manifests/0.log"
Sep 10 18:17:29.158458 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:17:29.158423    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-tzgsz_e8e62bff-8348-478c-85de-a31f0ebd0404/openshift-lws-operator/0.log"
Sep 10 18:17:31.206559 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:17:31.206529    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5c775fbbf-sbr8v_87b9586a-ebc1-451b-829b-896d50a75b34/kube-auth-proxy/0.log"
Sep 10 18:17:31.316127 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:17:31.316093    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-vqpk8_5b4bc747-b99d-4bf5-b1ac-4a60ca137839/payload-processing/0.log"
Sep 10 18:17:33.259176 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:17:33.259126    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5c775fbbf-sbr8v_87b9586a-ebc1-451b-829b-896d50a75b34/kube-auth-proxy/0.log"
Sep 10 18:17:33.361310 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:17:33.361194    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-vqpk8_5b4bc747-b99d-4bf5-b1ac-4a60ca137839/payload-processing/0.log"
Sep 10 18:17:35.825494 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:17:35.825462    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8xsvx_774f7882-94da-4a71-a091-32054dc8d27c/kube-multus-additional-cni-plugins/0.log"
Sep 10 18:17:35.843557 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:17:35.843523    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8xsvx_774f7882-94da-4a71-a091-32054dc8d27c/egress-router-binary-copy/0.log"
Sep 10 18:17:35.862372 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:17:35.862337    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8xsvx_774f7882-94da-4a71-a091-32054dc8d27c/cni-plugins/0.log"
Sep 10 18:17:35.878893 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:17:35.878865    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8xsvx_774f7882-94da-4a71-a091-32054dc8d27c/bond-cni-plugin/0.log"
Sep 10 18:17:35.896779 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:17:35.896742    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8xsvx_774f7882-94da-4a71-a091-32054dc8d27c/routeoverride-cni/0.log"
Sep 10 18:17:35.914156 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:17:35.914124    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8xsvx_774f7882-94da-4a71-a091-32054dc8d27c/whereabouts-cni-bincopy/0.log"
Sep 10 18:17:35.930822 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:17:35.930789    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8xsvx_774f7882-94da-4a71-a091-32054dc8d27c/whereabouts-cni/0.log"
Sep 10 18:17:36.237491 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:17:36.237454    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-cz2hn_64722621-3413-45b1-be7b-7a9a5a075215/kube-multus/0.log"
Sep 10 18:17:36.334524 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:17:36.334489    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-76dl2_4f8b428e-98e7-4306-b485-d39e9b22eb05/network-metrics-daemon/0.log"
Sep 10 18:17:36.347599 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:17:36.347567    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-76dl2_4f8b428e-98e7-4306-b485-d39e9b22eb05/kube-rbac-proxy/0.log"
Sep 10 18:17:37.403570 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:17:37.403485    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f9cn7_915faba9-e43b-4bdf-ab08-6063e393da6e/ovn-controller/0.log"
Sep 10 18:17:37.416608 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:17:37.416579    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f9cn7_915faba9-e43b-4bdf-ab08-6063e393da6e/ovn-acl-logging/0.log"
Sep 10 18:17:37.435892 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:17:37.435864    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f9cn7_915faba9-e43b-4bdf-ab08-6063e393da6e/kube-rbac-proxy-node/0.log"
Sep 10 18:17:37.452177 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:17:37.452146    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f9cn7_915faba9-e43b-4bdf-ab08-6063e393da6e/kube-rbac-proxy-ovn-metrics/0.log"
Sep 10 18:17:37.466900 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:17:37.466867    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f9cn7_915faba9-e43b-4bdf-ab08-6063e393da6e/northd/0.log"
Sep 10 18:17:37.483742 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:17:37.483699    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f9cn7_915faba9-e43b-4bdf-ab08-6063e393da6e/nbdb/0.log"
Sep 10 18:17:37.501014 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:17:37.500988    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f9cn7_915faba9-e43b-4bdf-ab08-6063e393da6e/sbdb/0.log"
Sep 10 18:17:37.571374 ip-10-0-136-161 kubenswrapper[2568]: I0910 18:17:37.571340    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f9cn7_915faba9-e43b-4bdf-ab08-6063e393da6e/ovnkube-controller/0.log"