Sep 15 13:36:37.878368 ip-10-0-128-41 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 15 13:36:37.878380 ip-10-0-128-41 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 15 13:36:37.878387 ip-10-0-128-41 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 15 13:36:37.878686 ip-10-0-128-41 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 15 13:36:47.969186 ip-10-0-128-41 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 15 13:36:47.969202 ip-10-0-128-41 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 2ff3ac02e0ff4bacb709765d524082d4 --
Sep 15 13:38:32.061675 ip-10-0-128-41 systemd[1]: Starting Kubernetes Kubelet...
Sep 15 13:38:32.485703 ip-10-0-128-41 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 15 13:38:32.485703 ip-10-0-128-41 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 15 13:38:32.485703 ip-10-0-128-41 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 15 13:38:32.485703 ip-10-0-128-41 kubenswrapper[2578]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 15 13:38:32.485703 ip-10-0-128-41 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 15 13:38:32.486735 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.486655    2578 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 15 13:38:32.489876 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.489861    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 13:38:32.489876 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.489876    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 13:38:32.489947 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.489880    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 13:38:32.489947 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.489883    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 13:38:32.489947 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.489885    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 13:38:32.489947 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.489888    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 13:38:32.489947 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.489891    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 13:38:32.489947 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.489893    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 13:38:32.489947 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.489896    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 13:38:32.489947 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.489898    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 13:38:32.489947 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.489901    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 13:38:32.489947 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.489903    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 13:38:32.489947 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.489910    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 13:38:32.489947 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.489913    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 13:38:32.489947 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.489916    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 13:38:32.489947 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.489918    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 13:38:32.489947 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.489921    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 13:38:32.489947 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.489924    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 13:38:32.489947 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.489927    2578 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 13:38:32.489947 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.489929    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 13:38:32.489947 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.489932    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 13:38:32.489947 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.489934    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 13:38:32.490427 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.489937    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 13:38:32.490427 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.489939    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 13:38:32.490427 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.489941    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 13:38:32.490427 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.489944    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 13:38:32.490427 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.489947    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 13:38:32.490427 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.489950    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 13:38:32.490427 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.489953    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 13:38:32.490427 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.489955    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 13:38:32.490427 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.489959    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 13:38:32.490427 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.489961    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 13:38:32.490427 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.489964    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 13:38:32.490427 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.489966    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 13:38:32.490427 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.489968    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 13:38:32.490427 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.489971    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 13:38:32.490427 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.489973    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 13:38:32.490427 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.489976    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 13:38:32.490427 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.489979    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 13:38:32.490427 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.489983    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 13:38:32.490427 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.489986    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 13:38:32.490888 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.489989    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 13:38:32.490888 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.489992    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 13:38:32.490888 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.489995    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 13:38:32.490888 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.489998    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 13:38:32.490888 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490001    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 13:38:32.490888 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490003    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 13:38:32.490888 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490006    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 13:38:32.490888 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490009    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 13:38:32.490888 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490011    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 13:38:32.490888 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490014    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 13:38:32.490888 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490017    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 13:38:32.490888 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490019    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 13:38:32.490888 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490023    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 13:38:32.490888 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490027    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 13:38:32.490888 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490031    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 13:38:32.490888 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490034    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 13:38:32.490888 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490036    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 13:38:32.490888 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490039    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 13:38:32.490888 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490043    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 13:38:32.491364 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490046    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 13:38:32.491364 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490049    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 13:38:32.491364 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490052    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 13:38:32.491364 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490055    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 13:38:32.491364 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490058    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 13:38:32.491364 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490061    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 13:38:32.491364 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490064    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 13:38:32.491364 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490066    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 13:38:32.491364 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490069    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 13:38:32.491364 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490071    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 13:38:32.491364 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490073    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 13:38:32.491364 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490077    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 13:38:32.491364 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490079    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 13:38:32.491364 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490082    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 13:38:32.491364 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490084    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 13:38:32.491364 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490087    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 13:38:32.491364 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490089    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 13:38:32.491364 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490091    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 13:38:32.491364 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490094    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 13:38:32.491364 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490096    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 13:38:32.491860 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490099    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 13:38:32.491860 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490101    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 13:38:32.491860 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490104    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 13:38:32.491860 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490106    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 13:38:32.491860 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490109    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 13:38:32.491860 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490111    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 13:38:32.491860 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490114    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 13:38:32.491860 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490118    2578 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 13:38:32.491860 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490120    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 13:38:32.491860 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490123    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 13:38:32.491860 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490126    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 13:38:32.491860 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490128    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 13:38:32.491860 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490130    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 13:38:32.491860 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490133    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 13:38:32.491860 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490135    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 13:38:32.491860 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490138    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 13:38:32.491860 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490140    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 13:38:32.491860 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490143    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 13:38:32.491860 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490145    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 13:38:32.491860 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490843    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 13:38:32.492343 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490849    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 13:38:32.492343 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490852    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 13:38:32.492343 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490857    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 13:38:32.492343 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490861    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 13:38:32.492343 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490865    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 13:38:32.492343 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490868    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 13:38:32.492343 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490871    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 13:38:32.492343 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490874    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 13:38:32.492343 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490877    2578 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 13:38:32.492343 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490879    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 13:38:32.492343 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490883    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 13:38:32.492343 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490886    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 13:38:32.492343 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490888    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 13:38:32.492343 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490891    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 13:38:32.492343 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490894    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 13:38:32.492343 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490897    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 13:38:32.492343 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490900    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 13:38:32.492343 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490903    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 13:38:32.492343 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490906    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 13:38:32.492831 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490909    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 13:38:32.492831 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490911    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 13:38:32.492831 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490914    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 13:38:32.492831 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490916    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 13:38:32.492831 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490919    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 13:38:32.492831 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490922    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 13:38:32.492831 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490925    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 13:38:32.492831 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490928    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 13:38:32.492831 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490930    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 13:38:32.492831 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490933    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 13:38:32.492831 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490935    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 13:38:32.492831 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490938    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 13:38:32.492831 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490940    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 13:38:32.492831 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490943    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 13:38:32.492831 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490945    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 13:38:32.492831 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490947    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 13:38:32.492831 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490950    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 13:38:32.492831 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490952    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 13:38:32.492831 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490955    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 13:38:32.492831 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490958    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 13:38:32.493323 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490961    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 13:38:32.493323 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490964    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 13:38:32.493323 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490966    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 13:38:32.493323 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490968    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 13:38:32.493323 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490971    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 13:38:32.493323 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490973    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 13:38:32.493323 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490975    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 13:38:32.493323 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490978    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 13:38:32.493323 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490980    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 13:38:32.493323 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490982    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 13:38:32.493323 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490985    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 13:38:32.493323 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490988    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 13:38:32.493323 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490991    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 13:38:32.493323 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490994    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 13:38:32.493323 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.490996    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 13:38:32.493323 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491000    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 13:38:32.493323 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491002    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 13:38:32.493323 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491005    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 13:38:32.493323 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491008    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 13:38:32.493822 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491010    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 13:38:32.493822 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491013    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 13:38:32.493822 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491015    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 13:38:32.493822 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491017    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 13:38:32.493822 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491020    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 13:38:32.493822 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491022    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 13:38:32.493822 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491024    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 13:38:32.493822 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491027    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 13:38:32.493822 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491029    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 13:38:32.493822 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491032    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 13:38:32.493822 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491034    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 13:38:32.493822 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491037    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 13:38:32.493822 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491045    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 13:38:32.493822 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491047    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 13:38:32.493822 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491052    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 13:38:32.493822 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491055    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 13:38:32.493822 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491057    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 13:38:32.493822 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491060    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 13:38:32.493822 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491063    2578 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 13:38:32.493822 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491066    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 13:38:32.494318 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491068    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 13:38:32.494318 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491071    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 13:38:32.494318 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491074    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 13:38:32.494318 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491077    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 13:38:32.494318 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491080    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 13:38:32.494318 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491083    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 13:38:32.494318 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491086    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 13:38:32.494318 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491088    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 13:38:32.494318 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491091    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 13:38:32.494318 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491093    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 13:38:32.494318 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491096    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 13:38:32.494318 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491098    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 13:38:32.494318 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491100    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 13:38:32.494318 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491103    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 13:38:32.494318 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491105    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 13:38:32.494318 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491108    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 13:38:32.494318 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491110    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 13:38:32.494318 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491113    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 13:38:32.494318 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491115    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 13:38:32.494318 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491117    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 13:38:32.494807 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491509    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 13:38:32.494807 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491514    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 13:38:32.494807 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491517    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 13:38:32.494807 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491521    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 13:38:32.494807 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491525    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 13:38:32.494807 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491529    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 13:38:32.494807 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491532    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 13:38:32.494807 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491535    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 13:38:32.494807 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491537    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 13:38:32.494807 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491540    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 13:38:32.494807 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491543    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 13:38:32.494807 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491546    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 13:38:32.494807 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491549    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 13:38:32.494807 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491551    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 13:38:32.494807 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491553    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 13:38:32.494807 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491556    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 13:38:32.494807 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491559    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 13:38:32.494807 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491565    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 13:38:32.494807 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491568    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 13:38:32.495296 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491571    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 13:38:32.495296 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491573    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 13:38:32.495296 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491576    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 13:38:32.495296 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491578    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 13:38:32.495296 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491581    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 13:38:32.495296 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491583    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 13:38:32.495296 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491586    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 13:38:32.495296 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491588    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 13:38:32.495296 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491591    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 13:38:32.495296 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491593    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 13:38:32.495296 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491596    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 13:38:32.495296 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491599    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 13:38:32.495296 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491601    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 13:38:32.495296 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491604    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 13:38:32.495296 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491607    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 13:38:32.495296 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491609    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 13:38:32.495296 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491612    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 13:38:32.495296 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491614    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 13:38:32.495296 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491617    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 13:38:32.495769 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491620    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 13:38:32.495769 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491622    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 13:38:32.495769 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491625    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 13:38:32.495769 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491627    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 13:38:32.495769 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491629    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 13:38:32.495769 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491633    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 13:38:32.495769 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491635    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 13:38:32.495769 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491638    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 13:38:32.495769 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491640    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 13:38:32.495769 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491643    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 13:38:32.495769 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491645    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 13:38:32.495769 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491649    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 13:38:32.495769 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491651    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 13:38:32.495769 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491654    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 13:38:32.495769 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491657    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 13:38:32.495769 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491659    2578 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 13:38:32.495769 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491661    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 13:38:32.495769 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491664    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 13:38:32.495769 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491667    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 13:38:32.495769 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491669    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 13:38:32.496287 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491672    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 13:38:32.496287 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491674    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 13:38:32.496287 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491677    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 13:38:32.496287 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491679    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 13:38:32.496287 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491681    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 13:38:32.496287 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491684    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 13:38:32.496287 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491686    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 13:38:32.496287 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491689    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 13:38:32.496287 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491691    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 13:38:32.496287 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491693    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 13:38:32.496287 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491696    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 13:38:32.496287 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491698    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 13:38:32.496287 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491701    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 13:38:32.496287 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491706    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 13:38:32.496287 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491709    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 13:38:32.496287 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491712    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 13:38:32.496287 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491715    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 13:38:32.496287 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491717    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 13:38:32.496287 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491720    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 13:38:32.496287 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491722    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 13:38:32.496768 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491725    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 13:38:32.496768 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491728    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 13:38:32.496768 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491732    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 13:38:32.496768 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491736    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 13:38:32.496768 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491738    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 13:38:32.496768 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491741    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 13:38:32.496768 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491743    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 13:38:32.496768 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491746    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 13:38:32.496768 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491748    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 13:38:32.496768 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491750    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 13:38:32.496768 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491753    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 13:38:32.496768 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491756    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 13:38:32.496768 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491758    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 13:38:32.496768 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491761    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 13:38:32.496768 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491763    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 13:38:32.496768 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491766    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 13:38:32.496768 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491768    2578 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 13:38:32.496768 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491771    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 13:38:32.496768 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491773    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 13:38:32.496768 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491776    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 13:38:32.497251 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.491778    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 13:38:32.497251 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.491848    2578 flags.go:64] FLAG: --address="0.0.0.0"
Sep 15 13:38:32.497251 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.491889    2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 15 13:38:32.497251 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.491897    2578 flags.go:64] FLAG: --anonymous-auth="true"
Sep 15 13:38:32.497251 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.491901    2578 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 15 13:38:32.497251 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.491906    2578 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 15 13:38:32.497251 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.491909    2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 15 13:38:32.497251 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.491913    2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 15 13:38:32.497251 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.491917    2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 15 13:38:32.497251 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.491920    2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 15 13:38:32.497251 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.491923    2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 15 13:38:32.497251 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.491926    2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 15 13:38:32.497251 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.491929    2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 15 13:38:32.497251 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.491933    2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 15 13:38:32.497251 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.491937    2578 flags.go:64] FLAG: --cgroup-root=""
Sep 15 13:38:32.497251 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.491940    2578 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 15 13:38:32.497251 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.491943    2578 flags.go:64] FLAG: --client-ca-file=""
Sep 15 13:38:32.497251 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.491946    2578 flags.go:64] FLAG: --cloud-provider="external"
Sep 15 13:38:32.497251 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.491949    2578 flags.go:64] FLAG: --cluster-dns="[]"
Sep 15 13:38:32.497251 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.491953    2578 flags.go:64] FLAG: --cluster-domain=""
Sep 15 13:38:32.497251 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.491956    2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 15 13:38:32.497251 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.491959    2578 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 15 13:38:32.497251 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.491962    2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 15 13:38:32.497251 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.491965    2578 flags.go:64] FLAG: --container-log-max-files="5"
Sep 15 13:38:32.497843 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.491969    2578 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 15 13:38:32.497843 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.491971    2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 15 13:38:32.497843 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.491974    2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 15 13:38:32.497843 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.491977    2578 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 15 13:38:32.497843 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.491980    2578 flags.go:64] FLAG: --contention-profiling="false"
Sep 15 13:38:32.497843 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.491983    2578 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 15 13:38:32.497843 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.491986    2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 15 13:38:32.497843 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.491989    2578 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 15 13:38:32.497843 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.491992    2578 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 15 13:38:32.497843 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.491996    2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 15 13:38:32.497843 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.491999    2578 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 15 13:38:32.497843 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492001    2578 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 15 13:38:32.497843 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492004    2578 flags.go:64] FLAG: --enable-load-reader="false"
Sep 15 13:38:32.497843 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492007    2578 flags.go:64] FLAG: --enable-server="true"
Sep 15 13:38:32.497843 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492010    2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 15 13:38:32.497843 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492015    2578 flags.go:64] FLAG: --event-burst="100"
Sep 15 13:38:32.497843 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492018    2578 flags.go:64] FLAG: --event-qps="50"
Sep 15 13:38:32.497843 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492020    2578 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 15 13:38:32.497843 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492023    2578 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 15 13:38:32.497843 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492026    2578 flags.go:64] FLAG: --eviction-hard=""
Sep 15 13:38:32.497843 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492030    2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 15 13:38:32.497843 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492032    2578 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 15 13:38:32.497843 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492037    2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 15 13:38:32.497843 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492040    2578 flags.go:64] FLAG: --eviction-soft=""
Sep 15 13:38:32.497843 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492043    2578 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 15 13:38:32.499055 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492046    2578 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 15 13:38:32.499055 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492049    2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 15 13:38:32.499055 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492052    2578 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 15 13:38:32.499055 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492055    2578 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 15 13:38:32.499055 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492057    2578 flags.go:64] FLAG: --fail-swap-on="true"
Sep 15 13:38:32.499055 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492060    2578 flags.go:64] FLAG: --feature-gates=""
Sep 15 13:38:32.499055 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492064    2578 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 15 13:38:32.499055 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492067    2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 15 13:38:32.499055 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492070    2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 15 13:38:32.499055 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492073    2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 15 13:38:32.499055 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492076    2578 flags.go:64] FLAG: --healthz-port="10248"
Sep 15 13:38:32.499055 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492079    2578 flags.go:64] FLAG: --help="false"
Sep 15 13:38:32.499055 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492082    2578 flags.go:64] FLAG: --hostname-override="ip-10-0-128-41.ec2.internal"
Sep 15 13:38:32.499055 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492085    2578 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 15 13:38:32.499055 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492087    2578 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 15 13:38:32.499055 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492090    2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 15 13:38:32.499055 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492093    2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 15 13:38:32.499055 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492096    2578 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 15 13:38:32.499055 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492099    2578 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 15 13:38:32.499055 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492102    2578 flags.go:64] FLAG: --image-service-endpoint=""
Sep 15 13:38:32.499055 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492105    2578 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 15 13:38:32.499055 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492108    2578 flags.go:64] FLAG: --kube-api-burst="100"
Sep 15 13:38:32.499055 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492112    2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 15 13:38:32.499779 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492115    2578 flags.go:64] FLAG: --kube-api-qps="50"
Sep 15 13:38:32.499779 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492118    2578 flags.go:64] FLAG: --kube-reserved=""
Sep 15 13:38:32.499779 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492120    2578 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 15 13:38:32.499779 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492123    2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 15 13:38:32.499779 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492126    2578 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 15 13:38:32.499779 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492129    2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 15 13:38:32.499779 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492133    2578 flags.go:64] FLAG: --lock-file=""
Sep 15 13:38:32.499779 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492136    2578 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 15 13:38:32.499779 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492139    2578 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 15 13:38:32.499779 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492142    2578 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 15 13:38:32.499779 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492147    2578 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 15 13:38:32.499779 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492150    2578 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 15 13:38:32.499779 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492152    2578 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 15 13:38:32.499779 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492155    2578 flags.go:64] FLAG: --logging-format="text"
Sep 15 13:38:32.499779 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492158    2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 15 13:38:32.499779 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492162    2578 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 15 13:38:32.499779 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492165    2578 flags.go:64] FLAG: --manifest-url=""
Sep 15 13:38:32.499779 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492168    2578 flags.go:64] FLAG: --manifest-url-header=""
Sep 15 13:38:32.499779 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492172    2578 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 15 13:38:32.499779 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492175    2578 flags.go:64] FLAG: --max-open-files="1000000"
Sep 15 13:38:32.499779 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492179    2578 flags.go:64] FLAG: --max-pods="110"
Sep 15 13:38:32.499779 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492181    2578 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 15 13:38:32.499779 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492184    2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 15 13:38:32.499779 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492187    2578 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 15 13:38:32.499779 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492190    2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 15 13:38:32.500485 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492193    2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 15 13:38:32.500485 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492196    2578 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 15 13:38:32.500485 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492199    2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 15 13:38:32.500485 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492211    2578 flags.go:64] FLAG: --node-status-max-images="50"
Sep 15 13:38:32.500485 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492214    2578 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 15 13:38:32.500485 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492217    2578 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 15 13:38:32.500485 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492220    2578 flags.go:64] FLAG: --pod-cidr=""
Sep 15 13:38:32.500485 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492224    2578 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 15 13:38:32.500485 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492229    2578 flags.go:64] FLAG: --pod-manifest-path=""
Sep 15 13:38:32.500485 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492232    2578 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 15 13:38:32.500485 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492235    2578 flags.go:64] FLAG: --pods-per-core="0"
Sep 15 13:38:32.500485 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492238    2578 flags.go:64] FLAG: --port="10250"
Sep 15 13:38:32.500485 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492240    2578 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 15 13:38:32.500485 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492244    2578 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-07914acda8609f288"
Sep 15 13:38:32.500485 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492248    2578 flags.go:64] FLAG: --qos-reserved=""
Sep 15 13:38:32.500485 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492251    2578 flags.go:64] FLAG: --read-only-port="10255"
Sep 15 13:38:32.500485 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492254    2578 flags.go:64] FLAG: --register-node="true"
Sep 15 13:38:32.500485 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492257    2578 flags.go:64] FLAG: --register-with-taints=""
Sep 15 13:38:32.500485 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492260    2578 flags.go:64] FLAG: --registry-burst="10"
Sep 15 13:38:32.500485 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492263    2578 flags.go:64] FLAG: --registry-qps="5"
Sep 15 13:38:32.500485 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492266    2578 flags.go:64] FLAG: --reserved-cpus=""
Sep 15 13:38:32.500485 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492268    2578 flags.go:64] FLAG: --reserved-memory=""
Sep 15 13:38:32.500485 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492272    2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 15 13:38:32.500485 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492274    2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 15 13:38:32.500485 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492277    2578 flags.go:64] FLAG: --rotate-certificates="false"
Sep 15 13:38:32.501094 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492280    2578 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 15 13:38:32.501094 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492283    2578 flags.go:64] FLAG: --runonce="false"
Sep 15 13:38:32.501094 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492285    2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 15 13:38:32.501094 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492288    2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 15 13:38:32.501094 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492291    2578 flags.go:64] FLAG: --seccomp-default="false"
Sep 15 13:38:32.501094 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492294    2578 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 15 13:38:32.501094 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492297    2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 15 13:38:32.501094 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492300    2578 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 15 13:38:32.501094 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492302    2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 15 13:38:32.501094 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492305    2578 flags.go:64] FLAG: --storage-driver-password="root"
Sep 15 13:38:32.501094 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492308    2578 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 15 13:38:32.501094 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492311    2578 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 15 13:38:32.501094 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492313    2578 flags.go:64] FLAG: --storage-driver-user="root"
Sep 15 13:38:32.501094 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492316    2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 15 13:38:32.501094 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492319    2578 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 15 13:38:32.501094 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492322    2578 flags.go:64] FLAG: --system-cgroups=""
Sep 15 13:38:32.501094 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492325    2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 15 13:38:32.501094 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492330    2578 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 15 13:38:32.501094 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492333    2578 flags.go:64] FLAG: --tls-cert-file=""
Sep 15 13:38:32.501094 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492335    2578 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 15 13:38:32.501094 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492340    2578 flags.go:64] FLAG: --tls-min-version=""
Sep 15 13:38:32.501094 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492343    2578 flags.go:64] FLAG: --tls-private-key-file=""
Sep 15 13:38:32.501094 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492348    2578 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 15 13:38:32.501094 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492351    2578 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 15 13:38:32.501094 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492354    2578 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 15 13:38:32.501739 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492357    2578 flags.go:64] FLAG: --v="2"
Sep 15 13:38:32.501739 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492361    2578 flags.go:64] FLAG: --version="false"
Sep 15 13:38:32.501739 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492365    2578 flags.go:64] FLAG: --vmodule=""
Sep 15 13:38:32.501739 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492381    2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 15 13:38:32.501739 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492384    2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 15 13:38:32.501739 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.492500    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 13:38:32.501739 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.492503    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 13:38:32.501739 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.492507    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 13:38:32.501739 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.492509    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 13:38:32.501739 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.492512    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 13:38:32.501739 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.492515    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 13:38:32.501739 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.492517    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 13:38:32.501739 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.492520    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 13:38:32.501739 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.492523    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 13:38:32.501739 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.492525    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 13:38:32.501739 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.492528    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 13:38:32.501739 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.492531    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 13:38:32.501739 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.492533    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 13:38:32.501739 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.492536    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 13:38:32.501739 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.492538    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 13:38:32.501739 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.492541    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 13:38:32.502242 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.492543    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 13:38:32.502242 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.492546    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 13:38:32.502242 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.492549    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 13:38:32.502242 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.492551    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 13:38:32.502242 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.492554    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 13:38:32.502242 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.492556    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 13:38:32.502242 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.492560    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 13:38:32.502242 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.492562    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 13:38:32.502242 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.492566    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 13:38:32.502242 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.492569    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 13:38:32.502242 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.492571    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 13:38:32.502242 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.492574    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 13:38:32.502242 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.492576    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 13:38:32.502242 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.492579    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 13:38:32.502242 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.492581    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 13:38:32.502242 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.492584    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 13:38:32.502242 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.492586    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 13:38:32.502242 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.492589    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 13:38:32.502242 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.492591    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 13:38:32.502242 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.492594    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 13:38:32.502755 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.492596    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 13:38:32.502755 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.492599    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 13:38:32.502755 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.492602    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 13:38:32.502755 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.492604    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 13:38:32.502755 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.492607    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 13:38:32.502755 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.492609    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 13:38:32.502755 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.492612    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 13:38:32.502755 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.492614    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 13:38:32.502755 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.492618    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 13:38:32.502755 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.492621    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 13:38:32.502755 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.492624    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 13:38:32.502755 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.492626    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 13:38:32.502755 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.492629    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 13:38:32.502755 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.492632    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 13:38:32.502755 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.492634    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 13:38:32.502755 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.492637    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 13:38:32.502755 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.492640    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 13:38:32.502755 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.492642    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 13:38:32.502755 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.492647    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 13:38:32.503213 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.492649    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 13:38:32.503213 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.492653    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 13:38:32.503213 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.492655    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 13:38:32.503213 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.492657    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 13:38:32.503213 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.492660    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 13:38:32.503213 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.492662    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 13:38:32.503213 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.492665    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 13:38:32.503213 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.492667    2578 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 13:38:32.503213 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.492670    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 13:38:32.503213 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.492673    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 13:38:32.503213 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.492675    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 13:38:32.503213 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.492678    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 13:38:32.503213 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.492680    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 13:38:32.503213 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.492683    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 13:38:32.503213 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.492685    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 13:38:32.503213 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.492687    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 13:38:32.503213 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.492690    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 13:38:32.503213 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.492692    2578 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 13:38:32.503213 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.492695    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 13:38:32.503213 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.492697    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 13:38:32.503723 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.492700    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 13:38:32.503723 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.492703    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 13:38:32.503723 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.492705    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 13:38:32.503723 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.492707    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 13:38:32.503723 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.492710    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 13:38:32.503723 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.492713    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 13:38:32.503723 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.492715    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 13:38:32.503723 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.492718    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 13:38:32.503723 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.492720    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 13:38:32.503723 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.492723    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 13:38:32.503723 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.492726    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 13:38:32.503723 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.492730    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 13:38:32.503723 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.492734    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 13:38:32.503723 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.492737    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 13:38:32.503723 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.492740    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 13:38:32.503723 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.492742    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 13:38:32.503723 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.492745    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 13:38:32.503723 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.492749    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 13:38:32.503723 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.492752    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 13:38:32.504224 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.492755    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 13:38:32.504224 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.492758    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 13:38:32.504224 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.492761    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 13:38:32.504224 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.492764    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 13:38:32.504224 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.492767    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 13:38:32.504224 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.492772    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 15 13:38:32.504224 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.501786    2578 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 15 13:38:32.504224 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.501803    2578 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 15 13:38:32.504224 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.502622    2578 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 15 13:38:32.504224 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.502630    2578 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 15 13:38:32.504224 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.502692    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 13:38:32.504224 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.502697    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 13:38:32.504224 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.502700    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 13:38:32.504224 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.502703    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 13:38:32.504224 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.502706    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 13:38:32.504626 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.502710    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 13:38:32.504626 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.502713    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 13:38:32.504626 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.502716    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 13:38:32.504626 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.502719    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 13:38:32.504626 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.502722    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 13:38:32.504626 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.502725    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 13:38:32.504626 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.502727    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 13:38:32.504626 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.502730    2578 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 13:38:32.504626 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.502733    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 13:38:32.504626 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.502735    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 13:38:32.504626 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.502738    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 13:38:32.504626 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.502740    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 13:38:32.504626 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.502743    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 13:38:32.504626 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.502745    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 13:38:32.504626 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.502748    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 13:38:32.504626 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.502750    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 13:38:32.504626 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.502753    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 13:38:32.504626 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.502756    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 13:38:32.504626 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.502758    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 13:38:32.504626 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.502761    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 13:38:32.505102 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.502764    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 13:38:32.505102 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.502766    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 13:38:32.505102 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.502770    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 13:38:32.505102 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.502774    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 13:38:32.505102 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.502784    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 13:38:32.505102 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.502787    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 13:38:32.505102 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.502790    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 13:38:32.505102 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.502792    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 13:38:32.505102 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.502796    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 13:38:32.505102 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.502800    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 13:38:32.505102 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.502803    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 13:38:32.505102 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.502806    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 13:38:32.505102 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.502808    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 13:38:32.505102 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.502811    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 13:38:32.505102 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.502813    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 13:38:32.505102 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.502816    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 13:38:32.505102 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.502819    2578 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 13:38:32.505102 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.502822    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 13:38:32.505102 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.502824    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 13:38:32.505682 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.502827    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 13:38:32.505682 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.502830    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 13:38:32.505682 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.502832    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 13:38:32.505682 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.502834    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 13:38:32.505682 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.502837    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 13:38:32.505682 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.502839    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 13:38:32.505682 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.502842    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 13:38:32.505682 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.502844    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 13:38:32.505682 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.502846    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 13:38:32.505682 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.502849    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 13:38:32.505682 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.502851    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 13:38:32.505682 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.502854    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 13:38:32.505682 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.502856    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 13:38:32.505682 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.502859    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 13:38:32.505682 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.502861    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 13:38:32.505682 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.502864    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 13:38:32.505682 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.502866    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 13:38:32.505682 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.502869    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 13:38:32.505682 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.502877    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 13:38:32.505682 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.502880    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 13:38:32.506178 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.502882    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 13:38:32.506178 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.502885    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 13:38:32.506178 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.502887    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 13:38:32.506178 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.502890    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 13:38:32.506178 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.502892    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 13:38:32.506178 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.502895    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 13:38:32.506178 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.502897    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 13:38:32.506178 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.502900    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 13:38:32.506178 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.502902    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 13:38:32.506178 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.502904    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 13:38:32.506178 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.502907    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 13:38:32.506178 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.502909    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 13:38:32.506178 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.502912    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 13:38:32.506178 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.502914    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 13:38:32.506178 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.502916    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 13:38:32.506178 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.502919    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 13:38:32.506178 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.502921    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 13:38:32.506178 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.502924    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 13:38:32.506178 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.502926    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 13:38:32.506178 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.502928    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 13:38:32.506672 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.502931    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 13:38:32.506672 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.502933    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 13:38:32.506672 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.502936    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 13:38:32.506672 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.502938    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 13:38:32.506672 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.502941    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 13:38:32.506672 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.502943    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 13:38:32.506672 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.502947    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 13:38:32.506672 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.502950    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 13:38:32.506672 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.502953    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 13:38:32.506672 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.502957    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 13:38:32.506672 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.502960    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 13:38:32.506672 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.502969    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 13:38:32.506672 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.502972    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 13:38:32.506672 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.502974    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 13:38:32.506672 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.502977    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 13:38:32.507053 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.502982    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 15 13:38:32.507053 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.503128    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 13:38:32.507053 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.503132    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 13:38:32.507053 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.503136    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 13:38:32.507053 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.503138    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 13:38:32.507053 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.503141    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 13:38:32.507053 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.503143    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 13:38:32.507053 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.503146    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 13:38:32.507053 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.503149    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 13:38:32.507053 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.503151    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 13:38:32.507053 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.503154    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 13:38:32.507053 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.503156    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 13:38:32.507053 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.503158    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 13:38:32.507053 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.503161    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 13:38:32.507053 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.503163    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 13:38:32.507449 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.503166    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 13:38:32.507449 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.503168    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 13:38:32.507449 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.503170    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 13:38:32.507449 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.503173    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 13:38:32.507449 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.503175    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 13:38:32.507449 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.503178    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 13:38:32.507449 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.503180    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 13:38:32.507449 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.503183    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 13:38:32.507449 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.503185    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 13:38:32.507449 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.503194    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 13:38:32.507449 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.503198    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 13:38:32.507449 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.503201    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 13:38:32.507449 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.503204    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 13:38:32.507449 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.503206    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 13:38:32.507449 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.503214    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 13:38:32.507449 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.503217    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 13:38:32.507449 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.503220    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 13:38:32.507449 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.503223    2578 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 13:38:32.507449 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.503225    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 13:38:32.507914 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.503228    2578 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 13:38:32.507914 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.503231    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 13:38:32.507914 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.503233    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 13:38:32.507914 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.503236    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 13:38:32.507914 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.503238    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 13:38:32.507914 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.503241    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 13:38:32.507914 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.503243    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 13:38:32.507914 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.503246    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 13:38:32.507914 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.503248    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 13:38:32.507914 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.503251    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 13:38:32.507914 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.503253    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 13:38:32.507914 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.503255    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 13:38:32.507914 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.503258    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 13:38:32.507914 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.503261    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 13:38:32.507914 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.503263    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 13:38:32.507914 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.503265    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 13:38:32.507914 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.503268    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 13:38:32.507914 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.503270    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 13:38:32.507914 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.503274    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 13:38:32.508390 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.503277    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 13:38:32.508390 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.503280    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 13:38:32.508390 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.503283    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 13:38:32.508390 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.503287    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 13:38:32.508390 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.503290    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 13:38:32.508390 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.503293    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 13:38:32.508390 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.503296    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 13:38:32.508390 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.503298    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 13:38:32.508390 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.503301    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 13:38:32.508390 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.503308    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 13:38:32.508390 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.503311    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 13:38:32.508390 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.503313    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 13:38:32.508390 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.503316    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 13:38:32.508390 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.503318    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 13:38:32.508390 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.503321    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 13:38:32.508390 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.503323    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 13:38:32.508390 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.503326    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 13:38:32.508390 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.503328    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 13:38:32.508390 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.503330    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 13:38:32.508390 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.503333    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 13:38:32.508883 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.503335    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 13:38:32.508883 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.503337    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 13:38:32.508883 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.503340    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 13:38:32.508883 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.503342    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 13:38:32.508883 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.503344    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 13:38:32.508883 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.503347    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 13:38:32.508883 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.503349    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 13:38:32.508883 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.503351    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 13:38:32.508883 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.503354    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 13:38:32.508883 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.503356    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 13:38:32.508883 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.503358    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 13:38:32.508883 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.503361    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 13:38:32.508883 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.503363    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 13:38:32.508883 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.503366    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 13:38:32.508883 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.503385    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 13:38:32.508883 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.503388    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 13:38:32.508883 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.503391    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 13:38:32.508883 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.503393    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 13:38:32.508883 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.503398    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 13:38:32.508883 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.503400    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 13:38:32.509362 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.503406    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 13:38:32.509362 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.503408    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 13:38:32.509362 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.503419    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 13:38:32.509362 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.503422    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 13:38:32.509362 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.503424    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 13:38:32.509362 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.503427    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 13:38:32.509362 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:32.503429    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 13:38:32.509362 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.503434    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 15 13:38:32.509362 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.503540    2578 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 15 13:38:32.509362 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.506048    2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 15 13:38:32.509362 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.507030    2578 server.go:1019] "Starting client certificate rotation"
Sep 15 13:38:32.509362 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.507124    2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 15 13:38:32.509362 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.507981    2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 15 13:38:32.510005 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.509991    2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 15 13:38:32.514988 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.514963    2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 15 13:38:32.523311 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.523296    2578 log.go:25] "Validated CRI v1 runtime API"
Sep 15 13:38:32.526528 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.526514    2578 log.go:25] "Validated CRI v1 image API"
Sep 15 13:38:32.527421 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.527404    2578 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 15 13:38:32.530819 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.530797    2578 fs.go:135] Filesystem UUIDs: map[66d02020-3c5c-4593-8049-f323be18223f:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 f8515aa8-0b28-4a22-969b-dc2d182a9115:/dev/nvme0n1p3]
Sep 15 13:38:32.530884 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.530819    2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 15 13:38:32.536113 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.536005    2578 manager.go:216] Machine: {Timestamp:2026-09-15 13:38:32.534504683 +0000 UTC m=+0.361384045 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3102440 MemoryCapacity:32812158976 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2e5b8856712494ff1f9998deb4ad73 SystemUUID:ec2e5b88-5671-2494-ff1f-9998deb4ad73 BootID:2ff3ac02-e0ff-4bac-b709-765d524082d4 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406081536 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406077440 Type:vfs Inodes:4005390 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:f8:c7:06:83 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:f8:c7:06:83 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:02:c1:4a:82:a7:b2 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812158976 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 15 13:38:32.536113 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.536112    2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 15 13:38:32.536215 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.536189    2578 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 15 13:38:32.540313 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.540287    2578 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 15 13:38:32.540489 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.540314    2578 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-41.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 15 13:38:32.540578 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.540558    2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 15 13:38:32.541281 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.541269    2578 topology_manager.go:138] "Creating topology manager with none policy"
Sep 15 13:38:32.541281 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.541281    2578 container_manager_linux.go:309] "Creating device plugin manager"
Sep 15 13:38:32.541348 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.541289    2578 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 15 13:38:32.542024 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.542013    2578 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 15 13:38:32.543172 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.543162    2578 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 15 13:38:32.547562 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.547550    2578 state_mem.go:36] "Initialized new in-memory state store"
Sep 15 13:38:32.547696 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.547686    2578 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 15 13:38:32.547732 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.547719    2578 kubelet.go:486] "Attempting to sync node with API server"
Sep 15 13:38:32.547759 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.547733    2578 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 15 13:38:32.547789 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.547758    2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 15 13:38:32.547789 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.547775    2578 kubelet.go:398] "Adding apiserver pod source"
Sep 15 13:38:32.547842 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.547798    2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 15 13:38:32.548245 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.548234    2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 15 13:38:32.548289 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.548252    2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 15 13:38:32.550774 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.550745    2578 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 15 13:38:32.554238 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.554219    2578 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 15 13:38:32.554310 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.554270    2578 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 15 13:38:32.556361 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.556343    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 15 13:38:32.556361 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.556362    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 15 13:38:32.556500 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.556383    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 15 13:38:32.556500 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.556389    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 15 13:38:32.556500 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.556398    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 15 13:38:32.556500 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.556405    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 15 13:38:32.556500 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.556418    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 15 13:38:32.556500 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.556423    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 15 13:38:32.556500 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.556430    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 15 13:38:32.556500 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.556436    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 15 13:38:32.556500 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.556445    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 15 13:38:32.556500 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.556451    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 15 13:38:32.557296 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.557286    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 15 13:38:32.557296 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.557295    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 15 13:38:32.558104 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:32.558077    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 15 13:38:32.558104 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:32.558079    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-41.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 15 13:38:32.562712 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.562700    2578 server.go:1268] "Started kubelet"
Sep 15 13:38:32.562806 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.562769    2578 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 15 13:38:32.562859 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.562775    2578 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 15 13:38:32.562859 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.562844    2578 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 15 13:38:32.563465 ip-10-0-128-41 systemd[1]: Started Kubernetes Kubelet.
Sep 15 13:38:32.564030 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.563782    2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8dgnd"
Sep 15 13:38:32.564362 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.564347    2578 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 15 13:38:32.565158 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.565144    2578 server.go:310] "Adding debug handlers to kubelet server"
Sep 15 13:38:32.566858 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.566840    2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-41.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 15 13:38:32.568317 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:32.568295    2578 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 15 13:38:32.570737 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.570721    2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8dgnd"
Sep 15 13:38:32.570817 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.570796    2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 15 13:38:32.570867 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.570817    2578 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 15 13:38:32.571134 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:32.571014    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-41.ec2.internal\" not found"
Sep 15 13:38:32.571764 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.571538    2578 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 15 13:38:32.571977 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.571958    2578 factory.go:55] Registering systemd factory
Sep 15 13:38:32.572047 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.571981    2578 factory.go:223] Registration of the systemd container factory successfully
Sep 15 13:38:32.572671 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.572651    2578 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 15 13:38:32.572671 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.572671    2578 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 15 13:38:32.573165 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.572965    2578 reconstruct.go:97] "Volume reconstruction finished"
Sep 15 13:38:32.573165 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.572976    2578 reconciler.go:29] "Reconciler: start to sync state"
Sep 15 13:38:32.573814 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.573799    2578 factory.go:153] Registering CRI-O factory
Sep 15 13:38:32.573814 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.573816    2578 factory.go:223] Registration of the crio container factory successfully
Sep 15 13:38:32.573940 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.573872    2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 15 13:38:32.573940 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.573892    2578 factory.go:103] Registering Raw factory
Sep 15 13:38:32.573940 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.573908    2578 manager.go:1196] Started watching for new ooms in manager
Sep 15 13:38:32.574540 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.574522    2578 manager.go:349] Starting recovery of all containers
Sep 15 13:38:32.575860 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:32.575826    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 15 13:38:32.575966 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:32.575943    2578 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-41.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 15 13:38:32.576714 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:32.575430    2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-41.ec2.internal.18d58222b723258f  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-41.ec2.internal,UID:ip-10-0-128-41.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-41.ec2.internal,},FirstTimestamp:2026-09-15 13:38:32.562673039 +0000 UTC m=+0.389552401,LastTimestamp:2026-09-15 13:38:32.562673039 +0000 UTC m=+0.389552401,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-41.ec2.internal,}"
Sep 15 13:38:32.587896 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.587881    2578 manager.go:354] Recovery completed
Sep 15 13:38:32.592001 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.591986    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 13:38:32.594025 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.593999    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-41.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 13:38:32.594094 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.594042    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-41.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 13:38:32.594094 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.594057    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-41.ec2.internal" event="NodeHasSufficientPID"
Sep 15 13:38:32.594673 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.594656    2578 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 15 13:38:32.594673 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.594668    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 13:38:32.594796 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.594671    2578 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 15 13:38:32.594796 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.594736    2578 state_mem.go:36] "Initialized new in-memory state store"
Sep 15 13:38:32.595307 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.595288    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-41.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 13:38:32.595426 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.595314    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-41.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 13:38:32.595426 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.595324    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-41.ec2.internal" event="NodeHasSufficientPID"
Sep 15 13:38:32.595931 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.595914    2578 policy_none.go:49] "None policy: Start"
Sep 15 13:38:32.595989 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.595935    2578 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 15 13:38:32.595989 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.595950    2578 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 15 13:38:32.597171 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.597157    2578 policy_none.go:47] "Start"
Sep 15 13:38:32.629928 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.629912    2578 manager.go:337] "Starting Device Plugin manager"
Sep 15 13:38:32.657441 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:32.629951    2578 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 15 13:38:32.657441 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.629965    2578 server.go:87] "Starting device plugin registration server"
Sep 15 13:38:32.657441 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.630271    2578 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 15 13:38:32.657441 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.630284    2578 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 15 13:38:32.657441 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.630446    2578 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 15 13:38:32.657441 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.630525    2578 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 15 13:38:32.657441 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.630535    2578 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 15 13:38:32.657441 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:32.631018    2578 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 15 13:38:32.657441 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:32.631076    2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-41.ec2.internal\" not found"
Sep 15 13:38:32.681974 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.681929    2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 15 13:38:32.683342 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.683326    2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 15 13:38:32.683404 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.683390    2578 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 15 13:38:32.683459 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.683427    2578 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 15 13:38:32.683503 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:32.683478    2578 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 15 13:38:32.686138 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.686118    2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 13:38:32.731332 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.731306    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 13:38:32.732239 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.732224    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-41.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 13:38:32.732320 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.732255    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-41.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 13:38:32.732320 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.732266    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-41.ec2.internal" event="NodeHasSufficientPID"
Sep 15 13:38:32.732320 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.732287    2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-41.ec2.internal"
Sep 15 13:38:32.741759 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.741688    2578 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-41.ec2.internal"
Sep 15 13:38:32.741759 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:32.741709    2578 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-41.ec2.internal\": node \"ip-10-0-128-41.ec2.internal\" not found"
Sep 15 13:38:32.758917 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:32.758892    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-41.ec2.internal\" not found"
Sep 15 13:38:32.784170 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.784142    2578 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-41.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-41.ec2.internal"]
Sep 15 13:38:32.784242 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.784216    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 13:38:32.785161 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.785146    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-41.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 13:38:32.785234 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.785186    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-41.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 13:38:32.785234 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.785198    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-41.ec2.internal" event="NodeHasSufficientPID"
Sep 15 13:38:32.786911 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.786899    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 13:38:32.787038 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.787025    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-41.ec2.internal"
Sep 15 13:38:32.787084 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.787051    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 13:38:32.787590 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.787572    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-41.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 13:38:32.787690 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.787600    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-41.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 13:38:32.787690 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.787613    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-41.ec2.internal" event="NodeHasSufficientPID"
Sep 15 13:38:32.788113 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.788097    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-41.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 13:38:32.788159 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.788132    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-41.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 13:38:32.788159 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.788150    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-41.ec2.internal" event="NodeHasSufficientPID"
Sep 15 13:38:32.789483 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.789466    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-41.ec2.internal"
Sep 15 13:38:32.789533 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.789501    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 13:38:32.790138 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.790112    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-41.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 13:38:32.790214 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.790142    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-41.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 13:38:32.790214 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.790156    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-41.ec2.internal" event="NodeHasSufficientPID"
Sep 15 13:38:32.816976 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:32.816955    2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-41.ec2.internal\" not found" node="ip-10-0-128-41.ec2.internal"
Sep 15 13:38:32.821485 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:32.821469    2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-41.ec2.internal\" not found" node="ip-10-0-128-41.ec2.internal"
Sep 15 13:38:32.859590 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:32.859569    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-41.ec2.internal\" not found"
Sep 15 13:38:32.875581 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.875554    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/00b57328426a8f6e26f2dac35d497a0b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-41.ec2.internal\" (UID: \"00b57328426a8f6e26f2dac35d497a0b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-41.ec2.internal"
Sep 15 13:38:32.875659 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.875587    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/00b57328426a8f6e26f2dac35d497a0b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-41.ec2.internal\" (UID: \"00b57328426a8f6e26f2dac35d497a0b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-41.ec2.internal"
Sep 15 13:38:32.875659 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.875603    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/05a0e38cdf2b9f115ed4af66ef9f8f2f-config\") pod \"kube-apiserver-proxy-ip-10-0-128-41.ec2.internal\" (UID: \"05a0e38cdf2b9f115ed4af66ef9f8f2f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-41.ec2.internal"
Sep 15 13:38:32.960402 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:32.960355    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-41.ec2.internal\" not found"
Sep 15 13:38:32.975765 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.975743    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/00b57328426a8f6e26f2dac35d497a0b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-41.ec2.internal\" (UID: \"00b57328426a8f6e26f2dac35d497a0b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-41.ec2.internal"
Sep 15 13:38:32.975813 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.975771    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/00b57328426a8f6e26f2dac35d497a0b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-41.ec2.internal\" (UID: \"00b57328426a8f6e26f2dac35d497a0b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-41.ec2.internal"
Sep 15 13:38:32.975813 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.975791    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/05a0e38cdf2b9f115ed4af66ef9f8f2f-config\") pod \"kube-apiserver-proxy-ip-10-0-128-41.ec2.internal\" (UID: \"05a0e38cdf2b9f115ed4af66ef9f8f2f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-41.ec2.internal"
Sep 15 13:38:32.975872 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.975801    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/00b57328426a8f6e26f2dac35d497a0b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-41.ec2.internal\" (UID: \"00b57328426a8f6e26f2dac35d497a0b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-41.ec2.internal"
Sep 15 13:38:32.975872 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.975817    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/05a0e38cdf2b9f115ed4af66ef9f8f2f-config\") pod \"kube-apiserver-proxy-ip-10-0-128-41.ec2.internal\" (UID: \"05a0e38cdf2b9f115ed4af66ef9f8f2f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-41.ec2.internal"
Sep 15 13:38:32.975872 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:32.975830    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/00b57328426a8f6e26f2dac35d497a0b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-41.ec2.internal\" (UID: \"00b57328426a8f6e26f2dac35d497a0b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-41.ec2.internal"
Sep 15 13:38:33.061226 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:33.061154    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-41.ec2.internal\" not found"
Sep 15 13:38:33.119736 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:33.119701    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-41.ec2.internal"
Sep 15 13:38:33.124545 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:33.124529    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-41.ec2.internal"
Sep 15 13:38:33.161531 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:33.161501    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-41.ec2.internal\" not found"
Sep 15 13:38:33.262073 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:33.262028    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-41.ec2.internal\" not found"
Sep 15 13:38:33.362702 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:33.362620    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-41.ec2.internal\" not found"
Sep 15 13:38:33.463126 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:33.463096    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-41.ec2.internal\" not found"
Sep 15 13:38:33.506617 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:33.506594    2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 15 13:38:33.507048 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:33.506744    2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 15 13:38:33.564105 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:33.564067    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-41.ec2.internal\" not found"
Sep 15 13:38:33.576383 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:33.576347    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-14 13:33:33 +0000 UTC" deadline="2028-05-13 23:02:03.943512722 +0000 UTC"
Sep 15 13:38:33.576501 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:33.576389    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14553h23m30.367128144s"
Sep 15 13:38:33.664507 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:33.664482    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-41.ec2.internal\" not found"
Sep 15 13:38:33.745213 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:33.745184    2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 13:38:33.764961 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:33.764932    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-41.ec2.internal\" not found"
Sep 15 13:38:33.773352 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:33.773328    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00b57328426a8f6e26f2dac35d497a0b.slice/crio-e7c6e5cdd12c5c436cd7ae0b18c10d0b1dd4955a43cbe06614952bb017b4c67d WatchSource:0}: Error finding container e7c6e5cdd12c5c436cd7ae0b18c10d0b1dd4955a43cbe06614952bb017b4c67d: Status 404 returned error can't find the container with id e7c6e5cdd12c5c436cd7ae0b18c10d0b1dd4955a43cbe06614952bb017b4c67d
Sep 15 13:38:33.777538 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:33.777523    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 13:38:33.865186 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:33.865139    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-41.ec2.internal\" not found"
Sep 15 13:38:33.891541 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:33.890757    2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 13:38:33.971917 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:33.971849    2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-41.ec2.internal"
Sep 15 13:38:35.051041 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.051022    2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 15 13:38:35.052061 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.052047    2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-41.ec2.internal"
Sep 15 13:38:35.060789 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.060775    2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 15 13:38:35.227166 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.227118    2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 13:38:35.600497 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.600466    2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 13:38:35.617314 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.617294    2578 apiserver.go:52] "Watching apiserver"
Sep 15 13:38:35.623355 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.623336    2578 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 15 13:38:35.625258 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.625237    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-kjvpd","openshift-network-operator/iptables-alerter-n5jmk","openshift-ovn-kubernetes/ovnkube-node-krtzm","kube-system/global-pull-secret-syncer-f54mn","kube-system/konnectivity-agent-bq5dg","kube-system/kube-apiserver-proxy-ip-10-0-128-41.ec2.internal","openshift-dns/node-resolver-425qw","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-41.ec2.internal","openshift-multus/multus-additional-cni-plugins-tgmg6","openshift-multus/network-metrics-daemon-fsnbc","openshift-network-diagnostics/network-check-target-24wlp","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jtkm9","openshift-cluster-node-tuning-operator/tuned-vxdpz","openshift-image-registry/node-ca-8tcrg"]
Sep 15 13:38:35.627304 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.627285    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-425qw"
Sep 15 13:38:35.628375 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.628359    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vxdpz"
Sep 15 13:38:35.629490 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.629472    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-krtzm"
Sep 15 13:38:35.629693 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.629677    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 15 13:38:35.629813 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.629784    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-9spgr\""
Sep 15 13:38:35.629954 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.629939    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 15 13:38:35.630266 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.630249    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 15 13:38:35.630433 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.630417    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 15 13:38:35.630578 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.630556    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-v86dx\""
Sep 15 13:38:35.630804 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.630777    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f54mn"
Sep 15 13:38:35.630885 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:35.630842    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f54mn" podUID="a1307640-dec4-44a3-a888-f8b1b097f902"
Sep 15 13:38:35.631804 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.631787    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bq5dg"
Sep 15 13:38:35.632414 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.632391    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 15 13:38:35.632531 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.632473    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 15 13:38:35.632531 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.632514    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 15 13:38:35.632659 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.632394    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 15 13:38:35.632659 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.632430    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 15 13:38:35.632659 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.632431    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 15 13:38:35.632659 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.632431    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-7v9md\""
Sep 15 13:38:35.633003 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.632983    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8tcrg"
Sep 15 13:38:35.634234 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.634216    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tgmg6"
Sep 15 13:38:35.634978 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.634795    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 15 13:38:35.634978 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.634942    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 15 13:38:35.635404 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.635377    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 15 13:38:35.635404 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.635383    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-twdbz\""
Sep 15 13:38:35.635534 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.635476    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-bdv7x\""
Sep 15 13:38:35.635568 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.635555    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 15 13:38:35.635603 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.635585    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 15 13:38:35.635722 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.635691    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-kjvpd"
Sep 15 13:38:35.636489 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.636465    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 15 13:38:35.636580 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.636544    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 15 13:38:35.636844 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.636479    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 15 13:38:35.636914 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.636872    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 15 13:38:35.637785 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.637381    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-kxwkx\""
Sep 15 13:38:35.637785 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.637390    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 15 13:38:35.638666 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.638149    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 15 13:38:35.638666 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.638365    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-f7cmq\""
Sep 15 13:38:35.638922 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.638904    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-n5jmk"
Sep 15 13:38:35.639561 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.639544    2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 15 13:38:35.641096 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.641081    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 15 13:38:35.641373 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.641357    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 15 13:38:35.641482 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.641468    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-fqhnn\""
Sep 15 13:38:35.641525 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.641492    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 15 13:38:35.641686 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.641672    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fsnbc"
Sep 15 13:38:35.641769 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:35.641751    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fsnbc" podUID="525d9c79-829f-45ae-9cd5-af323bc737ef"
Sep 15 13:38:35.643812 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.642867    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-24wlp"
Sep 15 13:38:35.643812 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:35.642929    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-24wlp" podUID="82807e36-72ea-4ef2-a3bf-66fa30a9b389"
Sep 15 13:38:35.644197 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.644184    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jtkm9"
Sep 15 13:38:35.646047 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.646030    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 15 13:38:35.646382 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.646367    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 15 13:38:35.646467 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.646453    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 15 13:38:35.646467 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.646462    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-cbz9x\""
Sep 15 13:38:35.650173 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.650158    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cf80e34c-17f8-4fb2-98c0-c9a5a6faf53f-konnectivity-ca\") pod \"konnectivity-agent-bq5dg\" (UID: \"cf80e34c-17f8-4fb2-98c0-c9a5a6faf53f\") " pod="kube-system/konnectivity-agent-bq5dg"
Sep 15 13:38:35.650226 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.650183    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a1307640-dec4-44a3-a888-f8b1b097f902-kubelet-config\") pod \"global-pull-secret-syncer-f54mn\" (UID: \"a1307640-dec4-44a3-a888-f8b1b097f902\") " pod="kube-system/global-pull-secret-syncer-f54mn"
Sep 15 13:38:35.650226 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.650201    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fa66793f-19a0-4e87-9a7e-f2c1491c261f-multus-conf-dir\") pod \"multus-kjvpd\" (UID: \"fa66793f-19a0-4e87-9a7e-f2c1491c261f\") " pod="openshift-multus/multus-kjvpd"
Sep 15 13:38:35.650316 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.650238    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7126a8b6-6691-4cb3-9115-bedab2e519ad-ovn-node-metrics-cert\") pod \"ovnkube-node-krtzm\" (UID: \"7126a8b6-6691-4cb3-9115-bedab2e519ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-krtzm"
Sep 15 13:38:35.650316 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.650268    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a1307640-dec4-44a3-a888-f8b1b097f902-dbus\") pod \"global-pull-secret-syncer-f54mn\" (UID: \"a1307640-dec4-44a3-a888-f8b1b097f902\") " pod="kube-system/global-pull-secret-syncer-f54mn"
Sep 15 13:38:35.650316 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.650286    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a1307640-dec4-44a3-a888-f8b1b097f902-original-pull-secret\") pod \"global-pull-secret-syncer-f54mn\" (UID: \"a1307640-dec4-44a3-a888-f8b1b097f902\") " pod="kube-system/global-pull-secret-syncer-f54mn"
Sep 15 13:38:35.650449 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.650321    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fa66793f-19a0-4e87-9a7e-f2c1491c261f-cni-binary-copy\") pod \"multus-kjvpd\" (UID: \"fa66793f-19a0-4e87-9a7e-f2c1491c261f\") " pod="openshift-multus/multus-kjvpd"
Sep 15 13:38:35.650449 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.650351    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c6770793-f370-4bf7-a572-5e367e27292d-etc-modprobe-d\") pod \"tuned-vxdpz\" (UID: \"c6770793-f370-4bf7-a572-5e367e27292d\") " pod="openshift-cluster-node-tuning-operator/tuned-vxdpz"
Sep 15 13:38:35.650449 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.650386    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/41073b32-ff62-4ae9-a4e8-aec2b819dd57-cnibin\") pod \"multus-additional-cni-plugins-tgmg6\" (UID: \"41073b32-ff62-4ae9-a4e8-aec2b819dd57\") " pod="openshift-multus/multus-additional-cni-plugins-tgmg6"
Sep 15 13:38:35.650449 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.650428    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fa66793f-19a0-4e87-9a7e-f2c1491c261f-multus-daemon-config\") pod \"multus-kjvpd\" (UID: \"fa66793f-19a0-4e87-9a7e-f2c1491c261f\") " pod="openshift-multus/multus-kjvpd"
Sep 15 13:38:35.650593 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.650479    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b469b218-cbd7-4873-836f-99ac075ab6ec-tmp-dir\") pod \"node-resolver-425qw\" (UID: \"b469b218-cbd7-4873-836f-99ac075ab6ec\") " pod="openshift-dns/node-resolver-425qw"
Sep 15 13:38:35.650593 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.650514    2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 15 13:38:35.650593 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.650518    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7126a8b6-6691-4cb3-9115-bedab2e519ad-run-openvswitch\") pod \"ovnkube-node-krtzm\" (UID: \"7126a8b6-6691-4cb3-9115-bedab2e519ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-krtzm"
Sep 15 13:38:35.650593 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.650544    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7126a8b6-6691-4cb3-9115-bedab2e519ad-log-socket\") pod \"ovnkube-node-krtzm\" (UID: \"7126a8b6-6691-4cb3-9115-bedab2e519ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-krtzm"
Sep 15 13:38:35.650593 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.650567    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7126a8b6-6691-4cb3-9115-bedab2e519ad-host-run-ovn-kubernetes\") pod \"ovnkube-node-krtzm\" (UID: \"7126a8b6-6691-4cb3-9115-bedab2e519ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-krtzm"
Sep 15 13:38:35.650784 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.650595    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7126a8b6-6691-4cb3-9115-bedab2e519ad-var-lib-openvswitch\") pod \"ovnkube-node-krtzm\" (UID: \"7126a8b6-6691-4cb3-9115-bedab2e519ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-krtzm"
Sep 15 13:38:35.650784 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.650619    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7126a8b6-6691-4cb3-9115-bedab2e519ad-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-krtzm\" (UID: \"7126a8b6-6691-4cb3-9115-bedab2e519ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-krtzm"
Sep 15 13:38:35.650784 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.650641    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7126a8b6-6691-4cb3-9115-bedab2e519ad-ovnkube-config\") pod \"ovnkube-node-krtzm\" (UID: \"7126a8b6-6691-4cb3-9115-bedab2e519ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-krtzm"
Sep 15 13:38:35.650784 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.650662    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zt7sm\" (UniqueName: \"kubernetes.io/projected/41073b32-ff62-4ae9-a4e8-aec2b819dd57-kube-api-access-zt7sm\") pod \"multus-additional-cni-plugins-tgmg6\" (UID: \"41073b32-ff62-4ae9-a4e8-aec2b819dd57\") " pod="openshift-multus/multus-additional-cni-plugins-tgmg6"
Sep 15 13:38:35.650784 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.650702    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fa66793f-19a0-4e87-9a7e-f2c1491c261f-multus-socket-dir-parent\") pod \"multus-kjvpd\" (UID: \"fa66793f-19a0-4e87-9a7e-f2c1491c261f\") " pod="openshift-multus/multus-kjvpd"
Sep 15 13:38:35.650784 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.650734    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fa66793f-19a0-4e87-9a7e-f2c1491c261f-host-var-lib-cni-bin\") pod \"multus-kjvpd\" (UID: \"fa66793f-19a0-4e87-9a7e-f2c1491c261f\") " pod="openshift-multus/multus-kjvpd"
Sep 15 13:38:35.650784 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.650758    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c6770793-f370-4bf7-a572-5e367e27292d-var-lib-kubelet\") pod \"tuned-vxdpz\" (UID: \"c6770793-f370-4bf7-a572-5e367e27292d\") " pod="openshift-cluster-node-tuning-operator/tuned-vxdpz"
Sep 15 13:38:35.650784 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.650782    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g52xs\" (UniqueName: \"kubernetes.io/projected/c6770793-f370-4bf7-a572-5e367e27292d-kube-api-access-g52xs\") pod \"tuned-vxdpz\" (UID: \"c6770793-f370-4bf7-a572-5e367e27292d\") " pod="openshift-cluster-node-tuning-operator/tuned-vxdpz"
Sep 15 13:38:35.651087 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.650804    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7126a8b6-6691-4cb3-9115-bedab2e519ad-systemd-units\") pod \"ovnkube-node-krtzm\" (UID: \"7126a8b6-6691-4cb3-9115-bedab2e519ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-krtzm"
Sep 15 13:38:35.651087 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.650842    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7126a8b6-6691-4cb3-9115-bedab2e519ad-host-cni-netd\") pod \"ovnkube-node-krtzm\" (UID: \"7126a8b6-6691-4cb3-9115-bedab2e519ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-krtzm"
Sep 15 13:38:35.651087 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.650864    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c6e7d350-b090-4857-a0ce-a608bdcfb099-host\") pod \"node-ca-8tcrg\" (UID: \"c6e7d350-b090-4857-a0ce-a608bdcfb099\") " pod="openshift-image-registry/node-ca-8tcrg"
Sep 15 13:38:35.651087 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.650888    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhcj6\" (UniqueName: \"kubernetes.io/projected/c6e7d350-b090-4857-a0ce-a608bdcfb099-kube-api-access-zhcj6\") pod \"node-ca-8tcrg\" (UID: \"c6e7d350-b090-4857-a0ce-a608bdcfb099\") " pod="openshift-image-registry/node-ca-8tcrg"
Sep 15 13:38:35.651087 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.650912    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvrrq\" (UniqueName: \"kubernetes.io/projected/ff188391-7b0a-4909-b12c-f980b7f047c8-kube-api-access-tvrrq\") pod \"iptables-alerter-n5jmk\" (UID: \"ff188391-7b0a-4909-b12c-f980b7f047c8\") " pod="openshift-network-operator/iptables-alerter-n5jmk"
Sep 15 13:38:35.651087 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.650934    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fa66793f-19a0-4e87-9a7e-f2c1491c261f-host-run-netns\") pod \"multus-kjvpd\" (UID: \"fa66793f-19a0-4e87-9a7e-f2c1491c261f\") " pod="openshift-multus/multus-kjvpd"
Sep 15 13:38:35.651087 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.650957    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fa66793f-19a0-4e87-9a7e-f2c1491c261f-host-var-lib-kubelet\") pod \"multus-kjvpd\" (UID: \"fa66793f-19a0-4e87-9a7e-f2c1491c261f\") " pod="openshift-multus/multus-kjvpd"
Sep 15 13:38:35.651087 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.650979    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/525d9c79-829f-45ae-9cd5-af323bc737ef-metrics-certs\") pod \"network-metrics-daemon-fsnbc\" (UID: \"525d9c79-829f-45ae-9cd5-af323bc737ef\") " pod="openshift-multus/network-metrics-daemon-fsnbc"
Sep 15 13:38:35.651087 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.650998    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c6770793-f370-4bf7-a572-5e367e27292d-etc-kubernetes\") pod \"tuned-vxdpz\" (UID: \"c6770793-f370-4bf7-a572-5e367e27292d\") " pod="openshift-cluster-node-tuning-operator/tuned-vxdpz"
Sep 15 13:38:35.651087 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.651012    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c6770793-f370-4bf7-a572-5e367e27292d-sys\") pod \"tuned-vxdpz\" (UID: \"c6770793-f370-4bf7-a572-5e367e27292d\") " pod="openshift-cluster-node-tuning-operator/tuned-vxdpz"
Sep 15 13:38:35.651087 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.651049    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7126a8b6-6691-4cb3-9115-bedab2e519ad-host-slash\") pod \"ovnkube-node-krtzm\" (UID: \"7126a8b6-6691-4cb3-9115-bedab2e519ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-krtzm"
Sep 15 13:38:35.651087 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.651083    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7126a8b6-6691-4cb3-9115-bedab2e519ad-env-overrides\") pod \"ovnkube-node-krtzm\" (UID: \"7126a8b6-6691-4cb3-9115-bedab2e519ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-krtzm"
Sep 15 13:38:35.651631 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.651111    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7126a8b6-6691-4cb3-9115-bedab2e519ad-ovnkube-script-lib\") pod \"ovnkube-node-krtzm\" (UID: \"7126a8b6-6691-4cb3-9115-bedab2e519ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-krtzm"
Sep 15 13:38:35.651631 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.651152    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fa66793f-19a0-4e87-9a7e-f2c1491c261f-host-var-lib-cni-multus\") pod \"multus-kjvpd\" (UID: \"fa66793f-19a0-4e87-9a7e-f2c1491c261f\") " pod="openshift-multus/multus-kjvpd"
Sep 15 13:38:35.651631 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.651182    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fa66793f-19a0-4e87-9a7e-f2c1491c261f-hostroot\") pod \"multus-kjvpd\" (UID: \"fa66793f-19a0-4e87-9a7e-f2c1491c261f\") " pod="openshift-multus/multus-kjvpd"
Sep 15 13:38:35.651631 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.651204    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gplj5\" (UniqueName: \"kubernetes.io/projected/fa66793f-19a0-4e87-9a7e-f2c1491c261f-kube-api-access-gplj5\") pod \"multus-kjvpd\" (UID: \"fa66793f-19a0-4e87-9a7e-f2c1491c261f\") " pod="openshift-multus/multus-kjvpd"
Sep 15 13:38:35.651631 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.651227    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c6770793-f370-4bf7-a572-5e367e27292d-etc-sysctl-d\") pod \"tuned-vxdpz\" (UID: \"c6770793-f370-4bf7-a572-5e367e27292d\") " pod="openshift-cluster-node-tuning-operator/tuned-vxdpz"
Sep 15 13:38:35.651631 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.651252    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/41073b32-ff62-4ae9-a4e8-aec2b819dd57-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tgmg6\" (UID: \"41073b32-ff62-4ae9-a4e8-aec2b819dd57\") " pod="openshift-multus/multus-additional-cni-plugins-tgmg6"
Sep 15 13:38:35.651631 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.651283    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fa66793f-19a0-4e87-9a7e-f2c1491c261f-host-run-k8s-cni-cncf-io\") pod \"multus-kjvpd\" (UID: \"fa66793f-19a0-4e87-9a7e-f2c1491c261f\") " pod="openshift-multus/multus-kjvpd"
Sep 15 13:38:35.651631 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.651307    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fa66793f-19a0-4e87-9a7e-f2c1491c261f-host-run-multus-certs\") pod \"multus-kjvpd\" (UID: \"fa66793f-19a0-4e87-9a7e-f2c1491c261f\") " pod="openshift-multus/multus-kjvpd"
Sep 15 13:38:35.651631 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.651323    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c6770793-f370-4bf7-a572-5e367e27292d-run\") pod \"tuned-vxdpz\" (UID: \"c6770793-f370-4bf7-a572-5e367e27292d\") " pod="openshift-cluster-node-tuning-operator/tuned-vxdpz"
Sep 15 13:38:35.651631 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.651337    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7126a8b6-6691-4cb3-9115-bedab2e519ad-host-kubelet\") pod \"ovnkube-node-krtzm\" (UID: \"7126a8b6-6691-4cb3-9115-bedab2e519ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-krtzm"
Sep 15 13:38:35.651631 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.651350    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7126a8b6-6691-4cb3-9115-bedab2e519ad-run-ovn\") pod \"ovnkube-node-krtzm\" (UID: \"7126a8b6-6691-4cb3-9115-bedab2e519ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-krtzm"
Sep 15 13:38:35.651631 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.651368    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/41073b32-ff62-4ae9-a4e8-aec2b819dd57-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tgmg6\" (UID: \"41073b32-ff62-4ae9-a4e8-aec2b819dd57\") " pod="openshift-multus/multus-additional-cni-plugins-tgmg6"
Sep 15 13:38:35.651631 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.651403    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7126a8b6-6691-4cb3-9115-bedab2e519ad-host-run-netns\") pod \"ovnkube-node-krtzm\" (UID: \"7126a8b6-6691-4cb3-9115-bedab2e519ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-krtzm"
Sep 15 13:38:35.651631 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.651433    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7126a8b6-6691-4cb3-9115-bedab2e519ad-host-cni-bin\") pod \"ovnkube-node-krtzm\" (UID: \"7126a8b6-6691-4cb3-9115-bedab2e519ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-krtzm"
Sep 15 13:38:35.651631 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.651455    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fa66793f-19a0-4e87-9a7e-f2c1491c261f-multus-cni-dir\") pod \"multus-kjvpd\" (UID: \"fa66793f-19a0-4e87-9a7e-f2c1491c261f\") " pod="openshift-multus/multus-kjvpd"
Sep 15 13:38:35.651631 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.651479    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c6770793-f370-4bf7-a572-5e367e27292d-etc-systemd\") pod \"tuned-vxdpz\" (UID: \"c6770793-f370-4bf7-a572-5e367e27292d\") " pod="openshift-cluster-node-tuning-operator/tuned-vxdpz"
Sep 15 13:38:35.652112 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.651513    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7126a8b6-6691-4cb3-9115-bedab2e519ad-etc-openvswitch\") pod \"ovnkube-node-krtzm\" (UID: \"7126a8b6-6691-4cb3-9115-bedab2e519ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-krtzm"
Sep 15 13:38:35.652112 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.651536    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7pmlz\" (UniqueName: \"kubernetes.io/projected/7126a8b6-6691-4cb3-9115-bedab2e519ad-kube-api-access-7pmlz\") pod \"ovnkube-node-krtzm\" (UID: \"7126a8b6-6691-4cb3-9115-bedab2e519ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-krtzm"
Sep 15 13:38:35.652112 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.651558    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/41073b32-ff62-4ae9-a4e8-aec2b819dd57-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tgmg6\" (UID: \"41073b32-ff62-4ae9-a4e8-aec2b819dd57\") " pod="openshift-multus/multus-additional-cni-plugins-tgmg6"
Sep 15 13:38:35.652112 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.651592    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hv46\" (UniqueName: \"kubernetes.io/projected/525d9c79-829f-45ae-9cd5-af323bc737ef-kube-api-access-6hv46\") pod \"network-metrics-daemon-fsnbc\" (UID: \"525d9c79-829f-45ae-9cd5-af323bc737ef\") " pod="openshift-multus/network-metrics-daemon-fsnbc"
Sep 15 13:38:35.652112 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.651621    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5cqb\" (UniqueName: \"kubernetes.io/projected/b469b218-cbd7-4873-836f-99ac075ab6ec-kube-api-access-h5cqb\") pod \"node-resolver-425qw\" (UID: \"b469b218-cbd7-4873-836f-99ac075ab6ec\") " pod="openshift-dns/node-resolver-425qw"
Sep 15 13:38:35.652112 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.651647    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c6770793-f370-4bf7-a572-5e367e27292d-etc-sysctl-conf\") pod \"tuned-vxdpz\" (UID: \"c6770793-f370-4bf7-a572-5e367e27292d\") " pod="openshift-cluster-node-tuning-operator/tuned-vxdpz"
Sep 15 13:38:35.652112 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.651701    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7126a8b6-6691-4cb3-9115-bedab2e519ad-node-log\") pod \"ovnkube-node-krtzm\" (UID: \"7126a8b6-6691-4cb3-9115-bedab2e519ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-krtzm"
Sep 15 13:38:35.652112 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.651730    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c6e7d350-b090-4857-a0ce-a608bdcfb099-serviceca\") pod \"node-ca-8tcrg\" (UID: \"c6e7d350-b090-4857-a0ce-a608bdcfb099\") " pod="openshift-image-registry/node-ca-8tcrg"
Sep 15 13:38:35.652112 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.651759    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ff188391-7b0a-4909-b12c-f980b7f047c8-iptables-alerter-script\") pod \"iptables-alerter-n5jmk\" (UID: \"ff188391-7b0a-4909-b12c-f980b7f047c8\") " pod="openshift-network-operator/iptables-alerter-n5jmk"
Sep 15 13:38:35.652112 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.651786    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ff188391-7b0a-4909-b12c-f980b7f047c8-host-slash\") pod \"iptables-alerter-n5jmk\" (UID: \"ff188391-7b0a-4909-b12c-f980b7f047c8\") " pod="openshift-network-operator/iptables-alerter-n5jmk"
Sep 15 13:38:35.652112 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.651809    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c6770793-f370-4bf7-a572-5e367e27292d-etc-tuned\") pod \"tuned-vxdpz\" (UID: \"c6770793-f370-4bf7-a572-5e367e27292d\") " pod="openshift-cluster-node-tuning-operator/tuned-vxdpz"
Sep 15 13:38:35.652112 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.651830    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7126a8b6-6691-4cb3-9115-bedab2e519ad-run-systemd\") pod \"ovnkube-node-krtzm\" (UID: \"7126a8b6-6691-4cb3-9115-bedab2e519ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-krtzm"
Sep 15 13:38:35.652112 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.651854    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fa66793f-19a0-4e87-9a7e-f2c1491c261f-system-cni-dir\") pod \"multus-kjvpd\" (UID: \"fa66793f-19a0-4e87-9a7e-f2c1491c261f\") " pod="openshift-multus/multus-kjvpd"
Sep 15 13:38:35.652112 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.651890    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fa66793f-19a0-4e87-9a7e-f2c1491c261f-cnibin\") pod \"multus-kjvpd\" (UID: \"fa66793f-19a0-4e87-9a7e-f2c1491c261f\") " pod="openshift-multus/multus-kjvpd"
Sep 15 13:38:35.652112 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.651913    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b469b218-cbd7-4873-836f-99ac075ab6ec-hosts-file\") pod \"node-resolver-425qw\" (UID: \"b469b218-cbd7-4873-836f-99ac075ab6ec\") " pod="openshift-dns/node-resolver-425qw"
Sep 15 13:38:35.652112 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.651928    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c6770793-f370-4bf7-a572-5e367e27292d-lib-modules\") pod \"tuned-vxdpz\" (UID: \"c6770793-f370-4bf7-a572-5e367e27292d\") " pod="openshift-cluster-node-tuning-operator/tuned-vxdpz"
Sep 15 13:38:35.652112 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.651952    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c6770793-f370-4bf7-a572-5e367e27292d-host\") pod \"tuned-vxdpz\" (UID: \"c6770793-f370-4bf7-a572-5e367e27292d\") " pod="openshift-cluster-node-tuning-operator/tuned-vxdpz"
Sep 15 13:38:35.652665 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.651977    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cf80e34c-17f8-4fb2-98c0-c9a5a6faf53f-agent-certs\") pod \"konnectivity-agent-bq5dg\" (UID: \"cf80e34c-17f8-4fb2-98c0-c9a5a6faf53f\") " pod="kube-system/konnectivity-agent-bq5dg"
Sep 15 13:38:35.652665 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.652000    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/41073b32-ff62-4ae9-a4e8-aec2b819dd57-system-cni-dir\") pod \"multus-additional-cni-plugins-tgmg6\" (UID: \"41073b32-ff62-4ae9-a4e8-aec2b819dd57\") " pod="openshift-multus/multus-additional-cni-plugins-tgmg6"
Sep 15 13:38:35.652665 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.652021    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/41073b32-ff62-4ae9-a4e8-aec2b819dd57-cni-binary-copy\") pod \"multus-additional-cni-plugins-tgmg6\" (UID: \"41073b32-ff62-4ae9-a4e8-aec2b819dd57\") " pod="openshift-multus/multus-additional-cni-plugins-tgmg6"
Sep 15 13:38:35.652665 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.652045    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fa66793f-19a0-4e87-9a7e-f2c1491c261f-etc-kubernetes\") pod \"multus-kjvpd\" (UID: \"fa66793f-19a0-4e87-9a7e-f2c1491c261f\") " pod="openshift-multus/multus-kjvpd"
Sep 15 13:38:35.652665 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.652065    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c6770793-f370-4bf7-a572-5e367e27292d-etc-sysconfig\") pod \"tuned-vxdpz\" (UID: \"c6770793-f370-4bf7-a572-5e367e27292d\") " pod="openshift-cluster-node-tuning-operator/tuned-vxdpz"
Sep 15 13:38:35.652665 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.652086    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c6770793-f370-4bf7-a572-5e367e27292d-tmp\") pod \"tuned-vxdpz\" (UID: \"c6770793-f370-4bf7-a572-5e367e27292d\") " pod="openshift-cluster-node-tuning-operator/tuned-vxdpz"
Sep 15 13:38:35.674020 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.674004    2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-b9fzh"
Sep 15 13:38:35.685859 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.685842    2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-b9fzh"
Sep 15 13:38:35.740838 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.740815    2578 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 15 13:38:35.752895 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.752856    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/41073b32-ff62-4ae9-a4e8-aec2b819dd57-system-cni-dir\") pod \"multus-additional-cni-plugins-tgmg6\" (UID: \"41073b32-ff62-4ae9-a4e8-aec2b819dd57\") " pod="openshift-multus/multus-additional-cni-plugins-tgmg6"
Sep 15 13:38:35.753015 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.752898    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/41073b32-ff62-4ae9-a4e8-aec2b819dd57-cni-binary-copy\") pod \"multus-additional-cni-plugins-tgmg6\" (UID: \"41073b32-ff62-4ae9-a4e8-aec2b819dd57\") " pod="openshift-multus/multus-additional-cni-plugins-tgmg6"
Sep 15 13:38:35.753015 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.752925    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fa66793f-19a0-4e87-9a7e-f2c1491c261f-etc-kubernetes\") pod \"multus-kjvpd\" (UID: \"fa66793f-19a0-4e87-9a7e-f2c1491c261f\") " pod="openshift-multus/multus-kjvpd"
Sep 15 13:38:35.753015 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.752950    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c6770793-f370-4bf7-a572-5e367e27292d-etc-sysconfig\") pod \"tuned-vxdpz\" (UID: \"c6770793-f370-4bf7-a572-5e367e27292d\") " pod="openshift-cluster-node-tuning-operator/tuned-vxdpz"
Sep 15 13:38:35.753015 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.752961    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/41073b32-ff62-4ae9-a4e8-aec2b819dd57-system-cni-dir\") pod \"multus-additional-cni-plugins-tgmg6\" (UID: \"41073b32-ff62-4ae9-a4e8-aec2b819dd57\") " pod="openshift-multus/multus-additional-cni-plugins-tgmg6"
Sep 15 13:38:35.753015 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.752974    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c6770793-f370-4bf7-a572-5e367e27292d-tmp\") pod \"tuned-vxdpz\" (UID: \"c6770793-f370-4bf7-a572-5e367e27292d\") " pod="openshift-cluster-node-tuning-operator/tuned-vxdpz"
Sep 15 13:38:35.753015 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.753004    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfszc\" (UniqueName: \"kubernetes.io/projected/40e2f2a1-4189-42a4-9686-91de9a5ada27-kube-api-access-cfszc\") pod \"aws-ebs-csi-driver-node-jtkm9\" (UID: \"40e2f2a1-4189-42a4-9686-91de9a5ada27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jtkm9"
Sep 15 13:38:35.753319 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.753018    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fa66793f-19a0-4e87-9a7e-f2c1491c261f-etc-kubernetes\") pod \"multus-kjvpd\" (UID: \"fa66793f-19a0-4e87-9a7e-f2c1491c261f\") " pod="openshift-multus/multus-kjvpd"
Sep 15 13:38:35.753319 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.753068    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c6770793-f370-4bf7-a572-5e367e27292d-etc-sysconfig\") pod \"tuned-vxdpz\" (UID: \"c6770793-f370-4bf7-a572-5e367e27292d\") " pod="openshift-cluster-node-tuning-operator/tuned-vxdpz"
Sep 15 13:38:35.753319 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.753114    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cf80e34c-17f8-4fb2-98c0-c9a5a6faf53f-konnectivity-ca\") pod \"konnectivity-agent-bq5dg\" (UID: \"cf80e34c-17f8-4fb2-98c0-c9a5a6faf53f\") " pod="kube-system/konnectivity-agent-bq5dg"
Sep 15 13:38:35.753319 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.753163    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a1307640-dec4-44a3-a888-f8b1b097f902-kubelet-config\") pod \"global-pull-secret-syncer-f54mn\" (UID: \"a1307640-dec4-44a3-a888-f8b1b097f902\") " pod="kube-system/global-pull-secret-syncer-f54mn"
Sep 15 13:38:35.753319 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.753193    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fa66793f-19a0-4e87-9a7e-f2c1491c261f-multus-conf-dir\") pod \"multus-kjvpd\" (UID: \"fa66793f-19a0-4e87-9a7e-f2c1491c261f\") " pod="openshift-multus/multus-kjvpd"
Sep 15 13:38:35.753319 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.753217    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/40e2f2a1-4189-42a4-9686-91de9a5ada27-socket-dir\") pod \"aws-ebs-csi-driver-node-jtkm9\" (UID: \"40e2f2a1-4189-42a4-9686-91de9a5ada27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jtkm9"
Sep 15 13:38:35.753319 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.753227    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a1307640-dec4-44a3-a888-f8b1b097f902-kubelet-config\") pod \"global-pull-secret-syncer-f54mn\" (UID: \"a1307640-dec4-44a3-a888-f8b1b097f902\") " pod="kube-system/global-pull-secret-syncer-f54mn"
Sep 15 13:38:35.753319 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.753242    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7126a8b6-6691-4cb3-9115-bedab2e519ad-ovn-node-metrics-cert\") pod \"ovnkube-node-krtzm\" (UID: \"7126a8b6-6691-4cb3-9115-bedab2e519ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-krtzm"
Sep 15 13:38:35.753319 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.753266    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a1307640-dec4-44a3-a888-f8b1b097f902-dbus\") pod \"global-pull-secret-syncer-f54mn\" (UID: \"a1307640-dec4-44a3-a888-f8b1b097f902\") " pod="kube-system/global-pull-secret-syncer-f54mn"
Sep 15 13:38:35.753319 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.753276    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fa66793f-19a0-4e87-9a7e-f2c1491c261f-multus-conf-dir\") pod \"multus-kjvpd\" (UID: \"fa66793f-19a0-4e87-9a7e-f2c1491c261f\") " pod="openshift-multus/multus-kjvpd"
Sep 15 13:38:35.753319 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.753288    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a1307640-dec4-44a3-a888-f8b1b097f902-original-pull-secret\") pod \"global-pull-secret-syncer-f54mn\" (UID: \"a1307640-dec4-44a3-a888-f8b1b097f902\") " pod="kube-system/global-pull-secret-syncer-f54mn"
Sep 15 13:38:35.753319 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.753313    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fa66793f-19a0-4e87-9a7e-f2c1491c261f-cni-binary-copy\") pod \"multus-kjvpd\" (UID: \"fa66793f-19a0-4e87-9a7e-f2c1491c261f\") " pod="openshift-multus/multus-kjvpd"
Sep 15 13:38:35.753813 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.753337    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c6770793-f370-4bf7-a572-5e367e27292d-etc-modprobe-d\") pod \"tuned-vxdpz\" (UID: \"c6770793-f370-4bf7-a572-5e367e27292d\") " pod="openshift-cluster-node-tuning-operator/tuned-vxdpz"
Sep 15 13:38:35.753813 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.753361    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/41073b32-ff62-4ae9-a4e8-aec2b819dd57-cnibin\") pod \"multus-additional-cni-plugins-tgmg6\" (UID: \"41073b32-ff62-4ae9-a4e8-aec2b819dd57\") " pod="openshift-multus/multus-additional-cni-plugins-tgmg6"
Sep 15 13:38:35.753813 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.753385    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fa66793f-19a0-4e87-9a7e-f2c1491c261f-multus-daemon-config\") pod \"multus-kjvpd\" (UID: \"fa66793f-19a0-4e87-9a7e-f2c1491c261f\") " pod="openshift-multus/multus-kjvpd"
Sep 15 13:38:35.753813 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.753434    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b469b218-cbd7-4873-836f-99ac075ab6ec-tmp-dir\") pod \"node-resolver-425qw\" (UID: \"b469b218-cbd7-4873-836f-99ac075ab6ec\") " pod="openshift-dns/node-resolver-425qw"
Sep 15 13:38:35.753813 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.753439    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a1307640-dec4-44a3-a888-f8b1b097f902-dbus\") pod \"global-pull-secret-syncer-f54mn\" (UID: \"a1307640-dec4-44a3-a888-f8b1b097f902\") " pod="kube-system/global-pull-secret-syncer-f54mn"
Sep 15 13:38:35.753813 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.753458    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7126a8b6-6691-4cb3-9115-bedab2e519ad-run-openvswitch\") pod \"ovnkube-node-krtzm\" (UID: \"7126a8b6-6691-4cb3-9115-bedab2e519ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-krtzm"
Sep 15 13:38:35.753813 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.753497    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7126a8b6-6691-4cb3-9115-bedab2e519ad-run-openvswitch\") pod \"ovnkube-node-krtzm\" (UID: \"7126a8b6-6691-4cb3-9115-bedab2e519ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-krtzm"
Sep 15 13:38:35.753813 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.753521    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7126a8b6-6691-4cb3-9115-bedab2e519ad-log-socket\") pod \"ovnkube-node-krtzm\" (UID: \"7126a8b6-6691-4cb3-9115-bedab2e519ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-krtzm"
Sep 15 13:38:35.753813 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.753539    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/41073b32-ff62-4ae9-a4e8-aec2b819dd57-cnibin\") pod \"multus-additional-cni-plugins-tgmg6\" (UID: \"41073b32-ff62-4ae9-a4e8-aec2b819dd57\") " pod="openshift-multus/multus-additional-cni-plugins-tgmg6"
Sep 15 13:38:35.753813 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.753546    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7126a8b6-6691-4cb3-9115-bedab2e519ad-host-run-ovn-kubernetes\") pod \"ovnkube-node-krtzm\" (UID: \"7126a8b6-6691-4cb3-9115-bedab2e519ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-krtzm"
Sep 15 13:38:35.753813 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.753580    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/40e2f2a1-4189-42a4-9686-91de9a5ada27-device-dir\") pod \"aws-ebs-csi-driver-node-jtkm9\" (UID: \"40e2f2a1-4189-42a4-9686-91de9a5ada27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jtkm9"
Sep 15 13:38:35.753813 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.753609    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7126a8b6-6691-4cb3-9115-bedab2e519ad-var-lib-openvswitch\") pod \"ovnkube-node-krtzm\" (UID: \"7126a8b6-6691-4cb3-9115-bedab2e519ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-krtzm"
Sep 15 13:38:35.753813 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.753633    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7126a8b6-6691-4cb3-9115-bedab2e519ad-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-krtzm\" (UID: \"7126a8b6-6691-4cb3-9115-bedab2e519ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-krtzm"
Sep 15 13:38:35.753813 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.753601    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7126a8b6-6691-4cb3-9115-bedab2e519ad-host-run-ovn-kubernetes\") pod \"ovnkube-node-krtzm\" (UID: \"7126a8b6-6691-4cb3-9115-bedab2e519ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-krtzm"
Sep 15 13:38:35.753813 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.753659    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7126a8b6-6691-4cb3-9115-bedab2e519ad-ovnkube-config\") pod \"ovnkube-node-krtzm\" (UID: \"7126a8b6-6691-4cb3-9115-bedab2e519ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-krtzm"
Sep 15 13:38:35.753813 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.753664    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/41073b32-ff62-4ae9-a4e8-aec2b819dd57-cni-binary-copy\") pod \"multus-additional-cni-plugins-tgmg6\" (UID: \"41073b32-ff62-4ae9-a4e8-aec2b819dd57\") " pod="openshift-multus/multus-additional-cni-plugins-tgmg6"
Sep 15 13:38:35.753813 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.753676    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cf80e34c-17f8-4fb2-98c0-c9a5a6faf53f-konnectivity-ca\") pod \"konnectivity-agent-bq5dg\" (UID: \"cf80e34c-17f8-4fb2-98c0-c9a5a6faf53f\") " pod="kube-system/konnectivity-agent-bq5dg"
Sep 15 13:38:35.754589 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.753788    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7126a8b6-6691-4cb3-9115-bedab2e519ad-log-socket\") pod \"ovnkube-node-krtzm\" (UID: \"7126a8b6-6691-4cb3-9115-bedab2e519ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-krtzm"
Sep 15 13:38:35.754589 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:35.753837    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 13:38:35.754589 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.753884    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zt7sm\" (UniqueName: \"kubernetes.io/projected/41073b32-ff62-4ae9-a4e8-aec2b819dd57-kube-api-access-zt7sm\") pod \"multus-additional-cni-plugins-tgmg6\" (UID: \"41073b32-ff62-4ae9-a4e8-aec2b819dd57\") " pod="openshift-multus/multus-additional-cni-plugins-tgmg6"
Sep 15 13:38:35.754589 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:35.753927    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1307640-dec4-44a3-a888-f8b1b097f902-original-pull-secret podName:a1307640-dec4-44a3-a888-f8b1b097f902 nodeName:}" failed. No retries permitted until 2026-09-15 13:38:36.253907793 +0000 UTC m=+3.013034076 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a1307640-dec4-44a3-a888-f8b1b097f902-original-pull-secret") pod "global-pull-secret-syncer-f54mn" (UID: "a1307640-dec4-44a3-a888-f8b1b097f902") : object "kube-system"/"original-pull-secret" not registered
Sep 15 13:38:35.754589 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.753944    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fa66793f-19a0-4e87-9a7e-f2c1491c261f-multus-socket-dir-parent\") pod \"multus-kjvpd\" (UID: \"fa66793f-19a0-4e87-9a7e-f2c1491c261f\") " pod="openshift-multus/multus-kjvpd"
Sep 15 13:38:35.754589 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.753952    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b469b218-cbd7-4873-836f-99ac075ab6ec-tmp-dir\") pod \"node-resolver-425qw\" (UID: \"b469b218-cbd7-4873-836f-99ac075ab6ec\") " pod="openshift-dns/node-resolver-425qw"
Sep 15 13:38:35.754589 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.753969    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fa66793f-19a0-4e87-9a7e-f2c1491c261f-host-var-lib-cni-bin\") pod \"multus-kjvpd\" (UID: \"fa66793f-19a0-4e87-9a7e-f2c1491c261f\") " pod="openshift-multus/multus-kjvpd"
Sep 15 13:38:35.754589 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.753995    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c6770793-f370-4bf7-a572-5e367e27292d-var-lib-kubelet\") pod \"tuned-vxdpz\" (UID: \"c6770793-f370-4bf7-a572-5e367e27292d\") " pod="openshift-cluster-node-tuning-operator/tuned-vxdpz"
Sep 15 13:38:35.754589 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.754017    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g52xs\" (UniqueName: \"kubernetes.io/projected/c6770793-f370-4bf7-a572-5e367e27292d-kube-api-access-g52xs\") pod \"tuned-vxdpz\" (UID: \"c6770793-f370-4bf7-a572-5e367e27292d\") " pod="openshift-cluster-node-tuning-operator/tuned-vxdpz"
Sep 15 13:38:35.754589 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.754073    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fa66793f-19a0-4e87-9a7e-f2c1491c261f-multus-socket-dir-parent\") pod \"multus-kjvpd\" (UID: \"fa66793f-19a0-4e87-9a7e-f2c1491c261f\") " pod="openshift-multus/multus-kjvpd"
Sep 15 13:38:35.754589 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.754107    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7126a8b6-6691-4cb3-9115-bedab2e519ad-systemd-units\") pod \"ovnkube-node-krtzm\" (UID: \"7126a8b6-6691-4cb3-9115-bedab2e519ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-krtzm"
Sep 15 13:38:35.754589 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.754152    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7126a8b6-6691-4cb3-9115-bedab2e519ad-host-cni-netd\") pod \"ovnkube-node-krtzm\" (UID: \"7126a8b6-6691-4cb3-9115-bedab2e519ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-krtzm"
Sep 15 13:38:35.754589 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.754199    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fa66793f-19a0-4e87-9a7e-f2c1491c261f-host-var-lib-cni-bin\") pod \"multus-kjvpd\" (UID: \"fa66793f-19a0-4e87-9a7e-f2c1491c261f\") " pod="openshift-multus/multus-kjvpd"
Sep 15 13:38:35.754589 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.754235    2578 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 15 13:38:35.754589 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.754247    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7126a8b6-6691-4cb3-9115-bedab2e519ad-host-cni-netd\") pod \"ovnkube-node-krtzm\" (UID: \"7126a8b6-6691-4cb3-9115-bedab2e519ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-krtzm"
Sep 15 13:38:35.754589 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.754287    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7126a8b6-6691-4cb3-9115-bedab2e519ad-var-lib-openvswitch\") pod \"ovnkube-node-krtzm\" (UID: \"7126a8b6-6691-4cb3-9115-bedab2e519ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-krtzm"
Sep 15 13:38:35.754589 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.754345    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c6770793-f370-4bf7-a572-5e367e27292d-var-lib-kubelet\") pod \"tuned-vxdpz\" (UID: \"c6770793-f370-4bf7-a572-5e367e27292d\") " pod="openshift-cluster-node-tuning-operator/tuned-vxdpz"
Sep 15 13:38:35.755320 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.754373    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m88lg\" (UniqueName: \"kubernetes.io/projected/82807e36-72ea-4ef2-a3bf-66fa30a9b389-kube-api-access-m88lg\") pod \"network-check-target-24wlp\" (UID: \"82807e36-72ea-4ef2-a3bf-66fa30a9b389\") " pod="openshift-network-diagnostics/network-check-target-24wlp"
Sep 15 13:38:35.755320 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.754397    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7126a8b6-6691-4cb3-9115-bedab2e519ad-systemd-units\") pod \"ovnkube-node-krtzm\" (UID: \"7126a8b6-6691-4cb3-9115-bedab2e519ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-krtzm"
Sep 15 13:38:35.755320 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.754406    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c6770793-f370-4bf7-a572-5e367e27292d-etc-modprobe-d\") pod \"tuned-vxdpz\" (UID: \"c6770793-f370-4bf7-a572-5e367e27292d\") " pod="openshift-cluster-node-tuning-operator/tuned-vxdpz"
Sep 15 13:38:35.755320 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.754405    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c6e7d350-b090-4857-a0ce-a608bdcfb099-host\") pod \"node-ca-8tcrg\" (UID: \"c6e7d350-b090-4857-a0ce-a608bdcfb099\") " pod="openshift-image-registry/node-ca-8tcrg"
Sep 15 13:38:35.755320 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.754442    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c6e7d350-b090-4857-a0ce-a608bdcfb099-host\") pod \"node-ca-8tcrg\" (UID: \"c6e7d350-b090-4857-a0ce-a608bdcfb099\") " pod="openshift-image-registry/node-ca-8tcrg"
Sep 15 13:38:35.755320 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.754448    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhcj6\" (UniqueName: \"kubernetes.io/projected/c6e7d350-b090-4857-a0ce-a608bdcfb099-kube-api-access-zhcj6\") pod \"node-ca-8tcrg\" (UID: \"c6e7d350-b090-4857-a0ce-a608bdcfb099\") " pod="openshift-image-registry/node-ca-8tcrg"
Sep 15 13:38:35.755320 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.754484    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvrrq\" (UniqueName: \"kubernetes.io/projected/ff188391-7b0a-4909-b12c-f980b7f047c8-kube-api-access-tvrrq\") pod \"iptables-alerter-n5jmk\" (UID: \"ff188391-7b0a-4909-b12c-f980b7f047c8\") " pod="openshift-network-operator/iptables-alerter-n5jmk"
Sep 15 13:38:35.755320 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.754508    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fa66793f-19a0-4e87-9a7e-f2c1491c261f-host-run-netns\") pod \"multus-kjvpd\" (UID: \"fa66793f-19a0-4e87-9a7e-f2c1491c261f\") " pod="openshift-multus/multus-kjvpd"
Sep 15 13:38:35.755320 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.754545    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fa66793f-19a0-4e87-9a7e-f2c1491c261f-host-var-lib-kubelet\") pod \"multus-kjvpd\" (UID: \"fa66793f-19a0-4e87-9a7e-f2c1491c261f\") " pod="openshift-multus/multus-kjvpd"
Sep 15 13:38:35.755320 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.754568    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/40e2f2a1-4189-42a4-9686-91de9a5ada27-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jtkm9\" (UID: \"40e2f2a1-4189-42a4-9686-91de9a5ada27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jtkm9"
Sep 15 13:38:35.755320 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.754600    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/525d9c79-829f-45ae-9cd5-af323bc737ef-metrics-certs\") pod \"network-metrics-daemon-fsnbc\" (UID: \"525d9c79-829f-45ae-9cd5-af323bc737ef\") " pod="openshift-multus/network-metrics-daemon-fsnbc"
Sep 15 13:38:35.755320 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.754626    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c6770793-f370-4bf7-a572-5e367e27292d-etc-kubernetes\") pod \"tuned-vxdpz\" (UID: \"c6770793-f370-4bf7-a572-5e367e27292d\") " pod="openshift-cluster-node-tuning-operator/tuned-vxdpz"
Sep 15 13:38:35.755320 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.754648    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c6770793-f370-4bf7-a572-5e367e27292d-sys\") pod \"tuned-vxdpz\" (UID: \"c6770793-f370-4bf7-a572-5e367e27292d\") " pod="openshift-cluster-node-tuning-operator/tuned-vxdpz"
Sep 15 13:38:35.755320 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.754670    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7126a8b6-6691-4cb3-9115-bedab2e519ad-host-slash\") pod \"ovnkube-node-krtzm\" (UID: \"7126a8b6-6691-4cb3-9115-bedab2e519ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-krtzm"
Sep 15 13:38:35.755320 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.754704    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7126a8b6-6691-4cb3-9115-bedab2e519ad-env-overrides\") pod \"ovnkube-node-krtzm\" (UID: \"7126a8b6-6691-4cb3-9115-bedab2e519ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-krtzm"
Sep 15 13:38:35.755320 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.754729    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7126a8b6-6691-4cb3-9115-bedab2e519ad-ovnkube-script-lib\") pod \"ovnkube-node-krtzm\" (UID: \"7126a8b6-6691-4cb3-9115-bedab2e519ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-krtzm"
Sep 15 13:38:35.755320 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.754733    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fa66793f-19a0-4e87-9a7e-f2c1491c261f-cni-binary-copy\") pod \"multus-kjvpd\" (UID: \"fa66793f-19a0-4e87-9a7e-f2c1491c261f\") " pod="openshift-multus/multus-kjvpd"
Sep 15 13:38:35.755979 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.754746    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7126a8b6-6691-4cb3-9115-bedab2e519ad-ovnkube-config\") pod \"ovnkube-node-krtzm\" (UID: \"7126a8b6-6691-4cb3-9115-bedab2e519ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-krtzm"
Sep 15 13:38:35.755979 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.754753    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fa66793f-19a0-4e87-9a7e-f2c1491c261f-host-var-lib-cni-multus\") pod \"multus-kjvpd\" (UID: \"fa66793f-19a0-4e87-9a7e-f2c1491c261f\") " pod="openshift-multus/multus-kjvpd"
Sep 15 13:38:35.755979 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.754804    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fa66793f-19a0-4e87-9a7e-f2c1491c261f-host-var-lib-cni-multus\") pod \"multus-kjvpd\" (UID: \"fa66793f-19a0-4e87-9a7e-f2c1491c261f\") " pod="openshift-multus/multus-kjvpd"
Sep 15 13:38:35.755979 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.754867    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c6770793-f370-4bf7-a572-5e367e27292d-sys\") pod \"tuned-vxdpz\" (UID: \"c6770793-f370-4bf7-a572-5e367e27292d\") " pod="openshift-cluster-node-tuning-operator/tuned-vxdpz"
Sep 15 13:38:35.755979 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.754897    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c6770793-f370-4bf7-a572-5e367e27292d-etc-kubernetes\") pod \"tuned-vxdpz\" (UID: \"c6770793-f370-4bf7-a572-5e367e27292d\") " pod="openshift-cluster-node-tuning-operator/tuned-vxdpz"
Sep 15 13:38:35.755979 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:35.754901    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 13:38:35.755979 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.754933    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7126a8b6-6691-4cb3-9115-bedab2e519ad-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-krtzm\" (UID: \"7126a8b6-6691-4cb3-9115-bedab2e519ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-krtzm"
Sep 15 13:38:35.755979 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:35.754978    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/525d9c79-829f-45ae-9cd5-af323bc737ef-metrics-certs podName:525d9c79-829f-45ae-9cd5-af323bc737ef nodeName:}" failed. No retries permitted until 2026-09-15 13:38:36.254936335 +0000 UTC m=+3.014062623 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/525d9c79-829f-45ae-9cd5-af323bc737ef-metrics-certs") pod "network-metrics-daemon-fsnbc" (UID: "525d9c79-829f-45ae-9cd5-af323bc737ef") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 13:38:35.755979 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.755023    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fa66793f-19a0-4e87-9a7e-f2c1491c261f-hostroot\") pod \"multus-kjvpd\" (UID: \"fa66793f-19a0-4e87-9a7e-f2c1491c261f\") " pod="openshift-multus/multus-kjvpd"
Sep 15 13:38:35.755979 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.755051    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gplj5\" (UniqueName: \"kubernetes.io/projected/fa66793f-19a0-4e87-9a7e-f2c1491c261f-kube-api-access-gplj5\") pod \"multus-kjvpd\" (UID: \"fa66793f-19a0-4e87-9a7e-f2c1491c261f\") " pod="openshift-multus/multus-kjvpd"
Sep 15 13:38:35.755979 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.755075    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c6770793-f370-4bf7-a572-5e367e27292d-etc-sysctl-d\") pod \"tuned-vxdpz\" (UID: \"c6770793-f370-4bf7-a572-5e367e27292d\") " pod="openshift-cluster-node-tuning-operator/tuned-vxdpz"
Sep 15 13:38:35.755979 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.755141    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/41073b32-ff62-4ae9-a4e8-aec2b819dd57-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tgmg6\" (UID: \"41073b32-ff62-4ae9-a4e8-aec2b819dd57\") " pod="openshift-multus/multus-additional-cni-plugins-tgmg6"
Sep 15 13:38:35.755979 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.755167    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fa66793f-19a0-4e87-9a7e-f2c1491c261f-host-run-k8s-cni-cncf-io\") pod \"multus-kjvpd\" (UID: \"fa66793f-19a0-4e87-9a7e-f2c1491c261f\") " pod="openshift-multus/multus-kjvpd"
Sep 15 13:38:35.755979 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.755194    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fa66793f-19a0-4e87-9a7e-f2c1491c261f-host-run-netns\") pod \"multus-kjvpd\" (UID: \"fa66793f-19a0-4e87-9a7e-f2c1491c261f\") " pod="openshift-multus/multus-kjvpd"
Sep 15 13:38:35.755979 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.755234    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fa66793f-19a0-4e87-9a7e-f2c1491c261f-multus-daemon-config\") pod \"multus-kjvpd\" (UID: \"fa66793f-19a0-4e87-9a7e-f2c1491c261f\") " pod="openshift-multus/multus-kjvpd"
Sep 15 13:38:35.755979 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.755246    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7126a8b6-6691-4cb3-9115-bedab2e519ad-env-overrides\") pod \"ovnkube-node-krtzm\" (UID: \"7126a8b6-6691-4cb3-9115-bedab2e519ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-krtzm"
Sep 15 13:38:35.755979 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.755254    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fa66793f-19a0-4e87-9a7e-f2c1491c261f-host-run-multus-certs\") pod \"multus-kjvpd\" (UID: \"fa66793f-19a0-4e87-9a7e-f2c1491c261f\") " pod="openshift-multus/multus-kjvpd"
Sep 15 13:38:35.756972 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.755280    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c6770793-f370-4bf7-a572-5e367e27292d-run\") pod \"tuned-vxdpz\" (UID: \"c6770793-f370-4bf7-a572-5e367e27292d\") " pod="openshift-cluster-node-tuning-operator/tuned-vxdpz"
Sep 15 13:38:35.756972 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.755300    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fa66793f-19a0-4e87-9a7e-f2c1491c261f-host-run-k8s-cni-cncf-io\") pod \"multus-kjvpd\" (UID: \"fa66793f-19a0-4e87-9a7e-f2c1491c261f\") " pod="openshift-multus/multus-kjvpd"
Sep 15 13:38:35.756972 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.755307    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/40e2f2a1-4189-42a4-9686-91de9a5ada27-etc-selinux\") pod \"aws-ebs-csi-driver-node-jtkm9\" (UID: \"40e2f2a1-4189-42a4-9686-91de9a5ada27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jtkm9"
Sep 15 13:38:35.756972 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.755335    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fa66793f-19a0-4e87-9a7e-f2c1491c261f-hostroot\") pod \"multus-kjvpd\" (UID: \"fa66793f-19a0-4e87-9a7e-f2c1491c261f\") " pod="openshift-multus/multus-kjvpd"
Sep 15 13:38:35.756972 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.755335    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7126a8b6-6691-4cb3-9115-bedab2e519ad-host-kubelet\") pod \"ovnkube-node-krtzm\" (UID: \"7126a8b6-6691-4cb3-9115-bedab2e519ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-krtzm"
Sep 15 13:38:35.756972 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.755367    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7126a8b6-6691-4cb3-9115-bedab2e519ad-run-ovn\") pod \"ovnkube-node-krtzm\" (UID: \"7126a8b6-6691-4cb3-9115-bedab2e519ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-krtzm"
Sep 15 13:38:35.756972 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.755371    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7126a8b6-6691-4cb3-9115-bedab2e519ad-host-kubelet\") pod \"ovnkube-node-krtzm\" (UID: \"7126a8b6-6691-4cb3-9115-bedab2e519ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-krtzm"
Sep 15 13:38:35.756972 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.755395    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/41073b32-ff62-4ae9-a4e8-aec2b819dd57-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tgmg6\" (UID: \"41073b32-ff62-4ae9-a4e8-aec2b819dd57\") " pod="openshift-multus/multus-additional-cni-plugins-tgmg6"
Sep 15 13:38:35.756972 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.755420    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7126a8b6-6691-4cb3-9115-bedab2e519ad-host-run-netns\") pod \"ovnkube-node-krtzm\" (UID: \"7126a8b6-6691-4cb3-9115-bedab2e519ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-krtzm"
Sep 15 13:38:35.756972 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.755421    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c6770793-f370-4bf7-a572-5e367e27292d-run\") pod \"tuned-vxdpz\" (UID: \"c6770793-f370-4bf7-a572-5e367e27292d\") " pod="openshift-cluster-node-tuning-operator/tuned-vxdpz"
Sep 15 13:38:35.756972 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.755461    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fa66793f-19a0-4e87-9a7e-f2c1491c261f-host-var-lib-kubelet\") pod \"multus-kjvpd\" (UID: \"fa66793f-19a0-4e87-9a7e-f2c1491c261f\") " pod="openshift-multus/multus-kjvpd"
Sep 15 13:38:35.756972 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.755470    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7126a8b6-6691-4cb3-9115-bedab2e519ad-host-run-netns\") pod \"ovnkube-node-krtzm\" (UID: \"7126a8b6-6691-4cb3-9115-bedab2e519ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-krtzm"
Sep 15 13:38:35.756972 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.755489    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7126a8b6-6691-4cb3-9115-bedab2e519ad-host-cni-bin\") pod \"ovnkube-node-krtzm\" (UID: \"7126a8b6-6691-4cb3-9115-bedab2e519ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-krtzm"
Sep 15 13:38:35.756972 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.755515    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fa66793f-19a0-4e87-9a7e-f2c1491c261f-multus-cni-dir\") pod \"multus-kjvpd\" (UID: \"fa66793f-19a0-4e87-9a7e-f2c1491c261f\") " pod="openshift-multus/multus-kjvpd"
Sep 15 13:38:35.756972 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.755515    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7126a8b6-6691-4cb3-9115-bedab2e519ad-host-slash\") pod \"ovnkube-node-krtzm\" (UID: \"7126a8b6-6691-4cb3-9115-bedab2e519ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-krtzm"
Sep 15 13:38:35.756972 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.755462    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c6770793-f370-4bf7-a572-5e367e27292d-etc-sysctl-d\") pod \"tuned-vxdpz\" (UID: \"c6770793-f370-4bf7-a572-5e367e27292d\") " pod="openshift-cluster-node-tuning-operator/tuned-vxdpz"
Sep 15 13:38:35.756972 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.755554    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7126a8b6-6691-4cb3-9115-bedab2e519ad-host-cni-bin\") pod \"ovnkube-node-krtzm\" (UID: \"7126a8b6-6691-4cb3-9115-bedab2e519ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-krtzm"
Sep 15 13:38:35.756972 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.755578    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fa66793f-19a0-4e87-9a7e-f2c1491c261f-multus-cni-dir\") pod \"multus-kjvpd\" (UID: \"fa66793f-19a0-4e87-9a7e-f2c1491c261f\") " pod="openshift-multus/multus-kjvpd"
Sep 15 13:38:35.757817 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.755590    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7126a8b6-6691-4cb3-9115-bedab2e519ad-run-ovn\") pod \"ovnkube-node-krtzm\" (UID: \"7126a8b6-6691-4cb3-9115-bedab2e519ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-krtzm"
Sep 15 13:38:35.757817 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.755602    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fa66793f-19a0-4e87-9a7e-f2c1491c261f-host-run-multus-certs\") pod \"multus-kjvpd\" (UID: \"fa66793f-19a0-4e87-9a7e-f2c1491c261f\") " pod="openshift-multus/multus-kjvpd"
Sep 15 13:38:35.757817 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.755670    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c6770793-f370-4bf7-a572-5e367e27292d-etc-systemd\") pod \"tuned-vxdpz\" (UID: \"c6770793-f370-4bf7-a572-5e367e27292d\") " pod="openshift-cluster-node-tuning-operator/tuned-vxdpz"
Sep 15 13:38:35.757817 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.755624    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c6770793-f370-4bf7-a572-5e367e27292d-etc-systemd\") pod \"tuned-vxdpz\" (UID: \"c6770793-f370-4bf7-a572-5e367e27292d\") " pod="openshift-cluster-node-tuning-operator/tuned-vxdpz"
Sep 15 13:38:35.757817 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.755985    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/40e2f2a1-4189-42a4-9686-91de9a5ada27-sys-fs\") pod \"aws-ebs-csi-driver-node-jtkm9\" (UID: \"40e2f2a1-4189-42a4-9686-91de9a5ada27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jtkm9"
Sep 15 13:38:35.757817 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.755914    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/41073b32-ff62-4ae9-a4e8-aec2b819dd57-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tgmg6\" (UID: \"41073b32-ff62-4ae9-a4e8-aec2b819dd57\") " pod="openshift-multus/multus-additional-cni-plugins-tgmg6"
Sep 15 13:38:35.757817 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.756231    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7126a8b6-6691-4cb3-9115-bedab2e519ad-etc-openvswitch\") pod \"ovnkube-node-krtzm\" (UID: \"7126a8b6-6691-4cb3-9115-bedab2e519ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-krtzm"
Sep 15 13:38:35.757817 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.756234    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/41073b32-ff62-4ae9-a4e8-aec2b819dd57-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tgmg6\" (UID: \"41073b32-ff62-4ae9-a4e8-aec2b819dd57\") " pod="openshift-multus/multus-additional-cni-plugins-tgmg6"
Sep 15 13:38:35.757817 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.756256    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7126a8b6-6691-4cb3-9115-bedab2e519ad-ovnkube-script-lib\") pod \"ovnkube-node-krtzm\" (UID: \"7126a8b6-6691-4cb3-9115-bedab2e519ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-krtzm"
Sep 15 13:38:35.757817 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.756277    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pmlz\" (UniqueName: \"kubernetes.io/projected/7126a8b6-6691-4cb3-9115-bedab2e519ad-kube-api-access-7pmlz\") pod \"ovnkube-node-krtzm\" (UID: \"7126a8b6-6691-4cb3-9115-bedab2e519ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-krtzm"
Sep 15 13:38:35.757817 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.756300    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7126a8b6-6691-4cb3-9115-bedab2e519ad-etc-openvswitch\") pod \"ovnkube-node-krtzm\" (UID: \"7126a8b6-6691-4cb3-9115-bedab2e519ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-krtzm"
Sep 15 13:38:35.757817 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.756334    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/41073b32-ff62-4ae9-a4e8-aec2b819dd57-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tgmg6\" (UID: \"41073b32-ff62-4ae9-a4e8-aec2b819dd57\") " pod="openshift-multus/multus-additional-cni-plugins-tgmg6"
Sep 15 13:38:35.757817 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.756359    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hv46\" (UniqueName: \"kubernetes.io/projected/525d9c79-829f-45ae-9cd5-af323bc737ef-kube-api-access-6hv46\") pod \"network-metrics-daemon-fsnbc\" (UID: \"525d9c79-829f-45ae-9cd5-af323bc737ef\") " pod="openshift-multus/network-metrics-daemon-fsnbc"
Sep 15 13:38:35.757817 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.756476    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/41073b32-ff62-4ae9-a4e8-aec2b819dd57-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tgmg6\" (UID: \"41073b32-ff62-4ae9-a4e8-aec2b819dd57\") " pod="openshift-multus/multus-additional-cni-plugins-tgmg6"
Sep 15 13:38:35.757817 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.756507    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5cqb\" (UniqueName: \"kubernetes.io/projected/b469b218-cbd7-4873-836f-99ac075ab6ec-kube-api-access-h5cqb\") pod \"node-resolver-425qw\" (UID: \"b469b218-cbd7-4873-836f-99ac075ab6ec\") " pod="openshift-dns/node-resolver-425qw"
Sep 15 13:38:35.757817 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.756506    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-41.ec2.internal" event={"ID":"00b57328426a8f6e26f2dac35d497a0b","Type":"ContainerStarted","Data":"e7c6e5cdd12c5c436cd7ae0b18c10d0b1dd4955a43cbe06614952bb017b4c67d"}
Sep 15 13:38:35.757817 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.756536    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c6770793-f370-4bf7-a572-5e367e27292d-etc-sysctl-conf\") pod \"tuned-vxdpz\" (UID: \"c6770793-f370-4bf7-a572-5e367e27292d\") " pod="openshift-cluster-node-tuning-operator/tuned-vxdpz"
Sep 15 13:38:35.758619 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.756593    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7126a8b6-6691-4cb3-9115-bedab2e519ad-node-log\") pod \"ovnkube-node-krtzm\" (UID: \"7126a8b6-6691-4cb3-9115-bedab2e519ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-krtzm"
Sep 15 13:38:35.758619 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.756620    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c6e7d350-b090-4857-a0ce-a608bdcfb099-serviceca\") pod \"node-ca-8tcrg\" (UID: \"c6e7d350-b090-4857-a0ce-a608bdcfb099\") " pod="openshift-image-registry/node-ca-8tcrg"
Sep 15 13:38:35.758619 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.756671    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ff188391-7b0a-4909-b12c-f980b7f047c8-iptables-alerter-script\") pod \"iptables-alerter-n5jmk\" (UID: \"ff188391-7b0a-4909-b12c-f980b7f047c8\") " pod="openshift-network-operator/iptables-alerter-n5jmk"
Sep 15 13:38:35.758619 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.756697    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ff188391-7b0a-4909-b12c-f980b7f047c8-host-slash\") pod \"iptables-alerter-n5jmk\" (UID: \"ff188391-7b0a-4909-b12c-f980b7f047c8\") " pod="openshift-network-operator/iptables-alerter-n5jmk"
Sep 15 13:38:35.758619 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.756732    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c6770793-f370-4bf7-a572-5e367e27292d-etc-tuned\") pod \"tuned-vxdpz\" (UID: \"c6770793-f370-4bf7-a572-5e367e27292d\") " pod="openshift-cluster-node-tuning-operator/tuned-vxdpz"
Sep 15 13:38:35.758619 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.756671    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7126a8b6-6691-4cb3-9115-bedab2e519ad-node-log\") pod \"ovnkube-node-krtzm\" (UID: \"7126a8b6-6691-4cb3-9115-bedab2e519ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-krtzm"
Sep 15 13:38:35.758619 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.756782    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7126a8b6-6691-4cb3-9115-bedab2e519ad-run-systemd\") pod \"ovnkube-node-krtzm\" (UID: \"7126a8b6-6691-4cb3-9115-bedab2e519ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-krtzm"
Sep 15 13:38:35.758619 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.756807    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fa66793f-19a0-4e87-9a7e-f2c1491c261f-system-cni-dir\") pod \"multus-kjvpd\" (UID: \"fa66793f-19a0-4e87-9a7e-f2c1491c261f\") " pod="openshift-multus/multus-kjvpd"
Sep 15 13:38:35.758619 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.756807    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ff188391-7b0a-4909-b12c-f980b7f047c8-host-slash\") pod \"iptables-alerter-n5jmk\" (UID: \"ff188391-7b0a-4909-b12c-f980b7f047c8\") " pod="openshift-network-operator/iptables-alerter-n5jmk"
Sep 15 13:38:35.758619 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.756848    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fa66793f-19a0-4e87-9a7e-f2c1491c261f-cnibin\") pod \"multus-kjvpd\" (UID: \"fa66793f-19a0-4e87-9a7e-f2c1491c261f\") " pod="openshift-multus/multus-kjvpd"
Sep 15 13:38:35.758619 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.756872    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fa66793f-19a0-4e87-9a7e-f2c1491c261f-system-cni-dir\") pod \"multus-kjvpd\" (UID: \"fa66793f-19a0-4e87-9a7e-f2c1491c261f\") " pod="openshift-multus/multus-kjvpd"
Sep 15 13:38:35.758619 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.756878    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7126a8b6-6691-4cb3-9115-bedab2e519ad-run-systemd\") pod \"ovnkube-node-krtzm\" (UID: \"7126a8b6-6691-4cb3-9115-bedab2e519ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-krtzm"
Sep 15 13:38:35.758619 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.756925    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b469b218-cbd7-4873-836f-99ac075ab6ec-hosts-file\") pod \"node-resolver-425qw\" (UID: \"b469b218-cbd7-4873-836f-99ac075ab6ec\") " pod="openshift-dns/node-resolver-425qw"
Sep 15 13:38:35.758619 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.756928    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fa66793f-19a0-4e87-9a7e-f2c1491c261f-cnibin\") pod \"multus-kjvpd\" (UID: \"fa66793f-19a0-4e87-9a7e-f2c1491c261f\") " pod="openshift-multus/multus-kjvpd"
Sep 15 13:38:35.758619 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.756962    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c6770793-f370-4bf7-a572-5e367e27292d-lib-modules\") pod \"tuned-vxdpz\" (UID: \"c6770793-f370-4bf7-a572-5e367e27292d\") " pod="openshift-cluster-node-tuning-operator/tuned-vxdpz"
Sep 15 13:38:35.758619 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.756980    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b469b218-cbd7-4873-836f-99ac075ab6ec-hosts-file\") pod \"node-resolver-425qw\" (UID: \"b469b218-cbd7-4873-836f-99ac075ab6ec\") " pod="openshift-dns/node-resolver-425qw"
Sep 15 13:38:35.758619 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.757019    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c6770793-f370-4bf7-a572-5e367e27292d-host\") pod \"tuned-vxdpz\" (UID: \"c6770793-f370-4bf7-a572-5e367e27292d\") " pod="openshift-cluster-node-tuning-operator/tuned-vxdpz"
Sep 15 13:38:35.758619 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.757061    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/40e2f2a1-4189-42a4-9686-91de9a5ada27-registration-dir\") pod \"aws-ebs-csi-driver-node-jtkm9\" (UID: \"40e2f2a1-4189-42a4-9686-91de9a5ada27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jtkm9"
Sep 15 13:38:35.759139 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.757067    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c6770793-f370-4bf7-a572-5e367e27292d-lib-modules\") pod \"tuned-vxdpz\" (UID: \"c6770793-f370-4bf7-a572-5e367e27292d\") " pod="openshift-cluster-node-tuning-operator/tuned-vxdpz"
Sep 15 13:38:35.759139 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.757085    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cf80e34c-17f8-4fb2-98c0-c9a5a6faf53f-agent-certs\") pod \"konnectivity-agent-bq5dg\" (UID: \"cf80e34c-17f8-4fb2-98c0-c9a5a6faf53f\") " pod="kube-system/konnectivity-agent-bq5dg"
Sep 15 13:38:35.759139 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.757099    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c6e7d350-b090-4857-a0ce-a608bdcfb099-serviceca\") pod \"node-ca-8tcrg\" (UID: \"c6e7d350-b090-4857-a0ce-a608bdcfb099\") " pod="openshift-image-registry/node-ca-8tcrg"
Sep 15 13:38:35.759139 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.757153    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c6770793-f370-4bf7-a572-5e367e27292d-host\") pod \"tuned-vxdpz\" (UID: \"c6770793-f370-4bf7-a572-5e367e27292d\") " pod="openshift-cluster-node-tuning-operator/tuned-vxdpz"
Sep 15 13:38:35.759139 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.757193    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c6770793-f370-4bf7-a572-5e367e27292d-etc-sysctl-conf\") pod \"tuned-vxdpz\" (UID: \"c6770793-f370-4bf7-a572-5e367e27292d\") " pod="openshift-cluster-node-tuning-operator/tuned-vxdpz"
Sep 15 13:38:35.759139 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.757392    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ff188391-7b0a-4909-b12c-f980b7f047c8-iptables-alerter-script\") pod \"iptables-alerter-n5jmk\" (UID: \"ff188391-7b0a-4909-b12c-f980b7f047c8\") " pod="openshift-network-operator/iptables-alerter-n5jmk"
Sep 15 13:38:35.759139 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.758619    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c6770793-f370-4bf7-a572-5e367e27292d-tmp\") pod \"tuned-vxdpz\" (UID: \"c6770793-f370-4bf7-a572-5e367e27292d\") " pod="openshift-cluster-node-tuning-operator/tuned-vxdpz"
Sep 15 13:38:35.759139 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.758835    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7126a8b6-6691-4cb3-9115-bedab2e519ad-ovn-node-metrics-cert\") pod \"ovnkube-node-krtzm\" (UID: \"7126a8b6-6691-4cb3-9115-bedab2e519ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-krtzm"
Sep 15 13:38:35.759139 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.759050    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c6770793-f370-4bf7-a572-5e367e27292d-etc-tuned\") pod \"tuned-vxdpz\" (UID: \"c6770793-f370-4bf7-a572-5e367e27292d\") " pod="openshift-cluster-node-tuning-operator/tuned-vxdpz"
Sep 15 13:38:35.759385 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.759326    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cf80e34c-17f8-4fb2-98c0-c9a5a6faf53f-agent-certs\") pod \"konnectivity-agent-bq5dg\" (UID: \"cf80e34c-17f8-4fb2-98c0-c9a5a6faf53f\") " pod="kube-system/konnectivity-agent-bq5dg"
Sep 15 13:38:35.762860 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.762832    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g52xs\" (UniqueName: \"kubernetes.io/projected/c6770793-f370-4bf7-a572-5e367e27292d-kube-api-access-g52xs\") pod \"tuned-vxdpz\" (UID: \"c6770793-f370-4bf7-a572-5e367e27292d\") " pod="openshift-cluster-node-tuning-operator/tuned-vxdpz"
Sep 15 13:38:35.763065 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.763034    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zt7sm\" (UniqueName: \"kubernetes.io/projected/41073b32-ff62-4ae9-a4e8-aec2b819dd57-kube-api-access-zt7sm\") pod \"multus-additional-cni-plugins-tgmg6\" (UID: \"41073b32-ff62-4ae9-a4e8-aec2b819dd57\") " pod="openshift-multus/multus-additional-cni-plugins-tgmg6"
Sep 15 13:38:35.764078 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.764056    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhcj6\" (UniqueName: \"kubernetes.io/projected/c6e7d350-b090-4857-a0ce-a608bdcfb099-kube-api-access-zhcj6\") pod \"node-ca-8tcrg\" (UID: \"c6e7d350-b090-4857-a0ce-a608bdcfb099\") " pod="openshift-image-registry/node-ca-8tcrg"
Sep 15 13:38:35.764218 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.764201    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvrrq\" (UniqueName: \"kubernetes.io/projected/ff188391-7b0a-4909-b12c-f980b7f047c8-kube-api-access-tvrrq\") pod \"iptables-alerter-n5jmk\" (UID: \"ff188391-7b0a-4909-b12c-f980b7f047c8\") " pod="openshift-network-operator/iptables-alerter-n5jmk"
Sep 15 13:38:35.764407 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.764386    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gplj5\" (UniqueName: \"kubernetes.io/projected/fa66793f-19a0-4e87-9a7e-f2c1491c261f-kube-api-access-gplj5\") pod \"multus-kjvpd\" (UID: \"fa66793f-19a0-4e87-9a7e-f2c1491c261f\") " pod="openshift-multus/multus-kjvpd"
Sep 15 13:38:35.764826 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.764810    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pmlz\" (UniqueName: \"kubernetes.io/projected/7126a8b6-6691-4cb3-9115-bedab2e519ad-kube-api-access-7pmlz\") pod \"ovnkube-node-krtzm\" (UID: \"7126a8b6-6691-4cb3-9115-bedab2e519ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-krtzm"
Sep 15 13:38:35.764946 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.764932    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5cqb\" (UniqueName: \"kubernetes.io/projected/b469b218-cbd7-4873-836f-99ac075ab6ec-kube-api-access-h5cqb\") pod \"node-resolver-425qw\" (UID: \"b469b218-cbd7-4873-836f-99ac075ab6ec\") " pod="openshift-dns/node-resolver-425qw"
Sep 15 13:38:35.765517 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.765498    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hv46\" (UniqueName: \"kubernetes.io/projected/525d9c79-829f-45ae-9cd5-af323bc737ef-kube-api-access-6hv46\") pod \"network-metrics-daemon-fsnbc\" (UID: \"525d9c79-829f-45ae-9cd5-af323bc737ef\") " pod="openshift-multus/network-metrics-daemon-fsnbc"
Sep 15 13:38:35.799671 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:35.799648    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05a0e38cdf2b9f115ed4af66ef9f8f2f.slice/crio-166a282616d3ad6e734e725b85061f40048e6d446c003095678ce34fc6005845 WatchSource:0}: Error finding container 166a282616d3ad6e734e725b85061f40048e6d446c003095678ce34fc6005845: Status 404 returned error can't find the container with id 166a282616d3ad6e734e725b85061f40048e6d446c003095678ce34fc6005845
Sep 15 13:38:35.857699 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.857627    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/40e2f2a1-4189-42a4-9686-91de9a5ada27-sys-fs\") pod \"aws-ebs-csi-driver-node-jtkm9\" (UID: \"40e2f2a1-4189-42a4-9686-91de9a5ada27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jtkm9"
Sep 15 13:38:35.857699 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.857661    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/40e2f2a1-4189-42a4-9686-91de9a5ada27-registration-dir\") pod \"aws-ebs-csi-driver-node-jtkm9\" (UID: \"40e2f2a1-4189-42a4-9686-91de9a5ada27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jtkm9"
Sep 15 13:38:35.857699 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.857681    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfszc\" (UniqueName: \"kubernetes.io/projected/40e2f2a1-4189-42a4-9686-91de9a5ada27-kube-api-access-cfszc\") pod \"aws-ebs-csi-driver-node-jtkm9\" (UID: \"40e2f2a1-4189-42a4-9686-91de9a5ada27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jtkm9"
Sep 15 13:38:35.857699 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.857697    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/40e2f2a1-4189-42a4-9686-91de9a5ada27-socket-dir\") pod \"aws-ebs-csi-driver-node-jtkm9\" (UID: \"40e2f2a1-4189-42a4-9686-91de9a5ada27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jtkm9"
Sep 15 13:38:35.857986 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.857724    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/40e2f2a1-4189-42a4-9686-91de9a5ada27-device-dir\") pod \"aws-ebs-csi-driver-node-jtkm9\" (UID: \"40e2f2a1-4189-42a4-9686-91de9a5ada27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jtkm9"
Sep 15 13:38:35.857986 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.857761    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m88lg\" (UniqueName: \"kubernetes.io/projected/82807e36-72ea-4ef2-a3bf-66fa30a9b389-kube-api-access-m88lg\") pod \"network-check-target-24wlp\" (UID: \"82807e36-72ea-4ef2-a3bf-66fa30a9b389\") " pod="openshift-network-diagnostics/network-check-target-24wlp"
Sep 15 13:38:35.857986 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.857765    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/40e2f2a1-4189-42a4-9686-91de9a5ada27-registration-dir\") pod \"aws-ebs-csi-driver-node-jtkm9\" (UID: \"40e2f2a1-4189-42a4-9686-91de9a5ada27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jtkm9"
Sep 15 13:38:35.857986 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.857789    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/40e2f2a1-4189-42a4-9686-91de9a5ada27-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jtkm9\" (UID: \"40e2f2a1-4189-42a4-9686-91de9a5ada27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jtkm9"
Sep 15 13:38:35.857986 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.857769    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/40e2f2a1-4189-42a4-9686-91de9a5ada27-sys-fs\") pod \"aws-ebs-csi-driver-node-jtkm9\" (UID: \"40e2f2a1-4189-42a4-9686-91de9a5ada27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jtkm9"
Sep 15 13:38:35.857986 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.857823    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/40e2f2a1-4189-42a4-9686-91de9a5ada27-device-dir\") pod \"aws-ebs-csi-driver-node-jtkm9\" (UID: \"40e2f2a1-4189-42a4-9686-91de9a5ada27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jtkm9"
Sep 15 13:38:35.857986 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.857848    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/40e2f2a1-4189-42a4-9686-91de9a5ada27-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jtkm9\" (UID: \"40e2f2a1-4189-42a4-9686-91de9a5ada27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jtkm9"
Sep 15 13:38:35.857986 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.857892    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/40e2f2a1-4189-42a4-9686-91de9a5ada27-socket-dir\") pod \"aws-ebs-csi-driver-node-jtkm9\" (UID: \"40e2f2a1-4189-42a4-9686-91de9a5ada27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jtkm9"
Sep 15 13:38:35.857986 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.857896    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/40e2f2a1-4189-42a4-9686-91de9a5ada27-etc-selinux\") pod \"aws-ebs-csi-driver-node-jtkm9\" (UID: \"40e2f2a1-4189-42a4-9686-91de9a5ada27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jtkm9"
Sep 15 13:38:35.857986 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.857962    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/40e2f2a1-4189-42a4-9686-91de9a5ada27-etc-selinux\") pod \"aws-ebs-csi-driver-node-jtkm9\" (UID: \"40e2f2a1-4189-42a4-9686-91de9a5ada27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jtkm9"
Sep 15 13:38:35.863867 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:35.863850    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 13:38:35.863924 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:35.863873    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 13:38:35.863924 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:35.863884    2578 projected.go:196] Error preparing data for projected volume kube-api-access-m88lg for pod openshift-network-diagnostics/network-check-target-24wlp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 13:38:35.863996 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:35.863943    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82807e36-72ea-4ef2-a3bf-66fa30a9b389-kube-api-access-m88lg podName:82807e36-72ea-4ef2-a3bf-66fa30a9b389 nodeName:}" failed. No retries permitted until 2026-09-15 13:38:36.363926335 +0000 UTC m=+3.123052619 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-m88lg" (UniqueName: "kubernetes.io/projected/82807e36-72ea-4ef2-a3bf-66fa30a9b389-kube-api-access-m88lg") pod "network-check-target-24wlp" (UID: "82807e36-72ea-4ef2-a3bf-66fa30a9b389") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 13:38:35.866256 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.866233    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfszc\" (UniqueName: \"kubernetes.io/projected/40e2f2a1-4189-42a4-9686-91de9a5ada27-kube-api-access-cfszc\") pod \"aws-ebs-csi-driver-node-jtkm9\" (UID: \"40e2f2a1-4189-42a4-9686-91de9a5ada27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jtkm9"
Sep 15 13:38:35.941928 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.941887    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-425qw"
Sep 15 13:38:35.946367 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.946350    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vxdpz"
Sep 15 13:38:35.950479 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:35.950457    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb469b218_cbd7_4873_836f_99ac075ab6ec.slice/crio-74dee60930853f30285f4b6ec9f559ef1cdfa9322a8a6647d59af5d569674b2e WatchSource:0}: Error finding container 74dee60930853f30285f4b6ec9f559ef1cdfa9322a8a6647d59af5d569674b2e: Status 404 returned error can't find the container with id 74dee60930853f30285f4b6ec9f559ef1cdfa9322a8a6647d59af5d569674b2e
Sep 15 13:38:35.955453 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.955381    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-krtzm"
Sep 15 13:38:35.957622 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.957604    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bq5dg"
Sep 15 13:38:35.963958 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.963941    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8tcrg"
Sep 15 13:38:35.965631 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:35.965608    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7126a8b6_6691_4cb3_9115_bedab2e519ad.slice/crio-89e7c47ed89b79c6e796bb929d0a989d22b6c49ac76b386eaad20923d12fae6f WatchSource:0}: Error finding container 89e7c47ed89b79c6e796bb929d0a989d22b6c49ac76b386eaad20923d12fae6f: Status 404 returned error can't find the container with id 89e7c47ed89b79c6e796bb929d0a989d22b6c49ac76b386eaad20923d12fae6f
Sep 15 13:38:35.967802 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:35.967770    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf80e34c_17f8_4fb2_98c0_c9a5a6faf53f.slice/crio-87ea5bc341c29877587dda8d13791e1fef843d3fc052a60a9ffda63d2a0560d8 WatchSource:0}: Error finding container 87ea5bc341c29877587dda8d13791e1fef843d3fc052a60a9ffda63d2a0560d8: Status 404 returned error can't find the container with id 87ea5bc341c29877587dda8d13791e1fef843d3fc052a60a9ffda63d2a0560d8
Sep 15 13:38:35.968824 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.968805    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tgmg6"
Sep 15 13:38:35.972748 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:35.972729    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6e7d350_b090_4857_a0ce_a608bdcfb099.slice/crio-7bb6454cb9738eb26447a4b9574f69a8896ad9da6db5f1e13ae767ba50ae6b77 WatchSource:0}: Error finding container 7bb6454cb9738eb26447a4b9574f69a8896ad9da6db5f1e13ae767ba50ae6b77: Status 404 returned error can't find the container with id 7bb6454cb9738eb26447a4b9574f69a8896ad9da6db5f1e13ae767ba50ae6b77
Sep 15 13:38:35.973382 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.973365    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-kjvpd"
Sep 15 13:38:35.976969 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:35.976947    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41073b32_ff62_4ae9_a4e8_aec2b819dd57.slice/crio-f7b51a549f8144ec0e4b36a7237c9f4694019c5a03eea08465182205f855e3a7 WatchSource:0}: Error finding container f7b51a549f8144ec0e4b36a7237c9f4694019c5a03eea08465182205f855e3a7: Status 404 returned error can't find the container with id f7b51a549f8144ec0e4b36a7237c9f4694019c5a03eea08465182205f855e3a7
Sep 15 13:38:35.978591 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.978576    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-n5jmk"
Sep 15 13:38:35.981726 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:35.981708    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa66793f_19a0_4e87_9a7e_f2c1491c261f.slice/crio-b0324574242035925ea68718bbf2ac3be9dc3df92a70501c94103f8728cf1e73 WatchSource:0}: Error finding container b0324574242035925ea68718bbf2ac3be9dc3df92a70501c94103f8728cf1e73: Status 404 returned error can't find the container with id b0324574242035925ea68718bbf2ac3be9dc3df92a70501c94103f8728cf1e73
Sep 15 13:38:35.982744 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:35.982715    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jtkm9"
Sep 15 13:38:35.987730 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:35.987707    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff188391_7b0a_4909_b12c_f980b7f047c8.slice/crio-4fbc9e08143bf065d9f3e9037f072f77b33a556685e81bb2821ada7a2907d1ac WatchSource:0}: Error finding container 4fbc9e08143bf065d9f3e9037f072f77b33a556685e81bb2821ada7a2907d1ac: Status 404 returned error can't find the container with id 4fbc9e08143bf065d9f3e9037f072f77b33a556685e81bb2821ada7a2907d1ac
Sep 15 13:38:35.991344 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:38:35.991324    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40e2f2a1_4189_42a4_9686_91de9a5ada27.slice/crio-c292266db090211c0bb5737a2f210813315025d15d1d811a40d0f8bb80ccba5e WatchSource:0}: Error finding container c292266db090211c0bb5737a2f210813315025d15d1d811a40d0f8bb80ccba5e: Status 404 returned error can't find the container with id c292266db090211c0bb5737a2f210813315025d15d1d811a40d0f8bb80ccba5e
Sep 15 13:38:36.259957 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:36.259874    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a1307640-dec4-44a3-a888-f8b1b097f902-original-pull-secret\") pod \"global-pull-secret-syncer-f54mn\" (UID: \"a1307640-dec4-44a3-a888-f8b1b097f902\") " pod="kube-system/global-pull-secret-syncer-f54mn"
Sep 15 13:38:36.259957 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:36.259940    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/525d9c79-829f-45ae-9cd5-af323bc737ef-metrics-certs\") pod \"network-metrics-daemon-fsnbc\" (UID: \"525d9c79-829f-45ae-9cd5-af323bc737ef\") " pod="openshift-multus/network-metrics-daemon-fsnbc"
Sep 15 13:38:36.260224 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:36.260082    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 13:38:36.260224 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:36.260159    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/525d9c79-829f-45ae-9cd5-af323bc737ef-metrics-certs podName:525d9c79-829f-45ae-9cd5-af323bc737ef nodeName:}" failed. No retries permitted until 2026-09-15 13:38:37.260140052 +0000 UTC m=+4.019266328 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/525d9c79-829f-45ae-9cd5-af323bc737ef-metrics-certs") pod "network-metrics-daemon-fsnbc" (UID: "525d9c79-829f-45ae-9cd5-af323bc737ef") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 13:38:36.260334 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:36.260230    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 13:38:36.260334 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:36.260265    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1307640-dec4-44a3-a888-f8b1b097f902-original-pull-secret podName:a1307640-dec4-44a3-a888-f8b1b097f902 nodeName:}" failed. No retries permitted until 2026-09-15 13:38:37.260253733 +0000 UTC m=+4.019380016 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a1307640-dec4-44a3-a888-f8b1b097f902-original-pull-secret") pod "global-pull-secret-syncer-f54mn" (UID: "a1307640-dec4-44a3-a888-f8b1b097f902") : object "kube-system"/"original-pull-secret" not registered
Sep 15 13:38:36.462389 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:36.462353    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m88lg\" (UniqueName: \"kubernetes.io/projected/82807e36-72ea-4ef2-a3bf-66fa30a9b389-kube-api-access-m88lg\") pod \"network-check-target-24wlp\" (UID: \"82807e36-72ea-4ef2-a3bf-66fa30a9b389\") " pod="openshift-network-diagnostics/network-check-target-24wlp"
Sep 15 13:38:36.462552 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:36.462534    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 13:38:36.462631 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:36.462556    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 13:38:36.462631 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:36.462568    2578 projected.go:196] Error preparing data for projected volume kube-api-access-m88lg for pod openshift-network-diagnostics/network-check-target-24wlp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 13:38:36.462631 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:36.462624    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82807e36-72ea-4ef2-a3bf-66fa30a9b389-kube-api-access-m88lg podName:82807e36-72ea-4ef2-a3bf-66fa30a9b389 nodeName:}" failed. No retries permitted until 2026-09-15 13:38:37.462606221 +0000 UTC m=+4.221732508 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-m88lg" (UniqueName: "kubernetes.io/projected/82807e36-72ea-4ef2-a3bf-66fa30a9b389-kube-api-access-m88lg") pod "network-check-target-24wlp" (UID: "82807e36-72ea-4ef2-a3bf-66fa30a9b389") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 13:38:36.688322 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:36.688195    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-14 13:33:35 +0000 UTC" deadline="2028-03-29 09:28:41.071988425 +0000 UTC"
Sep 15 13:38:36.688322 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:36.688261    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13459h50m4.38373196s"
Sep 15 13:38:36.752518 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:36.751826    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-24wlp"
Sep 15 13:38:36.752518 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:36.751954    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-24wlp" podUID="82807e36-72ea-4ef2-a3bf-66fa30a9b389"
Sep 15 13:38:36.752518 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:36.752372    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f54mn"
Sep 15 13:38:36.752518 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:36.752461    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f54mn" podUID="a1307640-dec4-44a3-a888-f8b1b097f902"
Sep 15 13:38:36.778986 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:36.778954    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-n5jmk" event={"ID":"ff188391-7b0a-4909-b12c-f980b7f047c8","Type":"ContainerStarted","Data":"4fbc9e08143bf065d9f3e9037f072f77b33a556685e81bb2821ada7a2907d1ac"}
Sep 15 13:38:36.791198 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:36.791164    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-kjvpd" event={"ID":"fa66793f-19a0-4e87-9a7e-f2c1491c261f","Type":"ContainerStarted","Data":"b0324574242035925ea68718bbf2ac3be9dc3df92a70501c94103f8728cf1e73"}
Sep 15 13:38:36.796216 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:36.796183    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-krtzm" event={"ID":"7126a8b6-6691-4cb3-9115-bedab2e519ad","Type":"ContainerStarted","Data":"89e7c47ed89b79c6e796bb929d0a989d22b6c49ac76b386eaad20923d12fae6f"}
Sep 15 13:38:36.801151 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:36.801062    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tgmg6" event={"ID":"41073b32-ff62-4ae9-a4e8-aec2b819dd57","Type":"ContainerStarted","Data":"f7b51a549f8144ec0e4b36a7237c9f4694019c5a03eea08465182205f855e3a7"}
Sep 15 13:38:36.815620 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:36.815593    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8tcrg" event={"ID":"c6e7d350-b090-4857-a0ce-a608bdcfb099","Type":"ContainerStarted","Data":"7bb6454cb9738eb26447a4b9574f69a8896ad9da6db5f1e13ae767ba50ae6b77"}
Sep 15 13:38:36.829378 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:36.829313    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bq5dg" event={"ID":"cf80e34c-17f8-4fb2-98c0-c9a5a6faf53f","Type":"ContainerStarted","Data":"87ea5bc341c29877587dda8d13791e1fef843d3fc052a60a9ffda63d2a0560d8"}
Sep 15 13:38:36.849103 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:36.849072    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vxdpz" event={"ID":"c6770793-f370-4bf7-a572-5e367e27292d","Type":"ContainerStarted","Data":"86eae60949045a3e0d0c68aa2ae1704988a494f3ebd58e8b898c0ef4494dcf93"}
Sep 15 13:38:36.859924 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:36.859859    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-425qw" event={"ID":"b469b218-cbd7-4873-836f-99ac075ab6ec","Type":"ContainerStarted","Data":"74dee60930853f30285f4b6ec9f559ef1cdfa9322a8a6647d59af5d569674b2e"}
Sep 15 13:38:36.879696 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:36.879411    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-41.ec2.internal" event={"ID":"05a0e38cdf2b9f115ed4af66ef9f8f2f","Type":"ContainerStarted","Data":"166a282616d3ad6e734e725b85061f40048e6d446c003095678ce34fc6005845"}
Sep 15 13:38:36.884692 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:36.884614    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jtkm9" event={"ID":"40e2f2a1-4189-42a4-9686-91de9a5ada27","Type":"ContainerStarted","Data":"c292266db090211c0bb5737a2f210813315025d15d1d811a40d0f8bb80ccba5e"}
Sep 15 13:38:37.268194 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:37.268083    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a1307640-dec4-44a3-a888-f8b1b097f902-original-pull-secret\") pod \"global-pull-secret-syncer-f54mn\" (UID: \"a1307640-dec4-44a3-a888-f8b1b097f902\") " pod="kube-system/global-pull-secret-syncer-f54mn"
Sep 15 13:38:37.268194 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:37.268164    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/525d9c79-829f-45ae-9cd5-af323bc737ef-metrics-certs\") pod \"network-metrics-daemon-fsnbc\" (UID: \"525d9c79-829f-45ae-9cd5-af323bc737ef\") " pod="openshift-multus/network-metrics-daemon-fsnbc"
Sep 15 13:38:37.268417 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:37.268236    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 13:38:37.268417 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:37.268304    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1307640-dec4-44a3-a888-f8b1b097f902-original-pull-secret podName:a1307640-dec4-44a3-a888-f8b1b097f902 nodeName:}" failed. No retries permitted until 2026-09-15 13:38:39.268284648 +0000 UTC m=+6.027410916 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a1307640-dec4-44a3-a888-f8b1b097f902-original-pull-secret") pod "global-pull-secret-syncer-f54mn" (UID: "a1307640-dec4-44a3-a888-f8b1b097f902") : object "kube-system"/"original-pull-secret" not registered
Sep 15 13:38:37.268638 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:37.268236    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 13:38:37.268699 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:37.268688    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/525d9c79-829f-45ae-9cd5-af323bc737ef-metrics-certs podName:525d9c79-829f-45ae-9cd5-af323bc737ef nodeName:}" failed. No retries permitted until 2026-09-15 13:38:39.268669626 +0000 UTC m=+6.027795904 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/525d9c79-829f-45ae-9cd5-af323bc737ef-metrics-certs") pod "network-metrics-daemon-fsnbc" (UID: "525d9c79-829f-45ae-9cd5-af323bc737ef") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 13:38:37.470905 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:37.470871    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m88lg\" (UniqueName: \"kubernetes.io/projected/82807e36-72ea-4ef2-a3bf-66fa30a9b389-kube-api-access-m88lg\") pod \"network-check-target-24wlp\" (UID: \"82807e36-72ea-4ef2-a3bf-66fa30a9b389\") " pod="openshift-network-diagnostics/network-check-target-24wlp"
Sep 15 13:38:37.471082 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:37.471038    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 13:38:37.471082 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:37.471057    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 13:38:37.471082 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:37.471070    2578 projected.go:196] Error preparing data for projected volume kube-api-access-m88lg for pod openshift-network-diagnostics/network-check-target-24wlp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 13:38:37.471258 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:37.471140    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82807e36-72ea-4ef2-a3bf-66fa30a9b389-kube-api-access-m88lg podName:82807e36-72ea-4ef2-a3bf-66fa30a9b389 nodeName:}" failed. No retries permitted until 2026-09-15 13:38:39.471106015 +0000 UTC m=+6.230232293 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-m88lg" (UniqueName: "kubernetes.io/projected/82807e36-72ea-4ef2-a3bf-66fa30a9b389-kube-api-access-m88lg") pod "network-check-target-24wlp" (UID: "82807e36-72ea-4ef2-a3bf-66fa30a9b389") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 13:38:37.688618 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:37.688535    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-14 13:33:35 +0000 UTC" deadline="2028-06-29 00:39:42.686444224 +0000 UTC"
Sep 15 13:38:37.688618 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:37.688575    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15659h1m4.997873744s"
Sep 15 13:38:37.752374 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:37.752342    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fsnbc"
Sep 15 13:38:37.752702 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:37.752533    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fsnbc" podUID="525d9c79-829f-45ae-9cd5-af323bc737ef"
Sep 15 13:38:38.751603 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:38.751533    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-24wlp"
Sep 15 13:38:38.752082 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:38.751792    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-24wlp" podUID="82807e36-72ea-4ef2-a3bf-66fa30a9b389"
Sep 15 13:38:38.752215 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:38.752185    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f54mn"
Sep 15 13:38:38.752323 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:38.752288    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f54mn" podUID="a1307640-dec4-44a3-a888-f8b1b097f902"
Sep 15 13:38:39.289687 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:39.289630    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a1307640-dec4-44a3-a888-f8b1b097f902-original-pull-secret\") pod \"global-pull-secret-syncer-f54mn\" (UID: \"a1307640-dec4-44a3-a888-f8b1b097f902\") " pod="kube-system/global-pull-secret-syncer-f54mn"
Sep 15 13:38:39.289875 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:39.289700    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/525d9c79-829f-45ae-9cd5-af323bc737ef-metrics-certs\") pod \"network-metrics-daemon-fsnbc\" (UID: \"525d9c79-829f-45ae-9cd5-af323bc737ef\") " pod="openshift-multus/network-metrics-daemon-fsnbc"
Sep 15 13:38:39.289875 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:39.289825    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 13:38:39.289995 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:39.289884    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/525d9c79-829f-45ae-9cd5-af323bc737ef-metrics-certs podName:525d9c79-829f-45ae-9cd5-af323bc737ef nodeName:}" failed. No retries permitted until 2026-09-15 13:38:43.289866219 +0000 UTC m=+10.048992498 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/525d9c79-829f-45ae-9cd5-af323bc737ef-metrics-certs") pod "network-metrics-daemon-fsnbc" (UID: "525d9c79-829f-45ae-9cd5-af323bc737ef") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 13:38:39.290283 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:39.290264    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 13:38:39.290358 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:39.290318    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1307640-dec4-44a3-a888-f8b1b097f902-original-pull-secret podName:a1307640-dec4-44a3-a888-f8b1b097f902 nodeName:}" failed. No retries permitted until 2026-09-15 13:38:43.290303318 +0000 UTC m=+10.049429605 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a1307640-dec4-44a3-a888-f8b1b097f902-original-pull-secret") pod "global-pull-secret-syncer-f54mn" (UID: "a1307640-dec4-44a3-a888-f8b1b097f902") : object "kube-system"/"original-pull-secret" not registered
Sep 15 13:38:39.491525 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:39.491481    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m88lg\" (UniqueName: \"kubernetes.io/projected/82807e36-72ea-4ef2-a3bf-66fa30a9b389-kube-api-access-m88lg\") pod \"network-check-target-24wlp\" (UID: \"82807e36-72ea-4ef2-a3bf-66fa30a9b389\") " pod="openshift-network-diagnostics/network-check-target-24wlp"
Sep 15 13:38:39.492150 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:39.491675    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 13:38:39.492150 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:39.491701    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 13:38:39.492150 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:39.491714    2578 projected.go:196] Error preparing data for projected volume kube-api-access-m88lg for pod openshift-network-diagnostics/network-check-target-24wlp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 13:38:39.492150 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:39.491766    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82807e36-72ea-4ef2-a3bf-66fa30a9b389-kube-api-access-m88lg podName:82807e36-72ea-4ef2-a3bf-66fa30a9b389 nodeName:}" failed. No retries permitted until 2026-09-15 13:38:43.49174881 +0000 UTC m=+10.250875093 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-m88lg" (UniqueName: "kubernetes.io/projected/82807e36-72ea-4ef2-a3bf-66fa30a9b389-kube-api-access-m88lg") pod "network-check-target-24wlp" (UID: "82807e36-72ea-4ef2-a3bf-66fa30a9b389") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 13:38:39.752401 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:39.752318    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fsnbc"
Sep 15 13:38:39.752846 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:39.752466    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fsnbc" podUID="525d9c79-829f-45ae-9cd5-af323bc737ef"
Sep 15 13:38:40.752812 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:40.752159    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-24wlp"
Sep 15 13:38:40.752812 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:40.752308    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-24wlp" podUID="82807e36-72ea-4ef2-a3bf-66fa30a9b389"
Sep 15 13:38:40.752812 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:40.752684    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f54mn"
Sep 15 13:38:40.752812 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:40.752778    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f54mn" podUID="a1307640-dec4-44a3-a888-f8b1b097f902"
Sep 15 13:38:41.752095 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:41.752061    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fsnbc"
Sep 15 13:38:41.752294 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:41.752220    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fsnbc" podUID="525d9c79-829f-45ae-9cd5-af323bc737ef"
Sep 15 13:38:42.752039 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:42.751626    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-24wlp"
Sep 15 13:38:42.752039 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:42.751721    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-24wlp" podUID="82807e36-72ea-4ef2-a3bf-66fa30a9b389"
Sep 15 13:38:42.752039 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:42.751902    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f54mn"
Sep 15 13:38:42.752039 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:42.751983    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f54mn" podUID="a1307640-dec4-44a3-a888-f8b1b097f902"
Sep 15 13:38:43.331040 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:43.330320    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a1307640-dec4-44a3-a888-f8b1b097f902-original-pull-secret\") pod \"global-pull-secret-syncer-f54mn\" (UID: \"a1307640-dec4-44a3-a888-f8b1b097f902\") " pod="kube-system/global-pull-secret-syncer-f54mn"
Sep 15 13:38:43.331040 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:43.330380    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/525d9c79-829f-45ae-9cd5-af323bc737ef-metrics-certs\") pod \"network-metrics-daemon-fsnbc\" (UID: \"525d9c79-829f-45ae-9cd5-af323bc737ef\") " pod="openshift-multus/network-metrics-daemon-fsnbc"
Sep 15 13:38:43.331040 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:43.330506    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 13:38:43.331040 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:43.330571    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/525d9c79-829f-45ae-9cd5-af323bc737ef-metrics-certs podName:525d9c79-829f-45ae-9cd5-af323bc737ef nodeName:}" failed. No retries permitted until 2026-09-15 13:38:51.330549312 +0000 UTC m=+18.089675590 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/525d9c79-829f-45ae-9cd5-af323bc737ef-metrics-certs") pod "network-metrics-daemon-fsnbc" (UID: "525d9c79-829f-45ae-9cd5-af323bc737ef") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 13:38:43.331040 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:43.330956    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 13:38:43.331040 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:43.331002    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1307640-dec4-44a3-a888-f8b1b097f902-original-pull-secret podName:a1307640-dec4-44a3-a888-f8b1b097f902 nodeName:}" failed. No retries permitted until 2026-09-15 13:38:51.33098759 +0000 UTC m=+18.090113857 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a1307640-dec4-44a3-a888-f8b1b097f902-original-pull-secret") pod "global-pull-secret-syncer-f54mn" (UID: "a1307640-dec4-44a3-a888-f8b1b097f902") : object "kube-system"/"original-pull-secret" not registered
Sep 15 13:38:43.531929 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:43.531880    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m88lg\" (UniqueName: \"kubernetes.io/projected/82807e36-72ea-4ef2-a3bf-66fa30a9b389-kube-api-access-m88lg\") pod \"network-check-target-24wlp\" (UID: \"82807e36-72ea-4ef2-a3bf-66fa30a9b389\") " pod="openshift-network-diagnostics/network-check-target-24wlp"
Sep 15 13:38:43.532563 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:43.532110    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 13:38:43.532563 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:43.532149    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 13:38:43.532563 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:43.532163    2578 projected.go:196] Error preparing data for projected volume kube-api-access-m88lg for pod openshift-network-diagnostics/network-check-target-24wlp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 13:38:43.532563 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:43.532222    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82807e36-72ea-4ef2-a3bf-66fa30a9b389-kube-api-access-m88lg podName:82807e36-72ea-4ef2-a3bf-66fa30a9b389 nodeName:}" failed. No retries permitted until 2026-09-15 13:38:51.532203162 +0000 UTC m=+18.291329451 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-m88lg" (UniqueName: "kubernetes.io/projected/82807e36-72ea-4ef2-a3bf-66fa30a9b389-kube-api-access-m88lg") pod "network-check-target-24wlp" (UID: "82807e36-72ea-4ef2-a3bf-66fa30a9b389") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 13:38:43.756101 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:43.756026    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fsnbc"
Sep 15 13:38:43.756505 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:43.756185    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fsnbc" podUID="525d9c79-829f-45ae-9cd5-af323bc737ef"
Sep 15 13:38:44.752377 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:44.751728    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-24wlp"
Sep 15 13:38:44.752377 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:44.751863    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-24wlp" podUID="82807e36-72ea-4ef2-a3bf-66fa30a9b389"
Sep 15 13:38:44.752377 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:44.751934    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f54mn"
Sep 15 13:38:44.752377 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:44.752006    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f54mn" podUID="a1307640-dec4-44a3-a888-f8b1b097f902"
Sep 15 13:38:45.751552 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:45.751518    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fsnbc"
Sep 15 13:38:45.752026 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:45.751674    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fsnbc" podUID="525d9c79-829f-45ae-9cd5-af323bc737ef"
Sep 15 13:38:46.752225 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:46.752188    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f54mn"
Sep 15 13:38:46.752735 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:46.752309    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f54mn" podUID="a1307640-dec4-44a3-a888-f8b1b097f902"
Sep 15 13:38:46.752735 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:46.752367    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-24wlp"
Sep 15 13:38:46.752735 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:46.752476    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-24wlp" podUID="82807e36-72ea-4ef2-a3bf-66fa30a9b389"
Sep 15 13:38:47.752053 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:47.751983    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fsnbc"
Sep 15 13:38:47.752219 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:47.752100    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fsnbc" podUID="525d9c79-829f-45ae-9cd5-af323bc737ef"
Sep 15 13:38:48.751650 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:48.751613    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f54mn"
Sep 15 13:38:48.751650 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:48.751646    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-24wlp"
Sep 15 13:38:48.752174 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:48.751733    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f54mn" podUID="a1307640-dec4-44a3-a888-f8b1b097f902"
Sep 15 13:38:48.752174 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:48.751838    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-24wlp" podUID="82807e36-72ea-4ef2-a3bf-66fa30a9b389"
Sep 15 13:38:49.752448 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:49.752417    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fsnbc"
Sep 15 13:38:49.752881 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:49.752566    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fsnbc" podUID="525d9c79-829f-45ae-9cd5-af323bc737ef"
Sep 15 13:38:50.752316 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:50.752278    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f54mn"
Sep 15 13:38:50.752316 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:50.752311    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-24wlp"
Sep 15 13:38:50.752862 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:50.752410    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f54mn" podUID="a1307640-dec4-44a3-a888-f8b1b097f902"
Sep 15 13:38:50.752862 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:50.752553    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-24wlp" podUID="82807e36-72ea-4ef2-a3bf-66fa30a9b389"
Sep 15 13:38:51.392593 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:51.392559    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a1307640-dec4-44a3-a888-f8b1b097f902-original-pull-secret\") pod \"global-pull-secret-syncer-f54mn\" (UID: \"a1307640-dec4-44a3-a888-f8b1b097f902\") " pod="kube-system/global-pull-secret-syncer-f54mn"
Sep 15 13:38:51.392738 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:51.392604    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/525d9c79-829f-45ae-9cd5-af323bc737ef-metrics-certs\") pod \"network-metrics-daemon-fsnbc\" (UID: \"525d9c79-829f-45ae-9cd5-af323bc737ef\") " pod="openshift-multus/network-metrics-daemon-fsnbc"
Sep 15 13:38:51.392738 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:51.392691    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 13:38:51.392807 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:51.392746    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1307640-dec4-44a3-a888-f8b1b097f902-original-pull-secret podName:a1307640-dec4-44a3-a888-f8b1b097f902 nodeName:}" failed. No retries permitted until 2026-09-15 13:39:07.39273275 +0000 UTC m=+34.151859014 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a1307640-dec4-44a3-a888-f8b1b097f902-original-pull-secret") pod "global-pull-secret-syncer-f54mn" (UID: "a1307640-dec4-44a3-a888-f8b1b097f902") : object "kube-system"/"original-pull-secret" not registered
Sep 15 13:38:51.392807 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:51.392694    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 13:38:51.392807 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:51.392784    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/525d9c79-829f-45ae-9cd5-af323bc737ef-metrics-certs podName:525d9c79-829f-45ae-9cd5-af323bc737ef nodeName:}" failed. No retries permitted until 2026-09-15 13:39:07.392772793 +0000 UTC m=+34.151899057 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/525d9c79-829f-45ae-9cd5-af323bc737ef-metrics-certs") pod "network-metrics-daemon-fsnbc" (UID: "525d9c79-829f-45ae-9cd5-af323bc737ef") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 13:38:51.593776 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:51.593714    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m88lg\" (UniqueName: \"kubernetes.io/projected/82807e36-72ea-4ef2-a3bf-66fa30a9b389-kube-api-access-m88lg\") pod \"network-check-target-24wlp\" (UID: \"82807e36-72ea-4ef2-a3bf-66fa30a9b389\") " pod="openshift-network-diagnostics/network-check-target-24wlp"
Sep 15 13:38:51.593911 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:51.593895    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 13:38:51.593968 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:51.593922    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 13:38:51.593968 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:51.593935    2578 projected.go:196] Error preparing data for projected volume kube-api-access-m88lg for pod openshift-network-diagnostics/network-check-target-24wlp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 13:38:51.594064 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:51.593995    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82807e36-72ea-4ef2-a3bf-66fa30a9b389-kube-api-access-m88lg podName:82807e36-72ea-4ef2-a3bf-66fa30a9b389 nodeName:}" failed. No retries permitted until 2026-09-15 13:39:07.593976884 +0000 UTC m=+34.353103172 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-m88lg" (UniqueName: "kubernetes.io/projected/82807e36-72ea-4ef2-a3bf-66fa30a9b389-kube-api-access-m88lg") pod "network-check-target-24wlp" (UID: "82807e36-72ea-4ef2-a3bf-66fa30a9b389") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 13:38:51.751719 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:51.751688    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fsnbc"
Sep 15 13:38:51.751911 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:51.751826    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fsnbc" podUID="525d9c79-829f-45ae-9cd5-af323bc737ef"
Sep 15 13:38:52.752176 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:52.752139    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-24wlp"
Sep 15 13:38:52.752176 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:52.752171    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f54mn"
Sep 15 13:38:52.752661 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:52.752321    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-24wlp" podUID="82807e36-72ea-4ef2-a3bf-66fa30a9b389"
Sep 15 13:38:52.752661 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:52.752507    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f54mn" podUID="a1307640-dec4-44a3-a888-f8b1b097f902"
Sep 15 13:38:53.752241 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:53.752204    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fsnbc"
Sep 15 13:38:53.752821 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:53.752328    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fsnbc" podUID="525d9c79-829f-45ae-9cd5-af323bc737ef"
Sep 15 13:38:54.751911 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:54.751881    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-24wlp"
Sep 15 13:38:54.752089 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:54.751881    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f54mn"
Sep 15 13:38:54.752089 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:54.751986    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-24wlp" podUID="82807e36-72ea-4ef2-a3bf-66fa30a9b389"
Sep 15 13:38:54.752089 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:54.752079    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f54mn" podUID="a1307640-dec4-44a3-a888-f8b1b097f902"
Sep 15 13:38:55.752106 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:55.751572    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fsnbc"
Sep 15 13:38:55.752623 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:55.752118    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fsnbc" podUID="525d9c79-829f-45ae-9cd5-af323bc737ef"
Sep 15 13:38:55.936292 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:55.936266    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-krtzm" event={"ID":"7126a8b6-6691-4cb3-9115-bedab2e519ad","Type":"ContainerStarted","Data":"df8274547d45e278e10642e2c5c268eaf2d196c6c2848f69a795cac2b1b5e6fb"}
Sep 15 13:38:55.936374 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:55.936355    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-krtzm" event={"ID":"7126a8b6-6691-4cb3-9115-bedab2e519ad","Type":"ContainerStarted","Data":"c60c703618657657d3e1ce3130d75c575e92d31ee5c5da866d8ec13978b708d1"}
Sep 15 13:38:55.936419 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:55.936409    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-krtzm" event={"ID":"7126a8b6-6691-4cb3-9115-bedab2e519ad","Type":"ContainerStarted","Data":"d5786d92b7fb30c0ced01a9b967e653cdeb1856119068ba0f25342adaa89a007"}
Sep 15 13:38:55.936469 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:55.936456    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-krtzm" event={"ID":"7126a8b6-6691-4cb3-9115-bedab2e519ad","Type":"ContainerStarted","Data":"2d18bad851e5e452743407dbbf90b2c6427b38ae692079c7ce5c80e1138f1ed2"}
Sep 15 13:38:55.936612 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:55.936508    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-krtzm" event={"ID":"7126a8b6-6691-4cb3-9115-bedab2e519ad","Type":"ContainerStarted","Data":"d46581e62a061dd9f5b73552262317d515de25903e67029e0f342aef3d86708b"}
Sep 15 13:38:55.937845 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:55.937821    2578 generic.go:356] "Generic (PLEG): container finished" podID="41073b32-ff62-4ae9-a4e8-aec2b819dd57" containerID="32281bdfe7c61e78c7a80b831969f9c4c72d78ad9cc33b0cf3d69cfb8d2e1803" exitCode=0
Sep 15 13:38:55.937952 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:55.937887    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tgmg6" event={"ID":"41073b32-ff62-4ae9-a4e8-aec2b819dd57","Type":"ContainerDied","Data":"32281bdfe7c61e78c7a80b831969f9c4c72d78ad9cc33b0cf3d69cfb8d2e1803"}
Sep 15 13:38:55.939399 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:55.939346    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8tcrg" event={"ID":"c6e7d350-b090-4857-a0ce-a608bdcfb099","Type":"ContainerStarted","Data":"223a2cd0eb90a434e38afaf0605907bc40b4177be1f027a8539150e82418c6e3"}
Sep 15 13:38:55.940841 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:55.940808    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bq5dg" event={"ID":"cf80e34c-17f8-4fb2-98c0-c9a5a6faf53f","Type":"ContainerStarted","Data":"bf636e4af806927aec42950f1fb3cf05e6b8f6ca8d5185c1407f7b4915a3d68f"}
Sep 15 13:38:55.942421 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:55.942402    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vxdpz" event={"ID":"c6770793-f370-4bf7-a572-5e367e27292d","Type":"ContainerStarted","Data":"d05fca583e78ffc35002209754f2709e7a977810442e9da6f2bab201785844db"}
Sep 15 13:38:55.943761 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:55.943741    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-425qw" event={"ID":"b469b218-cbd7-4873-836f-99ac075ab6ec","Type":"ContainerStarted","Data":"99b3fcf9334f1940a7331f7fea3162129e0d9640cd5ce73d6e8e321654dd2f1e"}
Sep 15 13:38:55.944997 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:55.944978    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-41.ec2.internal" event={"ID":"05a0e38cdf2b9f115ed4af66ef9f8f2f","Type":"ContainerStarted","Data":"6e1e2f15573d679a1a2a03a570e7f7c85a4c4ad6a387b924e9b9b276766302c6"}
Sep 15 13:38:55.946494 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:55.946473    2578 generic.go:356] "Generic (PLEG): container finished" podID="00b57328426a8f6e26f2dac35d497a0b" containerID="f825fb2661d679bb923156d0265e6e164c579d6f973cf91608c895a35770a397" exitCode=0
Sep 15 13:38:55.946569 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:55.946548    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-41.ec2.internal" event={"ID":"00b57328426a8f6e26f2dac35d497a0b","Type":"ContainerDied","Data":"f825fb2661d679bb923156d0265e6e164c579d6f973cf91608c895a35770a397"}
Sep 15 13:38:55.947955 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:55.947937    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jtkm9" event={"ID":"40e2f2a1-4189-42a4-9686-91de9a5ada27","Type":"ContainerStarted","Data":"d5bcd7c1c387d6bc5b75a137a08b4b92fc2fd0a56683e400c67aa672106f9dfc"}
Sep 15 13:38:55.949318 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:55.949302    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-kjvpd" event={"ID":"fa66793f-19a0-4e87-9a7e-f2c1491c261f","Type":"ContainerStarted","Data":"a637b2e0768bd2025f36f58f41a6e4f9c7a36852f0576baa70efcde4cbdddc7a"}
Sep 15 13:38:55.987676 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:55.987634    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-41.ec2.internal" podStartSLOduration=20.987620212 podStartE2EDuration="20.987620212s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 13:38:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:38:55.987231077 +0000 UTC m=+22.746357365" watchObservedRunningTime="2026-09-15 13:38:55.987620212 +0000 UTC m=+22.746746505"
Sep 15 13:38:56.006514 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:56.006463    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-vxdpz" podStartSLOduration=3.9647452530000002 podStartE2EDuration="23.006444751s" totalImagesPullingTime="19.041699498s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 13:38:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:38:56.002732344 +0000 UTC m=+22.761858623" watchObservedRunningTime="2026-09-15 13:38:56.006444751 +0000 UTC m=+22.765571036"
Sep 15 13:38:56.022882 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:56.022837    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-bq5dg" podStartSLOduration=7.454875499 podStartE2EDuration="23.022817688s" totalImagesPullingTime="15.567942189s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:38:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:38:56.022537156 +0000 UTC m=+22.781663445" watchObservedRunningTime="2026-09-15 13:38:56.022817688 +0000 UTC m=+22.781943978"
Sep 15 13:38:56.038712 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:56.038667    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-kjvpd" podStartSLOduration=3.616628339 podStartE2EDuration="23.038651539s" totalImagesPullingTime="19.4220232s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 13:38:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:38:56.037990457 +0000 UTC m=+22.797116742" watchObservedRunningTime="2026-09-15 13:38:56.038651539 +0000 UTC m=+22.797777829"
Sep 15 13:38:56.052735 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:56.052689    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-425qw" podStartSLOduration=4.058573206 podStartE2EDuration="23.052672783s" totalImagesPullingTime="18.994099577s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 13:38:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:38:56.052395831 +0000 UTC m=+22.811522121" watchObservedRunningTime="2026-09-15 13:38:56.052672783 +0000 UTC m=+22.811799070"
Sep 15 13:38:56.066300 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:56.066241    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-8tcrg" podStartSLOduration=4.070319797 podStartE2EDuration="23.06622851s" totalImagesPullingTime="18.995908713s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 13:38:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:38:56.066023652 +0000 UTC m=+22.825149938" watchObservedRunningTime="2026-09-15 13:38:56.06622851 +0000 UTC m=+22.825354796"
Sep 15 13:38:56.752156 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:56.752064    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-24wlp"
Sep 15 13:38:56.752754 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:56.752184    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-24wlp" podUID="82807e36-72ea-4ef2-a3bf-66fa30a9b389"
Sep 15 13:38:56.752754 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:56.752216    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f54mn"
Sep 15 13:38:56.752754 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:56.752270    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f54mn" podUID="a1307640-dec4-44a3-a888-f8b1b097f902"
Sep 15 13:38:56.953344 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:56.953142    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-41.ec2.internal" event={"ID":"00b57328426a8f6e26f2dac35d497a0b","Type":"ContainerStarted","Data":"e027fd6c1fc100207e2584683e5d74d5e2d483b96bc65a1f33a20baf797d2833"}
Sep 15 13:38:56.954703 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:56.954672    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-n5jmk" event={"ID":"ff188391-7b0a-4909-b12c-f980b7f047c8","Type":"ContainerStarted","Data":"14562a8de24463f63228711b8c6526ce587edcb69b46781e1ab95a8591c27d8b"}
Sep 15 13:38:56.958014 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:56.957990    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-krtzm" event={"ID":"7126a8b6-6691-4cb3-9115-bedab2e519ad","Type":"ContainerStarted","Data":"e51446c3713f98ef16bf3812b4ca8fad2a1eec9d4d3460e991fe8f299144b289"}
Sep 15 13:38:56.997109 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:56.997064    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-41.ec2.internal" podStartSLOduration=21.997050673 podStartE2EDuration="21.997050673s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 13:38:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:38:56.996920591 +0000 UTC m=+23.756046877" watchObservedRunningTime="2026-09-15 13:38:56.997050673 +0000 UTC m=+23.756176959"
Sep 15 13:38:57.018742 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:57.018648    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-n5jmk" podStartSLOduration=5.038110642 podStartE2EDuration="24.018636667s" totalImagesPullingTime="18.980526025s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 13:38:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:38:57.018243235 +0000 UTC m=+23.777369519" watchObservedRunningTime="2026-09-15 13:38:57.018636667 +0000 UTC m=+23.777762952"
Sep 15 13:38:57.204158 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:57.204114    2578 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 15 13:38:57.712229 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:57.712065    2578 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-15T13:38:57.204153053Z","UUID":"76924681-9866-4b8b-a0d4-def6711405f2","Handler":null,"Name":"","Endpoint":""}
Sep 15 13:38:57.713435 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:57.713416    2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 15 13:38:57.713536 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:57.713443    2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 15 13:38:57.751519 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:57.751486    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fsnbc"
Sep 15 13:38:57.751659 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:57.751627    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fsnbc" podUID="525d9c79-829f-45ae-9cd5-af323bc737ef"
Sep 15 13:38:57.962776 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:57.962682    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jtkm9" event={"ID":"40e2f2a1-4189-42a4-9686-91de9a5ada27","Type":"ContainerStarted","Data":"ed1b855c62e3df793cfee51630365a5a7880e24d7fd2c4a0506eef1031a2bb71"}
Sep 15 13:38:58.751817 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:58.751783    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f54mn"
Sep 15 13:38:58.752029 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:58.751900    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f54mn" podUID="a1307640-dec4-44a3-a888-f8b1b097f902"
Sep 15 13:38:58.752029 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:58.751964    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-24wlp"
Sep 15 13:38:58.752168 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:58.752062    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-24wlp" podUID="82807e36-72ea-4ef2-a3bf-66fa30a9b389"
Sep 15 13:38:58.760959 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:58.760934    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-bq5dg"
Sep 15 13:38:58.969355 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:58.969273    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-krtzm" event={"ID":"7126a8b6-6691-4cb3-9115-bedab2e519ad","Type":"ContainerStarted","Data":"cf13b5a9e92155f7841cb8bb1811927475f36bd689d2af97ab958b986bb44ebd"}
Sep 15 13:38:58.971750 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:58.971718    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jtkm9" event={"ID":"40e2f2a1-4189-42a4-9686-91de9a5ada27","Type":"ContainerStarted","Data":"878d87f0bffe34de6770a958e300e25cbbd098edbfbd0eef3120e338b1f46547"}
Sep 15 13:38:58.991434 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:58.991382    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jtkm9" podStartSLOduration=4.261354075 podStartE2EDuration="25.991363972s" totalImagesPullingTime="21.730009897s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 13:38:33 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:38:58.990751889 +0000 UTC m=+25.749878175" watchObservedRunningTime="2026-09-15 13:38:58.991363972 +0000 UTC m=+25.750490260"
Sep 15 13:38:59.751872 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:38:59.751843    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fsnbc"
Sep 15 13:38:59.752057 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:38:59.751964    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fsnbc" podUID="525d9c79-829f-45ae-9cd5-af323bc737ef"
Sep 15 13:39:00.752002 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:00.751911    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-24wlp"
Sep 15 13:39:00.752390 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:39:00.752034    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-24wlp" podUID="82807e36-72ea-4ef2-a3bf-66fa30a9b389"
Sep 15 13:39:00.752390 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:00.752112    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f54mn"
Sep 15 13:39:00.752390 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:39:00.752219    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f54mn" podUID="a1307640-dec4-44a3-a888-f8b1b097f902"
Sep 15 13:39:00.772412 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:00.772383    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-bq5dg"
Sep 15 13:39:00.772915 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:00.772888    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-bq5dg"
Sep 15 13:39:00.976772 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:00.976747    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-bq5dg"
Sep 15 13:39:01.752334 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:01.752098    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fsnbc"
Sep 15 13:39:01.752827 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:39:01.752389    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fsnbc" podUID="525d9c79-829f-45ae-9cd5-af323bc737ef"
Sep 15 13:39:01.981608 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:01.981577    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-krtzm" event={"ID":"7126a8b6-6691-4cb3-9115-bedab2e519ad","Type":"ContainerStarted","Data":"50ad8369fbf08f43194adc289c0580ce4e809a9635891d90eddc5feeda040b76"}
Sep 15 13:39:01.981822 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:01.981806    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-krtzm"
Sep 15 13:39:01.983479 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:01.983456    2578 generic.go:356] "Generic (PLEG): container finished" podID="41073b32-ff62-4ae9-a4e8-aec2b819dd57" containerID="8eed5ce702a4a63096600fa821437083c3f38a7b326d43f2fc981af316c3ef75" exitCode=0
Sep 15 13:39:01.983605 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:01.983538    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tgmg6" event={"ID":"41073b32-ff62-4ae9-a4e8-aec2b819dd57","Type":"ContainerDied","Data":"8eed5ce702a4a63096600fa821437083c3f38a7b326d43f2fc981af316c3ef75"}
Sep 15 13:39:01.997649 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:01.997627    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-krtzm"
Sep 15 13:39:02.011947 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:02.011875    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-krtzm" podStartSLOduration=9.674436046 podStartE2EDuration="29.011861984s" totalImagesPullingTime="19.337425938s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 13:38:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:39:02.008832739 +0000 UTC m=+28.767959027" watchObservedRunningTime="2026-09-15 13:39:02.011861984 +0000 UTC m=+28.770988299"
Sep 15 13:39:02.751549 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:02.751517    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f54mn"
Sep 15 13:39:02.751735 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:02.751523    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-24wlp"
Sep 15 13:39:02.751735 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:39:02.751622    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f54mn" podUID="a1307640-dec4-44a3-a888-f8b1b097f902"
Sep 15 13:39:02.751735 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:39:02.751693    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-24wlp" podUID="82807e36-72ea-4ef2-a3bf-66fa30a9b389"
Sep 15 13:39:02.986993 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:02.986954    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-krtzm"
Sep 15 13:39:02.987767 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:02.987033    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-krtzm"
Sep 15 13:39:03.006609 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:03.006546    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-krtzm"
Sep 15 13:39:03.127318 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:03.127285    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fsnbc"]
Sep 15 13:39:03.127499 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:03.127420    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fsnbc"
Sep 15 13:39:03.127574 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:39:03.127533    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fsnbc" podUID="525d9c79-829f-45ae-9cd5-af323bc737ef"
Sep 15 13:39:03.128048 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:03.128027    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-f54mn"]
Sep 15 13:39:03.128141 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:03.128110    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f54mn"
Sep 15 13:39:03.128241 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:39:03.128222    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f54mn" podUID="a1307640-dec4-44a3-a888-f8b1b097f902"
Sep 15 13:39:03.130079 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:03.130052    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-24wlp"]
Sep 15 13:39:03.130187 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:03.130165    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-24wlp"
Sep 15 13:39:03.130275 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:39:03.130256    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-24wlp" podUID="82807e36-72ea-4ef2-a3bf-66fa30a9b389"
Sep 15 13:39:03.991321 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:03.991227    2578 generic.go:356] "Generic (PLEG): container finished" podID="41073b32-ff62-4ae9-a4e8-aec2b819dd57" containerID="d928634ac84a2b9c66f7fa79271e75ba0235fdafc580960b228ec3daee987f93" exitCode=0
Sep 15 13:39:03.991646 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:03.991345    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tgmg6" event={"ID":"41073b32-ff62-4ae9-a4e8-aec2b819dd57","Type":"ContainerDied","Data":"d928634ac84a2b9c66f7fa79271e75ba0235fdafc580960b228ec3daee987f93"}
Sep 15 13:39:04.752278 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:04.752196    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-24wlp"
Sep 15 13:39:04.752432 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:04.752197    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f54mn"
Sep 15 13:39:04.752432 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:39:04.752292    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-24wlp" podUID="82807e36-72ea-4ef2-a3bf-66fa30a9b389"
Sep 15 13:39:04.752432 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:39:04.752386    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f54mn" podUID="a1307640-dec4-44a3-a888-f8b1b097f902"
Sep 15 13:39:04.752432 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:04.752197    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fsnbc"
Sep 15 13:39:04.752616 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:39:04.752547    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fsnbc" podUID="525d9c79-829f-45ae-9cd5-af323bc737ef"
Sep 15 13:39:06.751735 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:06.751706    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f54mn"
Sep 15 13:39:06.752095 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:06.751706    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-24wlp"
Sep 15 13:39:06.752095 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:39:06.751811    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f54mn" podUID="a1307640-dec4-44a3-a888-f8b1b097f902"
Sep 15 13:39:06.752095 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:39:06.751903    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-24wlp" podUID="82807e36-72ea-4ef2-a3bf-66fa30a9b389"
Sep 15 13:39:06.752095 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:06.751709    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fsnbc"
Sep 15 13:39:06.752095 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:39:06.752012    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fsnbc" podUID="525d9c79-829f-45ae-9cd5-af323bc737ef"
Sep 15 13:39:06.999605 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:06.999516    2578 generic.go:356] "Generic (PLEG): container finished" podID="41073b32-ff62-4ae9-a4e8-aec2b819dd57" containerID="b317d77ba36992c2273d908160cab8b4b07194ef8128d8b20607b94f8fc04266" exitCode=0
Sep 15 13:39:06.999605 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:06.999592    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tgmg6" event={"ID":"41073b32-ff62-4ae9-a4e8-aec2b819dd57","Type":"ContainerDied","Data":"b317d77ba36992c2273d908160cab8b4b07194ef8128d8b20607b94f8fc04266"}
Sep 15 13:39:07.413793 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:07.413756    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a1307640-dec4-44a3-a888-f8b1b097f902-original-pull-secret\") pod \"global-pull-secret-syncer-f54mn\" (UID: \"a1307640-dec4-44a3-a888-f8b1b097f902\") " pod="kube-system/global-pull-secret-syncer-f54mn"
Sep 15 13:39:07.413961 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:07.413809    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/525d9c79-829f-45ae-9cd5-af323bc737ef-metrics-certs\") pod \"network-metrics-daemon-fsnbc\" (UID: \"525d9c79-829f-45ae-9cd5-af323bc737ef\") " pod="openshift-multus/network-metrics-daemon-fsnbc"
Sep 15 13:39:07.413961 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:39:07.413899    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 13:39:07.413961 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:39:07.413907    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 13:39:07.414056 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:39:07.413965    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1307640-dec4-44a3-a888-f8b1b097f902-original-pull-secret podName:a1307640-dec4-44a3-a888-f8b1b097f902 nodeName:}" failed. No retries permitted until 2026-09-15 13:39:39.413948681 +0000 UTC m=+66.173074964 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a1307640-dec4-44a3-a888-f8b1b097f902-original-pull-secret") pod "global-pull-secret-syncer-f54mn" (UID: "a1307640-dec4-44a3-a888-f8b1b097f902") : object "kube-system"/"original-pull-secret" not registered
Sep 15 13:39:07.414056 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:39:07.413982    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/525d9c79-829f-45ae-9cd5-af323bc737ef-metrics-certs podName:525d9c79-829f-45ae-9cd5-af323bc737ef nodeName:}" failed. No retries permitted until 2026-09-15 13:39:39.413974399 +0000 UTC m=+66.173100698 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/525d9c79-829f-45ae-9cd5-af323bc737ef-metrics-certs") pod "network-metrics-daemon-fsnbc" (UID: "525d9c79-829f-45ae-9cd5-af323bc737ef") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 13:39:07.614946 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:07.614906    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m88lg\" (UniqueName: \"kubernetes.io/projected/82807e36-72ea-4ef2-a3bf-66fa30a9b389-kube-api-access-m88lg\") pod \"network-check-target-24wlp\" (UID: \"82807e36-72ea-4ef2-a3bf-66fa30a9b389\") " pod="openshift-network-diagnostics/network-check-target-24wlp"
Sep 15 13:39:07.615119 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:39:07.615087    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 13:39:07.615119 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:39:07.615118    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 13:39:07.615273 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:39:07.615150    2578 projected.go:196] Error preparing data for projected volume kube-api-access-m88lg for pod openshift-network-diagnostics/network-check-target-24wlp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 13:39:07.615273 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:39:07.615214    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82807e36-72ea-4ef2-a3bf-66fa30a9b389-kube-api-access-m88lg podName:82807e36-72ea-4ef2-a3bf-66fa30a9b389 nodeName:}" failed. No retries permitted until 2026-09-15 13:39:39.615195049 +0000 UTC m=+66.374321332 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-m88lg" (UniqueName: "kubernetes.io/projected/82807e36-72ea-4ef2-a3bf-66fa30a9b389-kube-api-access-m88lg") pod "network-check-target-24wlp" (UID: "82807e36-72ea-4ef2-a3bf-66fa30a9b389") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 13:39:08.063430 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:08.063399    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-41.ec2.internal" event="NodeReady"
Sep 15 13:39:08.063874 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:08.063551    2578 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 15 13:39:08.095678 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:08.095649    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-56444b6f6-q6gl8"]
Sep 15 13:39:08.097696 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:08.097671    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-56444b6f6-q6gl8"
Sep 15 13:39:08.100001 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:08.099969    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 15 13:39:08.100156 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:08.100026    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 15 13:39:08.100156 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:08.100032    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-kxsf6\""
Sep 15 13:39:08.100378 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:08.100356    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 15 13:39:08.105155 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:08.105115    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 15 13:39:08.108531 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:08.108511    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-6gzxz"]
Sep 15 13:39:08.110818 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:08.110800    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-s9sjm"]
Sep 15 13:39:08.110941 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:08.110923    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6gzxz"
Sep 15 13:39:08.112831 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:08.112809    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-56444b6f6-q6gl8"]
Sep 15 13:39:08.112920 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:08.112899    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-s9sjm"
Sep 15 13:39:08.116856 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:08.116835    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-mmgq5\""
Sep 15 13:39:08.116952 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:08.116872    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 15 13:39:08.116952 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:08.116907    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-dfkpb\""
Sep 15 13:39:08.117063 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:08.116963    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 15 13:39:08.117270 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:08.117252    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 15 13:39:08.117363 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:08.117289    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 15 13:39:08.117434 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:08.117258    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 15 13:39:08.127327 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:08.127307    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-s9sjm"]
Sep 15 13:39:08.130196 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:08.130168    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6gzxz"]
Sep 15 13:39:08.220219 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:08.220114    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fe529bf1-eb92-4c2f-a205-3aaed674d7a0-registry-tls\") pod \"image-registry-56444b6f6-q6gl8\" (UID: \"fe529bf1-eb92-4c2f-a205-3aaed674d7a0\") " pod="openshift-image-registry/image-registry-56444b6f6-q6gl8"
Sep 15 13:39:08.220219 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:08.220185    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fe529bf1-eb92-4c2f-a205-3aaed674d7a0-ca-trust-extracted\") pod \"image-registry-56444b6f6-q6gl8\" (UID: \"fe529bf1-eb92-4c2f-a205-3aaed674d7a0\") " pod="openshift-image-registry/image-registry-56444b6f6-q6gl8"
Sep 15 13:39:08.220431 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:08.220245    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fe529bf1-eb92-4c2f-a205-3aaed674d7a0-image-registry-private-configuration\") pod \"image-registry-56444b6f6-q6gl8\" (UID: \"fe529bf1-eb92-4c2f-a205-3aaed674d7a0\") " pod="openshift-image-registry/image-registry-56444b6f6-q6gl8"
Sep 15 13:39:08.220431 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:08.220274    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fe529bf1-eb92-4c2f-a205-3aaed674d7a0-registry-certificates\") pod \"image-registry-56444b6f6-q6gl8\" (UID: \"fe529bf1-eb92-4c2f-a205-3aaed674d7a0\") " pod="openshift-image-registry/image-registry-56444b6f6-q6gl8"
Sep 15 13:39:08.220431 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:08.220300    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fe529bf1-eb92-4c2f-a205-3aaed674d7a0-installation-pull-secrets\") pod \"image-registry-56444b6f6-q6gl8\" (UID: \"fe529bf1-eb92-4c2f-a205-3aaed674d7a0\") " pod="openshift-image-registry/image-registry-56444b6f6-q6gl8"
Sep 15 13:39:08.220431 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:08.220326    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1f0ca597-861a-4320-b16c-f87fa68dcf0b-config-volume\") pod \"dns-default-6gzxz\" (UID: \"1f0ca597-861a-4320-b16c-f87fa68dcf0b\") " pod="openshift-dns/dns-default-6gzxz"
Sep 15 13:39:08.220431 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:08.220355    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f0ca597-861a-4320-b16c-f87fa68dcf0b-tmp-dir\") pod \"dns-default-6gzxz\" (UID: \"1f0ca597-861a-4320-b16c-f87fa68dcf0b\") " pod="openshift-dns/dns-default-6gzxz"
Sep 15 13:39:08.220598 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:08.220423    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6czxr\" (UniqueName: \"kubernetes.io/projected/fe529bf1-eb92-4c2f-a205-3aaed674d7a0-kube-api-access-6czxr\") pod \"image-registry-56444b6f6-q6gl8\" (UID: \"fe529bf1-eb92-4c2f-a205-3aaed674d7a0\") " pod="openshift-image-registry/image-registry-56444b6f6-q6gl8"
Sep 15 13:39:08.220598 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:08.220462    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqf7q\" (UniqueName: \"kubernetes.io/projected/190df695-604e-4d5c-8807-e2095d95564b-kube-api-access-sqf7q\") pod \"ingress-canary-s9sjm\" (UID: \"190df695-604e-4d5c-8807-e2095d95564b\") " pod="openshift-ingress-canary/ingress-canary-s9sjm"
Sep 15 13:39:08.220598 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:08.220520    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fe529bf1-eb92-4c2f-a205-3aaed674d7a0-bound-sa-token\") pod \"image-registry-56444b6f6-q6gl8\" (UID: \"fe529bf1-eb92-4c2f-a205-3aaed674d7a0\") " pod="openshift-image-registry/image-registry-56444b6f6-q6gl8"
Sep 15 13:39:08.220598 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:08.220560    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96f5x\" (UniqueName: \"kubernetes.io/projected/1f0ca597-861a-4320-b16c-f87fa68dcf0b-kube-api-access-96f5x\") pod \"dns-default-6gzxz\" (UID: \"1f0ca597-861a-4320-b16c-f87fa68dcf0b\") " pod="openshift-dns/dns-default-6gzxz"
Sep 15 13:39:08.220598 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:08.220590    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fe529bf1-eb92-4c2f-a205-3aaed674d7a0-trusted-ca\") pod \"image-registry-56444b6f6-q6gl8\" (UID: \"fe529bf1-eb92-4c2f-a205-3aaed674d7a0\") " pod="openshift-image-registry/image-registry-56444b6f6-q6gl8"
Sep 15 13:39:08.220777 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:08.220617    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/190df695-604e-4d5c-8807-e2095d95564b-cert\") pod \"ingress-canary-s9sjm\" (UID: \"190df695-604e-4d5c-8807-e2095d95564b\") " pod="openshift-ingress-canary/ingress-canary-s9sjm"
Sep 15 13:39:08.220777 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:08.220673    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1f0ca597-861a-4320-b16c-f87fa68dcf0b-metrics-tls\") pod \"dns-default-6gzxz\" (UID: \"1f0ca597-861a-4320-b16c-f87fa68dcf0b\") " pod="openshift-dns/dns-default-6gzxz"
Sep 15 13:39:08.321414 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:08.321369    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fe529bf1-eb92-4c2f-a205-3aaed674d7a0-registry-tls\") pod \"image-registry-56444b6f6-q6gl8\" (UID: \"fe529bf1-eb92-4c2f-a205-3aaed674d7a0\") " pod="openshift-image-registry/image-registry-56444b6f6-q6gl8"
Sep 15 13:39:08.321414 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:08.321415    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fe529bf1-eb92-4c2f-a205-3aaed674d7a0-ca-trust-extracted\") pod \"image-registry-56444b6f6-q6gl8\" (UID: \"fe529bf1-eb92-4c2f-a205-3aaed674d7a0\") " pod="openshift-image-registry/image-registry-56444b6f6-q6gl8"
Sep 15 13:39:08.321653 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:08.321469    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fe529bf1-eb92-4c2f-a205-3aaed674d7a0-image-registry-private-configuration\") pod \"image-registry-56444b6f6-q6gl8\" (UID: \"fe529bf1-eb92-4c2f-a205-3aaed674d7a0\") " pod="openshift-image-registry/image-registry-56444b6f6-q6gl8"
Sep 15 13:39:08.321653 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:08.321494    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fe529bf1-eb92-4c2f-a205-3aaed674d7a0-registry-certificates\") pod \"image-registry-56444b6f6-q6gl8\" (UID: \"fe529bf1-eb92-4c2f-a205-3aaed674d7a0\") " pod="openshift-image-registry/image-registry-56444b6f6-q6gl8"
Sep 15 13:39:08.321653 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:08.321517    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fe529bf1-eb92-4c2f-a205-3aaed674d7a0-installation-pull-secrets\") pod \"image-registry-56444b6f6-q6gl8\" (UID: \"fe529bf1-eb92-4c2f-a205-3aaed674d7a0\") " pod="openshift-image-registry/image-registry-56444b6f6-q6gl8"
Sep 15 13:39:08.321653 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:08.321540    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1f0ca597-861a-4320-b16c-f87fa68dcf0b-config-volume\") pod \"dns-default-6gzxz\" (UID: \"1f0ca597-861a-4320-b16c-f87fa68dcf0b\") " pod="openshift-dns/dns-default-6gzxz"
Sep 15 13:39:08.321653 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:08.321572    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f0ca597-861a-4320-b16c-f87fa68dcf0b-tmp-dir\") pod \"dns-default-6gzxz\" (UID: \"1f0ca597-861a-4320-b16c-f87fa68dcf0b\") " pod="openshift-dns/dns-default-6gzxz"
Sep 15 13:39:08.321653 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:08.321608    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6czxr\" (UniqueName: \"kubernetes.io/projected/fe529bf1-eb92-4c2f-a205-3aaed674d7a0-kube-api-access-6czxr\") pod \"image-registry-56444b6f6-q6gl8\" (UID: \"fe529bf1-eb92-4c2f-a205-3aaed674d7a0\") " pod="openshift-image-registry/image-registry-56444b6f6-q6gl8"
Sep 15 13:39:08.321653 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:08.321633    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqf7q\" (UniqueName: \"kubernetes.io/projected/190df695-604e-4d5c-8807-e2095d95564b-kube-api-access-sqf7q\") pod \"ingress-canary-s9sjm\" (UID: \"190df695-604e-4d5c-8807-e2095d95564b\") " pod="openshift-ingress-canary/ingress-canary-s9sjm"
Sep 15 13:39:08.322000 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:08.321665    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fe529bf1-eb92-4c2f-a205-3aaed674d7a0-bound-sa-token\") pod \"image-registry-56444b6f6-q6gl8\" (UID: \"fe529bf1-eb92-4c2f-a205-3aaed674d7a0\") " pod="openshift-image-registry/image-registry-56444b6f6-q6gl8"
Sep 15 13:39:08.322000 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:08.321696    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96f5x\" (UniqueName: \"kubernetes.io/projected/1f0ca597-861a-4320-b16c-f87fa68dcf0b-kube-api-access-96f5x\") pod \"dns-default-6gzxz\" (UID: \"1f0ca597-861a-4320-b16c-f87fa68dcf0b\") " pod="openshift-dns/dns-default-6gzxz"
Sep 15 13:39:08.322000 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:08.321724    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fe529bf1-eb92-4c2f-a205-3aaed674d7a0-trusted-ca\") pod \"image-registry-56444b6f6-q6gl8\" (UID: \"fe529bf1-eb92-4c2f-a205-3aaed674d7a0\") " pod="openshift-image-registry/image-registry-56444b6f6-q6gl8"
Sep 15 13:39:08.322000 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:08.321750    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/190df695-604e-4d5c-8807-e2095d95564b-cert\") pod \"ingress-canary-s9sjm\" (UID: \"190df695-604e-4d5c-8807-e2095d95564b\") " pod="openshift-ingress-canary/ingress-canary-s9sjm"
Sep 15 13:39:08.322000 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:08.321789    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1f0ca597-861a-4320-b16c-f87fa68dcf0b-metrics-tls\") pod \"dns-default-6gzxz\" (UID: \"1f0ca597-861a-4320-b16c-f87fa68dcf0b\") " pod="openshift-dns/dns-default-6gzxz"
Sep 15 13:39:08.322000 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:39:08.321944    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 13:39:08.322000 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:39:08.321995    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f0ca597-861a-4320-b16c-f87fa68dcf0b-metrics-tls podName:1f0ca597-861a-4320-b16c-f87fa68dcf0b nodeName:}" failed. No retries permitted until 2026-09-15 13:39:08.821981815 +0000 UTC m=+35.581108095 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1f0ca597-861a-4320-b16c-f87fa68dcf0b-metrics-tls") pod "dns-default-6gzxz" (UID: "1f0ca597-861a-4320-b16c-f87fa68dcf0b") : secret "dns-default-metrics-tls" not found
Sep 15 13:39:08.322371 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:39:08.322299    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 15 13:39:08.322371 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:39:08.322313    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-56444b6f6-q6gl8: secret "image-registry-tls" not found
Sep 15 13:39:08.322371 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:39:08.322355    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fe529bf1-eb92-4c2f-a205-3aaed674d7a0-registry-tls podName:fe529bf1-eb92-4c2f-a205-3aaed674d7a0 nodeName:}" failed. No retries permitted until 2026-09-15 13:39:08.822341776 +0000 UTC m=+35.581468043 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fe529bf1-eb92-4c2f-a205-3aaed674d7a0-registry-tls") pod "image-registry-56444b6f6-q6gl8" (UID: "fe529bf1-eb92-4c2f-a205-3aaed674d7a0") : secret "image-registry-tls" not found
Sep 15 13:39:08.322723 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:08.322704    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fe529bf1-eb92-4c2f-a205-3aaed674d7a0-ca-trust-extracted\") pod \"image-registry-56444b6f6-q6gl8\" (UID: \"fe529bf1-eb92-4c2f-a205-3aaed674d7a0\") " pod="openshift-image-registry/image-registry-56444b6f6-q6gl8"
Sep 15 13:39:08.323806 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:08.323561    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f0ca597-861a-4320-b16c-f87fa68dcf0b-tmp-dir\") pod \"dns-default-6gzxz\" (UID: \"1f0ca597-861a-4320-b16c-f87fa68dcf0b\") " pod="openshift-dns/dns-default-6gzxz"
Sep 15 13:39:08.323806 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:08.323742    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fe529bf1-eb92-4c2f-a205-3aaed674d7a0-registry-certificates\") pod \"image-registry-56444b6f6-q6gl8\" (UID: \"fe529bf1-eb92-4c2f-a205-3aaed674d7a0\") " pod="openshift-image-registry/image-registry-56444b6f6-q6gl8"
Sep 15 13:39:08.323806 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:08.323745    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1f0ca597-861a-4320-b16c-f87fa68dcf0b-config-volume\") pod \"dns-default-6gzxz\" (UID: \"1f0ca597-861a-4320-b16c-f87fa68dcf0b\") " pod="openshift-dns/dns-default-6gzxz"
Sep 15 13:39:08.324041 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:08.323940    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fe529bf1-eb92-4c2f-a205-3aaed674d7a0-trusted-ca\") pod \"image-registry-56444b6f6-q6gl8\" (UID: \"fe529bf1-eb92-4c2f-a205-3aaed674d7a0\") " pod="openshift-image-registry/image-registry-56444b6f6-q6gl8"
Sep 15 13:39:08.332647 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:08.327901    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/190df695-604e-4d5c-8807-e2095d95564b-cert\") pod \"ingress-canary-s9sjm\" (UID: \"190df695-604e-4d5c-8807-e2095d95564b\") " pod="openshift-ingress-canary/ingress-canary-s9sjm"
Sep 15 13:39:08.332647 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:08.331918    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fe529bf1-eb92-4c2f-a205-3aaed674d7a0-installation-pull-secrets\") pod \"image-registry-56444b6f6-q6gl8\" (UID: \"fe529bf1-eb92-4c2f-a205-3aaed674d7a0\") " pod="openshift-image-registry/image-registry-56444b6f6-q6gl8"
Sep 15 13:39:08.332647 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:08.332085    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-96f5x\" (UniqueName: \"kubernetes.io/projected/1f0ca597-861a-4320-b16c-f87fa68dcf0b-kube-api-access-96f5x\") pod \"dns-default-6gzxz\" (UID: \"1f0ca597-861a-4320-b16c-f87fa68dcf0b\") " pod="openshift-dns/dns-default-6gzxz"
Sep 15 13:39:08.332647 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:08.332329    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6czxr\" (UniqueName: \"kubernetes.io/projected/fe529bf1-eb92-4c2f-a205-3aaed674d7a0-kube-api-access-6czxr\") pod \"image-registry-56444b6f6-q6gl8\" (UID: \"fe529bf1-eb92-4c2f-a205-3aaed674d7a0\") " pod="openshift-image-registry/image-registry-56444b6f6-q6gl8"
Sep 15 13:39:08.332647 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:08.332328    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqf7q\" (UniqueName: \"kubernetes.io/projected/190df695-604e-4d5c-8807-e2095d95564b-kube-api-access-sqf7q\") pod \"ingress-canary-s9sjm\" (UID: \"190df695-604e-4d5c-8807-e2095d95564b\") " pod="openshift-ingress-canary/ingress-canary-s9sjm"
Sep 15 13:39:08.333530 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:08.333511    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fe529bf1-eb92-4c2f-a205-3aaed674d7a0-bound-sa-token\") pod \"image-registry-56444b6f6-q6gl8\" (UID: \"fe529bf1-eb92-4c2f-a205-3aaed674d7a0\") " pod="openshift-image-registry/image-registry-56444b6f6-q6gl8"
Sep 15 13:39:08.333620 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:08.333556    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fe529bf1-eb92-4c2f-a205-3aaed674d7a0-image-registry-private-configuration\") pod \"image-registry-56444b6f6-q6gl8\" (UID: \"fe529bf1-eb92-4c2f-a205-3aaed674d7a0\") " pod="openshift-image-registry/image-registry-56444b6f6-q6gl8"
Sep 15 13:39:08.429538 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:08.429492    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-s9sjm"
Sep 15 13:39:08.720058 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:08.720025    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-s9sjm"]
Sep 15 13:39:08.726390 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:39:08.726365    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod190df695_604e_4d5c_8807_e2095d95564b.slice/crio-28fc478f268162f9362fed72e0e06783c0edfe5c8e0846b50fa982ef9fc8973c WatchSource:0}: Error finding container 28fc478f268162f9362fed72e0e06783c0edfe5c8e0846b50fa982ef9fc8973c: Status 404 returned error can't find the container with id 28fc478f268162f9362fed72e0e06783c0edfe5c8e0846b50fa982ef9fc8973c
Sep 15 13:39:08.752003 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:08.751941    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f54mn"
Sep 15 13:39:08.752112 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:08.752047    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-24wlp"
Sep 15 13:39:08.752112 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:08.752076    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fsnbc"
Sep 15 13:39:08.754518 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:08.754494    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 15 13:39:08.755168 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:08.755150    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 15 13:39:08.755254 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:08.755182    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ztmxf\""
Sep 15 13:39:08.755756 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:08.755731    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 15 13:39:08.755859 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:08.755739    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qwvrm\""
Sep 15 13:39:08.755859 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:08.755821    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 15 13:39:08.824900 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:08.824872    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1f0ca597-861a-4320-b16c-f87fa68dcf0b-metrics-tls\") pod \"dns-default-6gzxz\" (UID: \"1f0ca597-861a-4320-b16c-f87fa68dcf0b\") " pod="openshift-dns/dns-default-6gzxz"
Sep 15 13:39:08.825020 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:08.824932    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fe529bf1-eb92-4c2f-a205-3aaed674d7a0-registry-tls\") pod \"image-registry-56444b6f6-q6gl8\" (UID: \"fe529bf1-eb92-4c2f-a205-3aaed674d7a0\") " pod="openshift-image-registry/image-registry-56444b6f6-q6gl8"
Sep 15 13:39:08.825020 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:39:08.825005    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 13:39:08.825108 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:39:08.825052    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 15 13:39:08.825108 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:39:08.825065    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-56444b6f6-q6gl8: secret "image-registry-tls" not found
Sep 15 13:39:08.825108 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:39:08.825089    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f0ca597-861a-4320-b16c-f87fa68dcf0b-metrics-tls podName:1f0ca597-861a-4320-b16c-f87fa68dcf0b nodeName:}" failed. No retries permitted until 2026-09-15 13:39:09.82506762 +0000 UTC m=+36.584193908 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1f0ca597-861a-4320-b16c-f87fa68dcf0b-metrics-tls") pod "dns-default-6gzxz" (UID: "1f0ca597-861a-4320-b16c-f87fa68dcf0b") : secret "dns-default-metrics-tls" not found
Sep 15 13:39:08.825255 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:39:08.825119    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fe529bf1-eb92-4c2f-a205-3aaed674d7a0-registry-tls podName:fe529bf1-eb92-4c2f-a205-3aaed674d7a0 nodeName:}" failed. No retries permitted until 2026-09-15 13:39:09.825105848 +0000 UTC m=+36.584232139 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fe529bf1-eb92-4c2f-a205-3aaed674d7a0-registry-tls") pod "image-registry-56444b6f6-q6gl8" (UID: "fe529bf1-eb92-4c2f-a205-3aaed674d7a0") : secret "image-registry-tls" not found
Sep 15 13:39:09.005908 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:09.005822    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-s9sjm" event={"ID":"190df695-604e-4d5c-8807-e2095d95564b","Type":"ContainerStarted","Data":"28fc478f268162f9362fed72e0e06783c0edfe5c8e0846b50fa982ef9fc8973c"}
Sep 15 13:39:09.832940 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:09.832892    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fe529bf1-eb92-4c2f-a205-3aaed674d7a0-registry-tls\") pod \"image-registry-56444b6f6-q6gl8\" (UID: \"fe529bf1-eb92-4c2f-a205-3aaed674d7a0\") " pod="openshift-image-registry/image-registry-56444b6f6-q6gl8"
Sep 15 13:39:09.833468 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:09.833024    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1f0ca597-861a-4320-b16c-f87fa68dcf0b-metrics-tls\") pod \"dns-default-6gzxz\" (UID: \"1f0ca597-861a-4320-b16c-f87fa68dcf0b\") " pod="openshift-dns/dns-default-6gzxz"
Sep 15 13:39:09.833468 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:39:09.833095    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 15 13:39:09.833468 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:39:09.833107    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 13:39:09.833468 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:39:09.833112    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-56444b6f6-q6gl8: secret "image-registry-tls" not found
Sep 15 13:39:09.833468 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:39:09.833188    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fe529bf1-eb92-4c2f-a205-3aaed674d7a0-registry-tls podName:fe529bf1-eb92-4c2f-a205-3aaed674d7a0 nodeName:}" failed. No retries permitted until 2026-09-15 13:39:11.833170222 +0000 UTC m=+38.592296501 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fe529bf1-eb92-4c2f-a205-3aaed674d7a0-registry-tls") pod "image-registry-56444b6f6-q6gl8" (UID: "fe529bf1-eb92-4c2f-a205-3aaed674d7a0") : secret "image-registry-tls" not found
Sep 15 13:39:09.833468 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:39:09.833205    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f0ca597-861a-4320-b16c-f87fa68dcf0b-metrics-tls podName:1f0ca597-861a-4320-b16c-f87fa68dcf0b nodeName:}" failed. No retries permitted until 2026-09-15 13:39:11.833196946 +0000 UTC m=+38.592323212 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1f0ca597-861a-4320-b16c-f87fa68dcf0b-metrics-tls") pod "dns-default-6gzxz" (UID: "1f0ca597-861a-4320-b16c-f87fa68dcf0b") : secret "dns-default-metrics-tls" not found
Sep 15 13:39:11.850064 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:11.850022    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1f0ca597-861a-4320-b16c-f87fa68dcf0b-metrics-tls\") pod \"dns-default-6gzxz\" (UID: \"1f0ca597-861a-4320-b16c-f87fa68dcf0b\") " pod="openshift-dns/dns-default-6gzxz"
Sep 15 13:39:11.850615 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:11.850090    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fe529bf1-eb92-4c2f-a205-3aaed674d7a0-registry-tls\") pod \"image-registry-56444b6f6-q6gl8\" (UID: \"fe529bf1-eb92-4c2f-a205-3aaed674d7a0\") " pod="openshift-image-registry/image-registry-56444b6f6-q6gl8"
Sep 15 13:39:11.850615 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:39:11.850242    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 13:39:11.850615 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:39:11.850307    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f0ca597-861a-4320-b16c-f87fa68dcf0b-metrics-tls podName:1f0ca597-861a-4320-b16c-f87fa68dcf0b nodeName:}" failed. No retries permitted until 2026-09-15 13:39:15.850290739 +0000 UTC m=+42.609417035 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1f0ca597-861a-4320-b16c-f87fa68dcf0b-metrics-tls") pod "dns-default-6gzxz" (UID: "1f0ca597-861a-4320-b16c-f87fa68dcf0b") : secret "dns-default-metrics-tls" not found
Sep 15 13:39:11.850776 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:39:11.850246    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 15 13:39:11.850776 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:39:11.850675    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-56444b6f6-q6gl8: secret "image-registry-tls" not found
Sep 15 13:39:11.850776 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:39:11.850717    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fe529bf1-eb92-4c2f-a205-3aaed674d7a0-registry-tls podName:fe529bf1-eb92-4c2f-a205-3aaed674d7a0 nodeName:}" failed. No retries permitted until 2026-09-15 13:39:15.850704371 +0000 UTC m=+42.609830664 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fe529bf1-eb92-4c2f-a205-3aaed674d7a0-registry-tls") pod "image-registry-56444b6f6-q6gl8" (UID: "fe529bf1-eb92-4c2f-a205-3aaed674d7a0") : secret "image-registry-tls" not found
Sep 15 13:39:13.018940 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:13.018848    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-s9sjm" event={"ID":"190df695-604e-4d5c-8807-e2095d95564b","Type":"ContainerStarted","Data":"735f1d03a95942e190438f4e5ab61db444f18f86448c6ca58033891e8b33cadb"}
Sep 15 13:39:13.024723 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:13.024695    2578 generic.go:356] "Generic (PLEG): container finished" podID="41073b32-ff62-4ae9-a4e8-aec2b819dd57" containerID="b2b351342f12b56ab2acc92c78c1c48bbfd05170ab285f9039ba1947400afbb1" exitCode=0
Sep 15 13:39:13.024859 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:13.024737    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tgmg6" event={"ID":"41073b32-ff62-4ae9-a4e8-aec2b819dd57","Type":"ContainerDied","Data":"b2b351342f12b56ab2acc92c78c1c48bbfd05170ab285f9039ba1947400afbb1"}
Sep 15 13:39:13.036880 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:13.036756    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-s9sjm" podStartSLOduration=1.59625926 podStartE2EDuration="5.036739618s" totalImagesPullingTime="3.440480358s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:39:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:39:13.035831574 +0000 UTC m=+39.794957860" watchObservedRunningTime="2026-09-15 13:39:13.036739618 +0000 UTC m=+39.795865905"
Sep 15 13:39:14.030422 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:14.030221    2578 generic.go:356] "Generic (PLEG): container finished" podID="41073b32-ff62-4ae9-a4e8-aec2b819dd57" containerID="5934d2bddd4702be5adbc6c14d6f579decc5cc52ec68b2e87412244eb56be852" exitCode=0
Sep 15 13:39:14.030422 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:14.030305    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tgmg6" event={"ID":"41073b32-ff62-4ae9-a4e8-aec2b819dd57","Type":"ContainerDied","Data":"5934d2bddd4702be5adbc6c14d6f579decc5cc52ec68b2e87412244eb56be852"}
Sep 15 13:39:15.038190 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:15.038154    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tgmg6" event={"ID":"41073b32-ff62-4ae9-a4e8-aec2b819dd57","Type":"ContainerStarted","Data":"c032ad646f1a544c9c44785a3c70a008dd51be5fbdde5d2f366fadc6c3f0df49"}
Sep 15 13:39:15.062809 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:15.062751    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-tgmg6" podStartSLOduration=8.452421072 podStartE2EDuration="42.06273552s" totalImagesPullingTime="33.610314448s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 13:38:33 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:39:15.060972247 +0000 UTC m=+41.820098533" watchObservedRunningTime="2026-09-15 13:39:15.06273552 +0000 UTC m=+41.821861806"
Sep 15 13:39:15.877646 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:15.877609    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1f0ca597-861a-4320-b16c-f87fa68dcf0b-metrics-tls\") pod \"dns-default-6gzxz\" (UID: \"1f0ca597-861a-4320-b16c-f87fa68dcf0b\") " pod="openshift-dns/dns-default-6gzxz"
Sep 15 13:39:15.877822 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:15.877654    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fe529bf1-eb92-4c2f-a205-3aaed674d7a0-registry-tls\") pod \"image-registry-56444b6f6-q6gl8\" (UID: \"fe529bf1-eb92-4c2f-a205-3aaed674d7a0\") " pod="openshift-image-registry/image-registry-56444b6f6-q6gl8"
Sep 15 13:39:15.880892 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:15.880859    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fe529bf1-eb92-4c2f-a205-3aaed674d7a0-registry-tls\") pod \"image-registry-56444b6f6-q6gl8\" (UID: \"fe529bf1-eb92-4c2f-a205-3aaed674d7a0\") " pod="openshift-image-registry/image-registry-56444b6f6-q6gl8"
Sep 15 13:39:15.881005 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:15.880861    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1f0ca597-861a-4320-b16c-f87fa68dcf0b-metrics-tls\") pod \"dns-default-6gzxz\" (UID: \"1f0ca597-861a-4320-b16c-f87fa68dcf0b\") " pod="openshift-dns/dns-default-6gzxz"
Sep 15 13:39:15.909826 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:15.909793    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-56444b6f6-q6gl8"
Sep 15 13:39:15.922943 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:15.922922    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6gzxz"
Sep 15 13:39:16.211145 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:16.211049    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-56444b6f6-q6gl8"]
Sep 15 13:39:16.214815 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:39:16.214788    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe529bf1_eb92_4c2f_a205_3aaed674d7a0.slice/crio-51e59f69010e81726f71d451877ee974c8d483aeb2bda4f6a9dc3020cba2a79e WatchSource:0}: Error finding container 51e59f69010e81726f71d451877ee974c8d483aeb2bda4f6a9dc3020cba2a79e: Status 404 returned error can't find the container with id 51e59f69010e81726f71d451877ee974c8d483aeb2bda4f6a9dc3020cba2a79e
Sep 15 13:39:16.227074 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:16.227053    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6gzxz"]
Sep 15 13:39:16.229864 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:39:16.229838    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f0ca597_861a_4320_b16c_f87fa68dcf0b.slice/crio-0d0fdca940360a812d2f6e5a2b8b9484b9fdf9f9d889e243c1fa5d22b6fadab8 WatchSource:0}: Error finding container 0d0fdca940360a812d2f6e5a2b8b9484b9fdf9f9d889e243c1fa5d22b6fadab8: Status 404 returned error can't find the container with id 0d0fdca940360a812d2f6e5a2b8b9484b9fdf9f9d889e243c1fa5d22b6fadab8
Sep 15 13:39:17.043872 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:17.043840    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6gzxz" event={"ID":"1f0ca597-861a-4320-b16c-f87fa68dcf0b","Type":"ContainerStarted","Data":"0d0fdca940360a812d2f6e5a2b8b9484b9fdf9f9d889e243c1fa5d22b6fadab8"}
Sep 15 13:39:17.045201 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:17.045180    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-56444b6f6-q6gl8" event={"ID":"fe529bf1-eb92-4c2f-a205-3aaed674d7a0","Type":"ContainerStarted","Data":"e8c6d8524ff7c445119778dfe340709f85043ad7303e5f5b4aa9650f2cda6f5f"}
Sep 15 13:39:17.045256 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:17.045217    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-56444b6f6-q6gl8" event={"ID":"fe529bf1-eb92-4c2f-a205-3aaed674d7a0","Type":"ContainerStarted","Data":"51e59f69010e81726f71d451877ee974c8d483aeb2bda4f6a9dc3020cba2a79e"}
Sep 15 13:39:17.045334 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:17.045317    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-56444b6f6-q6gl8"
Sep 15 13:39:17.068638 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:17.068601    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-56444b6f6-q6gl8" podStartSLOduration=54.068588547 podStartE2EDuration="54.068588547s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:38:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:39:17.067847305 +0000 UTC m=+43.826973591" watchObservedRunningTime="2026-09-15 13:39:17.068588547 +0000 UTC m=+43.827714827"
Sep 15 13:39:22.059365 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:22.059328    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6gzxz" event={"ID":"1f0ca597-861a-4320-b16c-f87fa68dcf0b","Type":"ContainerStarted","Data":"5ee3bc60b5a1cf085c77bec0fc1d0a9bb1be68d1c965f869f35871e2f4c12057"}
Sep 15 13:39:22.059903 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:22.059378    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6gzxz" event={"ID":"1f0ca597-861a-4320-b16c-f87fa68dcf0b","Type":"ContainerStarted","Data":"c61ba9edd5c366ac06b3caa111ea1be4dcf593bacc7a1160ea8a56f6754ccbfd"}
Sep 15 13:39:22.059903 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:22.059456    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-6gzxz"
Sep 15 13:39:22.082173 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:22.082104    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-6gzxz" podStartSLOduration=8.9381654 podStartE2EDuration="14.082069652s" totalImagesPullingTime="5.143904252s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:39:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:39:22.081512918 +0000 UTC m=+48.840639205" watchObservedRunningTime="2026-09-15 13:39:22.082069652 +0000 UTC m=+48.841195939"
Sep 15 13:39:32.063701 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.063665    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-6gzxz"
Sep 15 13:39:32.625757 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.625722    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-mxjg9"]
Sep 15 13:39:32.628297 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.628275    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-mxjg9"
Sep 15 13:39:32.630089 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.630067    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-tw8sw"]
Sep 15 13:39:32.630559 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.630537    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Sep 15 13:39:32.630646 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.630611    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-2t26h\""
Sep 15 13:39:32.631399 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.631379    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Sep 15 13:39:32.632002 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.631976    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-tw8sw"
Sep 15 13:39:32.633196 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.633174    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-55fc4dcbd8-x64q6"]
Sep 15 13:39:32.634951 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.634932    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-55fc4dcbd8-x64q6"
Sep 15 13:39:32.636382 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.636364    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 15 13:39:32.636477 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.636454    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Sep 15 13:39:32.637035 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.637018    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 15 13:39:32.637035 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.637029    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Sep 15 13:39:32.637218 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.637020    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-w8jxj\""
Sep 15 13:39:32.637545 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.637357    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Sep 15 13:39:32.637545 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.637448    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 15 13:39:32.637787 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.637768    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Sep 15 13:39:32.637868 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.637809    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-pslrc\""
Sep 15 13:39:32.637966 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.637945    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Sep 15 13:39:32.638066 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.637996    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Sep 15 13:39:32.638148 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.638112    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 15 13:39:32.642886 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.642846    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-mxjg9"]
Sep 15 13:39:32.652278 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.652256    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-tw8sw"]
Sep 15 13:39:32.653778 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.653759    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-55fc4dcbd8-x64q6"]
Sep 15 13:39:32.665526 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.665507    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68987bbfb-lcwpj"]
Sep 15 13:39:32.667370 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.667354    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68987bbfb-lcwpj"
Sep 15 13:39:32.670529 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.670514    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Sep 15 13:39:32.670626 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.670516    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 15 13:39:32.670722 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.670706    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 15 13:39:32.670785 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.670769    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 15 13:39:32.670975 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.670960    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-dfqtj\""
Sep 15 13:39:32.678338 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.678317    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68987bbfb-lcwpj"]
Sep 15 13:39:32.688776 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.688754    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/cc6f77f9-a7c4-4a0f-8f5b-46459356b060-default-certificate\") pod \"router-default-55fc4dcbd8-x64q6\" (UID: \"cc6f77f9-a7c4-4a0f-8f5b-46459356b060\") " pod="openshift-ingress/router-default-55fc4dcbd8-x64q6"
Sep 15 13:39:32.688873 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.688794    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7b56d6ce-14c4-4816-8a10-c5cb22197363-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-68987bbfb-lcwpj\" (UID: \"7b56d6ce-14c4-4816-8a10-c5cb22197363\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68987bbfb-lcwpj"
Sep 15 13:39:32.688873 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.688824    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fz8wt\" (UniqueName: \"kubernetes.io/projected/4a3b4228-587e-4134-b561-79f80de47185-kube-api-access-fz8wt\") pod \"volume-data-source-validator-86695b7cc7-mxjg9\" (UID: \"4a3b4228-587e-4134-b561-79f80de47185\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-mxjg9"
Sep 15 13:39:32.688971 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.688885    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc6f77f9-a7c4-4a0f-8f5b-46459356b060-service-ca-bundle\") pod \"router-default-55fc4dcbd8-x64q6\" (UID: \"cc6f77f9-a7c4-4a0f-8f5b-46459356b060\") " pod="openshift-ingress/router-default-55fc4dcbd8-x64q6"
Sep 15 13:39:32.688971 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.688932    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e149b61b-8b51-4602-8fdf-b81c7a7b20ec-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-tw8sw\" (UID: \"e149b61b-8b51-4602-8fdf-b81c7a7b20ec\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-tw8sw"
Sep 15 13:39:32.688971 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.688953    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rrzx\" (UniqueName: \"kubernetes.io/projected/7b56d6ce-14c4-4816-8a10-c5cb22197363-kube-api-access-9rrzx\") pod \"managed-serviceaccount-addon-agent-68987bbfb-lcwpj\" (UID: \"7b56d6ce-14c4-4816-8a10-c5cb22197363\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68987bbfb-lcwpj"
Sep 15 13:39:32.689082 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.689024    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9l2hb\" (UniqueName: \"kubernetes.io/projected/e149b61b-8b51-4602-8fdf-b81c7a7b20ec-kube-api-access-9l2hb\") pod \"cluster-monitoring-operator-6cd954b897-tw8sw\" (UID: \"e149b61b-8b51-4602-8fdf-b81c7a7b20ec\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-tw8sw"
Sep 15 13:39:32.689082 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.689044    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lh2x7\" (UniqueName: \"kubernetes.io/projected/cc6f77f9-a7c4-4a0f-8f5b-46459356b060-kube-api-access-lh2x7\") pod \"router-default-55fc4dcbd8-x64q6\" (UID: \"cc6f77f9-a7c4-4a0f-8f5b-46459356b060\") " pod="openshift-ingress/router-default-55fc4dcbd8-x64q6"
Sep 15 13:39:32.689215 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.689101    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cc6f77f9-a7c4-4a0f-8f5b-46459356b060-metrics-certs\") pod \"router-default-55fc4dcbd8-x64q6\" (UID: \"cc6f77f9-a7c4-4a0f-8f5b-46459356b060\") " pod="openshift-ingress/router-default-55fc4dcbd8-x64q6"
Sep 15 13:39:32.689215 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.689161    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e149b61b-8b51-4602-8fdf-b81c7a7b20ec-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-tw8sw\" (UID: \"e149b61b-8b51-4602-8fdf-b81c7a7b20ec\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-tw8sw"
Sep 15 13:39:32.689215 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.689194    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/cc6f77f9-a7c4-4a0f-8f5b-46459356b060-stats-auth\") pod \"router-default-55fc4dcbd8-x64q6\" (UID: \"cc6f77f9-a7c4-4a0f-8f5b-46459356b060\") " pod="openshift-ingress/router-default-55fc4dcbd8-x64q6"
Sep 15 13:39:32.696183 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.696166    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-56444b6f6-q6gl8"]
Sep 15 13:39:32.701137 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.701091    2578 patch_prober.go:28] interesting pod/image-registry-56444b6f6-q6gl8 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 15 13:39:32.701224 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.701153    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-56444b6f6-q6gl8" podUID="fe529bf1-eb92-4c2f-a205-3aaed674d7a0" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 15 13:39:32.731039 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.731016    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-zpmzg"]
Sep 15 13:39:32.732996 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.732983    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-zpmzg"
Sep 15 13:39:32.738746 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.738697    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Sep 15 13:39:32.738942 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.738924    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-gdtsf\""
Sep 15 13:39:32.739221 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.739206    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Sep 15 13:39:32.739221 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.739211    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Sep 15 13:39:32.739356 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.739236    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Sep 15 13:39:32.748531 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.748506    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-86rtx"]
Sep 15 13:39:32.750494 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.750478    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-556c8d5f67-cj9zw"]
Sep 15 13:39:32.750605 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.750590    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-86rtx"
Sep 15 13:39:32.754573 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.752763    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-556c8d5f67-cj9zw"
Sep 15 13:39:32.754573 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.752888    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5844b856db-tkwx9"]
Sep 15 13:39:32.755026 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.754995    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Sep 15 13:39:32.755326 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.755307    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-z9cmq\""
Sep 15 13:39:32.755483 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.755465    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Sep 15 13:39:32.755570 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.755540    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Sep 15 13:39:32.756805 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.756777    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5844b856db-tkwx9"
Sep 15 13:39:32.759599 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.759579    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Sep 15 13:39:32.759698 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.759616    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 15 13:39:32.759835 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.759820    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-7vpl7\""
Sep 15 13:39:32.760335 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.760319    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Sep 15 13:39:32.760419 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.760341    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 15 13:39:32.772454 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.772432    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Sep 15 13:39:32.775852 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.775835    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-zpmzg"]
Sep 15 13:39:32.790355 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.790333    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/cc6f77f9-a7c4-4a0f-8f5b-46459356b060-default-certificate\") pod \"router-default-55fc4dcbd8-x64q6\" (UID: \"cc6f77f9-a7c4-4a0f-8f5b-46459356b060\") " pod="openshift-ingress/router-default-55fc4dcbd8-x64q6"
Sep 15 13:39:32.790444 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.790372    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vglmw\" (UniqueName: \"kubernetes.io/projected/492ebd98-bb7b-4ac7-8cd6-c5471e55b93f-kube-api-access-vglmw\") pod \"image-registry-556c8d5f67-cj9zw\" (UID: \"492ebd98-bb7b-4ac7-8cd6-c5471e55b93f\") " pod="openshift-image-registry/image-registry-556c8d5f67-cj9zw"
Sep 15 13:39:32.790444 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.790434    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/39befdfe-8c59-4d05-9da7-5bb64f8ce5a7-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-zpmzg\" (UID: \"39befdfe-8c59-4d05-9da7-5bb64f8ce5a7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-zpmzg"
Sep 15 13:39:32.790542 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.790460    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffcd10ba-e428-40f8-875a-64439cf04619-trusted-ca-bundle\") pod \"insights-operator-5844b856db-tkwx9\" (UID: \"ffcd10ba-e428-40f8-875a-64439cf04619\") " pod="openshift-insights/insights-operator-5844b856db-tkwx9"
Sep 15 13:39:32.790542 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.790490    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7b56d6ce-14c4-4816-8a10-c5cb22197363-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-68987bbfb-lcwpj\" (UID: \"7b56d6ce-14c4-4816-8a10-c5cb22197363\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68987bbfb-lcwpj"
Sep 15 13:39:32.790542 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.790519    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fz8wt\" (UniqueName: \"kubernetes.io/projected/4a3b4228-587e-4134-b561-79f80de47185-kube-api-access-fz8wt\") pod \"volume-data-source-validator-86695b7cc7-mxjg9\" (UID: \"4a3b4228-587e-4134-b561-79f80de47185\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-mxjg9"
Sep 15 13:39:32.790690 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.790545    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/492ebd98-bb7b-4ac7-8cd6-c5471e55b93f-registry-certificates\") pod \"image-registry-556c8d5f67-cj9zw\" (UID: \"492ebd98-bb7b-4ac7-8cd6-c5471e55b93f\") " pod="openshift-image-registry/image-registry-556c8d5f67-cj9zw"
Sep 15 13:39:32.790690 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.790572    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfgxc\" (UniqueName: \"kubernetes.io/projected/39befdfe-8c59-4d05-9da7-5bb64f8ce5a7-kube-api-access-sfgxc\") pod \"kube-storage-version-migrator-operator-6c8f84f897-zpmzg\" (UID: \"39befdfe-8c59-4d05-9da7-5bb64f8ce5a7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-zpmzg"
Sep 15 13:39:32.790690 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.790600    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/492ebd98-bb7b-4ac7-8cd6-c5471e55b93f-trusted-ca\") pod \"image-registry-556c8d5f67-cj9zw\" (UID: \"492ebd98-bb7b-4ac7-8cd6-c5471e55b93f\") " pod="openshift-image-registry/image-registry-556c8d5f67-cj9zw"
Sep 15 13:39:32.790690 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.790640    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ffcd10ba-e428-40f8-875a-64439cf04619-serving-cert\") pod \"insights-operator-5844b856db-tkwx9\" (UID: \"ffcd10ba-e428-40f8-875a-64439cf04619\") " pod="openshift-insights/insights-operator-5844b856db-tkwx9"
Sep 15 13:39:32.790690 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.790661    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ffcd10ba-e428-40f8-875a-64439cf04619-tmp\") pod \"insights-operator-5844b856db-tkwx9\" (UID: \"ffcd10ba-e428-40f8-875a-64439cf04619\") " pod="openshift-insights/insights-operator-5844b856db-tkwx9"
Sep 15 13:39:32.790947 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.790694    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lh2x7\" (UniqueName: \"kubernetes.io/projected/cc6f77f9-a7c4-4a0f-8f5b-46459356b060-kube-api-access-lh2x7\") pod \"router-default-55fc4dcbd8-x64q6\" (UID: \"cc6f77f9-a7c4-4a0f-8f5b-46459356b060\") " pod="openshift-ingress/router-default-55fc4dcbd8-x64q6"
Sep 15 13:39:32.790947 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.790727    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cc6f77f9-a7c4-4a0f-8f5b-46459356b060-metrics-certs\") pod \"router-default-55fc4dcbd8-x64q6\" (UID: \"cc6f77f9-a7c4-4a0f-8f5b-46459356b060\") " pod="openshift-ingress/router-default-55fc4dcbd8-x64q6"
Sep 15 13:39:32.790947 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.790756    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/492ebd98-bb7b-4ac7-8cd6-c5471e55b93f-registry-tls\") pod \"image-registry-556c8d5f67-cj9zw\" (UID: \"492ebd98-bb7b-4ac7-8cd6-c5471e55b93f\") " pod="openshift-image-registry/image-registry-556c8d5f67-cj9zw"
Sep 15 13:39:32.790947 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.790786    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/cc6f77f9-a7c4-4a0f-8f5b-46459356b060-stats-auth\") pod \"router-default-55fc4dcbd8-x64q6\" (UID: \"cc6f77f9-a7c4-4a0f-8f5b-46459356b060\") " pod="openshift-ingress/router-default-55fc4dcbd8-x64q6"
Sep 15 13:39:32.790947 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.790884    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/492ebd98-bb7b-4ac7-8cd6-c5471e55b93f-bound-sa-token\") pod \"image-registry-556c8d5f67-cj9zw\" (UID: \"492ebd98-bb7b-4ac7-8cd6-c5471e55b93f\") " pod="openshift-image-registry/image-registry-556c8d5f67-cj9zw"
Sep 15 13:39:32.791257 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.791087    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc6f77f9-a7c4-4a0f-8f5b-46459356b060-service-ca-bundle\") pod \"router-default-55fc4dcbd8-x64q6\" (UID: \"cc6f77f9-a7c4-4a0f-8f5b-46459356b060\") " pod="openshift-ingress/router-default-55fc4dcbd8-x64q6"
Sep 15 13:39:32.791257 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.791163    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e149b61b-8b51-4602-8fdf-b81c7a7b20ec-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-tw8sw\" (UID: \"e149b61b-8b51-4602-8fdf-b81c7a7b20ec\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-tw8sw"
Sep 15 13:39:32.791257 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.791195    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rrzx\" (UniqueName: \"kubernetes.io/projected/7b56d6ce-14c4-4816-8a10-c5cb22197363-kube-api-access-9rrzx\") pod \"managed-serviceaccount-addon-agent-68987bbfb-lcwpj\" (UID: \"7b56d6ce-14c4-4816-8a10-c5cb22197363\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68987bbfb-lcwpj"
Sep 15 13:39:32.791257 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.791244    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/ffcd10ba-e428-40f8-875a-64439cf04619-snapshots\") pod \"insights-operator-5844b856db-tkwx9\" (UID: \"ffcd10ba-e428-40f8-875a-64439cf04619\") " pod="openshift-insights/insights-operator-5844b856db-tkwx9"
Sep 15 13:39:32.791463 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.791439    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffcd10ba-e428-40f8-875a-64439cf04619-service-ca-bundle\") pod \"insights-operator-5844b856db-tkwx9\" (UID: \"ffcd10ba-e428-40f8-875a-64439cf04619\") " pod="openshift-insights/insights-operator-5844b856db-tkwx9"
Sep 15 13:39:32.791553 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.791536    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9l2hb\" (UniqueName: \"kubernetes.io/projected/e149b61b-8b51-4602-8fdf-b81c7a7b20ec-kube-api-access-9l2hb\") pod \"cluster-monitoring-operator-6cd954b897-tw8sw\" (UID: \"e149b61b-8b51-4602-8fdf-b81c7a7b20ec\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-tw8sw"
Sep 15 13:39:32.791649 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.791566    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/492ebd98-bb7b-4ac7-8cd6-c5471e55b93f-ca-trust-extracted\") pod \"image-registry-556c8d5f67-cj9zw\" (UID: \"492ebd98-bb7b-4ac7-8cd6-c5471e55b93f\") " pod="openshift-image-registry/image-registry-556c8d5f67-cj9zw"
Sep 15 13:39:32.791649 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.791597    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/492ebd98-bb7b-4ac7-8cd6-c5471e55b93f-installation-pull-secrets\") pod \"image-registry-556c8d5f67-cj9zw\" (UID: \"492ebd98-bb7b-4ac7-8cd6-c5471e55b93f\") " pod="openshift-image-registry/image-registry-556c8d5f67-cj9zw"
Sep 15 13:39:32.791649 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.791639    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e149b61b-8b51-4602-8fdf-b81c7a7b20ec-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-tw8sw\" (UID: \"e149b61b-8b51-4602-8fdf-b81c7a7b20ec\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-tw8sw"
Sep 15 13:39:32.791816 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.791663    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/39befdfe-8c59-4d05-9da7-5bb64f8ce5a7-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-zpmzg\" (UID: \"39befdfe-8c59-4d05-9da7-5bb64f8ce5a7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-zpmzg"
Sep 15 13:39:32.791816 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.791687    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1e3225af-06da-4138-9092-2055f515eb3d-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-86rtx\" (UID: \"1e3225af-06da-4138-9092-2055f515eb3d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-86rtx"
Sep 15 13:39:32.791816 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.791719    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/492ebd98-bb7b-4ac7-8cd6-c5471e55b93f-image-registry-private-configuration\") pod \"image-registry-556c8d5f67-cj9zw\" (UID: \"492ebd98-bb7b-4ac7-8cd6-c5471e55b93f\") " pod="openshift-image-registry/image-registry-556c8d5f67-cj9zw"
Sep 15 13:39:32.791816 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.791741    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgtqb\" (UniqueName: \"kubernetes.io/projected/1e3225af-06da-4138-9092-2055f515eb3d-kube-api-access-zgtqb\") pod \"cluster-samples-operator-86499c89c4-86rtx\" (UID: \"1e3225af-06da-4138-9092-2055f515eb3d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-86rtx"
Sep 15 13:39:32.791816 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.791769    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69kks\" (UniqueName: \"kubernetes.io/projected/ffcd10ba-e428-40f8-875a-64439cf04619-kube-api-access-69kks\") pod \"insights-operator-5844b856db-tkwx9\" (UID: \"ffcd10ba-e428-40f8-875a-64439cf04619\") " pod="openshift-insights/insights-operator-5844b856db-tkwx9"
Sep 15 13:39:32.792048 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.791867    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc6f77f9-a7c4-4a0f-8f5b-46459356b060-service-ca-bundle\") pod \"router-default-55fc4dcbd8-x64q6\" (UID: \"cc6f77f9-a7c4-4a0f-8f5b-46459356b060\") " pod="openshift-ingress/router-default-55fc4dcbd8-x64q6"
Sep 15 13:39:32.792503 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.792460    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e149b61b-8b51-4602-8fdf-b81c7a7b20ec-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-tw8sw\" (UID: \"e149b61b-8b51-4602-8fdf-b81c7a7b20ec\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-tw8sw"
Sep 15 13:39:32.794849 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.794408    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cc6f77f9-a7c4-4a0f-8f5b-46459356b060-metrics-certs\") pod \"router-default-55fc4dcbd8-x64q6\" (UID: \"cc6f77f9-a7c4-4a0f-8f5b-46459356b060\") " pod="openshift-ingress/router-default-55fc4dcbd8-x64q6"
Sep 15 13:39:32.794849 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.794747    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/cc6f77f9-a7c4-4a0f-8f5b-46459356b060-stats-auth\") pod \"router-default-55fc4dcbd8-x64q6\" (UID: \"cc6f77f9-a7c4-4a0f-8f5b-46459356b060\") " pod="openshift-ingress/router-default-55fc4dcbd8-x64q6"
Sep 15 13:39:32.794849 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.794831    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/cc6f77f9-a7c4-4a0f-8f5b-46459356b060-default-certificate\") pod \"router-default-55fc4dcbd8-x64q6\" (UID: \"cc6f77f9-a7c4-4a0f-8f5b-46459356b060\") " pod="openshift-ingress/router-default-55fc4dcbd8-x64q6"
Sep 15 13:39:32.795252 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.795231    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7b56d6ce-14c4-4816-8a10-c5cb22197363-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-68987bbfb-lcwpj\" (UID: \"7b56d6ce-14c4-4816-8a10-c5cb22197363\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68987bbfb-lcwpj"
Sep 15 13:39:32.795373 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.795355    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e149b61b-8b51-4602-8fdf-b81c7a7b20ec-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-tw8sw\" (UID: \"e149b61b-8b51-4602-8fdf-b81c7a7b20ec\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-tw8sw"
Sep 15 13:39:32.802165 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.802116    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-86rtx"]
Sep 15 13:39:32.802966 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.802954    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5844b856db-tkwx9"]
Sep 15 13:39:32.803698 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.803682    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-556c8d5f67-cj9zw"]
Sep 15 13:39:32.850859 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.850826    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fz8wt\" (UniqueName: \"kubernetes.io/projected/4a3b4228-587e-4134-b561-79f80de47185-kube-api-access-fz8wt\") pod \"volume-data-source-validator-86695b7cc7-mxjg9\" (UID: \"4a3b4228-587e-4134-b561-79f80de47185\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-mxjg9"
Sep 15 13:39:32.851014 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.850997    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lh2x7\" (UniqueName: \"kubernetes.io/projected/cc6f77f9-a7c4-4a0f-8f5b-46459356b060-kube-api-access-lh2x7\") pod \"router-default-55fc4dcbd8-x64q6\" (UID: \"cc6f77f9-a7c4-4a0f-8f5b-46459356b060\") " pod="openshift-ingress/router-default-55fc4dcbd8-x64q6"
Sep 15 13:39:32.851055 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.851017    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rrzx\" (UniqueName: \"kubernetes.io/projected/7b56d6ce-14c4-4816-8a10-c5cb22197363-kube-api-access-9rrzx\") pod \"managed-serviceaccount-addon-agent-68987bbfb-lcwpj\" (UID: \"7b56d6ce-14c4-4816-8a10-c5cb22197363\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68987bbfb-lcwpj"
Sep 15 13:39:32.851055 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.851019    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9l2hb\" (UniqueName: \"kubernetes.io/projected/e149b61b-8b51-4602-8fdf-b81c7a7b20ec-kube-api-access-9l2hb\") pod \"cluster-monitoring-operator-6cd954b897-tw8sw\" (UID: \"e149b61b-8b51-4602-8fdf-b81c7a7b20ec\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-tw8sw"
Sep 15 13:39:32.892168 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.892080    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/39befdfe-8c59-4d05-9da7-5bb64f8ce5a7-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-zpmzg\" (UID: \"39befdfe-8c59-4d05-9da7-5bb64f8ce5a7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-zpmzg"
Sep 15 13:39:32.892168 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.892109    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffcd10ba-e428-40f8-875a-64439cf04619-trusted-ca-bundle\") pod \"insights-operator-5844b856db-tkwx9\" (UID: \"ffcd10ba-e428-40f8-875a-64439cf04619\") " pod="openshift-insights/insights-operator-5844b856db-tkwx9"
Sep 15 13:39:32.892168 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.892147    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/492ebd98-bb7b-4ac7-8cd6-c5471e55b93f-registry-certificates\") pod \"image-registry-556c8d5f67-cj9zw\" (UID: \"492ebd98-bb7b-4ac7-8cd6-c5471e55b93f\") " pod="openshift-image-registry/image-registry-556c8d5f67-cj9zw"
Sep 15 13:39:32.892168 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.892165    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfgxc\" (UniqueName: \"kubernetes.io/projected/39befdfe-8c59-4d05-9da7-5bb64f8ce5a7-kube-api-access-sfgxc\") pod \"kube-storage-version-migrator-operator-6c8f84f897-zpmzg\" (UID: \"39befdfe-8c59-4d05-9da7-5bb64f8ce5a7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-zpmzg"
Sep 15 13:39:32.892481 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.892187    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/492ebd98-bb7b-4ac7-8cd6-c5471e55b93f-trusted-ca\") pod \"image-registry-556c8d5f67-cj9zw\" (UID: \"492ebd98-bb7b-4ac7-8cd6-c5471e55b93f\") " pod="openshift-image-registry/image-registry-556c8d5f67-cj9zw"
Sep 15 13:39:32.892481 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.892228    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ffcd10ba-e428-40f8-875a-64439cf04619-serving-cert\") pod \"insights-operator-5844b856db-tkwx9\" (UID: \"ffcd10ba-e428-40f8-875a-64439cf04619\") " pod="openshift-insights/insights-operator-5844b856db-tkwx9"
Sep 15 13:39:32.892481 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.892251    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ffcd10ba-e428-40f8-875a-64439cf04619-tmp\") pod \"insights-operator-5844b856db-tkwx9\" (UID: \"ffcd10ba-e428-40f8-875a-64439cf04619\") " pod="openshift-insights/insights-operator-5844b856db-tkwx9"
Sep 15 13:39:32.892481 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.892291    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/492ebd98-bb7b-4ac7-8cd6-c5471e55b93f-registry-tls\") pod \"image-registry-556c8d5f67-cj9zw\" (UID: \"492ebd98-bb7b-4ac7-8cd6-c5471e55b93f\") " pod="openshift-image-registry/image-registry-556c8d5f67-cj9zw"
Sep 15 13:39:32.892481 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.892323    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/492ebd98-bb7b-4ac7-8cd6-c5471e55b93f-bound-sa-token\") pod \"image-registry-556c8d5f67-cj9zw\" (UID: \"492ebd98-bb7b-4ac7-8cd6-c5471e55b93f\") " pod="openshift-image-registry/image-registry-556c8d5f67-cj9zw"
Sep 15 13:39:32.892481 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.892355    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/ffcd10ba-e428-40f8-875a-64439cf04619-snapshots\") pod \"insights-operator-5844b856db-tkwx9\" (UID: \"ffcd10ba-e428-40f8-875a-64439cf04619\") " pod="openshift-insights/insights-operator-5844b856db-tkwx9"
Sep 15 13:39:32.892481 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.892384    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffcd10ba-e428-40f8-875a-64439cf04619-service-ca-bundle\") pod \"insights-operator-5844b856db-tkwx9\" (UID: \"ffcd10ba-e428-40f8-875a-64439cf04619\") " pod="openshift-insights/insights-operator-5844b856db-tkwx9"
Sep 15 13:39:32.892481 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.892432    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/492ebd98-bb7b-4ac7-8cd6-c5471e55b93f-ca-trust-extracted\") pod \"image-registry-556c8d5f67-cj9zw\" (UID: \"492ebd98-bb7b-4ac7-8cd6-c5471e55b93f\") " pod="openshift-image-registry/image-registry-556c8d5f67-cj9zw"
Sep 15 13:39:32.892481 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.892464    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/492ebd98-bb7b-4ac7-8cd6-c5471e55b93f-installation-pull-secrets\") pod \"image-registry-556c8d5f67-cj9zw\" (UID: \"492ebd98-bb7b-4ac7-8cd6-c5471e55b93f\") " pod="openshift-image-registry/image-registry-556c8d5f67-cj9zw"
Sep 15 13:39:32.892915 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.892502    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/39befdfe-8c59-4d05-9da7-5bb64f8ce5a7-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-zpmzg\" (UID: \"39befdfe-8c59-4d05-9da7-5bb64f8ce5a7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-zpmzg"
Sep 15 13:39:32.892915 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.892535    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1e3225af-06da-4138-9092-2055f515eb3d-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-86rtx\" (UID: \"1e3225af-06da-4138-9092-2055f515eb3d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-86rtx"
Sep 15 13:39:32.892915 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.892566    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/492ebd98-bb7b-4ac7-8cd6-c5471e55b93f-image-registry-private-configuration\") pod \"image-registry-556c8d5f67-cj9zw\" (UID: \"492ebd98-bb7b-4ac7-8cd6-c5471e55b93f\") " pod="openshift-image-registry/image-registry-556c8d5f67-cj9zw"
Sep 15 13:39:32.892915 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.892593    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgtqb\" (UniqueName: \"kubernetes.io/projected/1e3225af-06da-4138-9092-2055f515eb3d-kube-api-access-zgtqb\") pod \"cluster-samples-operator-86499c89c4-86rtx\" (UID: \"1e3225af-06da-4138-9092-2055f515eb3d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-86rtx"
Sep 15 13:39:32.892915 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.892618    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69kks\" (UniqueName: \"kubernetes.io/projected/ffcd10ba-e428-40f8-875a-64439cf04619-kube-api-access-69kks\") pod \"insights-operator-5844b856db-tkwx9\" (UID: \"ffcd10ba-e428-40f8-875a-64439cf04619\") " pod="openshift-insights/insights-operator-5844b856db-tkwx9"
Sep 15 13:39:32.892915 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.892640    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ffcd10ba-e428-40f8-875a-64439cf04619-tmp\") pod \"insights-operator-5844b856db-tkwx9\" (UID: \"ffcd10ba-e428-40f8-875a-64439cf04619\") " pod="openshift-insights/insights-operator-5844b856db-tkwx9"
Sep 15 13:39:32.892915 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.892651    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vglmw\" (UniqueName: \"kubernetes.io/projected/492ebd98-bb7b-4ac7-8cd6-c5471e55b93f-kube-api-access-vglmw\") pod \"image-registry-556c8d5f67-cj9zw\" (UID: \"492ebd98-bb7b-4ac7-8cd6-c5471e55b93f\") " pod="openshift-image-registry/image-registry-556c8d5f67-cj9zw"
Sep 15 13:39:32.892915 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.892759    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/39befdfe-8c59-4d05-9da7-5bb64f8ce5a7-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-zpmzg\" (UID: \"39befdfe-8c59-4d05-9da7-5bb64f8ce5a7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-zpmzg"
Sep 15 13:39:32.893342 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.893004    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/492ebd98-bb7b-4ac7-8cd6-c5471e55b93f-registry-certificates\") pod \"image-registry-556c8d5f67-cj9zw\" (UID: \"492ebd98-bb7b-4ac7-8cd6-c5471e55b93f\") " pod="openshift-image-registry/image-registry-556c8d5f67-cj9zw"
Sep 15 13:39:32.893342 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.893189    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/492ebd98-bb7b-4ac7-8cd6-c5471e55b93f-trusted-ca\") pod \"image-registry-556c8d5f67-cj9zw\" (UID: \"492ebd98-bb7b-4ac7-8cd6-c5471e55b93f\") " pod="openshift-image-registry/image-registry-556c8d5f67-cj9zw"
Sep 15 13:39:32.893342 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.893240    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffcd10ba-e428-40f8-875a-64439cf04619-trusted-ca-bundle\") pod \"insights-operator-5844b856db-tkwx9\" (UID: \"ffcd10ba-e428-40f8-875a-64439cf04619\") " pod="openshift-insights/insights-operator-5844b856db-tkwx9"
Sep 15 13:39:32.893342 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.893295    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffcd10ba-e428-40f8-875a-64439cf04619-service-ca-bundle\") pod \"insights-operator-5844b856db-tkwx9\" (UID: \"ffcd10ba-e428-40f8-875a-64439cf04619\") " pod="openshift-insights/insights-operator-5844b856db-tkwx9"
Sep 15 13:39:32.893540 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.893269    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/ffcd10ba-e428-40f8-875a-64439cf04619-snapshots\") pod \"insights-operator-5844b856db-tkwx9\" (UID: \"ffcd10ba-e428-40f8-875a-64439cf04619\") " pod="openshift-insights/insights-operator-5844b856db-tkwx9"
Sep 15 13:39:32.893540 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.893354    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/492ebd98-bb7b-4ac7-8cd6-c5471e55b93f-ca-trust-extracted\") pod \"image-registry-556c8d5f67-cj9zw\" (UID: \"492ebd98-bb7b-4ac7-8cd6-c5471e55b93f\") " pod="openshift-image-registry/image-registry-556c8d5f67-cj9zw"
Sep 15 13:39:32.895808 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.895785    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/492ebd98-bb7b-4ac7-8cd6-c5471e55b93f-image-registry-private-configuration\") pod \"image-registry-556c8d5f67-cj9zw\" (UID: \"492ebd98-bb7b-4ac7-8cd6-c5471e55b93f\") " pod="openshift-image-registry/image-registry-556c8d5f67-cj9zw"
Sep 15 13:39:32.896155 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.895931    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/492ebd98-bb7b-4ac7-8cd6-c5471e55b93f-registry-tls\") pod \"image-registry-556c8d5f67-cj9zw\" (UID: \"492ebd98-bb7b-4ac7-8cd6-c5471e55b93f\") " pod="openshift-image-registry/image-registry-556c8d5f67-cj9zw"
Sep 15 13:39:32.896155 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.896010    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ffcd10ba-e428-40f8-875a-64439cf04619-serving-cert\") pod \"insights-operator-5844b856db-tkwx9\" (UID: \"ffcd10ba-e428-40f8-875a-64439cf04619\") " pod="openshift-insights/insights-operator-5844b856db-tkwx9"
Sep 15 13:39:32.896324 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.896266    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/492ebd98-bb7b-4ac7-8cd6-c5471e55b93f-installation-pull-secrets\") pod \"image-registry-556c8d5f67-cj9zw\" (UID: \"492ebd98-bb7b-4ac7-8cd6-c5471e55b93f\") " pod="openshift-image-registry/image-registry-556c8d5f67-cj9zw"
Sep 15 13:39:32.896415 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.896389    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1e3225af-06da-4138-9092-2055f515eb3d-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-86rtx\" (UID: \"1e3225af-06da-4138-9092-2055f515eb3d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-86rtx"
Sep 15 13:39:32.896592 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.896575    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/39befdfe-8c59-4d05-9da7-5bb64f8ce5a7-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-zpmzg\" (UID: \"39befdfe-8c59-4d05-9da7-5bb64f8ce5a7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-zpmzg"
Sep 15 13:39:32.904689 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.904669    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-69kks\" (UniqueName: \"kubernetes.io/projected/ffcd10ba-e428-40f8-875a-64439cf04619-kube-api-access-69kks\") pod \"insights-operator-5844b856db-tkwx9\" (UID: \"ffcd10ba-e428-40f8-875a-64439cf04619\") " pod="openshift-insights/insights-operator-5844b856db-tkwx9"
Sep 15 13:39:32.905010 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.904991    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfgxc\" (UniqueName: \"kubernetes.io/projected/39befdfe-8c59-4d05-9da7-5bb64f8ce5a7-kube-api-access-sfgxc\") pod \"kube-storage-version-migrator-operator-6c8f84f897-zpmzg\" (UID: \"39befdfe-8c59-4d05-9da7-5bb64f8ce5a7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-zpmzg"
Sep 15 13:39:32.905436 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.905416    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vglmw\" (UniqueName: \"kubernetes.io/projected/492ebd98-bb7b-4ac7-8cd6-c5471e55b93f-kube-api-access-vglmw\") pod \"image-registry-556c8d5f67-cj9zw\" (UID: \"492ebd98-bb7b-4ac7-8cd6-c5471e55b93f\") " pod="openshift-image-registry/image-registry-556c8d5f67-cj9zw"
Sep 15 13:39:32.906071 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.906055    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/492ebd98-bb7b-4ac7-8cd6-c5471e55b93f-bound-sa-token\") pod \"image-registry-556c8d5f67-cj9zw\" (UID: \"492ebd98-bb7b-4ac7-8cd6-c5471e55b93f\") " pod="openshift-image-registry/image-registry-556c8d5f67-cj9zw"
Sep 15 13:39:32.906520 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.906504    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgtqb\" (UniqueName: \"kubernetes.io/projected/1e3225af-06da-4138-9092-2055f515eb3d-kube-api-access-zgtqb\") pod \"cluster-samples-operator-86499c89c4-86rtx\" (UID: \"1e3225af-06da-4138-9092-2055f515eb3d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-86rtx"
Sep 15 13:39:32.940353 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.940329    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-mxjg9"
Sep 15 13:39:32.946508 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.946487    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-tw8sw"
Sep 15 13:39:32.952383 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.952365    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-55fc4dcbd8-x64q6"
Sep 15 13:39:32.987334 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:32.987275    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68987bbfb-lcwpj"
Sep 15 13:39:33.041100 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:33.040874    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-zpmzg"
Sep 15 13:39:33.062880 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:33.062852    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-86rtx"
Sep 15 13:39:33.068493 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:33.068463    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-556c8d5f67-cj9zw"
Sep 15 13:39:33.073729 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:33.073698    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5844b856db-tkwx9"
Sep 15 13:39:33.223662 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:33.223489    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-mxjg9"]
Sep 15 13:39:33.225900 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:39:33.225868    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a3b4228_587e_4134_b561_79f80de47185.slice/crio-f57ebc67b9a610578ff56fcc479afcbd48d0b75a93a2877f8b2ff8e3ef73f952 WatchSource:0}: Error finding container f57ebc67b9a610578ff56fcc479afcbd48d0b75a93a2877f8b2ff8e3ef73f952: Status 404 returned error can't find the container with id f57ebc67b9a610578ff56fcc479afcbd48d0b75a93a2877f8b2ff8e3ef73f952
Sep 15 13:39:33.249976 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:33.249903    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-tw8sw"]
Sep 15 13:39:33.252637 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:39:33.252607    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode149b61b_8b51_4602_8fdf_b81c7a7b20ec.slice/crio-fb71d2f76822fd331b4639978fff394f7e09d459fb4f7e7160d4c5d0eb884806 WatchSource:0}: Error finding container fb71d2f76822fd331b4639978fff394f7e09d459fb4f7e7160d4c5d0eb884806: Status 404 returned error can't find the container with id fb71d2f76822fd331b4639978fff394f7e09d459fb4f7e7160d4c5d0eb884806
Sep 15 13:39:33.253750 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:33.253725    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-55fc4dcbd8-x64q6"]
Sep 15 13:39:33.255880 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:39:33.255860    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc6f77f9_a7c4_4a0f_8f5b_46459356b060.slice/crio-0c4b09198ce9780dbc56ae84df9d9d0769b22227386c199b16cbba13c48d3593 WatchSource:0}: Error finding container 0c4b09198ce9780dbc56ae84df9d9d0769b22227386c199b16cbba13c48d3593: Status 404 returned error can't find the container with id 0c4b09198ce9780dbc56ae84df9d9d0769b22227386c199b16cbba13c48d3593
Sep 15 13:39:33.297392 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:33.297370    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68987bbfb-lcwpj"]
Sep 15 13:39:33.312898 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:39:33.310469    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7b56d6ce_14c4_4816_8a10_c5cb22197363.slice/crio-fcff1354f92ef514f454c1be2c69af5908cef213b2d9d843dd2cc06ba56ddb10 WatchSource:0}: Error finding container fcff1354f92ef514f454c1be2c69af5908cef213b2d9d843dd2cc06ba56ddb10: Status 404 returned error can't find the container with id fcff1354f92ef514f454c1be2c69af5908cef213b2d9d843dd2cc06ba56ddb10
Sep 15 13:39:33.327283 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:33.327234    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-zpmzg"]
Sep 15 13:39:33.329181 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:39:33.329160    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39befdfe_8c59_4d05_9da7_5bb64f8ce5a7.slice/crio-ea84e324a15f9ab2d8044a5991c147a5bf7f92cc1294595f499c4cb166e9942c WatchSource:0}: Error finding container ea84e324a15f9ab2d8044a5991c147a5bf7f92cc1294595f499c4cb166e9942c: Status 404 returned error can't find the container with id ea84e324a15f9ab2d8044a5991c147a5bf7f92cc1294595f499c4cb166e9942c
Sep 15 13:39:33.374140 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:33.374095    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-86rtx"]
Sep 15 13:39:33.378363 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:33.377357    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-556c8d5f67-cj9zw"]
Sep 15 13:39:33.380797 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:33.380396    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5844b856db-tkwx9"]
Sep 15 13:39:33.389872 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:39:33.389829    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffcd10ba_e428_40f8_875a_64439cf04619.slice/crio-b25f9de163fc8756445fe2844debbe61e885db9a535ef3c327b194152a7d49fb WatchSource:0}: Error finding container b25f9de163fc8756445fe2844debbe61e885db9a535ef3c327b194152a7d49fb: Status 404 returned error can't find the container with id b25f9de163fc8756445fe2844debbe61e885db9a535ef3c327b194152a7d49fb
Sep 15 13:39:34.097647 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:34.097612    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-556c8d5f67-cj9zw" event={"ID":"492ebd98-bb7b-4ac7-8cd6-c5471e55b93f","Type":"ContainerStarted","Data":"fafaa7408cb604af2d16019b23ff69854b594a79ac378f8c551f1dfbfb929667"}
Sep 15 13:39:34.098151 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:34.097690    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-556c8d5f67-cj9zw" event={"ID":"492ebd98-bb7b-4ac7-8cd6-c5471e55b93f","Type":"ContainerStarted","Data":"7bdef2a7739e8cc1ceea2cff36d9e31f2c4eeb1a6485f0f3bdcaea122d8b57ea"}
Sep 15 13:39:34.098151 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:34.097739    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-556c8d5f67-cj9zw"
Sep 15 13:39:34.099376 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:34.099348    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-zpmzg" event={"ID":"39befdfe-8c59-4d05-9da7-5bb64f8ce5a7","Type":"ContainerStarted","Data":"ea84e324a15f9ab2d8044a5991c147a5bf7f92cc1294595f499c4cb166e9942c"}
Sep 15 13:39:34.101957 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:34.101921    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-55fc4dcbd8-x64q6" event={"ID":"cc6f77f9-a7c4-4a0f-8f5b-46459356b060","Type":"ContainerStarted","Data":"2522d9d592cc69537386fa67f040a6744d5ef071ee1538c43afb1af1aeec2736"}
Sep 15 13:39:34.102073 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:34.101970    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-55fc4dcbd8-x64q6" event={"ID":"cc6f77f9-a7c4-4a0f-8f5b-46459356b060","Type":"ContainerStarted","Data":"0c4b09198ce9780dbc56ae84df9d9d0769b22227386c199b16cbba13c48d3593"}
Sep 15 13:39:34.103435 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:34.103408    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68987bbfb-lcwpj" event={"ID":"7b56d6ce-14c4-4816-8a10-c5cb22197363","Type":"ContainerStarted","Data":"fcff1354f92ef514f454c1be2c69af5908cef213b2d9d843dd2cc06ba56ddb10"}
Sep 15 13:39:34.104636 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:34.104614    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-tw8sw" event={"ID":"e149b61b-8b51-4602-8fdf-b81c7a7b20ec","Type":"ContainerStarted","Data":"fb71d2f76822fd331b4639978fff394f7e09d459fb4f7e7160d4c5d0eb884806"}
Sep 15 13:39:34.105997 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:34.105968    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-tkwx9" event={"ID":"ffcd10ba-e428-40f8-875a-64439cf04619","Type":"ContainerStarted","Data":"b25f9de163fc8756445fe2844debbe61e885db9a535ef3c327b194152a7d49fb"}
Sep 15 13:39:34.107355 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:34.107329    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-86rtx" event={"ID":"1e3225af-06da-4138-9092-2055f515eb3d","Type":"ContainerStarted","Data":"164622a6b38fadb2d28d6241d9b99a4663d3c83e7c20bc336eeaa5c161f2e71e"}
Sep 15 13:39:34.108816 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:34.108788    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-mxjg9" event={"ID":"4a3b4228-587e-4134-b561-79f80de47185","Type":"ContainerStarted","Data":"f57ebc67b9a610578ff56fcc479afcbd48d0b75a93a2877f8b2ff8e3ef73f952"}
Sep 15 13:39:34.117957 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:34.117205    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-556c8d5f67-cj9zw" podStartSLOduration=2.1171874 podStartE2EDuration="2.1171874s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:39:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:39:34.116984259 +0000 UTC m=+60.876110557" watchObservedRunningTime="2026-09-15 13:39:34.1171874 +0000 UTC m=+60.876313684"
Sep 15 13:39:34.953413 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:34.953326    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-55fc4dcbd8-x64q6"
Sep 15 13:39:34.955991 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:34.955968    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-55fc4dcbd8-x64q6"
Sep 15 13:39:34.986176 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:34.986104    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-55fc4dcbd8-x64q6" podStartSLOduration=2.9860833700000002 podStartE2EDuration="2.98608337s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:39:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:39:34.134401888 +0000 UTC m=+60.893528179" watchObservedRunningTime="2026-09-15 13:39:34.98608337 +0000 UTC m=+61.745209659"
Sep 15 13:39:35.007379 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:35.007349    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-krtzm"
Sep 15 13:39:35.114863 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:35.114833    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-55fc4dcbd8-x64q6"
Sep 15 13:39:35.116267 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:35.116245    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-55fc4dcbd8-x64q6"
Sep 15 13:39:37.133155 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:37.132758    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-tw8sw" event={"ID":"e149b61b-8b51-4602-8fdf-b81c7a7b20ec","Type":"ContainerStarted","Data":"92c4da0562909ffdbc503f624b8aea9d36285f39d8c16e698c8c7c04b57cf6ba"}
Sep 15 13:39:37.134945 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:37.134879    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-tkwx9" event={"ID":"ffcd10ba-e428-40f8-875a-64439cf04619","Type":"ContainerStarted","Data":"29cdadf6b0e182a055c9e9d99a2055fb17f209c85c22a70b77e6ecde106494c7"}
Sep 15 13:39:37.138164 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:37.138142    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-86rtx" event={"ID":"1e3225af-06da-4138-9092-2055f515eb3d","Type":"ContainerStarted","Data":"71d9063b5f96703da2199250ee838dac260106cb6522e66f009a831661289aca"}
Sep 15 13:39:37.138335 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:37.138322    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-86rtx" event={"ID":"1e3225af-06da-4138-9092-2055f515eb3d","Type":"ContainerStarted","Data":"87b88007a7f248a6b0673bbf7191c40aa6f71b6fd091f87f60262abe689a1857"}
Sep 15 13:39:37.141638 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:37.140813    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-mxjg9" event={"ID":"4a3b4228-587e-4134-b561-79f80de47185","Type":"ContainerStarted","Data":"eaea858789567202af067711433b0b68a13f88ff43e2981ed818e625b3e6dea3"}
Sep 15 13:39:37.143229 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:37.143190    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-zpmzg" event={"ID":"39befdfe-8c59-4d05-9da7-5bb64f8ce5a7","Type":"ContainerStarted","Data":"35686d422af8c24675b1988fce8f766cc477e597575ad152ba18891780569219"}
Sep 15 13:39:37.163547 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:37.162690    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-mxjg9" podStartSLOduration=1.96589054 podStartE2EDuration="5.162671753s" totalImagesPullingTime="3.196781213s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:39:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:39:37.162438536 +0000 UTC m=+63.921564823" watchObservedRunningTime="2026-09-15 13:39:37.162671753 +0000 UTC m=+63.921798041"
Sep 15 13:39:37.163652 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:37.163614    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-tw8sw" podStartSLOduration=1.5174020929999998 podStartE2EDuration="5.163599923s" totalImagesPullingTime="3.64619783s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:39:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:39:37.147972068 +0000 UTC m=+63.907098354" watchObservedRunningTime="2026-09-15 13:39:37.163599923 +0000 UTC m=+63.922726210"
Sep 15 13:39:37.180972 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:37.180922    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-zpmzg" podStartSLOduration=1.601169569 podStartE2EDuration="5.18090347s" totalImagesPullingTime="3.579733901s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:39:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:39:37.179396573 +0000 UTC m=+63.938522850" watchObservedRunningTime="2026-09-15 13:39:37.18090347 +0000 UTC m=+63.940029757"
Sep 15 13:39:37.196045 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:37.195993    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-86rtx" podStartSLOduration=1.73966062 podStartE2EDuration="5.19597506s" totalImagesPullingTime="3.45631444s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:39:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:39:37.195412319 +0000 UTC m=+63.954538601" watchObservedRunningTime="2026-09-15 13:39:37.19597506 +0000 UTC m=+63.955101348"
Sep 15 13:39:37.457024 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:37.456899    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5844b856db-tkwx9" podStartSLOduration=1.9393636459999999 podStartE2EDuration="5.456872902s" totalImagesPullingTime="3.517509256s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:39:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:39:37.214680284 +0000 UTC m=+63.973806569" watchObservedRunningTime="2026-09-15 13:39:37.456872902 +0000 UTC m=+64.215999189"
Sep 15 13:39:37.457697 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:37.457663    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-hr4q2"]
Sep 15 13:39:37.461162 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:37.460033    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-hr4q2"
Sep 15 13:39:37.464316 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:37.463925    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-rfgmw\""
Sep 15 13:39:37.464316 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:37.464172    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Sep 15 13:39:37.472908 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:37.472661    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-hr4q2"]
Sep 15 13:39:37.546076 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:37.546046    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/bf47f264-6165-46dd-9192-2d68ffdc9ebf-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-hr4q2\" (UID: \"bf47f264-6165-46dd-9192-2d68ffdc9ebf\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-hr4q2"
Sep 15 13:39:37.647010 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:37.646976    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/bf47f264-6165-46dd-9192-2d68ffdc9ebf-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-hr4q2\" (UID: \"bf47f264-6165-46dd-9192-2d68ffdc9ebf\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-hr4q2"
Sep 15 13:39:37.649562 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:37.649537    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/bf47f264-6165-46dd-9192-2d68ffdc9ebf-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-hr4q2\" (UID: \"bf47f264-6165-46dd-9192-2d68ffdc9ebf\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-hr4q2"
Sep 15 13:39:37.776288 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:37.776254    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-hr4q2"
Sep 15 13:39:37.878144 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:37.878088    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-vflrz"]
Sep 15 13:39:37.881501 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:37.881479    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vflrz"
Sep 15 13:39:37.883822 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:37.883797    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-jx2vh\""
Sep 15 13:39:37.883929 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:37.883833    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 15 13:39:37.883929 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:37.883840    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 15 13:39:37.892426 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:37.892405    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vflrz"]
Sep 15 13:39:37.949764 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:37.949736    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a1710f54-b8e1-4e6e-aebd-d54e6eb4217a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vflrz\" (UID: \"a1710f54-b8e1-4e6e-aebd-d54e6eb4217a\") " pod="openshift-insights/insights-runtime-extractor-vflrz"
Sep 15 13:39:37.949910 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:37.949771    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kd2g2\" (UniqueName: \"kubernetes.io/projected/a1710f54-b8e1-4e6e-aebd-d54e6eb4217a-kube-api-access-kd2g2\") pod \"insights-runtime-extractor-vflrz\" (UID: \"a1710f54-b8e1-4e6e-aebd-d54e6eb4217a\") " pod="openshift-insights/insights-runtime-extractor-vflrz"
Sep 15 13:39:37.949910 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:37.949805    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a1710f54-b8e1-4e6e-aebd-d54e6eb4217a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vflrz\" (UID: \"a1710f54-b8e1-4e6e-aebd-d54e6eb4217a\") " pod="openshift-insights/insights-runtime-extractor-vflrz"
Sep 15 13:39:37.949910 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:37.949870    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a1710f54-b8e1-4e6e-aebd-d54e6eb4217a-crio-socket\") pod \"insights-runtime-extractor-vflrz\" (UID: \"a1710f54-b8e1-4e6e-aebd-d54e6eb4217a\") " pod="openshift-insights/insights-runtime-extractor-vflrz"
Sep 15 13:39:37.949910 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:37.949887    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a1710f54-b8e1-4e6e-aebd-d54e6eb4217a-data-volume\") pod \"insights-runtime-extractor-vflrz\" (UID: \"a1710f54-b8e1-4e6e-aebd-d54e6eb4217a\") " pod="openshift-insights/insights-runtime-extractor-vflrz"
Sep 15 13:39:38.044520 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:38.044342    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-hr4q2"]
Sep 15 13:39:38.046840 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:39:38.046814    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf47f264_6165_46dd_9192_2d68ffdc9ebf.slice/crio-fa13b5f3b6252053e74b9d3283b26844637cb0a4be09d8f5243392f3f3087643 WatchSource:0}: Error finding container fa13b5f3b6252053e74b9d3283b26844637cb0a4be09d8f5243392f3f3087643: Status 404 returned error can't find the container with id fa13b5f3b6252053e74b9d3283b26844637cb0a4be09d8f5243392f3f3087643
Sep 15 13:39:38.050771 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:38.050736    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a1710f54-b8e1-4e6e-aebd-d54e6eb4217a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vflrz\" (UID: \"a1710f54-b8e1-4e6e-aebd-d54e6eb4217a\") " pod="openshift-insights/insights-runtime-extractor-vflrz"
Sep 15 13:39:38.050887 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:39:38.050868    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 15 13:39:38.051015 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:39:38.050929    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1710f54-b8e1-4e6e-aebd-d54e6eb4217a-insights-runtime-extractor-tls podName:a1710f54-b8e1-4e6e-aebd-d54e6eb4217a nodeName:}" failed. No retries permitted until 2026-09-15 13:39:38.550910738 +0000 UTC m=+65.310037016 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a1710f54-b8e1-4e6e-aebd-d54e6eb4217a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vflrz" (UID: "a1710f54-b8e1-4e6e-aebd-d54e6eb4217a") : secret "insights-runtime-extractor-tls" not found
Sep 15 13:39:38.051015 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:38.050979    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kd2g2\" (UniqueName: \"kubernetes.io/projected/a1710f54-b8e1-4e6e-aebd-d54e6eb4217a-kube-api-access-kd2g2\") pod \"insights-runtime-extractor-vflrz\" (UID: \"a1710f54-b8e1-4e6e-aebd-d54e6eb4217a\") " pod="openshift-insights/insights-runtime-extractor-vflrz"
Sep 15 13:39:38.051203 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:38.051036    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a1710f54-b8e1-4e6e-aebd-d54e6eb4217a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vflrz\" (UID: \"a1710f54-b8e1-4e6e-aebd-d54e6eb4217a\") " pod="openshift-insights/insights-runtime-extractor-vflrz"
Sep 15 13:39:38.051203 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:38.051095    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a1710f54-b8e1-4e6e-aebd-d54e6eb4217a-crio-socket\") pod \"insights-runtime-extractor-vflrz\" (UID: \"a1710f54-b8e1-4e6e-aebd-d54e6eb4217a\") " pod="openshift-insights/insights-runtime-extractor-vflrz"
Sep 15 13:39:38.051203 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:38.051179    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a1710f54-b8e1-4e6e-aebd-d54e6eb4217a-crio-socket\") pod \"insights-runtime-extractor-vflrz\" (UID: \"a1710f54-b8e1-4e6e-aebd-d54e6eb4217a\") " pod="openshift-insights/insights-runtime-extractor-vflrz"
Sep 15 13:39:38.051203 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:38.051186    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a1710f54-b8e1-4e6e-aebd-d54e6eb4217a-data-volume\") pod \"insights-runtime-extractor-vflrz\" (UID: \"a1710f54-b8e1-4e6e-aebd-d54e6eb4217a\") " pod="openshift-insights/insights-runtime-extractor-vflrz"
Sep 15 13:39:38.051376 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:39:38.051192    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 15 13:39:38.051376 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:39:38.051345    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a1710f54-b8e1-4e6e-aebd-d54e6eb4217a-kube-rbac-proxy-cm podName:a1710f54-b8e1-4e6e-aebd-d54e6eb4217a nodeName:}" failed. No retries permitted until 2026-09-15 13:39:38.551326996 +0000 UTC m=+65.310453279 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a1710f54-b8e1-4e6e-aebd-d54e6eb4217a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vflrz" (UID: "a1710f54-b8e1-4e6e-aebd-d54e6eb4217a") : configmap "kube-rbac-proxy" not found
Sep 15 13:39:38.051471 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:38.051452    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a1710f54-b8e1-4e6e-aebd-d54e6eb4217a-data-volume\") pod \"insights-runtime-extractor-vflrz\" (UID: \"a1710f54-b8e1-4e6e-aebd-d54e6eb4217a\") " pod="openshift-insights/insights-runtime-extractor-vflrz"
Sep 15 13:39:38.058032 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:38.058009    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kd2g2\" (UniqueName: \"kubernetes.io/projected/a1710f54-b8e1-4e6e-aebd-d54e6eb4217a-kube-api-access-kd2g2\") pod \"insights-runtime-extractor-vflrz\" (UID: \"a1710f54-b8e1-4e6e-aebd-d54e6eb4217a\") " pod="openshift-insights/insights-runtime-extractor-vflrz"
Sep 15 13:39:38.147723 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:38.147683    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-hr4q2" event={"ID":"bf47f264-6165-46dd-9192-2d68ffdc9ebf","Type":"ContainerStarted","Data":"fa13b5f3b6252053e74b9d3283b26844637cb0a4be09d8f5243392f3f3087643"}
Sep 15 13:39:38.555177 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:38.555107    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a1710f54-b8e1-4e6e-aebd-d54e6eb4217a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vflrz\" (UID: \"a1710f54-b8e1-4e6e-aebd-d54e6eb4217a\") " pod="openshift-insights/insights-runtime-extractor-vflrz"
Sep 15 13:39:38.555349 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:39:38.555242    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 15 13:39:38.555349 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:38.555284    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a1710f54-b8e1-4e6e-aebd-d54e6eb4217a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vflrz\" (UID: \"a1710f54-b8e1-4e6e-aebd-d54e6eb4217a\") " pod="openshift-insights/insights-runtime-extractor-vflrz"
Sep 15 13:39:38.555349 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:39:38.555310    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a1710f54-b8e1-4e6e-aebd-d54e6eb4217a-kube-rbac-proxy-cm podName:a1710f54-b8e1-4e6e-aebd-d54e6eb4217a nodeName:}" failed. No retries permitted until 2026-09-15 13:39:39.555292398 +0000 UTC m=+66.314418664 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a1710f54-b8e1-4e6e-aebd-d54e6eb4217a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vflrz" (UID: "a1710f54-b8e1-4e6e-aebd-d54e6eb4217a") : configmap "kube-rbac-proxy" not found
Sep 15 13:39:38.555450 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:39:38.555370    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 15 13:39:38.555450 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:39:38.555413    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1710f54-b8e1-4e6e-aebd-d54e6eb4217a-insights-runtime-extractor-tls podName:a1710f54-b8e1-4e6e-aebd-d54e6eb4217a nodeName:}" failed. No retries permitted until 2026-09-15 13:39:39.555401171 +0000 UTC m=+66.314527451 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a1710f54-b8e1-4e6e-aebd-d54e6eb4217a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vflrz" (UID: "a1710f54-b8e1-4e6e-aebd-d54e6eb4217a") : secret "insights-runtime-extractor-tls" not found
Sep 15 13:39:39.281272 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:39.281243    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6gzxz_1f0ca597-861a-4320-b16c-f87fa68dcf0b/dns/0.log"
Sep 15 13:39:39.464952 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:39.464917    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/525d9c79-829f-45ae-9cd5-af323bc737ef-metrics-certs\") pod \"network-metrics-daemon-fsnbc\" (UID: \"525d9c79-829f-45ae-9cd5-af323bc737ef\") " pod="openshift-multus/network-metrics-daemon-fsnbc"
Sep 15 13:39:39.465138 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:39.465018    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a1307640-dec4-44a3-a888-f8b1b097f902-original-pull-secret\") pod \"global-pull-secret-syncer-f54mn\" (UID: \"a1307640-dec4-44a3-a888-f8b1b097f902\") " pod="kube-system/global-pull-secret-syncer-f54mn"
Sep 15 13:39:39.465138 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:39.465039    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6gzxz_1f0ca597-861a-4320-b16c-f87fa68dcf0b/kube-rbac-proxy/0.log"
Sep 15 13:39:39.467287 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:39.467268    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 15 13:39:39.467333 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:39.467321    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 15 13:39:39.478473 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:39.478442    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/525d9c79-829f-45ae-9cd5-af323bc737ef-metrics-certs\") pod \"network-metrics-daemon-fsnbc\" (UID: \"525d9c79-829f-45ae-9cd5-af323bc737ef\") " pod="openshift-multus/network-metrics-daemon-fsnbc"
Sep 15 13:39:39.478578 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:39.478486    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a1307640-dec4-44a3-a888-f8b1b097f902-original-pull-secret\") pod \"global-pull-secret-syncer-f54mn\" (UID: \"a1307640-dec4-44a3-a888-f8b1b097f902\") " pod="kube-system/global-pull-secret-syncer-f54mn"
Sep 15 13:39:39.566022 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:39.565942    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a1710f54-b8e1-4e6e-aebd-d54e6eb4217a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vflrz\" (UID: \"a1710f54-b8e1-4e6e-aebd-d54e6eb4217a\") " pod="openshift-insights/insights-runtime-extractor-vflrz"
Sep 15 13:39:39.566022 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:39.566004    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a1710f54-b8e1-4e6e-aebd-d54e6eb4217a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vflrz\" (UID: \"a1710f54-b8e1-4e6e-aebd-d54e6eb4217a\") " pod="openshift-insights/insights-runtime-extractor-vflrz"
Sep 15 13:39:39.566231 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:39:39.566079    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 15 13:39:39.566231 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:39:39.566090    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 15 13:39:39.566231 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:39:39.566169    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1710f54-b8e1-4e6e-aebd-d54e6eb4217a-insights-runtime-extractor-tls podName:a1710f54-b8e1-4e6e-aebd-d54e6eb4217a nodeName:}" failed. No retries permitted until 2026-09-15 13:39:41.566152737 +0000 UTC m=+68.325279016 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a1710f54-b8e1-4e6e-aebd-d54e6eb4217a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vflrz" (UID: "a1710f54-b8e1-4e6e-aebd-d54e6eb4217a") : secret "insights-runtime-extractor-tls" not found
Sep 15 13:39:39.566231 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:39:39.566186    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a1710f54-b8e1-4e6e-aebd-d54e6eb4217a-kube-rbac-proxy-cm podName:a1710f54-b8e1-4e6e-aebd-d54e6eb4217a nodeName:}" failed. No retries permitted until 2026-09-15 13:39:41.566178464 +0000 UTC m=+68.325304728 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a1710f54-b8e1-4e6e-aebd-d54e6eb4217a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vflrz" (UID: "a1710f54-b8e1-4e6e-aebd-d54e6eb4217a") : configmap "kube-rbac-proxy" not found
Sep 15 13:39:39.663730 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:39.663695    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f54mn"
Sep 15 13:39:39.666691 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:39.666674    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m88lg\" (UniqueName: \"kubernetes.io/projected/82807e36-72ea-4ef2-a3bf-66fa30a9b389-kube-api-access-m88lg\") pod \"network-check-target-24wlp\" (UID: \"82807e36-72ea-4ef2-a3bf-66fa30a9b389\") " pod="openshift-network-diagnostics/network-check-target-24wlp"
Sep 15 13:39:39.670315 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:39.670290    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 15 13:39:39.679313 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:39.679292    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 15 13:39:39.679411 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:39.679296    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qwvrm\""
Sep 15 13:39:39.688458 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:39.688436    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fsnbc"
Sep 15 13:39:39.691393 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:39.691373    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m88lg\" (UniqueName: \"kubernetes.io/projected/82807e36-72ea-4ef2-a3bf-66fa30a9b389-kube-api-access-m88lg\") pod \"network-check-target-24wlp\" (UID: \"82807e36-72ea-4ef2-a3bf-66fa30a9b389\") " pod="openshift-network-diagnostics/network-check-target-24wlp"
Sep 15 13:39:39.942332 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:39.942257    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-f54mn"]
Sep 15 13:39:39.970694 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:39.970666    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fsnbc"]
Sep 15 13:39:39.973539 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:39.973517    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ztmxf\""
Sep 15 13:39:39.982345 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:39.982317    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-24wlp"
Sep 15 13:39:40.055023 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:39:40.054991    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod525d9c79_829f_45ae_9cd5_af323bc737ef.slice/crio-427c972d1461af9271e6d1042409f3f1ba1337edfc5e64d4b26dcede7fed7088 WatchSource:0}: Error finding container 427c972d1461af9271e6d1042409f3f1ba1337edfc5e64d4b26dcede7fed7088: Status 404 returned error can't find the container with id 427c972d1461af9271e6d1042409f3f1ba1337edfc5e64d4b26dcede7fed7088
Sep 15 13:39:40.055586 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:39:40.055561    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1307640_dec4_44a3_a888_f8b1b097f902.slice/crio-782f733d83b11d2867ecab685cf9a3932add34334247240663607b3ccee32f01 WatchSource:0}: Error finding container 782f733d83b11d2867ecab685cf9a3932add34334247240663607b3ccee32f01: Status 404 returned error can't find the container with id 782f733d83b11d2867ecab685cf9a3932add34334247240663607b3ccee32f01
Sep 15 13:39:40.156286 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:40.156252    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fsnbc" event={"ID":"525d9c79-829f-45ae-9cd5-af323bc737ef","Type":"ContainerStarted","Data":"427c972d1461af9271e6d1042409f3f1ba1337edfc5e64d4b26dcede7fed7088"}
Sep 15 13:39:40.157443 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:40.157384    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-f54mn" event={"ID":"a1307640-dec4-44a3-a888-f8b1b097f902","Type":"ContainerStarted","Data":"782f733d83b11d2867ecab685cf9a3932add34334247240663607b3ccee32f01"}
Sep 15 13:39:40.318941 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:40.318913    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-24wlp"]
Sep 15 13:39:40.321792 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:39:40.321766    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82807e36_72ea_4ef2_a3bf_66fa30a9b389.slice/crio-4b25639cb76d894cd2806e74a173a34068e073fbea4b0543f647df53c6ee62bb WatchSource:0}: Error finding container 4b25639cb76d894cd2806e74a173a34068e073fbea4b0543f647df53c6ee62bb: Status 404 returned error can't find the container with id 4b25639cb76d894cd2806e74a173a34068e073fbea4b0543f647df53c6ee62bb
Sep 15 13:39:40.469661 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:40.469608    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-425qw_b469b218-cbd7-4873-836f-99ac075ab6ec/dns-node-resolver/0.log"
Sep 15 13:39:41.065616 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:41.065556    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-556c8d5f67-cj9zw_492ebd98-bb7b-4ac7-8cd6-c5471e55b93f/registry/0.log"
Sep 15 13:39:41.163813 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:41.163774    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-24wlp" event={"ID":"82807e36-72ea-4ef2-a3bf-66fa30a9b389","Type":"ContainerStarted","Data":"4b25639cb76d894cd2806e74a173a34068e073fbea4b0543f647df53c6ee62bb"}
Sep 15 13:39:41.165903 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:41.165848    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-hr4q2" event={"ID":"bf47f264-6165-46dd-9192-2d68ffdc9ebf","Type":"ContainerStarted","Data":"4c4cf995e47e7b9a11c6c410a5ecb49bfb6bf8564a92d889cb2cfb9f2060894c"}
Sep 15 13:39:41.166355 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:41.166299    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-hr4q2"
Sep 15 13:39:41.173754 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:41.173731    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-hr4q2"
Sep 15 13:39:41.201249 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:41.201195    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-hr4q2" podStartSLOduration=2.134790983 podStartE2EDuration="4.201178323s" totalImagesPullingTime="2.06638734s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:39:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:39:41.185084379 +0000 UTC m=+67.944210656" watchObservedRunningTime="2026-09-15 13:39:41.201178323 +0000 UTC m=+67.960304609"
Sep 15 13:39:41.265737 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:41.265665    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-56444b6f6-q6gl8_fe529bf1-eb92-4c2f-a205-3aaed674d7a0/registry/0.log"
Sep 15 13:39:41.584197 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:41.584159    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a1710f54-b8e1-4e6e-aebd-d54e6eb4217a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vflrz\" (UID: \"a1710f54-b8e1-4e6e-aebd-d54e6eb4217a\") " pod="openshift-insights/insights-runtime-extractor-vflrz"
Sep 15 13:39:41.584633 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:41.584230    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a1710f54-b8e1-4e6e-aebd-d54e6eb4217a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vflrz\" (UID: \"a1710f54-b8e1-4e6e-aebd-d54e6eb4217a\") " pod="openshift-insights/insights-runtime-extractor-vflrz"
Sep 15 13:39:41.584633 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:39:41.584314    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 15 13:39:41.584633 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:39:41.584364    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 15 13:39:41.584633 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:39:41.584370    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1710f54-b8e1-4e6e-aebd-d54e6eb4217a-insights-runtime-extractor-tls podName:a1710f54-b8e1-4e6e-aebd-d54e6eb4217a nodeName:}" failed. No retries permitted until 2026-09-15 13:39:45.584356114 +0000 UTC m=+72.343482390 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a1710f54-b8e1-4e6e-aebd-d54e6eb4217a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vflrz" (UID: "a1710f54-b8e1-4e6e-aebd-d54e6eb4217a") : secret "insights-runtime-extractor-tls" not found
Sep 15 13:39:41.584633 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:39:41.584436    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a1710f54-b8e1-4e6e-aebd-d54e6eb4217a-kube-rbac-proxy-cm podName:a1710f54-b8e1-4e6e-aebd-d54e6eb4217a nodeName:}" failed. No retries permitted until 2026-09-15 13:39:45.584418268 +0000 UTC m=+72.343544532 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a1710f54-b8e1-4e6e-aebd-d54e6eb4217a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vflrz" (UID: "a1710f54-b8e1-4e6e-aebd-d54e6eb4217a") : configmap "kube-rbac-proxy" not found
Sep 15 13:39:41.666508 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:41.666480    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8tcrg_c6e7d350-b090-4857-a0ce-a608bdcfb099/node-ca/0.log"
Sep 15 13:39:42.173874 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:42.173814    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fsnbc" event={"ID":"525d9c79-829f-45ae-9cd5-af323bc737ef","Type":"ContainerStarted","Data":"44ce0d7e96e33eb16d966d43b3a5adc5684df05c575ea30b75108916a0892316"}
Sep 15 13:39:42.264663 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:42.264586    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-55fc4dcbd8-x64q6_cc6f77f9-a7c4-4a0f-8f5b-46459356b060/router/0.log"
Sep 15 13:39:42.703539 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:42.703498    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-56444b6f6-q6gl8"
Sep 15 13:39:42.865445 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:42.865405    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-s9sjm_190df695-604e-4d5c-8807-e2095d95564b/serve-healthcheck-canary/0.log"
Sep 15 13:39:43.180147 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:43.180085    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fsnbc" event={"ID":"525d9c79-829f-45ae-9cd5-af323bc737ef","Type":"ContainerStarted","Data":"4bc599f1ff41c30c8467c7d82be5d1dc11e21ca86740d714fa88fd2b5335f573"}
Sep 15 13:39:43.197751 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:43.197701    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-fsnbc" podStartSLOduration=68.296612819 podStartE2EDuration="1m10.197683054s" totalImagesPullingTime="1.901070235s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:38:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:39:43.195259507 +0000 UTC m=+69.954385806" watchObservedRunningTime="2026-09-15 13:39:43.197683054 +0000 UTC m=+69.956809339"
Sep 15 13:39:43.470689 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:43.470582    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-zpmzg_39befdfe-8c59-4d05-9da7-5bb64f8ce5a7/kube-storage-version-migrator-operator/0.log"
Sep 15 13:39:45.623576 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:45.623538    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a1710f54-b8e1-4e6e-aebd-d54e6eb4217a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vflrz\" (UID: \"a1710f54-b8e1-4e6e-aebd-d54e6eb4217a\") " pod="openshift-insights/insights-runtime-extractor-vflrz"
Sep 15 13:39:45.624031 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:45.623597    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a1710f54-b8e1-4e6e-aebd-d54e6eb4217a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vflrz\" (UID: \"a1710f54-b8e1-4e6e-aebd-d54e6eb4217a\") " pod="openshift-insights/insights-runtime-extractor-vflrz"
Sep 15 13:39:45.624031 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:39:45.623696    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 15 13:39:45.624031 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:39:45.623698    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 15 13:39:45.624031 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:39:45.623756    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1710f54-b8e1-4e6e-aebd-d54e6eb4217a-insights-runtime-extractor-tls podName:a1710f54-b8e1-4e6e-aebd-d54e6eb4217a nodeName:}" failed. No retries permitted until 2026-09-15 13:39:53.623738251 +0000 UTC m=+80.382864529 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a1710f54-b8e1-4e6e-aebd-d54e6eb4217a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vflrz" (UID: "a1710f54-b8e1-4e6e-aebd-d54e6eb4217a") : secret "insights-runtime-extractor-tls" not found
Sep 15 13:39:45.624031 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:39:45.623772    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a1710f54-b8e1-4e6e-aebd-d54e6eb4217a-kube-rbac-proxy-cm podName:a1710f54-b8e1-4e6e-aebd-d54e6eb4217a nodeName:}" failed. No retries permitted until 2026-09-15 13:39:53.623763557 +0000 UTC m=+80.382889822 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a1710f54-b8e1-4e6e-aebd-d54e6eb4217a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vflrz" (UID: "a1710f54-b8e1-4e6e-aebd-d54e6eb4217a") : configmap "kube-rbac-proxy" not found
Sep 15 13:39:46.966020 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:46.965985    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-4p6mg"]
Sep 15 13:39:46.968191 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:46.968164    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4p6mg"
Sep 15 13:39:46.970652 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:46.970598    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 15 13:39:46.970921 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:46.970902    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 15 13:39:46.970972 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:46.970902    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 15 13:39:46.971038 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:46.971018    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 15 13:39:46.971540 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:46.971525    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-cz7pd\""
Sep 15 13:39:47.036944 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:47.036914    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2d23b647-7f2e-4c14-997a-6c3c42cf592c-node-exporter-wtmp\") pod \"node-exporter-4p6mg\" (UID: \"2d23b647-7f2e-4c14-997a-6c3c42cf592c\") " pod="openshift-monitoring/node-exporter-4p6mg"
Sep 15 13:39:47.036944 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:47.036946    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2d23b647-7f2e-4c14-997a-6c3c42cf592c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4p6mg\" (UID: \"2d23b647-7f2e-4c14-997a-6c3c42cf592c\") " pod="openshift-monitoring/node-exporter-4p6mg"
Sep 15 13:39:47.037154 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:47.036968    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2d23b647-7f2e-4c14-997a-6c3c42cf592c-node-exporter-textfile\") pod \"node-exporter-4p6mg\" (UID: \"2d23b647-7f2e-4c14-997a-6c3c42cf592c\") " pod="openshift-monitoring/node-exporter-4p6mg"
Sep 15 13:39:47.037154 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:47.037030    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2d23b647-7f2e-4c14-997a-6c3c42cf592c-node-exporter-tls\") pod \"node-exporter-4p6mg\" (UID: \"2d23b647-7f2e-4c14-997a-6c3c42cf592c\") " pod="openshift-monitoring/node-exporter-4p6mg"
Sep 15 13:39:47.037154 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:47.037063    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2d23b647-7f2e-4c14-997a-6c3c42cf592c-metrics-client-ca\") pod \"node-exporter-4p6mg\" (UID: \"2d23b647-7f2e-4c14-997a-6c3c42cf592c\") " pod="openshift-monitoring/node-exporter-4p6mg"
Sep 15 13:39:47.037154 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:47.037144    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2d23b647-7f2e-4c14-997a-6c3c42cf592c-sys\") pod \"node-exporter-4p6mg\" (UID: \"2d23b647-7f2e-4c14-997a-6c3c42cf592c\") " pod="openshift-monitoring/node-exporter-4p6mg"
Sep 15 13:39:47.037339 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:47.037189    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8vvx\" (UniqueName: \"kubernetes.io/projected/2d23b647-7f2e-4c14-997a-6c3c42cf592c-kube-api-access-l8vvx\") pod \"node-exporter-4p6mg\" (UID: \"2d23b647-7f2e-4c14-997a-6c3c42cf592c\") " pod="openshift-monitoring/node-exporter-4p6mg"
Sep 15 13:39:47.037339 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:47.037231    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2d23b647-7f2e-4c14-997a-6c3c42cf592c-node-exporter-accelerators-collector-config\") pod \"node-exporter-4p6mg\" (UID: \"2d23b647-7f2e-4c14-997a-6c3c42cf592c\") " pod="openshift-monitoring/node-exporter-4p6mg"
Sep 15 13:39:47.037339 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:47.037256    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2d23b647-7f2e-4c14-997a-6c3c42cf592c-root\") pod \"node-exporter-4p6mg\" (UID: \"2d23b647-7f2e-4c14-997a-6c3c42cf592c\") " pod="openshift-monitoring/node-exporter-4p6mg"
Sep 15 13:39:47.137967 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:47.137932    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2d23b647-7f2e-4c14-997a-6c3c42cf592c-node-exporter-wtmp\") pod \"node-exporter-4p6mg\" (UID: \"2d23b647-7f2e-4c14-997a-6c3c42cf592c\") " pod="openshift-monitoring/node-exporter-4p6mg"
Sep 15 13:39:47.137967 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:47.137969    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2d23b647-7f2e-4c14-997a-6c3c42cf592c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4p6mg\" (UID: \"2d23b647-7f2e-4c14-997a-6c3c42cf592c\") " pod="openshift-monitoring/node-exporter-4p6mg"
Sep 15 13:39:47.138195 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:47.137989    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2d23b647-7f2e-4c14-997a-6c3c42cf592c-node-exporter-textfile\") pod \"node-exporter-4p6mg\" (UID: \"2d23b647-7f2e-4c14-997a-6c3c42cf592c\") " pod="openshift-monitoring/node-exporter-4p6mg"
Sep 15 13:39:47.138195 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:47.138119    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2d23b647-7f2e-4c14-997a-6c3c42cf592c-node-exporter-tls\") pod \"node-exporter-4p6mg\" (UID: \"2d23b647-7f2e-4c14-997a-6c3c42cf592c\") " pod="openshift-monitoring/node-exporter-4p6mg"
Sep 15 13:39:47.138195 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:47.138150    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2d23b647-7f2e-4c14-997a-6c3c42cf592c-node-exporter-wtmp\") pod \"node-exporter-4p6mg\" (UID: \"2d23b647-7f2e-4c14-997a-6c3c42cf592c\") " pod="openshift-monitoring/node-exporter-4p6mg"
Sep 15 13:39:47.138195 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:47.138182    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2d23b647-7f2e-4c14-997a-6c3c42cf592c-metrics-client-ca\") pod \"node-exporter-4p6mg\" (UID: \"2d23b647-7f2e-4c14-997a-6c3c42cf592c\") " pod="openshift-monitoring/node-exporter-4p6mg"
Sep 15 13:39:47.138366 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:47.138223    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2d23b647-7f2e-4c14-997a-6c3c42cf592c-sys\") pod \"node-exporter-4p6mg\" (UID: \"2d23b647-7f2e-4c14-997a-6c3c42cf592c\") " pod="openshift-monitoring/node-exporter-4p6mg"
Sep 15 13:39:47.138366 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:39:47.138250    2578 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 15 13:39:47.138366 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:47.138268    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8vvx\" (UniqueName: \"kubernetes.io/projected/2d23b647-7f2e-4c14-997a-6c3c42cf592c-kube-api-access-l8vvx\") pod \"node-exporter-4p6mg\" (UID: \"2d23b647-7f2e-4c14-997a-6c3c42cf592c\") " pod="openshift-monitoring/node-exporter-4p6mg"
Sep 15 13:39:47.138366 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:47.138285    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2d23b647-7f2e-4c14-997a-6c3c42cf592c-node-exporter-textfile\") pod \"node-exporter-4p6mg\" (UID: \"2d23b647-7f2e-4c14-997a-6c3c42cf592c\") " pod="openshift-monitoring/node-exporter-4p6mg"
Sep 15 13:39:47.138366 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:39:47.138328    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d23b647-7f2e-4c14-997a-6c3c42cf592c-node-exporter-tls podName:2d23b647-7f2e-4c14-997a-6c3c42cf592c nodeName:}" failed. No retries permitted until 2026-09-15 13:39:47.638307822 +0000 UTC m=+74.397434099 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/2d23b647-7f2e-4c14-997a-6c3c42cf592c-node-exporter-tls") pod "node-exporter-4p6mg" (UID: "2d23b647-7f2e-4c14-997a-6c3c42cf592c") : secret "node-exporter-tls" not found
Sep 15 13:39:47.138366 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:47.138340    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2d23b647-7f2e-4c14-997a-6c3c42cf592c-sys\") pod \"node-exporter-4p6mg\" (UID: \"2d23b647-7f2e-4c14-997a-6c3c42cf592c\") " pod="openshift-monitoring/node-exporter-4p6mg"
Sep 15 13:39:47.138660 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:47.138387    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2d23b647-7f2e-4c14-997a-6c3c42cf592c-node-exporter-accelerators-collector-config\") pod \"node-exporter-4p6mg\" (UID: \"2d23b647-7f2e-4c14-997a-6c3c42cf592c\") " pod="openshift-monitoring/node-exporter-4p6mg"
Sep 15 13:39:47.138660 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:47.138418    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2d23b647-7f2e-4c14-997a-6c3c42cf592c-root\") pod \"node-exporter-4p6mg\" (UID: \"2d23b647-7f2e-4c14-997a-6c3c42cf592c\") " pod="openshift-monitoring/node-exporter-4p6mg"
Sep 15 13:39:47.138660 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:47.138508    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2d23b647-7f2e-4c14-997a-6c3c42cf592c-root\") pod \"node-exporter-4p6mg\" (UID: \"2d23b647-7f2e-4c14-997a-6c3c42cf592c\") " pod="openshift-monitoring/node-exporter-4p6mg"
Sep 15 13:39:47.138837 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:47.138817    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2d23b647-7f2e-4c14-997a-6c3c42cf592c-metrics-client-ca\") pod \"node-exporter-4p6mg\" (UID: \"2d23b647-7f2e-4c14-997a-6c3c42cf592c\") " pod="openshift-monitoring/node-exporter-4p6mg"
Sep 15 13:39:47.139101 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:47.139080    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2d23b647-7f2e-4c14-997a-6c3c42cf592c-node-exporter-accelerators-collector-config\") pod \"node-exporter-4p6mg\" (UID: \"2d23b647-7f2e-4c14-997a-6c3c42cf592c\") " pod="openshift-monitoring/node-exporter-4p6mg"
Sep 15 13:39:47.140580 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:47.140559    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2d23b647-7f2e-4c14-997a-6c3c42cf592c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4p6mg\" (UID: \"2d23b647-7f2e-4c14-997a-6c3c42cf592c\") " pod="openshift-monitoring/node-exporter-4p6mg"
Sep 15 13:39:47.149512 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:47.149490    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8vvx\" (UniqueName: \"kubernetes.io/projected/2d23b647-7f2e-4c14-997a-6c3c42cf592c-kube-api-access-l8vvx\") pod \"node-exporter-4p6mg\" (UID: \"2d23b647-7f2e-4c14-997a-6c3c42cf592c\") " pod="openshift-monitoring/node-exporter-4p6mg"
Sep 15 13:39:47.199909 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:47.199873    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68987bbfb-lcwpj" event={"ID":"7b56d6ce-14c4-4816-8a10-c5cb22197363","Type":"ContainerStarted","Data":"6aabe1842cbcc7a26c643d0b2f66f9d21b5879057e588521cc0f3fdac7145d52"}
Sep 15 13:39:47.201520 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:47.201489    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-f54mn" event={"ID":"a1307640-dec4-44a3-a888-f8b1b097f902","Type":"ContainerStarted","Data":"a789ab76ef6c212421fd56d9a19cfd0235753342235d730f1331bd171c0a1a1f"}
Sep 15 13:39:47.203307 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:47.203273    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-24wlp" event={"ID":"82807e36-72ea-4ef2-a3bf-66fa30a9b389","Type":"ContainerStarted","Data":"605a666ad446f8d85486c3cee6f354252695b3a4de9008fb1c8059e19b3c3206"}
Sep 15 13:39:47.203415 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:47.203345    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-24wlp"
Sep 15 13:39:47.218360 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:47.218286    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68987bbfb-lcwpj" podStartSLOduration=2.265769543 podStartE2EDuration="15.218274749s" totalImagesPullingTime="12.952505206s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:39:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:39:47.218057919 +0000 UTC m=+73.977184204" watchObservedRunningTime="2026-09-15 13:39:47.218274749 +0000 UTC m=+73.977401025"
Sep 15 13:39:47.241807 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:47.241766    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-24wlp" podStartSLOduration=68.307269815 podStartE2EDuration="1m14.241754403s" totalImagesPullingTime="5.934484588s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:38:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:39:47.240924704 +0000 UTC m=+74.000050990" watchObservedRunningTime="2026-09-15 13:39:47.241754403 +0000 UTC m=+74.000881027"
Sep 15 13:39:47.262611 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:47.262562    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-f54mn" podStartSLOduration=68.051152988 podStartE2EDuration="1m14.262546213s" totalImagesPullingTime="6.211393225s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 13:38:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:39:47.260788324 +0000 UTC m=+74.019914610" watchObservedRunningTime="2026-09-15 13:39:47.262546213 +0000 UTC m=+74.021672523"
Sep 15 13:39:47.642165 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:47.642120    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2d23b647-7f2e-4c14-997a-6c3c42cf592c-node-exporter-tls\") pod \"node-exporter-4p6mg\" (UID: \"2d23b647-7f2e-4c14-997a-6c3c42cf592c\") " pod="openshift-monitoring/node-exporter-4p6mg"
Sep 15 13:39:47.645084 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:47.645052    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2d23b647-7f2e-4c14-997a-6c3c42cf592c-node-exporter-tls\") pod \"node-exporter-4p6mg\" (UID: \"2d23b647-7f2e-4c14-997a-6c3c42cf592c\") " pod="openshift-monitoring/node-exporter-4p6mg"
Sep 15 13:39:47.877228 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:47.877198    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4p6mg"
Sep 15 13:39:47.887881 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:39:47.887838    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d23b647_7f2e_4c14_997a_6c3c42cf592c.slice/crio-03576ad2374d4c1e577f1cda16ea7966fc85d89a478c6d4cb316cbafa329cd37 WatchSource:0}: Error finding container 03576ad2374d4c1e577f1cda16ea7966fc85d89a478c6d4cb316cbafa329cd37: Status 404 returned error can't find the container with id 03576ad2374d4c1e577f1cda16ea7966fc85d89a478c6d4cb316cbafa329cd37
Sep 15 13:39:48.208347 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:48.208304    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4p6mg" event={"ID":"2d23b647-7f2e-4c14-997a-6c3c42cf592c","Type":"ContainerStarted","Data":"03576ad2374d4c1e577f1cda16ea7966fc85d89a478c6d4cb316cbafa329cd37"}
Sep 15 13:39:50.221543 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:50.221504    2578 generic.go:356] "Generic (PLEG): container finished" podID="2d23b647-7f2e-4c14-997a-6c3c42cf592c" containerID="99571f35cda2ae60610336371bf7899c9f70822473c6f11a35fb52acf9c4cc0c" exitCode=0
Sep 15 13:39:50.221928 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:50.221587    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4p6mg" event={"ID":"2d23b647-7f2e-4c14-997a-6c3c42cf592c","Type":"ContainerDied","Data":"99571f35cda2ae60610336371bf7899c9f70822473c6f11a35fb52acf9c4cc0c"}
Sep 15 13:39:51.227346 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:51.227311    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4p6mg" event={"ID":"2d23b647-7f2e-4c14-997a-6c3c42cf592c","Type":"ContainerStarted","Data":"2b7fed35bfb4669875f7bb7ab5b15c099f695d604f8702b7850c04d488279ed6"}
Sep 15 13:39:51.227721 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:51.227368    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4p6mg" event={"ID":"2d23b647-7f2e-4c14-997a-6c3c42cf592c","Type":"ContainerStarted","Data":"fcf6784a4e4bdb7ae50e5f729776b677d0b43bf27c961feb8991d7d5c23b23cc"}
Sep 15 13:39:51.250381 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:51.250332    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-4p6mg" podStartSLOduration=3.665620281 podStartE2EDuration="5.250316943s" totalImagesPullingTime="1.511443301s" totalInitContainerRuntime="73.253361ms" isStatefulPod=true podCreationTimestamp="2026-09-15 13:39:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:39:51.248980458 +0000 UTC m=+78.008106744" watchObservedRunningTime="2026-09-15 13:39:51.250316943 +0000 UTC m=+78.009443267"
Sep 15 13:39:53.694448 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:53.694413    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a1710f54-b8e1-4e6e-aebd-d54e6eb4217a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vflrz\" (UID: \"a1710f54-b8e1-4e6e-aebd-d54e6eb4217a\") " pod="openshift-insights/insights-runtime-extractor-vflrz"
Sep 15 13:39:53.695008 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:53.694460    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a1710f54-b8e1-4e6e-aebd-d54e6eb4217a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vflrz\" (UID: \"a1710f54-b8e1-4e6e-aebd-d54e6eb4217a\") " pod="openshift-insights/insights-runtime-extractor-vflrz"
Sep 15 13:39:53.695008 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:53.694907    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a1710f54-b8e1-4e6e-aebd-d54e6eb4217a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vflrz\" (UID: \"a1710f54-b8e1-4e6e-aebd-d54e6eb4217a\") " pod="openshift-insights/insights-runtime-extractor-vflrz"
Sep 15 13:39:53.697014 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:53.696991    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a1710f54-b8e1-4e6e-aebd-d54e6eb4217a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vflrz\" (UID: \"a1710f54-b8e1-4e6e-aebd-d54e6eb4217a\") " pod="openshift-insights/insights-runtime-extractor-vflrz"
Sep 15 13:39:53.791217 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:53.791179    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vflrz"
Sep 15 13:39:53.931961 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:53.931927    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6454ccbd44-5nw6f"]
Sep 15 13:39:53.944412 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:53.944384    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6454ccbd44-5nw6f"
Sep 15 13:39:53.946647 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:53.946541    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6454ccbd44-5nw6f"]
Sep 15 13:39:53.946647 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:53.946582    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 15 13:39:53.947402 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:53.947383    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 15 13:39:53.947467 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:53.947411    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 15 13:39:53.947467 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:53.947383    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 15 13:39:53.947950 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:53.947933    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-pw8rk\""
Sep 15 13:39:53.948084 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:53.948069    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 15 13:39:53.948220 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:53.948070    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 15 13:39:53.948420 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:53.948403    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 15 13:39:53.951338 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:53.951315    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 15 13:39:54.063938 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:54.063798    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vflrz"]
Sep 15 13:39:54.066753 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:39:54.066727    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1710f54_b8e1_4e6e_aebd_d54e6eb4217a.slice/crio-7f511a05d42a07619d3ff6c2b95d9b2a8ff20f6b78536674ebb26ee413caaea3 WatchSource:0}: Error finding container 7f511a05d42a07619d3ff6c2b95d9b2a8ff20f6b78536674ebb26ee413caaea3: Status 404 returned error can't find the container with id 7f511a05d42a07619d3ff6c2b95d9b2a8ff20f6b78536674ebb26ee413caaea3
Sep 15 13:39:54.097109 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:54.097077    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4674ba52-3636-44ac-9354-ab763878d540-trusted-ca-bundle\") pod \"console-6454ccbd44-5nw6f\" (UID: \"4674ba52-3636-44ac-9354-ab763878d540\") " pod="openshift-console/console-6454ccbd44-5nw6f"
Sep 15 13:39:54.097224 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:54.097135    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4674ba52-3636-44ac-9354-ab763878d540-service-ca\") pod \"console-6454ccbd44-5nw6f\" (UID: \"4674ba52-3636-44ac-9354-ab763878d540\") " pod="openshift-console/console-6454ccbd44-5nw6f"
Sep 15 13:39:54.097224 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:54.097163    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4674ba52-3636-44ac-9354-ab763878d540-console-config\") pod \"console-6454ccbd44-5nw6f\" (UID: \"4674ba52-3636-44ac-9354-ab763878d540\") " pod="openshift-console/console-6454ccbd44-5nw6f"
Sep 15 13:39:54.097301 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:54.097247    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4674ba52-3636-44ac-9354-ab763878d540-console-oauth-config\") pod \"console-6454ccbd44-5nw6f\" (UID: \"4674ba52-3636-44ac-9354-ab763878d540\") " pod="openshift-console/console-6454ccbd44-5nw6f"
Sep 15 13:39:54.097337 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:54.097322    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rx2k9\" (UniqueName: \"kubernetes.io/projected/4674ba52-3636-44ac-9354-ab763878d540-kube-api-access-rx2k9\") pod \"console-6454ccbd44-5nw6f\" (UID: \"4674ba52-3636-44ac-9354-ab763878d540\") " pod="openshift-console/console-6454ccbd44-5nw6f"
Sep 15 13:39:54.097410 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:54.097393    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4674ba52-3636-44ac-9354-ab763878d540-console-serving-cert\") pod \"console-6454ccbd44-5nw6f\" (UID: \"4674ba52-3636-44ac-9354-ab763878d540\") " pod="openshift-console/console-6454ccbd44-5nw6f"
Sep 15 13:39:54.097457 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:54.097425    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4674ba52-3636-44ac-9354-ab763878d540-oauth-serving-cert\") pod \"console-6454ccbd44-5nw6f\" (UID: \"4674ba52-3636-44ac-9354-ab763878d540\") " pod="openshift-console/console-6454ccbd44-5nw6f"
Sep 15 13:39:54.198098 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:54.198010    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4674ba52-3636-44ac-9354-ab763878d540-trusted-ca-bundle\") pod \"console-6454ccbd44-5nw6f\" (UID: \"4674ba52-3636-44ac-9354-ab763878d540\") " pod="openshift-console/console-6454ccbd44-5nw6f"
Sep 15 13:39:54.198098 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:54.198052    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4674ba52-3636-44ac-9354-ab763878d540-service-ca\") pod \"console-6454ccbd44-5nw6f\" (UID: \"4674ba52-3636-44ac-9354-ab763878d540\") " pod="openshift-console/console-6454ccbd44-5nw6f"
Sep 15 13:39:54.198098 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:54.198071    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4674ba52-3636-44ac-9354-ab763878d540-console-config\") pod \"console-6454ccbd44-5nw6f\" (UID: \"4674ba52-3636-44ac-9354-ab763878d540\") " pod="openshift-console/console-6454ccbd44-5nw6f"
Sep 15 13:39:54.198098 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:54.198095    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4674ba52-3636-44ac-9354-ab763878d540-console-oauth-config\") pod \"console-6454ccbd44-5nw6f\" (UID: \"4674ba52-3636-44ac-9354-ab763878d540\") " pod="openshift-console/console-6454ccbd44-5nw6f"
Sep 15 13:39:54.198425 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:54.198145    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rx2k9\" (UniqueName: \"kubernetes.io/projected/4674ba52-3636-44ac-9354-ab763878d540-kube-api-access-rx2k9\") pod \"console-6454ccbd44-5nw6f\" (UID: \"4674ba52-3636-44ac-9354-ab763878d540\") " pod="openshift-console/console-6454ccbd44-5nw6f"
Sep 15 13:39:54.198425 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:54.198172    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4674ba52-3636-44ac-9354-ab763878d540-console-serving-cert\") pod \"console-6454ccbd44-5nw6f\" (UID: \"4674ba52-3636-44ac-9354-ab763878d540\") " pod="openshift-console/console-6454ccbd44-5nw6f"
Sep 15 13:39:54.198425 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:54.198201    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4674ba52-3636-44ac-9354-ab763878d540-oauth-serving-cert\") pod \"console-6454ccbd44-5nw6f\" (UID: \"4674ba52-3636-44ac-9354-ab763878d540\") " pod="openshift-console/console-6454ccbd44-5nw6f"
Sep 15 13:39:54.199042 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:54.198913    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4674ba52-3636-44ac-9354-ab763878d540-oauth-serving-cert\") pod \"console-6454ccbd44-5nw6f\" (UID: \"4674ba52-3636-44ac-9354-ab763878d540\") " pod="openshift-console/console-6454ccbd44-5nw6f"
Sep 15 13:39:54.199323 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:54.199002    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4674ba52-3636-44ac-9354-ab763878d540-service-ca\") pod \"console-6454ccbd44-5nw6f\" (UID: \"4674ba52-3636-44ac-9354-ab763878d540\") " pod="openshift-console/console-6454ccbd44-5nw6f"
Sep 15 13:39:54.199323 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:54.199036    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4674ba52-3636-44ac-9354-ab763878d540-console-config\") pod \"console-6454ccbd44-5nw6f\" (UID: \"4674ba52-3636-44ac-9354-ab763878d540\") " pod="openshift-console/console-6454ccbd44-5nw6f"
Sep 15 13:39:54.199455 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:54.199064    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4674ba52-3636-44ac-9354-ab763878d540-trusted-ca-bundle\") pod \"console-6454ccbd44-5nw6f\" (UID: \"4674ba52-3636-44ac-9354-ab763878d540\") " pod="openshift-console/console-6454ccbd44-5nw6f"
Sep 15 13:39:54.200831 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:54.200811    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4674ba52-3636-44ac-9354-ab763878d540-console-serving-cert\") pod \"console-6454ccbd44-5nw6f\" (UID: \"4674ba52-3636-44ac-9354-ab763878d540\") " pod="openshift-console/console-6454ccbd44-5nw6f"
Sep 15 13:39:54.200910 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:54.200835    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4674ba52-3636-44ac-9354-ab763878d540-console-oauth-config\") pod \"console-6454ccbd44-5nw6f\" (UID: \"4674ba52-3636-44ac-9354-ab763878d540\") " pod="openshift-console/console-6454ccbd44-5nw6f"
Sep 15 13:39:54.208851 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:54.208833    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rx2k9\" (UniqueName: \"kubernetes.io/projected/4674ba52-3636-44ac-9354-ab763878d540-kube-api-access-rx2k9\") pod \"console-6454ccbd44-5nw6f\" (UID: \"4674ba52-3636-44ac-9354-ab763878d540\") " pod="openshift-console/console-6454ccbd44-5nw6f"
Sep 15 13:39:54.241174 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:54.241115    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vflrz" event={"ID":"a1710f54-b8e1-4e6e-aebd-d54e6eb4217a","Type":"ContainerStarted","Data":"930782843dd51dcd6fcf77c97f42a8a8fdd5c480441a6dd345dc86926c707baa"}
Sep 15 13:39:54.241318 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:54.241195    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vflrz" event={"ID":"a1710f54-b8e1-4e6e-aebd-d54e6eb4217a","Type":"ContainerStarted","Data":"7f511a05d42a07619d3ff6c2b95d9b2a8ff20f6b78536674ebb26ee413caaea3"}
Sep 15 13:39:54.254857 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:54.254831    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6454ccbd44-5nw6f"
Sep 15 13:39:54.526406 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:54.526378    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6454ccbd44-5nw6f"]
Sep 15 13:39:54.528963 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:39:54.528939    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4674ba52_3636_44ac_9354_ab763878d540.slice/crio-51b6245eec132eab378e2bea2e7a0b8276ce72bba5a7b81fe48d800da57b0aff WatchSource:0}: Error finding container 51b6245eec132eab378e2bea2e7a0b8276ce72bba5a7b81fe48d800da57b0aff: Status 404 returned error can't find the container with id 51b6245eec132eab378e2bea2e7a0b8276ce72bba5a7b81fe48d800da57b0aff
Sep 15 13:39:55.247581 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:55.247500    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vflrz" event={"ID":"a1710f54-b8e1-4e6e-aebd-d54e6eb4217a","Type":"ContainerStarted","Data":"8e8188cf51dcdf02557ed68deafd93dd0e4d3d8e4117b02594610680b74df259"}
Sep 15 13:39:55.249350 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:55.249322    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6454ccbd44-5nw6f" event={"ID":"4674ba52-3636-44ac-9354-ab763878d540","Type":"ContainerStarted","Data":"51b6245eec132eab378e2bea2e7a0b8276ce72bba5a7b81fe48d800da57b0aff"}
Sep 15 13:39:56.126919 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:56.126883    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-556c8d5f67-cj9zw"
Sep 15 13:39:57.716261 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:57.716214    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-56444b6f6-q6gl8" podUID="fe529bf1-eb92-4c2f-a205-3aaed674d7a0" containerName="registry" containerID="cri-o://e8c6d8524ff7c445119778dfe340709f85043ad7303e5f5b4aa9650f2cda6f5f" gracePeriod=30
Sep 15 13:39:57.952386 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:57.952364    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-56444b6f6-q6gl8"
Sep 15 13:39:58.032916 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:58.032893    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6czxr\" (UniqueName: \"kubernetes.io/projected/fe529bf1-eb92-4c2f-a205-3aaed674d7a0-kube-api-access-6czxr\") pod \"fe529bf1-eb92-4c2f-a205-3aaed674d7a0\" (UID: \"fe529bf1-eb92-4c2f-a205-3aaed674d7a0\") "
Sep 15 13:39:58.033073 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:58.032936    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fe529bf1-eb92-4c2f-a205-3aaed674d7a0-registry-tls\") pod \"fe529bf1-eb92-4c2f-a205-3aaed674d7a0\" (UID: \"fe529bf1-eb92-4c2f-a205-3aaed674d7a0\") "
Sep 15 13:39:58.033073 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:58.032976    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fe529bf1-eb92-4c2f-a205-3aaed674d7a0-ca-trust-extracted\") pod \"fe529bf1-eb92-4c2f-a205-3aaed674d7a0\" (UID: \"fe529bf1-eb92-4c2f-a205-3aaed674d7a0\") "
Sep 15 13:39:58.033073 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:58.033010    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fe529bf1-eb92-4c2f-a205-3aaed674d7a0-registry-certificates\") pod \"fe529bf1-eb92-4c2f-a205-3aaed674d7a0\" (UID: \"fe529bf1-eb92-4c2f-a205-3aaed674d7a0\") "
Sep 15 13:39:58.033073 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:58.033031    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fe529bf1-eb92-4c2f-a205-3aaed674d7a0-image-registry-private-configuration\") pod \"fe529bf1-eb92-4c2f-a205-3aaed674d7a0\" (UID: \"fe529bf1-eb92-4c2f-a205-3aaed674d7a0\") "
Sep 15 13:39:58.033073 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:58.033061    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fe529bf1-eb92-4c2f-a205-3aaed674d7a0-trusted-ca\") pod \"fe529bf1-eb92-4c2f-a205-3aaed674d7a0\" (UID: \"fe529bf1-eb92-4c2f-a205-3aaed674d7a0\") "
Sep 15 13:39:58.033337 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:58.033199    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fe529bf1-eb92-4c2f-a205-3aaed674d7a0-installation-pull-secrets\") pod \"fe529bf1-eb92-4c2f-a205-3aaed674d7a0\" (UID: \"fe529bf1-eb92-4c2f-a205-3aaed674d7a0\") "
Sep 15 13:39:58.033337 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:58.033250    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fe529bf1-eb92-4c2f-a205-3aaed674d7a0-bound-sa-token\") pod \"fe529bf1-eb92-4c2f-a205-3aaed674d7a0\" (UID: \"fe529bf1-eb92-4c2f-a205-3aaed674d7a0\") "
Sep 15 13:39:58.033804 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:58.033508    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe529bf1-eb92-4c2f-a205-3aaed674d7a0-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "fe529bf1-eb92-4c2f-a205-3aaed674d7a0" (UID: "fe529bf1-eb92-4c2f-a205-3aaed674d7a0"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 13:39:58.033804 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:58.033601    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe529bf1-eb92-4c2f-a205-3aaed674d7a0-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "fe529bf1-eb92-4c2f-a205-3aaed674d7a0" (UID: "fe529bf1-eb92-4c2f-a205-3aaed674d7a0"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 13:39:58.035683 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:58.035652    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe529bf1-eb92-4c2f-a205-3aaed674d7a0-kube-api-access-6czxr" (OuterVolumeSpecName: "kube-api-access-6czxr") pod "fe529bf1-eb92-4c2f-a205-3aaed674d7a0" (UID: "fe529bf1-eb92-4c2f-a205-3aaed674d7a0"). InnerVolumeSpecName "kube-api-access-6czxr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:39:58.035800 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:58.035716    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe529bf1-eb92-4c2f-a205-3aaed674d7a0-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "fe529bf1-eb92-4c2f-a205-3aaed674d7a0" (UID: "fe529bf1-eb92-4c2f-a205-3aaed674d7a0"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:39:58.036009 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:58.035979    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe529bf1-eb92-4c2f-a205-3aaed674d7a0-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "fe529bf1-eb92-4c2f-a205-3aaed674d7a0" (UID: "fe529bf1-eb92-4c2f-a205-3aaed674d7a0"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:39:58.036098 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:58.036004    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe529bf1-eb92-4c2f-a205-3aaed674d7a0-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "fe529bf1-eb92-4c2f-a205-3aaed674d7a0" (UID: "fe529bf1-eb92-4c2f-a205-3aaed674d7a0"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 13:39:58.036164 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:58.036086    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe529bf1-eb92-4c2f-a205-3aaed674d7a0-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "fe529bf1-eb92-4c2f-a205-3aaed674d7a0" (UID: "fe529bf1-eb92-4c2f-a205-3aaed674d7a0"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 13:39:58.041708 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:58.041688    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe529bf1-eb92-4c2f-a205-3aaed674d7a0-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "fe529bf1-eb92-4c2f-a205-3aaed674d7a0" (UID: "fe529bf1-eb92-4c2f-a205-3aaed674d7a0"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:39:58.133915 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:58.133876    2578 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fe529bf1-eb92-4c2f-a205-3aaed674d7a0-ca-trust-extracted\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:39:58.133915 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:58.133911    2578 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fe529bf1-eb92-4c2f-a205-3aaed674d7a0-registry-certificates\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:39:58.133915 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:58.133922    2578 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fe529bf1-eb92-4c2f-a205-3aaed674d7a0-image-registry-private-configuration\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:39:58.134111 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:58.133932    2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fe529bf1-eb92-4c2f-a205-3aaed674d7a0-trusted-ca\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:39:58.134111 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:58.133940    2578 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fe529bf1-eb92-4c2f-a205-3aaed674d7a0-installation-pull-secrets\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:39:58.134111 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:58.133949    2578 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fe529bf1-eb92-4c2f-a205-3aaed674d7a0-bound-sa-token\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:39:58.134111 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:58.133957    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6czxr\" (UniqueName: \"kubernetes.io/projected/fe529bf1-eb92-4c2f-a205-3aaed674d7a0-kube-api-access-6czxr\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:39:58.134111 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:58.133964    2578 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fe529bf1-eb92-4c2f-a205-3aaed674d7a0-registry-tls\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:39:58.262854 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:58.262814    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vflrz" event={"ID":"a1710f54-b8e1-4e6e-aebd-d54e6eb4217a","Type":"ContainerStarted","Data":"390daa4c5d4199ef45ab00d011a5e7301af3af9ea3e773797fb544b7cbf444e2"}
Sep 15 13:39:58.264356 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:58.264333    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6454ccbd44-5nw6f" event={"ID":"4674ba52-3636-44ac-9354-ab763878d540","Type":"ContainerStarted","Data":"720c957dc68f7f3709ea96b687e8fcee0d431cdeed87f6baed3b4176980a2cbf"}
Sep 15 13:39:58.265504 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:58.265480    2578 generic.go:356] "Generic (PLEG): container finished" podID="fe529bf1-eb92-4c2f-a205-3aaed674d7a0" containerID="e8c6d8524ff7c445119778dfe340709f85043ad7303e5f5b4aa9650f2cda6f5f" exitCode=0
Sep 15 13:39:58.265573 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:58.265519    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-56444b6f6-q6gl8"
Sep 15 13:39:58.265573 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:58.265545    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-56444b6f6-q6gl8" event={"ID":"fe529bf1-eb92-4c2f-a205-3aaed674d7a0","Type":"ContainerDied","Data":"e8c6d8524ff7c445119778dfe340709f85043ad7303e5f5b4aa9650f2cda6f5f"}
Sep 15 13:39:58.265639 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:58.265584    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-56444b6f6-q6gl8" event={"ID":"fe529bf1-eb92-4c2f-a205-3aaed674d7a0","Type":"ContainerDied","Data":"51e59f69010e81726f71d451877ee974c8d483aeb2bda4f6a9dc3020cba2a79e"}
Sep 15 13:39:58.265639 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:58.265625    2578 scope.go:117] "RemoveContainer" containerID="e8c6d8524ff7c445119778dfe340709f85043ad7303e5f5b4aa9650f2cda6f5f"
Sep 15 13:39:58.274227 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:58.274212    2578 scope.go:117] "RemoveContainer" containerID="e8c6d8524ff7c445119778dfe340709f85043ad7303e5f5b4aa9650f2cda6f5f"
Sep 15 13:39:58.274499 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:39:58.274480    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e8c6d8524ff7c445119778dfe340709f85043ad7303e5f5b4aa9650f2cda6f5f\": container with ID starting with e8c6d8524ff7c445119778dfe340709f85043ad7303e5f5b4aa9650f2cda6f5f not found: ID does not exist" containerID="e8c6d8524ff7c445119778dfe340709f85043ad7303e5f5b4aa9650f2cda6f5f"
Sep 15 13:39:58.274546 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:58.274508    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8c6d8524ff7c445119778dfe340709f85043ad7303e5f5b4aa9650f2cda6f5f"} err="failed to get container status \"e8c6d8524ff7c445119778dfe340709f85043ad7303e5f5b4aa9650f2cda6f5f\": rpc error: code = NotFound desc = could not find container \"e8c6d8524ff7c445119778dfe340709f85043ad7303e5f5b4aa9650f2cda6f5f\": container with ID starting with e8c6d8524ff7c445119778dfe340709f85043ad7303e5f5b4aa9650f2cda6f5f not found: ID does not exist"
Sep 15 13:39:58.285825 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:58.285733    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-vflrz" podStartSLOduration=17.98982918 podStartE2EDuration="21.285719624s" totalImagesPullingTime="3.295890444s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 13:39:37 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:39:58.285508967 +0000 UTC m=+85.044635253" watchObservedRunningTime="2026-09-15 13:39:58.285719624 +0000 UTC m=+85.044845916"
Sep 15 13:39:58.302184 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:58.302165    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-56444b6f6-q6gl8"]
Sep 15 13:39:58.306111 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:58.306092    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-56444b6f6-q6gl8"]
Sep 15 13:39:58.329993 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:58.329948    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6454ccbd44-5nw6f" podStartSLOduration=2.379311878 podStartE2EDuration="5.329935628s" totalImagesPullingTime="2.95062375s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:39:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:39:58.329813164 +0000 UTC m=+85.088939453" watchObservedRunningTime="2026-09-15 13:39:58.329935628 +0000 UTC m=+85.089061914"
Sep 15 13:39:59.756183 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:39:59.756119    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe529bf1-eb92-4c2f-a205-3aaed674d7a0" path="/var/lib/kubelet/pods/fe529bf1-eb92-4c2f-a205-3aaed674d7a0/volumes"
Sep 15 13:40:04.255929 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:40:04.255886    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6454ccbd44-5nw6f"
Sep 15 13:40:04.256385 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:40:04.255954    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6454ccbd44-5nw6f"
Sep 15 13:40:04.260761 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:40:04.260734    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6454ccbd44-5nw6f"
Sep 15 13:40:04.291770 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:40:04.291743    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6454ccbd44-5nw6f"
Sep 15 13:40:18.210890 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:40:18.210848    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-24wlp"
Sep 15 13:41:11.150989 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:11.150951    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6655b69fc9-wmb2j"]
Sep 15 13:41:11.151474 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:11.151219    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe529bf1-eb92-4c2f-a205-3aaed674d7a0" containerName="registry"
Sep 15 13:41:11.151474 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:11.151230    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe529bf1-eb92-4c2f-a205-3aaed674d7a0" containerName="registry"
Sep 15 13:41:11.151474 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:11.151285    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe529bf1-eb92-4c2f-a205-3aaed674d7a0" containerName="registry"
Sep 15 13:41:11.153359 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:11.153333    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6655b69fc9-wmb2j"
Sep 15 13:41:11.157553 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:11.157531    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Sep 15 13:41:11.157683 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:11.157577    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-2mvsz\""
Sep 15 13:41:11.157747 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:11.157688    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Sep 15 13:41:11.157747 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:11.157714    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Sep 15 13:41:11.157846 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:11.157752    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Sep 15 13:41:11.157904 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:11.157857    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Sep 15 13:41:11.163227 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:11.163209    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Sep 15 13:41:11.167591 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:11.167568    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6655b69fc9-wmb2j"]
Sep 15 13:41:11.293161 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:11.293100    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1993b823-2d2f-44b5-a062-64a4de750365-telemeter-client-tls\") pod \"telemeter-client-6655b69fc9-wmb2j\" (UID: \"1993b823-2d2f-44b5-a062-64a4de750365\") " pod="openshift-monitoring/telemeter-client-6655b69fc9-wmb2j"
Sep 15 13:41:11.293161 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:11.293163    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1993b823-2d2f-44b5-a062-64a4de750365-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6655b69fc9-wmb2j\" (UID: \"1993b823-2d2f-44b5-a062-64a4de750365\") " pod="openshift-monitoring/telemeter-client-6655b69fc9-wmb2j"
Sep 15 13:41:11.293373 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:11.293183    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bltkb\" (UniqueName: \"kubernetes.io/projected/1993b823-2d2f-44b5-a062-64a4de750365-kube-api-access-bltkb\") pod \"telemeter-client-6655b69fc9-wmb2j\" (UID: \"1993b823-2d2f-44b5-a062-64a4de750365\") " pod="openshift-monitoring/telemeter-client-6655b69fc9-wmb2j"
Sep 15 13:41:11.293373 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:11.293200    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1993b823-2d2f-44b5-a062-64a4de750365-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6655b69fc9-wmb2j\" (UID: \"1993b823-2d2f-44b5-a062-64a4de750365\") " pod="openshift-monitoring/telemeter-client-6655b69fc9-wmb2j"
Sep 15 13:41:11.293373 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:11.293233    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1993b823-2d2f-44b5-a062-64a4de750365-federate-client-tls\") pod \"telemeter-client-6655b69fc9-wmb2j\" (UID: \"1993b823-2d2f-44b5-a062-64a4de750365\") " pod="openshift-monitoring/telemeter-client-6655b69fc9-wmb2j"
Sep 15 13:41:11.293373 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:11.293259    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1993b823-2d2f-44b5-a062-64a4de750365-secret-telemeter-client\") pod \"telemeter-client-6655b69fc9-wmb2j\" (UID: \"1993b823-2d2f-44b5-a062-64a4de750365\") " pod="openshift-monitoring/telemeter-client-6655b69fc9-wmb2j"
Sep 15 13:41:11.293373 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:11.293307    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1993b823-2d2f-44b5-a062-64a4de750365-serving-certs-ca-bundle\") pod \"telemeter-client-6655b69fc9-wmb2j\" (UID: \"1993b823-2d2f-44b5-a062-64a4de750365\") " pod="openshift-monitoring/telemeter-client-6655b69fc9-wmb2j"
Sep 15 13:41:11.293373 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:11.293352    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1993b823-2d2f-44b5-a062-64a4de750365-metrics-client-ca\") pod \"telemeter-client-6655b69fc9-wmb2j\" (UID: \"1993b823-2d2f-44b5-a062-64a4de750365\") " pod="openshift-monitoring/telemeter-client-6655b69fc9-wmb2j"
Sep 15 13:41:11.394642 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:11.394606    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1993b823-2d2f-44b5-a062-64a4de750365-metrics-client-ca\") pod \"telemeter-client-6655b69fc9-wmb2j\" (UID: \"1993b823-2d2f-44b5-a062-64a4de750365\") " pod="openshift-monitoring/telemeter-client-6655b69fc9-wmb2j"
Sep 15 13:41:11.394808 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:11.394657    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1993b823-2d2f-44b5-a062-64a4de750365-telemeter-client-tls\") pod \"telemeter-client-6655b69fc9-wmb2j\" (UID: \"1993b823-2d2f-44b5-a062-64a4de750365\") " pod="openshift-monitoring/telemeter-client-6655b69fc9-wmb2j"
Sep 15 13:41:11.394808 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:11.394705    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1993b823-2d2f-44b5-a062-64a4de750365-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6655b69fc9-wmb2j\" (UID: \"1993b823-2d2f-44b5-a062-64a4de750365\") " pod="openshift-monitoring/telemeter-client-6655b69fc9-wmb2j"
Sep 15 13:41:11.394808 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:11.394729    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bltkb\" (UniqueName: \"kubernetes.io/projected/1993b823-2d2f-44b5-a062-64a4de750365-kube-api-access-bltkb\") pod \"telemeter-client-6655b69fc9-wmb2j\" (UID: \"1993b823-2d2f-44b5-a062-64a4de750365\") " pod="openshift-monitoring/telemeter-client-6655b69fc9-wmb2j"
Sep 15 13:41:11.394808 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:11.394756    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1993b823-2d2f-44b5-a062-64a4de750365-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6655b69fc9-wmb2j\" (UID: \"1993b823-2d2f-44b5-a062-64a4de750365\") " pod="openshift-monitoring/telemeter-client-6655b69fc9-wmb2j"
Sep 15 13:41:11.395005 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:11.394809    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1993b823-2d2f-44b5-a062-64a4de750365-federate-client-tls\") pod \"telemeter-client-6655b69fc9-wmb2j\" (UID: \"1993b823-2d2f-44b5-a062-64a4de750365\") " pod="openshift-monitoring/telemeter-client-6655b69fc9-wmb2j"
Sep 15 13:41:11.395005 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:11.394837    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1993b823-2d2f-44b5-a062-64a4de750365-secret-telemeter-client\") pod \"telemeter-client-6655b69fc9-wmb2j\" (UID: \"1993b823-2d2f-44b5-a062-64a4de750365\") " pod="openshift-monitoring/telemeter-client-6655b69fc9-wmb2j"
Sep 15 13:41:11.395005 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:11.394859    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1993b823-2d2f-44b5-a062-64a4de750365-serving-certs-ca-bundle\") pod \"telemeter-client-6655b69fc9-wmb2j\" (UID: \"1993b823-2d2f-44b5-a062-64a4de750365\") " pod="openshift-monitoring/telemeter-client-6655b69fc9-wmb2j"
Sep 15 13:41:11.395593 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:11.395562    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1993b823-2d2f-44b5-a062-64a4de750365-metrics-client-ca\") pod \"telemeter-client-6655b69fc9-wmb2j\" (UID: \"1993b823-2d2f-44b5-a062-64a4de750365\") " pod="openshift-monitoring/telemeter-client-6655b69fc9-wmb2j"
Sep 15 13:41:11.395947 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:11.395562    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1993b823-2d2f-44b5-a062-64a4de750365-serving-certs-ca-bundle\") pod \"telemeter-client-6655b69fc9-wmb2j\" (UID: \"1993b823-2d2f-44b5-a062-64a4de750365\") " pod="openshift-monitoring/telemeter-client-6655b69fc9-wmb2j"
Sep 15 13:41:11.396104 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:11.396077    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1993b823-2d2f-44b5-a062-64a4de750365-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6655b69fc9-wmb2j\" (UID: \"1993b823-2d2f-44b5-a062-64a4de750365\") " pod="openshift-monitoring/telemeter-client-6655b69fc9-wmb2j"
Sep 15 13:41:11.397434 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:11.397408    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1993b823-2d2f-44b5-a062-64a4de750365-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6655b69fc9-wmb2j\" (UID: \"1993b823-2d2f-44b5-a062-64a4de750365\") " pod="openshift-monitoring/telemeter-client-6655b69fc9-wmb2j"
Sep 15 13:41:11.397541 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:11.397524    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1993b823-2d2f-44b5-a062-64a4de750365-telemeter-client-tls\") pod \"telemeter-client-6655b69fc9-wmb2j\" (UID: \"1993b823-2d2f-44b5-a062-64a4de750365\") " pod="openshift-monitoring/telemeter-client-6655b69fc9-wmb2j"
Sep 15 13:41:11.397610 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:11.397595    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1993b823-2d2f-44b5-a062-64a4de750365-secret-telemeter-client\") pod \"telemeter-client-6655b69fc9-wmb2j\" (UID: \"1993b823-2d2f-44b5-a062-64a4de750365\") " pod="openshift-monitoring/telemeter-client-6655b69fc9-wmb2j"
Sep 15 13:41:11.397727 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:11.397707    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1993b823-2d2f-44b5-a062-64a4de750365-federate-client-tls\") pod \"telemeter-client-6655b69fc9-wmb2j\" (UID: \"1993b823-2d2f-44b5-a062-64a4de750365\") " pod="openshift-monitoring/telemeter-client-6655b69fc9-wmb2j"
Sep 15 13:41:11.403000 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:11.402950    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bltkb\" (UniqueName: \"kubernetes.io/projected/1993b823-2d2f-44b5-a062-64a4de750365-kube-api-access-bltkb\") pod \"telemeter-client-6655b69fc9-wmb2j\" (UID: \"1993b823-2d2f-44b5-a062-64a4de750365\") " pod="openshift-monitoring/telemeter-client-6655b69fc9-wmb2j"
Sep 15 13:41:11.463048 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:11.463018    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6655b69fc9-wmb2j"
Sep 15 13:41:11.738910 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:11.738795    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6655b69fc9-wmb2j"]
Sep 15 13:41:11.741234 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:41:11.741206    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1993b823_2d2f_44b5_a062_64a4de750365.slice/crio-4bf93b3e21cf100fab557e6656f24c255ba873a8e5da469846264c881f08f16c WatchSource:0}: Error finding container 4bf93b3e21cf100fab557e6656f24c255ba873a8e5da469846264c881f08f16c: Status 404 returned error can't find the container with id 4bf93b3e21cf100fab557e6656f24c255ba873a8e5da469846264c881f08f16c
Sep 15 13:41:12.531878 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:12.531848    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6655b69fc9-wmb2j" event={"ID":"1993b823-2d2f-44b5-a062-64a4de750365","Type":"ContainerStarted","Data":"4bf93b3e21cf100fab557e6656f24c255ba873a8e5da469846264c881f08f16c"}
Sep 15 13:41:14.541187 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:14.541143    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6655b69fc9-wmb2j" event={"ID":"1993b823-2d2f-44b5-a062-64a4de750365","Type":"ContainerStarted","Data":"9ff47a4f1c96dc5bc4fa0a98cb869289f403f56b2adc488d6cb6686be2376292"}
Sep 15 13:41:15.547651 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:15.547610    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6655b69fc9-wmb2j" event={"ID":"1993b823-2d2f-44b5-a062-64a4de750365","Type":"ContainerStarted","Data":"cf5fe19fcf098d3d86970cd7f865361ce0da8de73c756c7d24d13d697e2e2627"}
Sep 15 13:41:15.548025 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:15.547687    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6655b69fc9-wmb2j" event={"ID":"1993b823-2d2f-44b5-a062-64a4de750365","Type":"ContainerStarted","Data":"5fadb2a9a86dd39d33bc0caabc983dd6f622bae8f0b77e2b78e0b18db8fdd4c4"}
Sep 15 13:41:15.570421 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:15.570368    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6655b69fc9-wmb2j" podStartSLOduration=1.361536493 podStartE2EDuration="4.570347464s" totalImagesPullingTime="3.208810971s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:41:11 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:41:15.568981583 +0000 UTC m=+162.328107873" watchObservedRunningTime="2026-09-15 13:41:15.570347464 +0000 UTC m=+162.329473749"
Sep 15 13:41:15.662791 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:15.662763    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7858577f6b-cq5lv"]
Sep 15 13:41:15.665912 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:15.665890    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7858577f6b-cq5lv"
Sep 15 13:41:15.683065 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:15.683043    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7858577f6b-cq5lv"]
Sep 15 13:41:15.734217 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:15.734184    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2cb6bb0-0b7c-4693-8513-87ce074ce7ed-trusted-ca-bundle\") pod \"console-7858577f6b-cq5lv\" (UID: \"b2cb6bb0-0b7c-4693-8513-87ce074ce7ed\") " pod="openshift-console/console-7858577f6b-cq5lv"
Sep 15 13:41:15.734367 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:15.734223    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b2cb6bb0-0b7c-4693-8513-87ce074ce7ed-console-oauth-config\") pod \"console-7858577f6b-cq5lv\" (UID: \"b2cb6bb0-0b7c-4693-8513-87ce074ce7ed\") " pod="openshift-console/console-7858577f6b-cq5lv"
Sep 15 13:41:15.734367 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:15.734242    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b2cb6bb0-0b7c-4693-8513-87ce074ce7ed-oauth-serving-cert\") pod \"console-7858577f6b-cq5lv\" (UID: \"b2cb6bb0-0b7c-4693-8513-87ce074ce7ed\") " pod="openshift-console/console-7858577f6b-cq5lv"
Sep 15 13:41:15.734367 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:15.734319    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b2cb6bb0-0b7c-4693-8513-87ce074ce7ed-console-config\") pod \"console-7858577f6b-cq5lv\" (UID: \"b2cb6bb0-0b7c-4693-8513-87ce074ce7ed\") " pod="openshift-console/console-7858577f6b-cq5lv"
Sep 15 13:41:15.734367 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:15.734351    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b2cb6bb0-0b7c-4693-8513-87ce074ce7ed-service-ca\") pod \"console-7858577f6b-cq5lv\" (UID: \"b2cb6bb0-0b7c-4693-8513-87ce074ce7ed\") " pod="openshift-console/console-7858577f6b-cq5lv"
Sep 15 13:41:15.734526 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:15.734377    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b2cb6bb0-0b7c-4693-8513-87ce074ce7ed-console-serving-cert\") pod \"console-7858577f6b-cq5lv\" (UID: \"b2cb6bb0-0b7c-4693-8513-87ce074ce7ed\") " pod="openshift-console/console-7858577f6b-cq5lv"
Sep 15 13:41:15.734526 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:15.734395    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-429jt\" (UniqueName: \"kubernetes.io/projected/b2cb6bb0-0b7c-4693-8513-87ce074ce7ed-kube-api-access-429jt\") pod \"console-7858577f6b-cq5lv\" (UID: \"b2cb6bb0-0b7c-4693-8513-87ce074ce7ed\") " pod="openshift-console/console-7858577f6b-cq5lv"
Sep 15 13:41:15.835487 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:15.835403    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b2cb6bb0-0b7c-4693-8513-87ce074ce7ed-console-oauth-config\") pod \"console-7858577f6b-cq5lv\" (UID: \"b2cb6bb0-0b7c-4693-8513-87ce074ce7ed\") " pod="openshift-console/console-7858577f6b-cq5lv"
Sep 15 13:41:15.835487 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:15.835436    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b2cb6bb0-0b7c-4693-8513-87ce074ce7ed-oauth-serving-cert\") pod \"console-7858577f6b-cq5lv\" (UID: \"b2cb6bb0-0b7c-4693-8513-87ce074ce7ed\") " pod="openshift-console/console-7858577f6b-cq5lv"
Sep 15 13:41:15.835487 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:15.835473    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b2cb6bb0-0b7c-4693-8513-87ce074ce7ed-console-config\") pod \"console-7858577f6b-cq5lv\" (UID: \"b2cb6bb0-0b7c-4693-8513-87ce074ce7ed\") " pod="openshift-console/console-7858577f6b-cq5lv"
Sep 15 13:41:15.835703 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:15.835642    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b2cb6bb0-0b7c-4693-8513-87ce074ce7ed-service-ca\") pod \"console-7858577f6b-cq5lv\" (UID: \"b2cb6bb0-0b7c-4693-8513-87ce074ce7ed\") " pod="openshift-console/console-7858577f6b-cq5lv"
Sep 15 13:41:15.835703 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:15.835677    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b2cb6bb0-0b7c-4693-8513-87ce074ce7ed-console-serving-cert\") pod \"console-7858577f6b-cq5lv\" (UID: \"b2cb6bb0-0b7c-4693-8513-87ce074ce7ed\") " pod="openshift-console/console-7858577f6b-cq5lv"
Sep 15 13:41:15.835703 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:15.835695    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-429jt\" (UniqueName: \"kubernetes.io/projected/b2cb6bb0-0b7c-4693-8513-87ce074ce7ed-kube-api-access-429jt\") pod \"console-7858577f6b-cq5lv\" (UID: \"b2cb6bb0-0b7c-4693-8513-87ce074ce7ed\") " pod="openshift-console/console-7858577f6b-cq5lv"
Sep 15 13:41:15.835851 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:15.835755    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2cb6bb0-0b7c-4693-8513-87ce074ce7ed-trusted-ca-bundle\") pod \"console-7858577f6b-cq5lv\" (UID: \"b2cb6bb0-0b7c-4693-8513-87ce074ce7ed\") " pod="openshift-console/console-7858577f6b-cq5lv"
Sep 15 13:41:15.836271 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:15.836246    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b2cb6bb0-0b7c-4693-8513-87ce074ce7ed-oauth-serving-cert\") pod \"console-7858577f6b-cq5lv\" (UID: \"b2cb6bb0-0b7c-4693-8513-87ce074ce7ed\") " pod="openshift-console/console-7858577f6b-cq5lv"
Sep 15 13:41:15.836555 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:15.836246    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b2cb6bb0-0b7c-4693-8513-87ce074ce7ed-console-config\") pod \"console-7858577f6b-cq5lv\" (UID: \"b2cb6bb0-0b7c-4693-8513-87ce074ce7ed\") " pod="openshift-console/console-7858577f6b-cq5lv"
Sep 15 13:41:15.836555 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:15.836518    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2cb6bb0-0b7c-4693-8513-87ce074ce7ed-trusted-ca-bundle\") pod \"console-7858577f6b-cq5lv\" (UID: \"b2cb6bb0-0b7c-4693-8513-87ce074ce7ed\") " pod="openshift-console/console-7858577f6b-cq5lv"
Sep 15 13:41:15.836555 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:15.836523    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b2cb6bb0-0b7c-4693-8513-87ce074ce7ed-service-ca\") pod \"console-7858577f6b-cq5lv\" (UID: \"b2cb6bb0-0b7c-4693-8513-87ce074ce7ed\") " pod="openshift-console/console-7858577f6b-cq5lv"
Sep 15 13:41:15.838104 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:15.838076    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b2cb6bb0-0b7c-4693-8513-87ce074ce7ed-console-serving-cert\") pod \"console-7858577f6b-cq5lv\" (UID: \"b2cb6bb0-0b7c-4693-8513-87ce074ce7ed\") " pod="openshift-console/console-7858577f6b-cq5lv"
Sep 15 13:41:15.838222 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:15.838153    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b2cb6bb0-0b7c-4693-8513-87ce074ce7ed-console-oauth-config\") pod \"console-7858577f6b-cq5lv\" (UID: \"b2cb6bb0-0b7c-4693-8513-87ce074ce7ed\") " pod="openshift-console/console-7858577f6b-cq5lv"
Sep 15 13:41:15.854803 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:15.854775    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-429jt\" (UniqueName: \"kubernetes.io/projected/b2cb6bb0-0b7c-4693-8513-87ce074ce7ed-kube-api-access-429jt\") pod \"console-7858577f6b-cq5lv\" (UID: \"b2cb6bb0-0b7c-4693-8513-87ce074ce7ed\") " pod="openshift-console/console-7858577f6b-cq5lv"
Sep 15 13:41:15.975454 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:15.975417    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7858577f6b-cq5lv"
Sep 15 13:41:16.275246 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:16.274895    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7858577f6b-cq5lv"]
Sep 15 13:41:16.277526 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:41:16.277484    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2cb6bb0_0b7c_4693_8513_87ce074ce7ed.slice/crio-9993b8060608c89051c4a27d90ae0274ad4244b3bbd3d6d77920822b9b4aa887 WatchSource:0}: Error finding container 9993b8060608c89051c4a27d90ae0274ad4244b3bbd3d6d77920822b9b4aa887: Status 404 returned error can't find the container with id 9993b8060608c89051c4a27d90ae0274ad4244b3bbd3d6d77920822b9b4aa887
Sep 15 13:41:16.552716 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:16.552610    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7858577f6b-cq5lv" event={"ID":"b2cb6bb0-0b7c-4693-8513-87ce074ce7ed","Type":"ContainerStarted","Data":"efe24b852bbae2f8d95bcfed4765428bcd66c5715dbe1472857e599135abc488"}
Sep 15 13:41:16.552716 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:16.552673    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7858577f6b-cq5lv" event={"ID":"b2cb6bb0-0b7c-4693-8513-87ce074ce7ed","Type":"ContainerStarted","Data":"9993b8060608c89051c4a27d90ae0274ad4244b3bbd3d6d77920822b9b4aa887"}
Sep 15 13:41:16.570281 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:16.570236    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7858577f6b-cq5lv" podStartSLOduration=1.570221364 podStartE2EDuration="1.570221364s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:41:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:41:16.569240297 +0000 UTC m=+163.328366607" watchObservedRunningTime="2026-09-15 13:41:16.570221364 +0000 UTC m=+163.329347650"
Sep 15 13:41:25.976620 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:25.976515    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7858577f6b-cq5lv"
Sep 15 13:41:25.976620 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:25.976597    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7858577f6b-cq5lv"
Sep 15 13:41:25.981355 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:25.981331    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7858577f6b-cq5lv"
Sep 15 13:41:26.592657 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:26.592627    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7858577f6b-cq5lv"
Sep 15 13:41:26.638619 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:26.638573    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6454ccbd44-5nw6f"]
Sep 15 13:41:51.660282 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:51.660235    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6454ccbd44-5nw6f" podUID="4674ba52-3636-44ac-9354-ab763878d540" containerName="console" containerID="cri-o://720c957dc68f7f3709ea96b687e8fcee0d431cdeed87f6baed3b4176980a2cbf" gracePeriod=15
Sep 15 13:41:51.899795 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:51.899770    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6454ccbd44-5nw6f"
Sep 15 13:41:52.024354 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:52.024275    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4674ba52-3636-44ac-9354-ab763878d540-trusted-ca-bundle\") pod \"4674ba52-3636-44ac-9354-ab763878d540\" (UID: \"4674ba52-3636-44ac-9354-ab763878d540\") "
Sep 15 13:41:52.024354 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:52.024307    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4674ba52-3636-44ac-9354-ab763878d540-console-config\") pod \"4674ba52-3636-44ac-9354-ab763878d540\" (UID: \"4674ba52-3636-44ac-9354-ab763878d540\") "
Sep 15 13:41:52.024354 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:52.024330    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4674ba52-3636-44ac-9354-ab763878d540-console-serving-cert\") pod \"4674ba52-3636-44ac-9354-ab763878d540\" (UID: \"4674ba52-3636-44ac-9354-ab763878d540\") "
Sep 15 13:41:52.024354 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:52.024354    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4674ba52-3636-44ac-9354-ab763878d540-oauth-serving-cert\") pod \"4674ba52-3636-44ac-9354-ab763878d540\" (UID: \"4674ba52-3636-44ac-9354-ab763878d540\") "
Sep 15 13:41:52.024613 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:52.024578    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4674ba52-3636-44ac-9354-ab763878d540-console-oauth-config\") pod \"4674ba52-3636-44ac-9354-ab763878d540\" (UID: \"4674ba52-3636-44ac-9354-ab763878d540\") "
Sep 15 13:41:52.024671 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:52.024655    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4674ba52-3636-44ac-9354-ab763878d540-service-ca\") pod \"4674ba52-3636-44ac-9354-ab763878d540\" (UID: \"4674ba52-3636-44ac-9354-ab763878d540\") "
Sep 15 13:41:52.024744 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:52.024658    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4674ba52-3636-44ac-9354-ab763878d540-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "4674ba52-3636-44ac-9354-ab763878d540" (UID: "4674ba52-3636-44ac-9354-ab763878d540"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 13:41:52.024744 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:52.024706    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rx2k9\" (UniqueName: \"kubernetes.io/projected/4674ba52-3636-44ac-9354-ab763878d540-kube-api-access-rx2k9\") pod \"4674ba52-3636-44ac-9354-ab763878d540\" (UID: \"4674ba52-3636-44ac-9354-ab763878d540\") "
Sep 15 13:41:52.024744 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:52.024727    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4674ba52-3636-44ac-9354-ab763878d540-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4674ba52-3636-44ac-9354-ab763878d540" (UID: "4674ba52-3636-44ac-9354-ab763878d540"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 13:41:52.024744 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:52.024733    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4674ba52-3636-44ac-9354-ab763878d540-console-config" (OuterVolumeSpecName: "console-config") pod "4674ba52-3636-44ac-9354-ab763878d540" (UID: "4674ba52-3636-44ac-9354-ab763878d540"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 13:41:52.024990 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:52.024969    2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4674ba52-3636-44ac-9354-ab763878d540-oauth-serving-cert\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:41:52.025076 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:52.024995    2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4674ba52-3636-44ac-9354-ab763878d540-trusted-ca-bundle\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:41:52.025076 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:52.025009    2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4674ba52-3636-44ac-9354-ab763878d540-console-config\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:41:52.025076 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:52.025049    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4674ba52-3636-44ac-9354-ab763878d540-service-ca" (OuterVolumeSpecName: "service-ca") pod "4674ba52-3636-44ac-9354-ab763878d540" (UID: "4674ba52-3636-44ac-9354-ab763878d540"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 13:41:52.026675 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:52.026643    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4674ba52-3636-44ac-9354-ab763878d540-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4674ba52-3636-44ac-9354-ab763878d540" (UID: "4674ba52-3636-44ac-9354-ab763878d540"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 13:41:52.026763 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:52.026710    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4674ba52-3636-44ac-9354-ab763878d540-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4674ba52-3636-44ac-9354-ab763878d540" (UID: "4674ba52-3636-44ac-9354-ab763878d540"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 13:41:52.026866 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:52.026846    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4674ba52-3636-44ac-9354-ab763878d540-kube-api-access-rx2k9" (OuterVolumeSpecName: "kube-api-access-rx2k9") pod "4674ba52-3636-44ac-9354-ab763878d540" (UID: "4674ba52-3636-44ac-9354-ab763878d540"). InnerVolumeSpecName "kube-api-access-rx2k9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:41:52.126400 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:52.126362    2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4674ba52-3636-44ac-9354-ab763878d540-service-ca\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:41:52.126400 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:52.126393    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rx2k9\" (UniqueName: \"kubernetes.io/projected/4674ba52-3636-44ac-9354-ab763878d540-kube-api-access-rx2k9\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:41:52.126400 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:52.126402    2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4674ba52-3636-44ac-9354-ab763878d540-console-serving-cert\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:41:52.126614 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:52.126411    2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4674ba52-3636-44ac-9354-ab763878d540-console-oauth-config\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:41:52.686226 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:52.686188    2578 generic.go:356] "Generic (PLEG): container finished" podID="4674ba52-3636-44ac-9354-ab763878d540" containerID="720c957dc68f7f3709ea96b687e8fcee0d431cdeed87f6baed3b4176980a2cbf" exitCode=0
Sep 15 13:41:52.686666 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:52.686237    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6454ccbd44-5nw6f"
Sep 15 13:41:52.686666 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:52.686273    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6454ccbd44-5nw6f" event={"ID":"4674ba52-3636-44ac-9354-ab763878d540","Type":"ContainerDied","Data":"720c957dc68f7f3709ea96b687e8fcee0d431cdeed87f6baed3b4176980a2cbf"}
Sep 15 13:41:52.686666 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:52.686325    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6454ccbd44-5nw6f" event={"ID":"4674ba52-3636-44ac-9354-ab763878d540","Type":"ContainerDied","Data":"51b6245eec132eab378e2bea2e7a0b8276ce72bba5a7b81fe48d800da57b0aff"}
Sep 15 13:41:52.686666 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:52.686348    2578 scope.go:117] "RemoveContainer" containerID="720c957dc68f7f3709ea96b687e8fcee0d431cdeed87f6baed3b4176980a2cbf"
Sep 15 13:41:52.694910 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:52.694893    2578 scope.go:117] "RemoveContainer" containerID="720c957dc68f7f3709ea96b687e8fcee0d431cdeed87f6baed3b4176980a2cbf"
Sep 15 13:41:52.695199 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:41:52.695169    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"720c957dc68f7f3709ea96b687e8fcee0d431cdeed87f6baed3b4176980a2cbf\": container with ID starting with 720c957dc68f7f3709ea96b687e8fcee0d431cdeed87f6baed3b4176980a2cbf not found: ID does not exist" containerID="720c957dc68f7f3709ea96b687e8fcee0d431cdeed87f6baed3b4176980a2cbf"
Sep 15 13:41:52.695295 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:52.695196    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"720c957dc68f7f3709ea96b687e8fcee0d431cdeed87f6baed3b4176980a2cbf"} err="failed to get container status \"720c957dc68f7f3709ea96b687e8fcee0d431cdeed87f6baed3b4176980a2cbf\": rpc error: code = NotFound desc = could not find container \"720c957dc68f7f3709ea96b687e8fcee0d431cdeed87f6baed3b4176980a2cbf\": container with ID starting with 720c957dc68f7f3709ea96b687e8fcee0d431cdeed87f6baed3b4176980a2cbf not found: ID does not exist"
Sep 15 13:41:52.706055 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:52.706036    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6454ccbd44-5nw6f"]
Sep 15 13:41:52.709852 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:52.709832    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6454ccbd44-5nw6f"]
Sep 15 13:41:53.756173 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:41:53.756112    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4674ba52-3636-44ac-9354-ab763878d540" path="/var/lib/kubelet/pods/4674ba52-3636-44ac-9354-ab763878d540/volumes"
Sep 15 13:42:41.603213 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:42:41.603182    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-846b8bbf66-952lx"]
Sep 15 13:42:41.603634 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:42:41.603470    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4674ba52-3636-44ac-9354-ab763878d540" containerName="console"
Sep 15 13:42:41.603634 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:42:41.603481    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4674ba52-3636-44ac-9354-ab763878d540" containerName="console"
Sep 15 13:42:41.603634 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:42:41.603535    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="4674ba52-3636-44ac-9354-ab763878d540" containerName="console"
Sep 15 13:42:41.607586 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:42:41.607566    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-846b8bbf66-952lx"
Sep 15 13:42:41.620173 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:42:41.620119    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-846b8bbf66-952lx"]
Sep 15 13:42:41.712785 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:42:41.712748    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7ca8f112-ac2a-4653-896f-f09c53976903-console-config\") pod \"console-846b8bbf66-952lx\" (UID: \"7ca8f112-ac2a-4653-896f-f09c53976903\") " pod="openshift-console/console-846b8bbf66-952lx"
Sep 15 13:42:41.712785 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:42:41.712787    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vkvt\" (UniqueName: \"kubernetes.io/projected/7ca8f112-ac2a-4653-896f-f09c53976903-kube-api-access-6vkvt\") pod \"console-846b8bbf66-952lx\" (UID: \"7ca8f112-ac2a-4653-896f-f09c53976903\") " pod="openshift-console/console-846b8bbf66-952lx"
Sep 15 13:42:41.713025 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:42:41.712807    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7ca8f112-ac2a-4653-896f-f09c53976903-console-serving-cert\") pod \"console-846b8bbf66-952lx\" (UID: \"7ca8f112-ac2a-4653-896f-f09c53976903\") " pod="openshift-console/console-846b8bbf66-952lx"
Sep 15 13:42:41.713025 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:42:41.712875    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ca8f112-ac2a-4653-896f-f09c53976903-trusted-ca-bundle\") pod \"console-846b8bbf66-952lx\" (UID: \"7ca8f112-ac2a-4653-896f-f09c53976903\") " pod="openshift-console/console-846b8bbf66-952lx"
Sep 15 13:42:41.713025 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:42:41.712937    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7ca8f112-ac2a-4653-896f-f09c53976903-oauth-serving-cert\") pod \"console-846b8bbf66-952lx\" (UID: \"7ca8f112-ac2a-4653-896f-f09c53976903\") " pod="openshift-console/console-846b8bbf66-952lx"
Sep 15 13:42:41.713025 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:42:41.712960    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7ca8f112-ac2a-4653-896f-f09c53976903-console-oauth-config\") pod \"console-846b8bbf66-952lx\" (UID: \"7ca8f112-ac2a-4653-896f-f09c53976903\") " pod="openshift-console/console-846b8bbf66-952lx"
Sep 15 13:42:41.713025 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:42:41.713001    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7ca8f112-ac2a-4653-896f-f09c53976903-service-ca\") pod \"console-846b8bbf66-952lx\" (UID: \"7ca8f112-ac2a-4653-896f-f09c53976903\") " pod="openshift-console/console-846b8bbf66-952lx"
Sep 15 13:42:41.814109 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:42:41.814073    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7ca8f112-ac2a-4653-896f-f09c53976903-console-config\") pod \"console-846b8bbf66-952lx\" (UID: \"7ca8f112-ac2a-4653-896f-f09c53976903\") " pod="openshift-console/console-846b8bbf66-952lx"
Sep 15 13:42:41.814109 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:42:41.814113    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vkvt\" (UniqueName: \"kubernetes.io/projected/7ca8f112-ac2a-4653-896f-f09c53976903-kube-api-access-6vkvt\") pod \"console-846b8bbf66-952lx\" (UID: \"7ca8f112-ac2a-4653-896f-f09c53976903\") " pod="openshift-console/console-846b8bbf66-952lx"
Sep 15 13:42:41.814378 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:42:41.814157    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7ca8f112-ac2a-4653-896f-f09c53976903-console-serving-cert\") pod \"console-846b8bbf66-952lx\" (UID: \"7ca8f112-ac2a-4653-896f-f09c53976903\") " pod="openshift-console/console-846b8bbf66-952lx"
Sep 15 13:42:41.814378 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:42:41.814180    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ca8f112-ac2a-4653-896f-f09c53976903-trusted-ca-bundle\") pod \"console-846b8bbf66-952lx\" (UID: \"7ca8f112-ac2a-4653-896f-f09c53976903\") " pod="openshift-console/console-846b8bbf66-952lx"
Sep 15 13:42:41.814378 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:42:41.814212    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7ca8f112-ac2a-4653-896f-f09c53976903-oauth-serving-cert\") pod \"console-846b8bbf66-952lx\" (UID: \"7ca8f112-ac2a-4653-896f-f09c53976903\") " pod="openshift-console/console-846b8bbf66-952lx"
Sep 15 13:42:41.814378 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:42:41.814237    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7ca8f112-ac2a-4653-896f-f09c53976903-console-oauth-config\") pod \"console-846b8bbf66-952lx\" (UID: \"7ca8f112-ac2a-4653-896f-f09c53976903\") " pod="openshift-console/console-846b8bbf66-952lx"
Sep 15 13:42:41.814378 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:42:41.814329    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7ca8f112-ac2a-4653-896f-f09c53976903-service-ca\") pod \"console-846b8bbf66-952lx\" (UID: \"7ca8f112-ac2a-4653-896f-f09c53976903\") " pod="openshift-console/console-846b8bbf66-952lx"
Sep 15 13:42:41.814938 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:42:41.814909    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7ca8f112-ac2a-4653-896f-f09c53976903-console-config\") pod \"console-846b8bbf66-952lx\" (UID: \"7ca8f112-ac2a-4653-896f-f09c53976903\") " pod="openshift-console/console-846b8bbf66-952lx"
Sep 15 13:42:41.815047 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:42:41.814921    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7ca8f112-ac2a-4653-896f-f09c53976903-oauth-serving-cert\") pod \"console-846b8bbf66-952lx\" (UID: \"7ca8f112-ac2a-4653-896f-f09c53976903\") " pod="openshift-console/console-846b8bbf66-952lx"
Sep 15 13:42:41.815088 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:42:41.815055    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7ca8f112-ac2a-4653-896f-f09c53976903-service-ca\") pod \"console-846b8bbf66-952lx\" (UID: \"7ca8f112-ac2a-4653-896f-f09c53976903\") " pod="openshift-console/console-846b8bbf66-952lx"
Sep 15 13:42:41.815088 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:42:41.815061    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ca8f112-ac2a-4653-896f-f09c53976903-trusted-ca-bundle\") pod \"console-846b8bbf66-952lx\" (UID: \"7ca8f112-ac2a-4653-896f-f09c53976903\") " pod="openshift-console/console-846b8bbf66-952lx"
Sep 15 13:42:41.816762 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:42:41.816732    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7ca8f112-ac2a-4653-896f-f09c53976903-console-oauth-config\") pod \"console-846b8bbf66-952lx\" (UID: \"7ca8f112-ac2a-4653-896f-f09c53976903\") " pod="openshift-console/console-846b8bbf66-952lx"
Sep 15 13:42:41.816927 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:42:41.816908    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7ca8f112-ac2a-4653-896f-f09c53976903-console-serving-cert\") pod \"console-846b8bbf66-952lx\" (UID: \"7ca8f112-ac2a-4653-896f-f09c53976903\") " pod="openshift-console/console-846b8bbf66-952lx"
Sep 15 13:42:41.822038 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:42:41.822018    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vkvt\" (UniqueName: \"kubernetes.io/projected/7ca8f112-ac2a-4653-896f-f09c53976903-kube-api-access-6vkvt\") pod \"console-846b8bbf66-952lx\" (UID: \"7ca8f112-ac2a-4653-896f-f09c53976903\") " pod="openshift-console/console-846b8bbf66-952lx"
Sep 15 13:42:41.916730 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:42:41.916642    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-846b8bbf66-952lx"
Sep 15 13:42:42.188602 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:42:42.188578    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-846b8bbf66-952lx"]
Sep 15 13:42:42.190638 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:42:42.190605    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ca8f112_ac2a_4653_896f_f09c53976903.slice/crio-d0d2f6118ef1f3be1bf8ce6e8f958a8b5a1e1ded34eec12800eb31e840638046 WatchSource:0}: Error finding container d0d2f6118ef1f3be1bf8ce6e8f958a8b5a1e1ded34eec12800eb31e840638046: Status 404 returned error can't find the container with id d0d2f6118ef1f3be1bf8ce6e8f958a8b5a1e1ded34eec12800eb31e840638046
Sep 15 13:42:42.864090 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:42:42.864054    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-846b8bbf66-952lx" event={"ID":"7ca8f112-ac2a-4653-896f-f09c53976903","Type":"ContainerStarted","Data":"6963934d88a155ef16a1af0981647ebababb6ed454e7869b0a6ecf043a4e5067"}
Sep 15 13:42:42.864479 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:42:42.864149    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-846b8bbf66-952lx" event={"ID":"7ca8f112-ac2a-4653-896f-f09c53976903","Type":"ContainerStarted","Data":"d0d2f6118ef1f3be1bf8ce6e8f958a8b5a1e1ded34eec12800eb31e840638046"}
Sep 15 13:42:42.883369 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:42:42.883322    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-846b8bbf66-952lx" podStartSLOduration=1.883307117 podStartE2EDuration="1.883307117s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:42:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:42:42.882118126 +0000 UTC m=+249.641244413" watchObservedRunningTime="2026-09-15 13:42:42.883307117 +0000 UTC m=+249.642433403"
Sep 15 13:42:51.917173 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:42:51.917110    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-846b8bbf66-952lx"
Sep 15 13:42:51.917629 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:42:51.917200    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-846b8bbf66-952lx"
Sep 15 13:42:51.921981 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:42:51.921961    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-846b8bbf66-952lx"
Sep 15 13:42:52.903336 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:42:52.903308    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-846b8bbf66-952lx"
Sep 15 13:42:52.953368 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:42:52.953334    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7858577f6b-cq5lv"]
Sep 15 13:43:17.973918 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:17.973860    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7858577f6b-cq5lv" podUID="b2cb6bb0-0b7c-4693-8513-87ce074ce7ed" containerName="console" containerID="cri-o://efe24b852bbae2f8d95bcfed4765428bcd66c5715dbe1472857e599135abc488" gracePeriod=15
Sep 15 13:43:18.211603 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:18.211579    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7858577f6b-cq5lv"
Sep 15 13:43:18.318130 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:18.318098    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b2cb6bb0-0b7c-4693-8513-87ce074ce7ed-console-oauth-config\") pod \"b2cb6bb0-0b7c-4693-8513-87ce074ce7ed\" (UID: \"b2cb6bb0-0b7c-4693-8513-87ce074ce7ed\") "
Sep 15 13:43:18.318283 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:18.318172    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b2cb6bb0-0b7c-4693-8513-87ce074ce7ed-console-serving-cert\") pod \"b2cb6bb0-0b7c-4693-8513-87ce074ce7ed\" (UID: \"b2cb6bb0-0b7c-4693-8513-87ce074ce7ed\") "
Sep 15 13:43:18.318283 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:18.318198    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b2cb6bb0-0b7c-4693-8513-87ce074ce7ed-oauth-serving-cert\") pod \"b2cb6bb0-0b7c-4693-8513-87ce074ce7ed\" (UID: \"b2cb6bb0-0b7c-4693-8513-87ce074ce7ed\") "
Sep 15 13:43:18.318283 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:18.318222    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b2cb6bb0-0b7c-4693-8513-87ce074ce7ed-console-config\") pod \"b2cb6bb0-0b7c-4693-8513-87ce074ce7ed\" (UID: \"b2cb6bb0-0b7c-4693-8513-87ce074ce7ed\") "
Sep 15 13:43:18.318283 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:18.318260    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b2cb6bb0-0b7c-4693-8513-87ce074ce7ed-service-ca\") pod \"b2cb6bb0-0b7c-4693-8513-87ce074ce7ed\" (UID: \"b2cb6bb0-0b7c-4693-8513-87ce074ce7ed\") "
Sep 15 13:43:18.318482 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:18.318371    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-429jt\" (UniqueName: \"kubernetes.io/projected/b2cb6bb0-0b7c-4693-8513-87ce074ce7ed-kube-api-access-429jt\") pod \"b2cb6bb0-0b7c-4693-8513-87ce074ce7ed\" (UID: \"b2cb6bb0-0b7c-4693-8513-87ce074ce7ed\") "
Sep 15 13:43:18.318482 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:18.318435    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2cb6bb0-0b7c-4693-8513-87ce074ce7ed-trusted-ca-bundle\") pod \"b2cb6bb0-0b7c-4693-8513-87ce074ce7ed\" (UID: \"b2cb6bb0-0b7c-4693-8513-87ce074ce7ed\") "
Sep 15 13:43:18.318704 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:18.318673    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2cb6bb0-0b7c-4693-8513-87ce074ce7ed-service-ca" (OuterVolumeSpecName: "service-ca") pod "b2cb6bb0-0b7c-4693-8513-87ce074ce7ed" (UID: "b2cb6bb0-0b7c-4693-8513-87ce074ce7ed"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 13:43:18.318704 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:18.318687    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2cb6bb0-0b7c-4693-8513-87ce074ce7ed-console-config" (OuterVolumeSpecName: "console-config") pod "b2cb6bb0-0b7c-4693-8513-87ce074ce7ed" (UID: "b2cb6bb0-0b7c-4693-8513-87ce074ce7ed"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 13:43:18.318870 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:18.318677    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2cb6bb0-0b7c-4693-8513-87ce074ce7ed-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b2cb6bb0-0b7c-4693-8513-87ce074ce7ed" (UID: "b2cb6bb0-0b7c-4693-8513-87ce074ce7ed"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 13:43:18.319229 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:18.319201    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2cb6bb0-0b7c-4693-8513-87ce074ce7ed-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b2cb6bb0-0b7c-4693-8513-87ce074ce7ed" (UID: "b2cb6bb0-0b7c-4693-8513-87ce074ce7ed"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 13:43:18.320509 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:18.320488    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2cb6bb0-0b7c-4693-8513-87ce074ce7ed-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b2cb6bb0-0b7c-4693-8513-87ce074ce7ed" (UID: "b2cb6bb0-0b7c-4693-8513-87ce074ce7ed"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 13:43:18.320572 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:18.320505    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2cb6bb0-0b7c-4693-8513-87ce074ce7ed-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b2cb6bb0-0b7c-4693-8513-87ce074ce7ed" (UID: "b2cb6bb0-0b7c-4693-8513-87ce074ce7ed"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 13:43:18.320611 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:18.320587    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2cb6bb0-0b7c-4693-8513-87ce074ce7ed-kube-api-access-429jt" (OuterVolumeSpecName: "kube-api-access-429jt") pod "b2cb6bb0-0b7c-4693-8513-87ce074ce7ed" (UID: "b2cb6bb0-0b7c-4693-8513-87ce074ce7ed"). InnerVolumeSpecName "kube-api-access-429jt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:43:18.419201 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:18.419151    2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2cb6bb0-0b7c-4693-8513-87ce074ce7ed-trusted-ca-bundle\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:43:18.419201 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:18.419193    2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b2cb6bb0-0b7c-4693-8513-87ce074ce7ed-console-oauth-config\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:43:18.419201 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:18.419203    2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b2cb6bb0-0b7c-4693-8513-87ce074ce7ed-console-serving-cert\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:43:18.419201 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:18.419212    2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b2cb6bb0-0b7c-4693-8513-87ce074ce7ed-oauth-serving-cert\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:43:18.419201 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:18.419221    2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b2cb6bb0-0b7c-4693-8513-87ce074ce7ed-console-config\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:43:18.419490 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:18.419229    2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b2cb6bb0-0b7c-4693-8513-87ce074ce7ed-service-ca\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:43:18.419490 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:18.419236    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-429jt\" (UniqueName: \"kubernetes.io/projected/b2cb6bb0-0b7c-4693-8513-87ce074ce7ed-kube-api-access-429jt\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:43:18.995675 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:18.995639    2578 generic.go:356] "Generic (PLEG): container finished" podID="b2cb6bb0-0b7c-4693-8513-87ce074ce7ed" containerID="efe24b852bbae2f8d95bcfed4765428bcd66c5715dbe1472857e599135abc488" exitCode=0
Sep 15 13:43:18.996172 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:18.995688    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7858577f6b-cq5lv"
Sep 15 13:43:18.996172 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:18.995724    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7858577f6b-cq5lv" event={"ID":"b2cb6bb0-0b7c-4693-8513-87ce074ce7ed","Type":"ContainerDied","Data":"efe24b852bbae2f8d95bcfed4765428bcd66c5715dbe1472857e599135abc488"}
Sep 15 13:43:18.996172 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:18.995773    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7858577f6b-cq5lv" event={"ID":"b2cb6bb0-0b7c-4693-8513-87ce074ce7ed","Type":"ContainerDied","Data":"9993b8060608c89051c4a27d90ae0274ad4244b3bbd3d6d77920822b9b4aa887"}
Sep 15 13:43:18.996172 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:18.995792    2578 scope.go:117] "RemoveContainer" containerID="efe24b852bbae2f8d95bcfed4765428bcd66c5715dbe1472857e599135abc488"
Sep 15 13:43:19.004677 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:19.004664    2578 scope.go:117] "RemoveContainer" containerID="efe24b852bbae2f8d95bcfed4765428bcd66c5715dbe1472857e599135abc488"
Sep 15 13:43:19.004943 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:43:19.004927    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"efe24b852bbae2f8d95bcfed4765428bcd66c5715dbe1472857e599135abc488\": container with ID starting with efe24b852bbae2f8d95bcfed4765428bcd66c5715dbe1472857e599135abc488 not found: ID does not exist" containerID="efe24b852bbae2f8d95bcfed4765428bcd66c5715dbe1472857e599135abc488"
Sep 15 13:43:19.004991 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:19.004951    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"efe24b852bbae2f8d95bcfed4765428bcd66c5715dbe1472857e599135abc488"} err="failed to get container status \"efe24b852bbae2f8d95bcfed4765428bcd66c5715dbe1472857e599135abc488\": rpc error: code = NotFound desc = could not find container \"efe24b852bbae2f8d95bcfed4765428bcd66c5715dbe1472857e599135abc488\": container with ID starting with efe24b852bbae2f8d95bcfed4765428bcd66c5715dbe1472857e599135abc488 not found: ID does not exist"
Sep 15 13:43:19.018331 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:19.018308    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7858577f6b-cq5lv"]
Sep 15 13:43:19.021664 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:19.021645    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7858577f6b-cq5lv"]
Sep 15 13:43:19.756133 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:19.756085    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b2cb6bb0-0b7c-4693-8513-87ce074ce7ed" path="/var/lib/kubelet/pods/b2cb6bb0-0b7c-4693-8513-87ce074ce7ed/volumes"
Sep 15 13:43:23.557415 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:23.557380    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t6xzd"]
Sep 15 13:43:23.558082 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:23.557669    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2cb6bb0-0b7c-4693-8513-87ce074ce7ed" containerName="console"
Sep 15 13:43:23.558082 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:23.557680    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2cb6bb0-0b7c-4693-8513-87ce074ce7ed" containerName="console"
Sep 15 13:43:23.558082 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:23.557730    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2cb6bb0-0b7c-4693-8513-87ce074ce7ed" containerName="console"
Sep 15 13:43:23.562303 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:23.562286    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t6xzd"
Sep 15 13:43:23.564569 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:23.564544    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 15 13:43:23.564670 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:23.564607    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-bjmkq\""
Sep 15 13:43:23.564670 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:23.564648    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 15 13:43:23.568510 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:23.568489    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t6xzd"]
Sep 15 13:43:23.660603 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:23.660559    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/24740c84-5150-4c40-a2b8-bc5da69146c9-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t6xzd\" (UID: \"24740c84-5150-4c40-a2b8-bc5da69146c9\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t6xzd"
Sep 15 13:43:23.660774 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:23.660634    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7dfc\" (UniqueName: \"kubernetes.io/projected/24740c84-5150-4c40-a2b8-bc5da69146c9-kube-api-access-z7dfc\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t6xzd\" (UID: \"24740c84-5150-4c40-a2b8-bc5da69146c9\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t6xzd"
Sep 15 13:43:23.660774 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:23.660660    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/24740c84-5150-4c40-a2b8-bc5da69146c9-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t6xzd\" (UID: \"24740c84-5150-4c40-a2b8-bc5da69146c9\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t6xzd"
Sep 15 13:43:23.761434 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:23.761402    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7dfc\" (UniqueName: \"kubernetes.io/projected/24740c84-5150-4c40-a2b8-bc5da69146c9-kube-api-access-z7dfc\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t6xzd\" (UID: \"24740c84-5150-4c40-a2b8-bc5da69146c9\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t6xzd"
Sep 15 13:43:23.761434 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:23.761438    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/24740c84-5150-4c40-a2b8-bc5da69146c9-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t6xzd\" (UID: \"24740c84-5150-4c40-a2b8-bc5da69146c9\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t6xzd"
Sep 15 13:43:23.761665 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:23.761515    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/24740c84-5150-4c40-a2b8-bc5da69146c9-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t6xzd\" (UID: \"24740c84-5150-4c40-a2b8-bc5da69146c9\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t6xzd"
Sep 15 13:43:23.761879 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:23.761858    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/24740c84-5150-4c40-a2b8-bc5da69146c9-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t6xzd\" (UID: \"24740c84-5150-4c40-a2b8-bc5da69146c9\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t6xzd"
Sep 15 13:43:23.761956 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:23.761896    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/24740c84-5150-4c40-a2b8-bc5da69146c9-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t6xzd\" (UID: \"24740c84-5150-4c40-a2b8-bc5da69146c9\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t6xzd"
Sep 15 13:43:23.770255 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:23.770236    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7dfc\" (UniqueName: \"kubernetes.io/projected/24740c84-5150-4c40-a2b8-bc5da69146c9-kube-api-access-z7dfc\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t6xzd\" (UID: \"24740c84-5150-4c40-a2b8-bc5da69146c9\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t6xzd"
Sep 15 13:43:23.872085 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:23.872003    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t6xzd"
Sep 15 13:43:24.141268 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:24.141244    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t6xzd"]
Sep 15 13:43:24.143825 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:43:24.143798    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24740c84_5150_4c40_a2b8_bc5da69146c9.slice/crio-0ee57206f289fc32af983f1d908dfac0db4edb8c9eecf3b654bf1b6cb714ce96 WatchSource:0}: Error finding container 0ee57206f289fc32af983f1d908dfac0db4edb8c9eecf3b654bf1b6cb714ce96: Status 404 returned error can't find the container with id 0ee57206f289fc32af983f1d908dfac0db4edb8c9eecf3b654bf1b6cb714ce96
Sep 15 13:43:25.019045 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:25.019008    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t6xzd" event={"ID":"24740c84-5150-4c40-a2b8-bc5da69146c9","Type":"ContainerStarted","Data":"0ee57206f289fc32af983f1d908dfac0db4edb8c9eecf3b654bf1b6cb714ce96"}
Sep 15 13:43:31.048780 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:31.048744    2578 generic.go:356] "Generic (PLEG): container finished" podID="24740c84-5150-4c40-a2b8-bc5da69146c9" containerID="397a9f252deef2dad319b21a732b134f3105cdb58fb60f7403f963e64dd9196e" exitCode=0
Sep 15 13:43:31.049264 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:31.048794    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t6xzd" event={"ID":"24740c84-5150-4c40-a2b8-bc5da69146c9","Type":"ContainerDied","Data":"397a9f252deef2dad319b21a732b134f3105cdb58fb60f7403f963e64dd9196e"}
Sep 15 13:43:33.661039 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:33.660976    2578 kubelet.go:1648] "Image garbage collection succeeded"
Sep 15 13:43:34.064661 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:34.064625    2578 generic.go:356] "Generic (PLEG): container finished" podID="24740c84-5150-4c40-a2b8-bc5da69146c9" containerID="337e55db17d47ac393881b0e32d4b60621ea0c7d7e1417bf4047a5775d84066b" exitCode=0
Sep 15 13:43:34.066715 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:34.064697    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t6xzd" event={"ID":"24740c84-5150-4c40-a2b8-bc5da69146c9","Type":"ContainerDied","Data":"337e55db17d47ac393881b0e32d4b60621ea0c7d7e1417bf4047a5775d84066b"}
Sep 15 13:43:42.096459 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:42.096429    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t6xzd" event={"ID":"24740c84-5150-4c40-a2b8-bc5da69146c9","Type":"ContainerStarted","Data":"1d6f4c83eb1d83a5c98042404f0cde5a3356799dcbfcbb2d5b96d6e18014ba4b"}
Sep 15 13:43:42.114793 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:42.114749    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t6xzd" podStartSLOduration=2.2976525 podStartE2EDuration="19.114734464s" totalImagesPullingTime="16.817081964s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:43:23 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:43:42.113542365 +0000 UTC m=+308.872668651" watchObservedRunningTime="2026-09-15 13:43:42.114734464 +0000 UTC m=+308.873860750"
Sep 15 13:43:43.101721 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:43.101687    2578 generic.go:356] "Generic (PLEG): container finished" podID="24740c84-5150-4c40-a2b8-bc5da69146c9" containerID="1d6f4c83eb1d83a5c98042404f0cde5a3356799dcbfcbb2d5b96d6e18014ba4b" exitCode=0
Sep 15 13:43:43.102096 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:43.101775    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t6xzd" event={"ID":"24740c84-5150-4c40-a2b8-bc5da69146c9","Type":"ContainerDied","Data":"1d6f4c83eb1d83a5c98042404f0cde5a3356799dcbfcbb2d5b96d6e18014ba4b"}
Sep 15 13:43:44.221777 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:44.221756    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t6xzd"
Sep 15 13:43:44.347728 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:44.347693    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z7dfc\" (UniqueName: \"kubernetes.io/projected/24740c84-5150-4c40-a2b8-bc5da69146c9-kube-api-access-z7dfc\") pod \"24740c84-5150-4c40-a2b8-bc5da69146c9\" (UID: \"24740c84-5150-4c40-a2b8-bc5da69146c9\") "
Sep 15 13:43:44.347872 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:44.347749    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/24740c84-5150-4c40-a2b8-bc5da69146c9-bundle\") pod \"24740c84-5150-4c40-a2b8-bc5da69146c9\" (UID: \"24740c84-5150-4c40-a2b8-bc5da69146c9\") "
Sep 15 13:43:44.347872 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:44.347806    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/24740c84-5150-4c40-a2b8-bc5da69146c9-util\") pod \"24740c84-5150-4c40-a2b8-bc5da69146c9\" (UID: \"24740c84-5150-4c40-a2b8-bc5da69146c9\") "
Sep 15 13:43:44.348476 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:44.348452    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24740c84-5150-4c40-a2b8-bc5da69146c9-bundle" (OuterVolumeSpecName: "bundle") pod "24740c84-5150-4c40-a2b8-bc5da69146c9" (UID: "24740c84-5150-4c40-a2b8-bc5da69146c9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:43:44.350089 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:44.350061    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24740c84-5150-4c40-a2b8-bc5da69146c9-kube-api-access-z7dfc" (OuterVolumeSpecName: "kube-api-access-z7dfc") pod "24740c84-5150-4c40-a2b8-bc5da69146c9" (UID: "24740c84-5150-4c40-a2b8-bc5da69146c9"). InnerVolumeSpecName "kube-api-access-z7dfc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:43:44.352008 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:44.351988    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24740c84-5150-4c40-a2b8-bc5da69146c9-util" (OuterVolumeSpecName: "util") pod "24740c84-5150-4c40-a2b8-bc5da69146c9" (UID: "24740c84-5150-4c40-a2b8-bc5da69146c9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:43:44.448519 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:44.448445    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/24740c84-5150-4c40-a2b8-bc5da69146c9-util\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:43:44.448519 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:44.448479    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z7dfc\" (UniqueName: \"kubernetes.io/projected/24740c84-5150-4c40-a2b8-bc5da69146c9-kube-api-access-z7dfc\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:43:44.448519 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:44.448495    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/24740c84-5150-4c40-a2b8-bc5da69146c9-bundle\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:43:45.110139 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:45.110099    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t6xzd"
Sep 15 13:43:45.110139 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:45.110103    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t6xzd" event={"ID":"24740c84-5150-4c40-a2b8-bc5da69146c9","Type":"ContainerDied","Data":"0ee57206f289fc32af983f1d908dfac0db4edb8c9eecf3b654bf1b6cb714ce96"}
Sep 15 13:43:45.110334 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:45.110173    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0ee57206f289fc32af983f1d908dfac0db4edb8c9eecf3b654bf1b6cb714ce96"
Sep 15 13:43:51.569351 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:51.569317    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zk6ls"]
Sep 15 13:43:51.569725 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:51.569612    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24740c84-5150-4c40-a2b8-bc5da69146c9" containerName="extract"
Sep 15 13:43:51.569725 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:51.569625    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="24740c84-5150-4c40-a2b8-bc5da69146c9" containerName="extract"
Sep 15 13:43:51.569725 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:51.569635    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24740c84-5150-4c40-a2b8-bc5da69146c9" containerName="pull"
Sep 15 13:43:51.569725 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:51.569640    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="24740c84-5150-4c40-a2b8-bc5da69146c9" containerName="pull"
Sep 15 13:43:51.569725 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:51.569657    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24740c84-5150-4c40-a2b8-bc5da69146c9" containerName="util"
Sep 15 13:43:51.569725 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:51.569662    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="24740c84-5150-4c40-a2b8-bc5da69146c9" containerName="util"
Sep 15 13:43:51.569725 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:51.569707    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="24740c84-5150-4c40-a2b8-bc5da69146c9" containerName="extract"
Sep 15 13:43:51.573042 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:51.573023    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zk6ls"
Sep 15 13:43:51.575660 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:51.575636    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Sep 15 13:43:51.575744 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:51.575636    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Sep 15 13:43:51.575795 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:51.575780    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-j4rc5\""
Sep 15 13:43:51.590077 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:51.590055    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zk6ls"]
Sep 15 13:43:51.710615 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:51.710582    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/248e545e-46bb-4db6-911d-19dc17534c15-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-zk6ls\" (UID: \"248e545e-46bb-4db6-911d-19dc17534c15\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zk6ls"
Sep 15 13:43:51.710809 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:51.710633    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6x5m\" (UniqueName: \"kubernetes.io/projected/248e545e-46bb-4db6-911d-19dc17534c15-kube-api-access-f6x5m\") pod \"cert-manager-operator-controller-manager-55c444bf86-zk6ls\" (UID: \"248e545e-46bb-4db6-911d-19dc17534c15\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zk6ls"
Sep 15 13:43:51.811543 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:51.811494    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6x5m\" (UniqueName: \"kubernetes.io/projected/248e545e-46bb-4db6-911d-19dc17534c15-kube-api-access-f6x5m\") pod \"cert-manager-operator-controller-manager-55c444bf86-zk6ls\" (UID: \"248e545e-46bb-4db6-911d-19dc17534c15\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zk6ls"
Sep 15 13:43:51.811749 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:51.811673    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/248e545e-46bb-4db6-911d-19dc17534c15-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-zk6ls\" (UID: \"248e545e-46bb-4db6-911d-19dc17534c15\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zk6ls"
Sep 15 13:43:51.812087 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:51.812065    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/248e545e-46bb-4db6-911d-19dc17534c15-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-zk6ls\" (UID: \"248e545e-46bb-4db6-911d-19dc17534c15\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zk6ls"
Sep 15 13:43:51.822524 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:51.822477    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6x5m\" (UniqueName: \"kubernetes.io/projected/248e545e-46bb-4db6-911d-19dc17534c15-kube-api-access-f6x5m\") pod \"cert-manager-operator-controller-manager-55c444bf86-zk6ls\" (UID: \"248e545e-46bb-4db6-911d-19dc17534c15\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zk6ls"
Sep 15 13:43:51.881580 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:51.881558    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zk6ls"
Sep 15 13:43:52.158941 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:52.158914    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zk6ls"]
Sep 15 13:43:52.161533 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:43:52.161497    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod248e545e_46bb_4db6_911d_19dc17534c15.slice/crio-4a0ce2e075b30f638b146d9711ec4726c01e3d405d3ab9497dd20e5c23552fe5 WatchSource:0}: Error finding container 4a0ce2e075b30f638b146d9711ec4726c01e3d405d3ab9497dd20e5c23552fe5: Status 404 returned error can't find the container with id 4a0ce2e075b30f638b146d9711ec4726c01e3d405d3ab9497dd20e5c23552fe5
Sep 15 13:43:52.164210 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:52.164192    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 13:43:53.144185 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:53.144148    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zk6ls" event={"ID":"248e545e-46bb-4db6-911d-19dc17534c15","Type":"ContainerStarted","Data":"4a0ce2e075b30f638b146d9711ec4726c01e3d405d3ab9497dd20e5c23552fe5"}
Sep 15 13:43:56.158313 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:56.158267    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zk6ls" event={"ID":"248e545e-46bb-4db6-911d-19dc17534c15","Type":"ContainerStarted","Data":"4626d7b0c7eb51278ca8d4c531716f8d70b7e8b6177d4fa178fa4dc823c51ad7"}
Sep 15 13:43:56.179715 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:56.179663    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zk6ls" podStartSLOduration=2.061657058 podStartE2EDuration="5.179648818s" totalImagesPullingTime="3.11799176s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:43:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:43:56.178764191 +0000 UTC m=+322.937890477" watchObservedRunningTime="2026-09-15 13:43:56.179648818 +0000 UTC m=+322.938775105"
Sep 15 13:43:56.773955 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:56.773919    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmqqzl"]
Sep 15 13:43:56.776261 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:56.776238    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmqqzl"
Sep 15 13:43:56.786050 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:56.786032    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 15 13:43:56.786835 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:56.786820    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-bjmkq\""
Sep 15 13:43:56.786981 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:56.786965    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 15 13:43:56.816141 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:56.816087    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmqqzl"]
Sep 15 13:43:56.857257 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:56.857226    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/87e0a198-c501-4fcb-82df-29e5a28cd483-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmqqzl\" (UID: \"87e0a198-c501-4fcb-82df-29e5a28cd483\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmqqzl"
Sep 15 13:43:56.857456 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:56.857281    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/87e0a198-c501-4fcb-82df-29e5a28cd483-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmqqzl\" (UID: \"87e0a198-c501-4fcb-82df-29e5a28cd483\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmqqzl"
Sep 15 13:43:56.857456 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:56.857392    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9lzb\" (UniqueName: \"kubernetes.io/projected/87e0a198-c501-4fcb-82df-29e5a28cd483-kube-api-access-n9lzb\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmqqzl\" (UID: \"87e0a198-c501-4fcb-82df-29e5a28cd483\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmqqzl"
Sep 15 13:43:56.958753 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:56.958721    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/87e0a198-c501-4fcb-82df-29e5a28cd483-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmqqzl\" (UID: \"87e0a198-c501-4fcb-82df-29e5a28cd483\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmqqzl"
Sep 15 13:43:56.958958 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:56.958786    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9lzb\" (UniqueName: \"kubernetes.io/projected/87e0a198-c501-4fcb-82df-29e5a28cd483-kube-api-access-n9lzb\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmqqzl\" (UID: \"87e0a198-c501-4fcb-82df-29e5a28cd483\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmqqzl"
Sep 15 13:43:56.958958 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:56.958826    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/87e0a198-c501-4fcb-82df-29e5a28cd483-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmqqzl\" (UID: \"87e0a198-c501-4fcb-82df-29e5a28cd483\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmqqzl"
Sep 15 13:43:56.959159 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:56.959116    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/87e0a198-c501-4fcb-82df-29e5a28cd483-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmqqzl\" (UID: \"87e0a198-c501-4fcb-82df-29e5a28cd483\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmqqzl"
Sep 15 13:43:56.959234 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:56.959215    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/87e0a198-c501-4fcb-82df-29e5a28cd483-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmqqzl\" (UID: \"87e0a198-c501-4fcb-82df-29e5a28cd483\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmqqzl"
Sep 15 13:43:56.992607 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:56.992581    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9lzb\" (UniqueName: \"kubernetes.io/projected/87e0a198-c501-4fcb-82df-29e5a28cd483-kube-api-access-n9lzb\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmqqzl\" (UID: \"87e0a198-c501-4fcb-82df-29e5a28cd483\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmqqzl"
Sep 15 13:43:57.085555 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:57.085518    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmqqzl"
Sep 15 13:43:57.354786 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:57.354760    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmqqzl"]
Sep 15 13:43:57.357412 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:43:57.357385    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87e0a198_c501_4fcb_82df_29e5a28cd483.slice/crio-0e71a0b2da8920288154a944b2f0c2a051bfbfcbd3f4e84d23197bd663a71907 WatchSource:0}: Error finding container 0e71a0b2da8920288154a944b2f0c2a051bfbfcbd3f4e84d23197bd663a71907: Status 404 returned error can't find the container with id 0e71a0b2da8920288154a944b2f0c2a051bfbfcbd3f4e84d23197bd663a71907
Sep 15 13:43:58.169139 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:58.169098    2578 generic.go:356] "Generic (PLEG): container finished" podID="87e0a198-c501-4fcb-82df-29e5a28cd483" containerID="7abffc64c7d0643a9ce77bf8b3a34b946b6abb2674f5b9caf68b1f3acfce98f3" exitCode=0
Sep 15 13:43:58.169296 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:58.169187    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmqqzl" event={"ID":"87e0a198-c501-4fcb-82df-29e5a28cd483","Type":"ContainerDied","Data":"7abffc64c7d0643a9ce77bf8b3a34b946b6abb2674f5b9caf68b1f3acfce98f3"}
Sep 15 13:43:58.169296 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:43:58.169235    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmqqzl" event={"ID":"87e0a198-c501-4fcb-82df-29e5a28cd483","Type":"ContainerStarted","Data":"0e71a0b2da8920288154a944b2f0c2a051bfbfcbd3f4e84d23197bd663a71907"}
Sep 15 13:44:01.185610 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:01.185579    2578 generic.go:356] "Generic (PLEG): container finished" podID="87e0a198-c501-4fcb-82df-29e5a28cd483" containerID="b070ba4729a33b141e8628113f66fd00b8302e4a9b0595509684a849ca5983a0" exitCode=0
Sep 15 13:44:01.185982 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:01.185650    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmqqzl" event={"ID":"87e0a198-c501-4fcb-82df-29e5a28cd483","Type":"ContainerDied","Data":"b070ba4729a33b141e8628113f66fd00b8302e4a9b0595509684a849ca5983a0"}
Sep 15 13:44:02.191715 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:02.191684    2578 generic.go:356] "Generic (PLEG): container finished" podID="87e0a198-c501-4fcb-82df-29e5a28cd483" containerID="a24e5cfcf6d622f590f86ee9b8368e0818a9aa552d60af8eb9fb4868d1875e89" exitCode=0
Sep 15 13:44:02.192098 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:02.191774    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmqqzl" event={"ID":"87e0a198-c501-4fcb-82df-29e5a28cd483","Type":"ContainerDied","Data":"a24e5cfcf6d622f590f86ee9b8368e0818a9aa552d60af8eb9fb4868d1875e89"}
Sep 15 13:44:03.319539 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:03.319515    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmqqzl"
Sep 15 13:44:03.414233 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:03.414200    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/87e0a198-c501-4fcb-82df-29e5a28cd483-bundle\") pod \"87e0a198-c501-4fcb-82df-29e5a28cd483\" (UID: \"87e0a198-c501-4fcb-82df-29e5a28cd483\") "
Sep 15 13:44:03.414375 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:03.414247    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n9lzb\" (UniqueName: \"kubernetes.io/projected/87e0a198-c501-4fcb-82df-29e5a28cd483-kube-api-access-n9lzb\") pod \"87e0a198-c501-4fcb-82df-29e5a28cd483\" (UID: \"87e0a198-c501-4fcb-82df-29e5a28cd483\") "
Sep 15 13:44:03.414375 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:03.414299    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/87e0a198-c501-4fcb-82df-29e5a28cd483-util\") pod \"87e0a198-c501-4fcb-82df-29e5a28cd483\" (UID: \"87e0a198-c501-4fcb-82df-29e5a28cd483\") "
Sep 15 13:44:03.414609 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:03.414587    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87e0a198-c501-4fcb-82df-29e5a28cd483-bundle" (OuterVolumeSpecName: "bundle") pod "87e0a198-c501-4fcb-82df-29e5a28cd483" (UID: "87e0a198-c501-4fcb-82df-29e5a28cd483"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:44:03.416586 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:03.416564    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87e0a198-c501-4fcb-82df-29e5a28cd483-kube-api-access-n9lzb" (OuterVolumeSpecName: "kube-api-access-n9lzb") pod "87e0a198-c501-4fcb-82df-29e5a28cd483" (UID: "87e0a198-c501-4fcb-82df-29e5a28cd483"). InnerVolumeSpecName "kube-api-access-n9lzb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:44:03.419669 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:03.419647    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87e0a198-c501-4fcb-82df-29e5a28cd483-util" (OuterVolumeSpecName: "util") pod "87e0a198-c501-4fcb-82df-29e5a28cd483" (UID: "87e0a198-c501-4fcb-82df-29e5a28cd483"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:44:03.515779 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:03.515691    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/87e0a198-c501-4fcb-82df-29e5a28cd483-bundle\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:44:03.515779 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:03.515723    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n9lzb\" (UniqueName: \"kubernetes.io/projected/87e0a198-c501-4fcb-82df-29e5a28cd483-kube-api-access-n9lzb\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:44:03.515779 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:03.515735    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/87e0a198-c501-4fcb-82df-29e5a28cd483-util\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:44:04.201198 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:04.201169    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmqqzl"
Sep 15 13:44:04.201198 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:04.201178    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmqqzl" event={"ID":"87e0a198-c501-4fcb-82df-29e5a28cd483","Type":"ContainerDied","Data":"0e71a0b2da8920288154a944b2f0c2a051bfbfcbd3f4e84d23197bd663a71907"}
Sep 15 13:44:04.201400 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:04.201225    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0e71a0b2da8920288154a944b2f0c2a051bfbfcbd3f4e84d23197bd663a71907"
Sep 15 13:44:09.323014 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:09.322975    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-trdd7"]
Sep 15 13:44:09.323596 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:09.323386    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87e0a198-c501-4fcb-82df-29e5a28cd483" containerName="extract"
Sep 15 13:44:09.323596 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:09.323403    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="87e0a198-c501-4fcb-82df-29e5a28cd483" containerName="extract"
Sep 15 13:44:09.323596 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:09.323424    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87e0a198-c501-4fcb-82df-29e5a28cd483" containerName="pull"
Sep 15 13:44:09.323596 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:09.323435    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="87e0a198-c501-4fcb-82df-29e5a28cd483" containerName="pull"
Sep 15 13:44:09.323596 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:09.323460    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87e0a198-c501-4fcb-82df-29e5a28cd483" containerName="util"
Sep 15 13:44:09.323596 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:09.323467    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="87e0a198-c501-4fcb-82df-29e5a28cd483" containerName="util"
Sep 15 13:44:09.323596 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:09.323539    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="87e0a198-c501-4fcb-82df-29e5a28cd483" containerName="extract"
Sep 15 13:44:09.335654 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:09.335633    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-trdd7"
Sep 15 13:44:09.336276 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:09.336253    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-trdd7"]
Sep 15 13:44:09.337864 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:09.337841    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 15 13:44:09.338699 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:09.338681    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 15 13:44:09.338780 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:09.338703    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-8dwk9\""
Sep 15 13:44:09.468088 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:09.468054    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/53d0c35e-831f-4a49-aa66-53a4e6457363-tmp\") pod \"openshift-lws-operator-fd8ccff4c-trdd7\" (UID: \"53d0c35e-831f-4a49-aa66-53a4e6457363\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-trdd7"
Sep 15 13:44:09.468251 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:09.468103    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54mz9\" (UniqueName: \"kubernetes.io/projected/53d0c35e-831f-4a49-aa66-53a4e6457363-kube-api-access-54mz9\") pod \"openshift-lws-operator-fd8ccff4c-trdd7\" (UID: \"53d0c35e-831f-4a49-aa66-53a4e6457363\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-trdd7"
Sep 15 13:44:09.568895 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:09.568864    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/53d0c35e-831f-4a49-aa66-53a4e6457363-tmp\") pod \"openshift-lws-operator-fd8ccff4c-trdd7\" (UID: \"53d0c35e-831f-4a49-aa66-53a4e6457363\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-trdd7"
Sep 15 13:44:09.569045 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:09.568916    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54mz9\" (UniqueName: \"kubernetes.io/projected/53d0c35e-831f-4a49-aa66-53a4e6457363-kube-api-access-54mz9\") pod \"openshift-lws-operator-fd8ccff4c-trdd7\" (UID: \"53d0c35e-831f-4a49-aa66-53a4e6457363\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-trdd7"
Sep 15 13:44:09.569368 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:09.569347    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/53d0c35e-831f-4a49-aa66-53a4e6457363-tmp\") pod \"openshift-lws-operator-fd8ccff4c-trdd7\" (UID: \"53d0c35e-831f-4a49-aa66-53a4e6457363\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-trdd7"
Sep 15 13:44:09.577751 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:09.577693    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-54mz9\" (UniqueName: \"kubernetes.io/projected/53d0c35e-831f-4a49-aa66-53a4e6457363-kube-api-access-54mz9\") pod \"openshift-lws-operator-fd8ccff4c-trdd7\" (UID: \"53d0c35e-831f-4a49-aa66-53a4e6457363\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-trdd7"
Sep 15 13:44:09.645357 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:09.645327    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-trdd7"
Sep 15 13:44:09.944354 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:09.944276    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-trdd7"]
Sep 15 13:44:09.946318 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:44:09.946290    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod53d0c35e_831f_4a49_aa66_53a4e6457363.slice/crio-74a77f4a466e488a5ee4323856d5dd02d294f8640fe7a507a4ef3fbbf27f2620 WatchSource:0}: Error finding container 74a77f4a466e488a5ee4323856d5dd02d294f8640fe7a507a4ef3fbbf27f2620: Status 404 returned error can't find the container with id 74a77f4a466e488a5ee4323856d5dd02d294f8640fe7a507a4ef3fbbf27f2620
Sep 15 13:44:10.226948 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:10.226868    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-trdd7" event={"ID":"53d0c35e-831f-4a49-aa66-53a4e6457363","Type":"ContainerStarted","Data":"74a77f4a466e488a5ee4323856d5dd02d294f8640fe7a507a4ef3fbbf27f2620"}
Sep 15 13:44:14.245290 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:14.245256    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-trdd7" event={"ID":"53d0c35e-831f-4a49-aa66-53a4e6457363","Type":"ContainerStarted","Data":"4877325a35737cef0ebe49618e4f689a36571f39ea0c826f11fa657060a287ee"}
Sep 15 13:44:14.278917 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:14.278863    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-trdd7" podStartSLOduration=1.64213642 podStartE2EDuration="5.278846314s" totalImagesPullingTime="3.636709894s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:44:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:44:14.278049363 +0000 UTC m=+341.037175649" watchObservedRunningTime="2026-09-15 13:44:14.278846314 +0000 UTC m=+341.037972600"
Sep 15 13:44:16.643337 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:16.643298    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx7dx6"]
Sep 15 13:44:16.645884 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:16.645864    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx7dx6"
Sep 15 13:44:16.649261 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:16.649240    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 15 13:44:16.649423 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:16.649409    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 15 13:44:16.649756 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:16.649743    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-bjmkq\""
Sep 15 13:44:16.656527 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:16.656502    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx7dx6"]
Sep 15 13:44:16.721608 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:16.721570    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d4627d40-27f7-433c-ac5d-62847e447488-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx7dx6\" (UID: \"d4627d40-27f7-433c-ac5d-62847e447488\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx7dx6"
Sep 15 13:44:16.721764 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:16.721613    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8z9qq\" (UniqueName: \"kubernetes.io/projected/d4627d40-27f7-433c-ac5d-62847e447488-kube-api-access-8z9qq\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx7dx6\" (UID: \"d4627d40-27f7-433c-ac5d-62847e447488\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx7dx6"
Sep 15 13:44:16.721764 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:16.721704    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d4627d40-27f7-433c-ac5d-62847e447488-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx7dx6\" (UID: \"d4627d40-27f7-433c-ac5d-62847e447488\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx7dx6"
Sep 15 13:44:16.822751 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:16.822710    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d4627d40-27f7-433c-ac5d-62847e447488-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx7dx6\" (UID: \"d4627d40-27f7-433c-ac5d-62847e447488\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx7dx6"
Sep 15 13:44:16.822751 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:16.822754    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8z9qq\" (UniqueName: \"kubernetes.io/projected/d4627d40-27f7-433c-ac5d-62847e447488-kube-api-access-8z9qq\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx7dx6\" (UID: \"d4627d40-27f7-433c-ac5d-62847e447488\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx7dx6"
Sep 15 13:44:16.822997 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:16.822822    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d4627d40-27f7-433c-ac5d-62847e447488-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx7dx6\" (UID: \"d4627d40-27f7-433c-ac5d-62847e447488\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx7dx6"
Sep 15 13:44:16.823116 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:16.823088    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d4627d40-27f7-433c-ac5d-62847e447488-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx7dx6\" (UID: \"d4627d40-27f7-433c-ac5d-62847e447488\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx7dx6"
Sep 15 13:44:16.823252 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:16.823189    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d4627d40-27f7-433c-ac5d-62847e447488-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx7dx6\" (UID: \"d4627d40-27f7-433c-ac5d-62847e447488\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx7dx6"
Sep 15 13:44:16.830053 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:16.830030    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8z9qq\" (UniqueName: \"kubernetes.io/projected/d4627d40-27f7-433c-ac5d-62847e447488-kube-api-access-8z9qq\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx7dx6\" (UID: \"d4627d40-27f7-433c-ac5d-62847e447488\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx7dx6"
Sep 15 13:44:16.954646 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:16.954564    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx7dx6"
Sep 15 13:44:17.225232 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:17.225153    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx7dx6"]
Sep 15 13:44:17.228114 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:44:17.228084    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4627d40_27f7_433c_ac5d_62847e447488.slice/crio-369f708ea9d45dfb2ea5deed14c3a83e60bbc0a8bc480bdef21a44c36c3499ca WatchSource:0}: Error finding container 369f708ea9d45dfb2ea5deed14c3a83e60bbc0a8bc480bdef21a44c36c3499ca: Status 404 returned error can't find the container with id 369f708ea9d45dfb2ea5deed14c3a83e60bbc0a8bc480bdef21a44c36c3499ca
Sep 15 13:44:17.258725 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:17.258689    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx7dx6" event={"ID":"d4627d40-27f7-433c-ac5d-62847e447488","Type":"ContainerStarted","Data":"369f708ea9d45dfb2ea5deed14c3a83e60bbc0a8bc480bdef21a44c36c3499ca"}
Sep 15 13:44:18.264404 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:18.264314    2578 generic.go:356] "Generic (PLEG): container finished" podID="d4627d40-27f7-433c-ac5d-62847e447488" containerID="a648cbd93befeb1641a4136485e455efb1b34a778e62a4f8607627243a34f624" exitCode=0
Sep 15 13:44:18.264743 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:18.264402    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx7dx6" event={"ID":"d4627d40-27f7-433c-ac5d-62847e447488","Type":"ContainerDied","Data":"a648cbd93befeb1641a4136485e455efb1b34a778e62a4f8607627243a34f624"}
Sep 15 13:44:19.269890 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:19.269803    2578 generic.go:356] "Generic (PLEG): container finished" podID="d4627d40-27f7-433c-ac5d-62847e447488" containerID="e8ffbe86f0c008f8013984eefc3e1ed7b7f82459e7a87d94c5f629ef769be2ee" exitCode=0
Sep 15 13:44:19.270252 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:19.269886    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx7dx6" event={"ID":"d4627d40-27f7-433c-ac5d-62847e447488","Type":"ContainerDied","Data":"e8ffbe86f0c008f8013984eefc3e1ed7b7f82459e7a87d94c5f629ef769be2ee"}
Sep 15 13:44:20.276402 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:20.276371    2578 generic.go:356] "Generic (PLEG): container finished" podID="d4627d40-27f7-433c-ac5d-62847e447488" containerID="94c8d7bac61d1aec15a584dd65b915be753fcbca7f926712a03cde11e9611580" exitCode=0
Sep 15 13:44:20.276850 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:20.276438    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx7dx6" event={"ID":"d4627d40-27f7-433c-ac5d-62847e447488","Type":"ContainerDied","Data":"94c8d7bac61d1aec15a584dd65b915be753fcbca7f926712a03cde11e9611580"}
Sep 15 13:44:21.401423 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:21.401397    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx7dx6"
Sep 15 13:44:21.458038 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:21.458003    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d4627d40-27f7-433c-ac5d-62847e447488-util\") pod \"d4627d40-27f7-433c-ac5d-62847e447488\" (UID: \"d4627d40-27f7-433c-ac5d-62847e447488\") "
Sep 15 13:44:21.458218 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:21.458053    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8z9qq\" (UniqueName: \"kubernetes.io/projected/d4627d40-27f7-433c-ac5d-62847e447488-kube-api-access-8z9qq\") pod \"d4627d40-27f7-433c-ac5d-62847e447488\" (UID: \"d4627d40-27f7-433c-ac5d-62847e447488\") "
Sep 15 13:44:21.458218 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:21.458118    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d4627d40-27f7-433c-ac5d-62847e447488-bundle\") pod \"d4627d40-27f7-433c-ac5d-62847e447488\" (UID: \"d4627d40-27f7-433c-ac5d-62847e447488\") "
Sep 15 13:44:21.458960 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:21.458928    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4627d40-27f7-433c-ac5d-62847e447488-bundle" (OuterVolumeSpecName: "bundle") pod "d4627d40-27f7-433c-ac5d-62847e447488" (UID: "d4627d40-27f7-433c-ac5d-62847e447488"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:44:21.460258 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:21.460231    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4627d40-27f7-433c-ac5d-62847e447488-kube-api-access-8z9qq" (OuterVolumeSpecName: "kube-api-access-8z9qq") pod "d4627d40-27f7-433c-ac5d-62847e447488" (UID: "d4627d40-27f7-433c-ac5d-62847e447488"). InnerVolumeSpecName "kube-api-access-8z9qq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:44:21.463945 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:21.463922    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4627d40-27f7-433c-ac5d-62847e447488-util" (OuterVolumeSpecName: "util") pod "d4627d40-27f7-433c-ac5d-62847e447488" (UID: "d4627d40-27f7-433c-ac5d-62847e447488"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:44:21.559387 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:21.559304    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d4627d40-27f7-433c-ac5d-62847e447488-util\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:44:21.559387 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:21.559335    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8z9qq\" (UniqueName: \"kubernetes.io/projected/d4627d40-27f7-433c-ac5d-62847e447488-kube-api-access-8z9qq\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:44:21.559387 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:21.559349    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d4627d40-27f7-433c-ac5d-62847e447488-bundle\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:44:22.286695 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:22.286666    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx7dx6"
Sep 15 13:44:22.286695 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:22.286675    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx7dx6" event={"ID":"d4627d40-27f7-433c-ac5d-62847e447488","Type":"ContainerDied","Data":"369f708ea9d45dfb2ea5deed14c3a83e60bbc0a8bc480bdef21a44c36c3499ca"}
Sep 15 13:44:22.286904 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:22.286725    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="369f708ea9d45dfb2ea5deed14c3a83e60bbc0a8bc480bdef21a44c36c3499ca"
Sep 15 13:44:31.063777 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:31.063696    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0v4qmt"]
Sep 15 13:44:31.064151 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:31.063972    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4627d40-27f7-433c-ac5d-62847e447488" containerName="pull"
Sep 15 13:44:31.064151 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:31.063982    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4627d40-27f7-433c-ac5d-62847e447488" containerName="pull"
Sep 15 13:44:31.064151 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:31.063989    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4627d40-27f7-433c-ac5d-62847e447488" containerName="extract"
Sep 15 13:44:31.064151 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:31.063994    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4627d40-27f7-433c-ac5d-62847e447488" containerName="extract"
Sep 15 13:44:31.064151 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:31.064013    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4627d40-27f7-433c-ac5d-62847e447488" containerName="util"
Sep 15 13:44:31.064151 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:31.064020    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4627d40-27f7-433c-ac5d-62847e447488" containerName="util"
Sep 15 13:44:31.064151 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:31.064083    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4627d40-27f7-433c-ac5d-62847e447488" containerName="extract"
Sep 15 13:44:31.066423 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:31.066407    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0v4qmt"
Sep 15 13:44:31.068570 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:31.068545    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 15 13:44:31.068771 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:31.068757    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-bjmkq\""
Sep 15 13:44:31.069344 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:31.069329    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 15 13:44:31.077397 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:31.077377    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0v4qmt"]
Sep 15 13:44:31.140221 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:31.140185    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5g66c\" (UniqueName: \"kubernetes.io/projected/390060a7-ece3-449a-a67b-e15722dfcb7d-kube-api-access-5g66c\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0v4qmt\" (UID: \"390060a7-ece3-449a-a67b-e15722dfcb7d\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0v4qmt"
Sep 15 13:44:31.140385 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:31.140314    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/390060a7-ece3-449a-a67b-e15722dfcb7d-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0v4qmt\" (UID: \"390060a7-ece3-449a-a67b-e15722dfcb7d\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0v4qmt"
Sep 15 13:44:31.140385 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:31.140346    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/390060a7-ece3-449a-a67b-e15722dfcb7d-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0v4qmt\" (UID: \"390060a7-ece3-449a-a67b-e15722dfcb7d\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0v4qmt"
Sep 15 13:44:31.241753 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:31.241717    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/390060a7-ece3-449a-a67b-e15722dfcb7d-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0v4qmt\" (UID: \"390060a7-ece3-449a-a67b-e15722dfcb7d\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0v4qmt"
Sep 15 13:44:31.241753 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:31.241755    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/390060a7-ece3-449a-a67b-e15722dfcb7d-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0v4qmt\" (UID: \"390060a7-ece3-449a-a67b-e15722dfcb7d\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0v4qmt"
Sep 15 13:44:31.241954 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:31.241786    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5g66c\" (UniqueName: \"kubernetes.io/projected/390060a7-ece3-449a-a67b-e15722dfcb7d-kube-api-access-5g66c\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0v4qmt\" (UID: \"390060a7-ece3-449a-a67b-e15722dfcb7d\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0v4qmt"
Sep 15 13:44:31.242090 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:31.242068    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/390060a7-ece3-449a-a67b-e15722dfcb7d-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0v4qmt\" (UID: \"390060a7-ece3-449a-a67b-e15722dfcb7d\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0v4qmt"
Sep 15 13:44:31.242173 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:31.242155    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/390060a7-ece3-449a-a67b-e15722dfcb7d-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0v4qmt\" (UID: \"390060a7-ece3-449a-a67b-e15722dfcb7d\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0v4qmt"
Sep 15 13:44:31.255066 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:31.255037    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5g66c\" (UniqueName: \"kubernetes.io/projected/390060a7-ece3-449a-a67b-e15722dfcb7d-kube-api-access-5g66c\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0v4qmt\" (UID: \"390060a7-ece3-449a-a67b-e15722dfcb7d\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0v4qmt"
Sep 15 13:44:31.375303 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:31.375221    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0v4qmt"
Sep 15 13:44:31.646536 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:31.646507    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0v4qmt"]
Sep 15 13:44:31.649088 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:44:31.649057    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod390060a7_ece3_449a_a67b_e15722dfcb7d.slice/crio-c3f5af5d407cbd819b9f29fc489848cb3d31f19a46a048dd248b1883a379cd04 WatchSource:0}: Error finding container c3f5af5d407cbd819b9f29fc489848cb3d31f19a46a048dd248b1883a379cd04: Status 404 returned error can't find the container with id c3f5af5d407cbd819b9f29fc489848cb3d31f19a46a048dd248b1883a379cd04
Sep 15 13:44:32.331933 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:32.331895    2578 generic.go:356] "Generic (PLEG): container finished" podID="390060a7-ece3-449a-a67b-e15722dfcb7d" containerID="9e0fb000b3fbe29385be9d1b2292bb5442b623369e80af1e92e3811aebef66b0" exitCode=0
Sep 15 13:44:32.332367 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:32.331979    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0v4qmt" event={"ID":"390060a7-ece3-449a-a67b-e15722dfcb7d","Type":"ContainerDied","Data":"9e0fb000b3fbe29385be9d1b2292bb5442b623369e80af1e92e3811aebef66b0"}
Sep 15 13:44:32.332367 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:32.332022    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0v4qmt" event={"ID":"390060a7-ece3-449a-a67b-e15722dfcb7d","Type":"ContainerStarted","Data":"c3f5af5d407cbd819b9f29fc489848cb3d31f19a46a048dd248b1883a379cd04"}
Sep 15 13:44:32.827794 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:32.827762    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79c64c4b4d-m7x76"]
Sep 15 13:44:32.830036 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:32.830018    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-79c64c4b4d-m7x76"
Sep 15 13:44:32.832948 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:32.832916    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 15 13:44:32.833066 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:32.832981    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 15 13:44:32.833232 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:32.833217    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 15 13:44:32.833316 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:32.833261    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-p7czt\""
Sep 15 13:44:32.833316 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:32.833306    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 15 13:44:32.851013 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:32.850994    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79c64c4b4d-m7x76"]
Sep 15 13:44:32.956749 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:32.956719    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9930f089-375a-4f00-beaf-58065e7a9856-manifests\") pod \"opendatahub-operator-controller-manager-79c64c4b4d-m7x76\" (UID: \"9930f089-375a-4f00-beaf-58065e7a9856\") " pod="opendatahub/opendatahub-operator-controller-manager-79c64c4b4d-m7x76"
Sep 15 13:44:32.956945 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:32.956753    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9930f089-375a-4f00-beaf-58065e7a9856-webhook-cert\") pod \"opendatahub-operator-controller-manager-79c64c4b4d-m7x76\" (UID: \"9930f089-375a-4f00-beaf-58065e7a9856\") " pod="opendatahub/opendatahub-operator-controller-manager-79c64c4b4d-m7x76"
Sep 15 13:44:32.956945 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:32.956797    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nsmg\" (UniqueName: \"kubernetes.io/projected/9930f089-375a-4f00-beaf-58065e7a9856-kube-api-access-4nsmg\") pod \"opendatahub-operator-controller-manager-79c64c4b4d-m7x76\" (UID: \"9930f089-375a-4f00-beaf-58065e7a9856\") " pod="opendatahub/opendatahub-operator-controller-manager-79c64c4b4d-m7x76"
Sep 15 13:44:32.956945 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:32.956849    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9930f089-375a-4f00-beaf-58065e7a9856-tmp\") pod \"opendatahub-operator-controller-manager-79c64c4b4d-m7x76\" (UID: \"9930f089-375a-4f00-beaf-58065e7a9856\") " pod="opendatahub/opendatahub-operator-controller-manager-79c64c4b4d-m7x76"
Sep 15 13:44:32.956945 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:32.956869    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9930f089-375a-4f00-beaf-58065e7a9856-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79c64c4b4d-m7x76\" (UID: \"9930f089-375a-4f00-beaf-58065e7a9856\") " pod="opendatahub/opendatahub-operator-controller-manager-79c64c4b4d-m7x76"
Sep 15 13:44:33.057499 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:33.057475    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9930f089-375a-4f00-beaf-58065e7a9856-tmp\") pod \"opendatahub-operator-controller-manager-79c64c4b4d-m7x76\" (UID: \"9930f089-375a-4f00-beaf-58065e7a9856\") " pod="opendatahub/opendatahub-operator-controller-manager-79c64c4b4d-m7x76"
Sep 15 13:44:33.057597 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:33.057506    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9930f089-375a-4f00-beaf-58065e7a9856-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79c64c4b4d-m7x76\" (UID: \"9930f089-375a-4f00-beaf-58065e7a9856\") " pod="opendatahub/opendatahub-operator-controller-manager-79c64c4b4d-m7x76"
Sep 15 13:44:33.057597 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:33.057547    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9930f089-375a-4f00-beaf-58065e7a9856-manifests\") pod \"opendatahub-operator-controller-manager-79c64c4b4d-m7x76\" (UID: \"9930f089-375a-4f00-beaf-58065e7a9856\") " pod="opendatahub/opendatahub-operator-controller-manager-79c64c4b4d-m7x76"
Sep 15 13:44:33.057597 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:33.057561    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9930f089-375a-4f00-beaf-58065e7a9856-webhook-cert\") pod \"opendatahub-operator-controller-manager-79c64c4b4d-m7x76\" (UID: \"9930f089-375a-4f00-beaf-58065e7a9856\") " pod="opendatahub/opendatahub-operator-controller-manager-79c64c4b4d-m7x76"
Sep 15 13:44:33.057597 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:33.057590    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nsmg\" (UniqueName: \"kubernetes.io/projected/9930f089-375a-4f00-beaf-58065e7a9856-kube-api-access-4nsmg\") pod \"opendatahub-operator-controller-manager-79c64c4b4d-m7x76\" (UID: \"9930f089-375a-4f00-beaf-58065e7a9856\") " pod="opendatahub/opendatahub-operator-controller-manager-79c64c4b4d-m7x76"
Sep 15 13:44:33.057971 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:33.057946    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9930f089-375a-4f00-beaf-58065e7a9856-manifests\") pod \"opendatahub-operator-controller-manager-79c64c4b4d-m7x76\" (UID: \"9930f089-375a-4f00-beaf-58065e7a9856\") " pod="opendatahub/opendatahub-operator-controller-manager-79c64c4b4d-m7x76"
Sep 15 13:44:33.059753 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:33.059725    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9930f089-375a-4f00-beaf-58065e7a9856-tmp\") pod \"opendatahub-operator-controller-manager-79c64c4b4d-m7x76\" (UID: \"9930f089-375a-4f00-beaf-58065e7a9856\") " pod="opendatahub/opendatahub-operator-controller-manager-79c64c4b4d-m7x76"
Sep 15 13:44:33.059981 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:33.059960    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9930f089-375a-4f00-beaf-58065e7a9856-webhook-cert\") pod \"opendatahub-operator-controller-manager-79c64c4b4d-m7x76\" (UID: \"9930f089-375a-4f00-beaf-58065e7a9856\") " pod="opendatahub/opendatahub-operator-controller-manager-79c64c4b4d-m7x76"
Sep 15 13:44:33.060068 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:33.060047    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9930f089-375a-4f00-beaf-58065e7a9856-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79c64c4b4d-m7x76\" (UID: \"9930f089-375a-4f00-beaf-58065e7a9856\") " pod="opendatahub/opendatahub-operator-controller-manager-79c64c4b4d-m7x76"
Sep 15 13:44:33.067766 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:33.067744    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nsmg\" (UniqueName: \"kubernetes.io/projected/9930f089-375a-4f00-beaf-58065e7a9856-kube-api-access-4nsmg\") pod \"opendatahub-operator-controller-manager-79c64c4b4d-m7x76\" (UID: \"9930f089-375a-4f00-beaf-58065e7a9856\") " pod="opendatahub/opendatahub-operator-controller-manager-79c64c4b4d-m7x76"
Sep 15 13:44:33.140167 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:33.140140    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-79c64c4b4d-m7x76"
Sep 15 13:44:33.338795 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:33.338761    2578 generic.go:356] "Generic (PLEG): container finished" podID="390060a7-ece3-449a-a67b-e15722dfcb7d" containerID="6492d549c477033850c5b763a08c04505576d84afb4a475d8b8ee32eb54e14b6" exitCode=0
Sep 15 13:44:33.339199 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:33.338854    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0v4qmt" event={"ID":"390060a7-ece3-449a-a67b-e15722dfcb7d","Type":"ContainerDied","Data":"6492d549c477033850c5b763a08c04505576d84afb4a475d8b8ee32eb54e14b6"}
Sep 15 13:44:33.425470 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:33.425431    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79c64c4b4d-m7x76"]
Sep 15 13:44:33.426788 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:44:33.426760    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9930f089_375a_4f00_beaf_58065e7a9856.slice/crio-d2e04f5ab0166e595acbee98b967c253f233f7a1f268dec2cd183357b7a7e5ea WatchSource:0}: Error finding container d2e04f5ab0166e595acbee98b967c253f233f7a1f268dec2cd183357b7a7e5ea: Status 404 returned error can't find the container with id d2e04f5ab0166e595acbee98b967c253f233f7a1f268dec2cd183357b7a7e5ea
Sep 15 13:44:34.347297 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:34.347263    2578 generic.go:356] "Generic (PLEG): container finished" podID="390060a7-ece3-449a-a67b-e15722dfcb7d" containerID="13cd1a298c5e32151c5dd828452fb34664736405758b8aecb348357ae0c662c9" exitCode=0
Sep 15 13:44:34.347766 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:34.347411    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0v4qmt" event={"ID":"390060a7-ece3-449a-a67b-e15722dfcb7d","Type":"ContainerDied","Data":"13cd1a298c5e32151c5dd828452fb34664736405758b8aecb348357ae0c662c9"}
Sep 15 13:44:34.349194 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:34.349163    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79c64c4b4d-m7x76" event={"ID":"9930f089-375a-4f00-beaf-58065e7a9856","Type":"ContainerStarted","Data":"d2e04f5ab0166e595acbee98b967c253f233f7a1f268dec2cd183357b7a7e5ea"}
Sep 15 13:44:36.360078 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:36.360053    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0v4qmt"
Sep 15 13:44:36.361191 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:36.361165    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0v4qmt" event={"ID":"390060a7-ece3-449a-a67b-e15722dfcb7d","Type":"ContainerDied","Data":"c3f5af5d407cbd819b9f29fc489848cb3d31f19a46a048dd248b1883a379cd04"}
Sep 15 13:44:36.361299 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:36.361215    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c3f5af5d407cbd819b9f29fc489848cb3d31f19a46a048dd248b1883a379cd04"
Sep 15 13:44:36.489937 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:36.489898    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/390060a7-ece3-449a-a67b-e15722dfcb7d-bundle\") pod \"390060a7-ece3-449a-a67b-e15722dfcb7d\" (UID: \"390060a7-ece3-449a-a67b-e15722dfcb7d\") "
Sep 15 13:44:36.489937 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:36.489936    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/390060a7-ece3-449a-a67b-e15722dfcb7d-util\") pod \"390060a7-ece3-449a-a67b-e15722dfcb7d\" (UID: \"390060a7-ece3-449a-a67b-e15722dfcb7d\") "
Sep 15 13:44:36.490147 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:36.489972    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5g66c\" (UniqueName: \"kubernetes.io/projected/390060a7-ece3-449a-a67b-e15722dfcb7d-kube-api-access-5g66c\") pod \"390060a7-ece3-449a-a67b-e15722dfcb7d\" (UID: \"390060a7-ece3-449a-a67b-e15722dfcb7d\") "
Sep 15 13:44:36.490706 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:36.490669    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/390060a7-ece3-449a-a67b-e15722dfcb7d-bundle" (OuterVolumeSpecName: "bundle") pod "390060a7-ece3-449a-a67b-e15722dfcb7d" (UID: "390060a7-ece3-449a-a67b-e15722dfcb7d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:44:36.492450 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:36.492426    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/390060a7-ece3-449a-a67b-e15722dfcb7d-kube-api-access-5g66c" (OuterVolumeSpecName: "kube-api-access-5g66c") pod "390060a7-ece3-449a-a67b-e15722dfcb7d" (UID: "390060a7-ece3-449a-a67b-e15722dfcb7d"). InnerVolumeSpecName "kube-api-access-5g66c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:44:36.495081 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:36.495061    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/390060a7-ece3-449a-a67b-e15722dfcb7d-util" (OuterVolumeSpecName: "util") pod "390060a7-ece3-449a-a67b-e15722dfcb7d" (UID: "390060a7-ece3-449a-a67b-e15722dfcb7d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:44:36.590868 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:36.590834    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/390060a7-ece3-449a-a67b-e15722dfcb7d-bundle\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:44:36.590868 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:36.590863    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/390060a7-ece3-449a-a67b-e15722dfcb7d-util\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:44:36.591068 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:36.590875    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5g66c\" (UniqueName: \"kubernetes.io/projected/390060a7-ece3-449a-a67b-e15722dfcb7d-kube-api-access-5g66c\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:44:37.366873 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:37.366833    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79c64c4b4d-m7x76" event={"ID":"9930f089-375a-4f00-beaf-58065e7a9856","Type":"ContainerStarted","Data":"9367e8bad99d3cc1cdb44deae58dea79b80b1aab08079fea92485283878fd501"}
Sep 15 13:44:37.367243 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:37.366994    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0v4qmt"
Sep 15 13:44:38.373062 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:38.373025    2578 generic.go:356] "Generic (PLEG): container finished" podID="9930f089-375a-4f00-beaf-58065e7a9856" containerID="9367e8bad99d3cc1cdb44deae58dea79b80b1aab08079fea92485283878fd501" exitCode=0
Sep 15 13:44:38.373457 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:38.373072    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79c64c4b4d-m7x76" event={"ID":"9930f089-375a-4f00-beaf-58065e7a9856","Type":"ContainerDied","Data":"9367e8bad99d3cc1cdb44deae58dea79b80b1aab08079fea92485283878fd501"}
Sep 15 13:44:39.380253 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:39.380214    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79c64c4b4d-m7x76" event={"ID":"9930f089-375a-4f00-beaf-58065e7a9856","Type":"ContainerStarted","Data":"2c9e048ff033a32ae3ab919ff85d72e7de7dbafadab253157b6dcbccdec87a18"}
Sep 15 13:44:39.380641 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:39.380323    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-79c64c4b4d-m7x76"
Sep 15 13:44:39.401755 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:39.401708    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-79c64c4b4d-m7x76" podStartSLOduration=3.113209022 podStartE2EDuration="7.401692751s" totalImagesPullingTime="3.259840957s" totalInitContainerRuntime="1.028642772s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:44:32 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:44:39.399849759 +0000 UTC m=+366.158976046" watchObservedRunningTime="2026-09-15 13:44:39.401692751 +0000 UTC m=+366.160819037"
Sep 15 13:44:50.392565 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:50.392531    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-79c64c4b4d-m7x76"
Sep 15 13:44:54.033946 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:54.033910    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-698b9db946-nq62k"]
Sep 15 13:44:54.034413 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:54.034221    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="390060a7-ece3-449a-a67b-e15722dfcb7d" containerName="extract"
Sep 15 13:44:54.034413 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:54.034232    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="390060a7-ece3-449a-a67b-e15722dfcb7d" containerName="extract"
Sep 15 13:44:54.034413 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:54.034240    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="390060a7-ece3-449a-a67b-e15722dfcb7d" containerName="util"
Sep 15 13:44:54.034413 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:54.034247    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="390060a7-ece3-449a-a67b-e15722dfcb7d" containerName="util"
Sep 15 13:44:54.034413 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:54.034252    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="390060a7-ece3-449a-a67b-e15722dfcb7d" containerName="pull"
Sep 15 13:44:54.034413 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:54.034257    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="390060a7-ece3-449a-a67b-e15722dfcb7d" containerName="pull"
Sep 15 13:44:54.034413 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:54.034320    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="390060a7-ece3-449a-a67b-e15722dfcb7d" containerName="extract"
Sep 15 13:44:54.041934 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:54.041911    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-698b9db946-nq62k"
Sep 15 13:44:54.044534 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:54.044511    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 15 13:44:54.044649 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:54.044534    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 15 13:44:54.061421 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:54.061393    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-698b9db946-nq62k"]
Sep 15 13:44:54.142617 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:54.142576    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3daa183-93c9-4594-ac13-c48a9432b956-tls-certs\") pod \"kube-auth-proxy-698b9db946-nq62k\" (UID: \"d3daa183-93c9-4594-ac13-c48a9432b956\") " pod="openshift-ingress/kube-auth-proxy-698b9db946-nq62k"
Sep 15 13:44:54.142617 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:54.142615    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d3daa183-93c9-4594-ac13-c48a9432b956-tmp\") pod \"kube-auth-proxy-698b9db946-nq62k\" (UID: \"d3daa183-93c9-4594-ac13-c48a9432b956\") " pod="openshift-ingress/kube-auth-proxy-698b9db946-nq62k"
Sep 15 13:44:54.142818 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:54.142646    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phllb\" (UniqueName: \"kubernetes.io/projected/d3daa183-93c9-4594-ac13-c48a9432b956-kube-api-access-phllb\") pod \"kube-auth-proxy-698b9db946-nq62k\" (UID: \"d3daa183-93c9-4594-ac13-c48a9432b956\") " pod="openshift-ingress/kube-auth-proxy-698b9db946-nq62k"
Sep 15 13:44:54.243914 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:54.243880    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3daa183-93c9-4594-ac13-c48a9432b956-tls-certs\") pod \"kube-auth-proxy-698b9db946-nq62k\" (UID: \"d3daa183-93c9-4594-ac13-c48a9432b956\") " pod="openshift-ingress/kube-auth-proxy-698b9db946-nq62k"
Sep 15 13:44:54.243914 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:54.243918    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d3daa183-93c9-4594-ac13-c48a9432b956-tmp\") pod \"kube-auth-proxy-698b9db946-nq62k\" (UID: \"d3daa183-93c9-4594-ac13-c48a9432b956\") " pod="openshift-ingress/kube-auth-proxy-698b9db946-nq62k"
Sep 15 13:44:54.244153 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:54.243952    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phllb\" (UniqueName: \"kubernetes.io/projected/d3daa183-93c9-4594-ac13-c48a9432b956-kube-api-access-phllb\") pod \"kube-auth-proxy-698b9db946-nq62k\" (UID: \"d3daa183-93c9-4594-ac13-c48a9432b956\") " pod="openshift-ingress/kube-auth-proxy-698b9db946-nq62k"
Sep 15 13:44:54.246360 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:54.246329    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d3daa183-93c9-4594-ac13-c48a9432b956-tmp\") pod \"kube-auth-proxy-698b9db946-nq62k\" (UID: \"d3daa183-93c9-4594-ac13-c48a9432b956\") " pod="openshift-ingress/kube-auth-proxy-698b9db946-nq62k"
Sep 15 13:44:54.246568 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:54.246548    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3daa183-93c9-4594-ac13-c48a9432b956-tls-certs\") pod \"kube-auth-proxy-698b9db946-nq62k\" (UID: \"d3daa183-93c9-4594-ac13-c48a9432b956\") " pod="openshift-ingress/kube-auth-proxy-698b9db946-nq62k"
Sep 15 13:44:54.259453 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:54.259427    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-phllb\" (UniqueName: \"kubernetes.io/projected/d3daa183-93c9-4594-ac13-c48a9432b956-kube-api-access-phllb\") pod \"kube-auth-proxy-698b9db946-nq62k\" (UID: \"d3daa183-93c9-4594-ac13-c48a9432b956\") " pod="openshift-ingress/kube-auth-proxy-698b9db946-nq62k"
Sep 15 13:44:54.351291 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:54.351210    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-698b9db946-nq62k"
Sep 15 13:44:54.601517 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:54.601435    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-c4867564f-4zxcl"]
Sep 15 13:44:54.606210 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:54.606189    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c4867564f-4zxcl"
Sep 15 13:44:54.618860 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:54.618837    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c4867564f-4zxcl"]
Sep 15 13:44:54.634293 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:54.634269    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-698b9db946-nq62k"]
Sep 15 13:44:54.636929 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:44:54.636902    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3daa183_93c9_4594_ac13_c48a9432b956.slice/crio-50ee4db5d364dcde3e66527bcbfea475d1228c2653d204ca165c8426af739da5 WatchSource:0}: Error finding container 50ee4db5d364dcde3e66527bcbfea475d1228c2653d204ca165c8426af739da5: Status 404 returned error can't find the container with id 50ee4db5d364dcde3e66527bcbfea475d1228c2653d204ca165c8426af739da5
Sep 15 13:44:54.748043 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:54.748010    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1906bdeb-6fdb-480f-b891-711dc2a5d8d3-console-oauth-config\") pod \"console-c4867564f-4zxcl\" (UID: \"1906bdeb-6fdb-480f-b891-711dc2a5d8d3\") " pod="openshift-console/console-c4867564f-4zxcl"
Sep 15 13:44:54.748043 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:54.748049    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1906bdeb-6fdb-480f-b891-711dc2a5d8d3-trusted-ca-bundle\") pod \"console-c4867564f-4zxcl\" (UID: \"1906bdeb-6fdb-480f-b891-711dc2a5d8d3\") " pod="openshift-console/console-c4867564f-4zxcl"
Sep 15 13:44:54.748305 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:54.748067    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1906bdeb-6fdb-480f-b891-711dc2a5d8d3-console-config\") pod \"console-c4867564f-4zxcl\" (UID: \"1906bdeb-6fdb-480f-b891-711dc2a5d8d3\") " pod="openshift-console/console-c4867564f-4zxcl"
Sep 15 13:44:54.748305 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:54.748091    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1906bdeb-6fdb-480f-b891-711dc2a5d8d3-service-ca\") pod \"console-c4867564f-4zxcl\" (UID: \"1906bdeb-6fdb-480f-b891-711dc2a5d8d3\") " pod="openshift-console/console-c4867564f-4zxcl"
Sep 15 13:44:54.748305 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:54.748212    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1906bdeb-6fdb-480f-b891-711dc2a5d8d3-oauth-serving-cert\") pod \"console-c4867564f-4zxcl\" (UID: \"1906bdeb-6fdb-480f-b891-711dc2a5d8d3\") " pod="openshift-console/console-c4867564f-4zxcl"
Sep 15 13:44:54.748305 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:54.748246    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lb7n5\" (UniqueName: \"kubernetes.io/projected/1906bdeb-6fdb-480f-b891-711dc2a5d8d3-kube-api-access-lb7n5\") pod \"console-c4867564f-4zxcl\" (UID: \"1906bdeb-6fdb-480f-b891-711dc2a5d8d3\") " pod="openshift-console/console-c4867564f-4zxcl"
Sep 15 13:44:54.748305 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:54.748289    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1906bdeb-6fdb-480f-b891-711dc2a5d8d3-console-serving-cert\") pod \"console-c4867564f-4zxcl\" (UID: \"1906bdeb-6fdb-480f-b891-711dc2a5d8d3\") " pod="openshift-console/console-c4867564f-4zxcl"
Sep 15 13:44:54.848804 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:54.848768    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1906bdeb-6fdb-480f-b891-711dc2a5d8d3-service-ca\") pod \"console-c4867564f-4zxcl\" (UID: \"1906bdeb-6fdb-480f-b891-711dc2a5d8d3\") " pod="openshift-console/console-c4867564f-4zxcl"
Sep 15 13:44:54.848804 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:54.848808    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1906bdeb-6fdb-480f-b891-711dc2a5d8d3-oauth-serving-cert\") pod \"console-c4867564f-4zxcl\" (UID: \"1906bdeb-6fdb-480f-b891-711dc2a5d8d3\") " pod="openshift-console/console-c4867564f-4zxcl"
Sep 15 13:44:54.849038 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:54.848824    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lb7n5\" (UniqueName: \"kubernetes.io/projected/1906bdeb-6fdb-480f-b891-711dc2a5d8d3-kube-api-access-lb7n5\") pod \"console-c4867564f-4zxcl\" (UID: \"1906bdeb-6fdb-480f-b891-711dc2a5d8d3\") " pod="openshift-console/console-c4867564f-4zxcl"
Sep 15 13:44:54.849038 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:54.848851    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1906bdeb-6fdb-480f-b891-711dc2a5d8d3-console-serving-cert\") pod \"console-c4867564f-4zxcl\" (UID: \"1906bdeb-6fdb-480f-b891-711dc2a5d8d3\") " pod="openshift-console/console-c4867564f-4zxcl"
Sep 15 13:44:54.849689 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:54.849230    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1906bdeb-6fdb-480f-b891-711dc2a5d8d3-console-oauth-config\") pod \"console-c4867564f-4zxcl\" (UID: \"1906bdeb-6fdb-480f-b891-711dc2a5d8d3\") " pod="openshift-console/console-c4867564f-4zxcl"
Sep 15 13:44:54.849689 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:54.849280    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1906bdeb-6fdb-480f-b891-711dc2a5d8d3-trusted-ca-bundle\") pod \"console-c4867564f-4zxcl\" (UID: \"1906bdeb-6fdb-480f-b891-711dc2a5d8d3\") " pod="openshift-console/console-c4867564f-4zxcl"
Sep 15 13:44:54.849689 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:54.849510    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1906bdeb-6fdb-480f-b891-711dc2a5d8d3-console-config\") pod \"console-c4867564f-4zxcl\" (UID: \"1906bdeb-6fdb-480f-b891-711dc2a5d8d3\") " pod="openshift-console/console-c4867564f-4zxcl"
Sep 15 13:44:54.849689 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:54.849683    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1906bdeb-6fdb-480f-b891-711dc2a5d8d3-service-ca\") pod \"console-c4867564f-4zxcl\" (UID: \"1906bdeb-6fdb-480f-b891-711dc2a5d8d3\") " pod="openshift-console/console-c4867564f-4zxcl"
Sep 15 13:44:54.850155 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:54.849684    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1906bdeb-6fdb-480f-b891-711dc2a5d8d3-oauth-serving-cert\") pod \"console-c4867564f-4zxcl\" (UID: \"1906bdeb-6fdb-480f-b891-711dc2a5d8d3\") " pod="openshift-console/console-c4867564f-4zxcl"
Sep 15 13:44:54.850155 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:54.850073    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1906bdeb-6fdb-480f-b891-711dc2a5d8d3-console-config\") pod \"console-c4867564f-4zxcl\" (UID: \"1906bdeb-6fdb-480f-b891-711dc2a5d8d3\") " pod="openshift-console/console-c4867564f-4zxcl"
Sep 15 13:44:54.850447 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:54.850423    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1906bdeb-6fdb-480f-b891-711dc2a5d8d3-trusted-ca-bundle\") pod \"console-c4867564f-4zxcl\" (UID: \"1906bdeb-6fdb-480f-b891-711dc2a5d8d3\") " pod="openshift-console/console-c4867564f-4zxcl"
Sep 15 13:44:54.851804 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:54.851747    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1906bdeb-6fdb-480f-b891-711dc2a5d8d3-console-oauth-config\") pod \"console-c4867564f-4zxcl\" (UID: \"1906bdeb-6fdb-480f-b891-711dc2a5d8d3\") " pod="openshift-console/console-c4867564f-4zxcl"
Sep 15 13:44:54.851914 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:54.851895    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1906bdeb-6fdb-480f-b891-711dc2a5d8d3-console-serving-cert\") pod \"console-c4867564f-4zxcl\" (UID: \"1906bdeb-6fdb-480f-b891-711dc2a5d8d3\") " pod="openshift-console/console-c4867564f-4zxcl"
Sep 15 13:44:54.861426 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:54.861409    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lb7n5\" (UniqueName: \"kubernetes.io/projected/1906bdeb-6fdb-480f-b891-711dc2a5d8d3-kube-api-access-lb7n5\") pod \"console-c4867564f-4zxcl\" (UID: \"1906bdeb-6fdb-480f-b891-711dc2a5d8d3\") " pod="openshift-console/console-c4867564f-4zxcl"
Sep 15 13:44:54.915912 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:54.915885    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c4867564f-4zxcl"
Sep 15 13:44:55.193946 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:55.193916    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c4867564f-4zxcl"]
Sep 15 13:44:55.195318 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:44:55.195291    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1906bdeb_6fdb_480f_b891_711dc2a5d8d3.slice/crio-027b4a905fa54480f84b12a447a371ec9689da5458138dcf16a1e89a06c0a9fe WatchSource:0}: Error finding container 027b4a905fa54480f84b12a447a371ec9689da5458138dcf16a1e89a06c0a9fe: Status 404 returned error can't find the container with id 027b4a905fa54480f84b12a447a371ec9689da5458138dcf16a1e89a06c0a9fe
Sep 15 13:44:55.458795 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:55.458704    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-698b9db946-nq62k" event={"ID":"d3daa183-93c9-4594-ac13-c48a9432b956","Type":"ContainerStarted","Data":"50ee4db5d364dcde3e66527bcbfea475d1228c2653d204ca165c8426af739da5"}
Sep 15 13:44:55.461620 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:55.461590    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c4867564f-4zxcl" event={"ID":"1906bdeb-6fdb-480f-b891-711dc2a5d8d3","Type":"ContainerStarted","Data":"3dfe0cc11be8339787d14fb99d406cfa6e2ba64e206efc327562f83274adf4d0"}
Sep 15 13:44:55.461747 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:55.461641    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c4867564f-4zxcl" event={"ID":"1906bdeb-6fdb-480f-b891-711dc2a5d8d3","Type":"ContainerStarted","Data":"027b4a905fa54480f84b12a447a371ec9689da5458138dcf16a1e89a06c0a9fe"}
Sep 15 13:44:55.490816 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:55.490754    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-c4867564f-4zxcl" podStartSLOduration=1.49073382 podStartE2EDuration="1.49073382s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:44:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:44:55.489288776 +0000 UTC m=+382.248415064" watchObservedRunningTime="2026-09-15 13:44:55.49073382 +0000 UTC m=+382.249860107"
Sep 15 13:44:57.474455 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:57.474423    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-698b9db946-nq62k" event={"ID":"d3daa183-93c9-4594-ac13-c48a9432b956","Type":"ContainerStarted","Data":"3aaf0b6dbaa0c46a9c24f2e4fb0489ac2cd37739cd24a89afc5f3232a700e16e"}
Sep 15 13:44:57.491996 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:44:57.491949    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-698b9db946-nq62k" podStartSLOduration=1.7516697460000001 podStartE2EDuration="4.491934173s" totalImagesPullingTime="2.740264427s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:44:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:44:57.490929892 +0000 UTC m=+384.250056179" watchObservedRunningTime="2026-09-15 13:44:57.491934173 +0000 UTC m=+384.251060458"
Sep 15 13:45:01.218652 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:01.218609    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cn944f"]
Sep 15 13:45:01.222478 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:01.222446    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cn944f"
Sep 15 13:45:01.224789 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:01.224766    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 15 13:45:01.224912 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:01.224795    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-48qg8\""
Sep 15 13:45:01.239671 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:01.239648    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cn944f"]
Sep 15 13:45:01.308943 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:01.308910    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c36a0b6f-a495-4981-a50c-116c85318be0-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cn944f\" (UID: \"c36a0b6f-a495-4981-a50c-116c85318be0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cn944f"
Sep 15 13:45:01.308943 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:01.308949    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c36a0b6f-a495-4981-a50c-116c85318be0-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cn944f\" (UID: \"c36a0b6f-a495-4981-a50c-116c85318be0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cn944f"
Sep 15 13:45:01.309157 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:01.308967    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c36a0b6f-a495-4981-a50c-116c85318be0-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cn944f\" (UID: \"c36a0b6f-a495-4981-a50c-116c85318be0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cn944f"
Sep 15 13:45:01.309157 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:01.309057    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c36a0b6f-a495-4981-a50c-116c85318be0-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cn944f\" (UID: \"c36a0b6f-a495-4981-a50c-116c85318be0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cn944f"
Sep 15 13:45:01.309157 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:01.309102    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c36a0b6f-a495-4981-a50c-116c85318be0-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cn944f\" (UID: \"c36a0b6f-a495-4981-a50c-116c85318be0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cn944f"
Sep 15 13:45:01.309272 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:01.309159    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c36a0b6f-a495-4981-a50c-116c85318be0-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cn944f\" (UID: \"c36a0b6f-a495-4981-a50c-116c85318be0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cn944f"
Sep 15 13:45:01.309272 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:01.309185    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c36a0b6f-a495-4981-a50c-116c85318be0-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cn944f\" (UID: \"c36a0b6f-a495-4981-a50c-116c85318be0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cn944f"
Sep 15 13:45:01.309272 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:01.309200    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrghv\" (UniqueName: \"kubernetes.io/projected/c36a0b6f-a495-4981-a50c-116c85318be0-kube-api-access-xrghv\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cn944f\" (UID: \"c36a0b6f-a495-4981-a50c-116c85318be0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cn944f"
Sep 15 13:45:01.309272 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:01.309219    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c36a0b6f-a495-4981-a50c-116c85318be0-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cn944f\" (UID: \"c36a0b6f-a495-4981-a50c-116c85318be0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cn944f"
Sep 15 13:45:01.410319 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:01.410287    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c36a0b6f-a495-4981-a50c-116c85318be0-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cn944f\" (UID: \"c36a0b6f-a495-4981-a50c-116c85318be0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cn944f"
Sep 15 13:45:01.410511 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:01.410337    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c36a0b6f-a495-4981-a50c-116c85318be0-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cn944f\" (UID: \"c36a0b6f-a495-4981-a50c-116c85318be0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cn944f"
Sep 15 13:45:01.410511 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:01.410368    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c36a0b6f-a495-4981-a50c-116c85318be0-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cn944f\" (UID: \"c36a0b6f-a495-4981-a50c-116c85318be0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cn944f"
Sep 15 13:45:01.410511 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:01.410388    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrghv\" (UniqueName: \"kubernetes.io/projected/c36a0b6f-a495-4981-a50c-116c85318be0-kube-api-access-xrghv\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cn944f\" (UID: \"c36a0b6f-a495-4981-a50c-116c85318be0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cn944f"
Sep 15 13:45:01.410511 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:01.410414    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c36a0b6f-a495-4981-a50c-116c85318be0-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cn944f\" (UID: \"c36a0b6f-a495-4981-a50c-116c85318be0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cn944f"
Sep 15 13:45:01.410511 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:01.410456    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c36a0b6f-a495-4981-a50c-116c85318be0-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cn944f\" (UID: \"c36a0b6f-a495-4981-a50c-116c85318be0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cn944f"
Sep 15 13:45:01.410787 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:01.410575    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c36a0b6f-a495-4981-a50c-116c85318be0-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cn944f\" (UID: \"c36a0b6f-a495-4981-a50c-116c85318be0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cn944f"
Sep 15 13:45:01.410787 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:01.410643    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c36a0b6f-a495-4981-a50c-116c85318be0-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cn944f\" (UID: \"c36a0b6f-a495-4981-a50c-116c85318be0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cn944f"
Sep 15 13:45:01.410787 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:01.410713    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c36a0b6f-a495-4981-a50c-116c85318be0-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cn944f\" (UID: \"c36a0b6f-a495-4981-a50c-116c85318be0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cn944f"
Sep 15 13:45:01.410787 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:01.410722    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c36a0b6f-a495-4981-a50c-116c85318be0-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cn944f\" (UID: \"c36a0b6f-a495-4981-a50c-116c85318be0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cn944f"
Sep 15 13:45:01.410983 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:01.410967    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c36a0b6f-a495-4981-a50c-116c85318be0-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cn944f\" (UID: \"c36a0b6f-a495-4981-a50c-116c85318be0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cn944f"
Sep 15 13:45:01.411045 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:01.411003    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c36a0b6f-a495-4981-a50c-116c85318be0-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cn944f\" (UID: \"c36a0b6f-a495-4981-a50c-116c85318be0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cn944f"
Sep 15 13:45:01.411100 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:01.411051    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c36a0b6f-a495-4981-a50c-116c85318be0-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cn944f\" (UID: \"c36a0b6f-a495-4981-a50c-116c85318be0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cn944f"
Sep 15 13:45:01.411248 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:01.411217    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c36a0b6f-a495-4981-a50c-116c85318be0-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cn944f\" (UID: \"c36a0b6f-a495-4981-a50c-116c85318be0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cn944f"
Sep 15 13:45:01.412788 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:01.412768    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c36a0b6f-a495-4981-a50c-116c85318be0-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cn944f\" (UID: \"c36a0b6f-a495-4981-a50c-116c85318be0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cn944f"
Sep 15 13:45:01.413037 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:01.413019    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c36a0b6f-a495-4981-a50c-116c85318be0-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cn944f\" (UID: \"c36a0b6f-a495-4981-a50c-116c85318be0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cn944f"
Sep 15 13:45:01.419840 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:01.419819    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c36a0b6f-a495-4981-a50c-116c85318be0-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cn944f\" (UID: \"c36a0b6f-a495-4981-a50c-116c85318be0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cn944f"
Sep 15 13:45:01.420582 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:01.420562    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrghv\" (UniqueName: \"kubernetes.io/projected/c36a0b6f-a495-4981-a50c-116c85318be0-kube-api-access-xrghv\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cn944f\" (UID: \"c36a0b6f-a495-4981-a50c-116c85318be0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cn944f"
Sep 15 13:45:01.532857 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:01.532832    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cn944f"
Sep 15 13:45:01.808747 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:01.808725    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cn944f"]
Sep 15 13:45:01.810672 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:45:01.810648    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc36a0b6f_a495_4981_a50c_116c85318be0.slice/crio-3a6ede0fbd169509bd62854795458bd3d422426d1043a317e3515de881962780 WatchSource:0}: Error finding container 3a6ede0fbd169509bd62854795458bd3d422426d1043a317e3515de881962780: Status 404 returned error can't find the container with id 3a6ede0fbd169509bd62854795458bd3d422426d1043a317e3515de881962780
Sep 15 13:45:02.502924 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:02.502883    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cn944f" event={"ID":"c36a0b6f-a495-4981-a50c-116c85318be0","Type":"ContainerStarted","Data":"3a6ede0fbd169509bd62854795458bd3d422426d1043a317e3515de881962780"}
Sep 15 13:45:04.713381 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:04.713350    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-5r2sc"]
Sep 15 13:45:04.719807 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:04.719781    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-5r2sc"
Sep 15 13:45:04.725542 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:04.725514    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Sep 15 13:45:04.725674 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:04.725516    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-mmx94\""
Sep 15 13:45:04.737982 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:04.737953    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-5r2sc"]
Sep 15 13:45:04.739576 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:04.739544    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54hdd\" (UniqueName: \"kubernetes.io/projected/116b8837-faa3-4205-a545-74d5d324da96-kube-api-access-54hdd\") pod \"odh-model-controller-7998c67dc4-5r2sc\" (UID: \"116b8837-faa3-4205-a545-74d5d324da96\") " pod="opendatahub/odh-model-controller-7998c67dc4-5r2sc"
Sep 15 13:45:04.739723 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:04.739593    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/116b8837-faa3-4205-a545-74d5d324da96-cert\") pod \"odh-model-controller-7998c67dc4-5r2sc\" (UID: \"116b8837-faa3-4205-a545-74d5d324da96\") " pod="opendatahub/odh-model-controller-7998c67dc4-5r2sc"
Sep 15 13:45:04.840960 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:04.840916    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54hdd\" (UniqueName: \"kubernetes.io/projected/116b8837-faa3-4205-a545-74d5d324da96-kube-api-access-54hdd\") pod \"odh-model-controller-7998c67dc4-5r2sc\" (UID: \"116b8837-faa3-4205-a545-74d5d324da96\") " pod="opendatahub/odh-model-controller-7998c67dc4-5r2sc"
Sep 15 13:45:04.841164 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:04.840970    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/116b8837-faa3-4205-a545-74d5d324da96-cert\") pod \"odh-model-controller-7998c67dc4-5r2sc\" (UID: \"116b8837-faa3-4205-a545-74d5d324da96\") " pod="opendatahub/odh-model-controller-7998c67dc4-5r2sc"
Sep 15 13:45:04.841640 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:45:04.841550    2578 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Sep 15 13:45:04.841640 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:45:04.841630    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/116b8837-faa3-4205-a545-74d5d324da96-cert podName:116b8837-faa3-4205-a545-74d5d324da96 nodeName:}" failed. No retries permitted until 2026-09-15 13:45:05.341607023 +0000 UTC m=+392.100733303 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/116b8837-faa3-4205-a545-74d5d324da96-cert") pod "odh-model-controller-7998c67dc4-5r2sc" (UID: "116b8837-faa3-4205-a545-74d5d324da96") : secret "odh-model-controller-webhook-cert" not found
Sep 15 13:45:04.853044 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:04.853013    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-54hdd\" (UniqueName: \"kubernetes.io/projected/116b8837-faa3-4205-a545-74d5d324da96-kube-api-access-54hdd\") pod \"odh-model-controller-7998c67dc4-5r2sc\" (UID: \"116b8837-faa3-4205-a545-74d5d324da96\") " pod="opendatahub/odh-model-controller-7998c67dc4-5r2sc"
Sep 15 13:45:04.916109 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:04.916056    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-c4867564f-4zxcl"
Sep 15 13:45:04.916370 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:04.916232    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-c4867564f-4zxcl"
Sep 15 13:45:04.921576 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:04.921548    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-c4867564f-4zxcl"
Sep 15 13:45:05.265008 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:05.264966    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-78hrh"]
Sep 15 13:45:05.272461 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:05.272437    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-78hrh"
Sep 15 13:45:05.274976 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:05.274954    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Sep 15 13:45:05.275108 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:05.275001    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-tfcnr\""
Sep 15 13:45:05.283074 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:05.283043    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-78hrh"]
Sep 15 13:45:05.347846 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:05.347808    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k97ct\" (UniqueName: \"kubernetes.io/projected/0f80514d-701e-4963-a345-48c7d8796057-kube-api-access-k97ct\") pod \"model-serving-api-54d89bd5fc-78hrh\" (UID: \"0f80514d-701e-4963-a345-48c7d8796057\") " pod="opendatahub/model-serving-api-54d89bd5fc-78hrh"
Sep 15 13:45:05.348044 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:05.347866    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/116b8837-faa3-4205-a545-74d5d324da96-cert\") pod \"odh-model-controller-7998c67dc4-5r2sc\" (UID: \"116b8837-faa3-4205-a545-74d5d324da96\") " pod="opendatahub/odh-model-controller-7998c67dc4-5r2sc"
Sep 15 13:45:05.348044 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:05.347948    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f80514d-701e-4963-a345-48c7d8796057-tls-certs\") pod \"model-serving-api-54d89bd5fc-78hrh\" (UID: \"0f80514d-701e-4963-a345-48c7d8796057\") " pod="opendatahub/model-serving-api-54d89bd5fc-78hrh"
Sep 15 13:45:05.350927 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:05.350898    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/116b8837-faa3-4205-a545-74d5d324da96-cert\") pod \"odh-model-controller-7998c67dc4-5r2sc\" (UID: \"116b8837-faa3-4205-a545-74d5d324da96\") " pod="opendatahub/odh-model-controller-7998c67dc4-5r2sc"
Sep 15 13:45:05.449173 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:05.449133    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k97ct\" (UniqueName: \"kubernetes.io/projected/0f80514d-701e-4963-a345-48c7d8796057-kube-api-access-k97ct\") pod \"model-serving-api-54d89bd5fc-78hrh\" (UID: \"0f80514d-701e-4963-a345-48c7d8796057\") " pod="opendatahub/model-serving-api-54d89bd5fc-78hrh"
Sep 15 13:45:05.449352 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:05.449228    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f80514d-701e-4963-a345-48c7d8796057-tls-certs\") pod \"model-serving-api-54d89bd5fc-78hrh\" (UID: \"0f80514d-701e-4963-a345-48c7d8796057\") " pod="opendatahub/model-serving-api-54d89bd5fc-78hrh"
Sep 15 13:45:05.449428 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:45:05.449389    2578 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Sep 15 13:45:05.449493 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:45:05.449483    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f80514d-701e-4963-a345-48c7d8796057-tls-certs podName:0f80514d-701e-4963-a345-48c7d8796057 nodeName:}" failed. No retries permitted until 2026-09-15 13:45:05.949452454 +0000 UTC m=+392.708578734 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/0f80514d-701e-4963-a345-48c7d8796057-tls-certs") pod "model-serving-api-54d89bd5fc-78hrh" (UID: "0f80514d-701e-4963-a345-48c7d8796057") : secret "model-serving-api-tls" not found
Sep 15 13:45:05.460501 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:05.460471    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k97ct\" (UniqueName: \"kubernetes.io/projected/0f80514d-701e-4963-a345-48c7d8796057-kube-api-access-k97ct\") pod \"model-serving-api-54d89bd5fc-78hrh\" (UID: \"0f80514d-701e-4963-a345-48c7d8796057\") " pod="opendatahub/model-serving-api-54d89bd5fc-78hrh"
Sep 15 13:45:05.523464 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:05.523374    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-c4867564f-4zxcl"
Sep 15 13:45:05.570559 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:05.570527    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-846b8bbf66-952lx"]
Sep 15 13:45:05.632414 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:05.632383    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-5r2sc"
Sep 15 13:45:05.703601 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:05.703560    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 15 13:45:05.703707 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:05.703636    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 15 13:45:05.703707 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:05.703663    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 15 13:45:05.910747 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:05.910717    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-5r2sc"]
Sep 15 13:45:05.917912 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:45:05.917869    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod116b8837_faa3_4205_a545_74d5d324da96.slice/crio-4342fd916617d1d7707ca6931101dcb1392b66132448e4f1625b54eec9bdd5dc WatchSource:0}: Error finding container 4342fd916617d1d7707ca6931101dcb1392b66132448e4f1625b54eec9bdd5dc: Status 404 returned error can't find the container with id 4342fd916617d1d7707ca6931101dcb1392b66132448e4f1625b54eec9bdd5dc
Sep 15 13:45:05.954418 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:05.954387    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f80514d-701e-4963-a345-48c7d8796057-tls-certs\") pod \"model-serving-api-54d89bd5fc-78hrh\" (UID: \"0f80514d-701e-4963-a345-48c7d8796057\") " pod="opendatahub/model-serving-api-54d89bd5fc-78hrh"
Sep 15 13:45:05.957028 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:05.957007    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f80514d-701e-4963-a345-48c7d8796057-tls-certs\") pod \"model-serving-api-54d89bd5fc-78hrh\" (UID: \"0f80514d-701e-4963-a345-48c7d8796057\") " pod="opendatahub/model-serving-api-54d89bd5fc-78hrh"
Sep 15 13:45:06.186104 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:06.186015    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-78hrh"
Sep 15 13:45:06.464109 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:06.464086    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-78hrh"]
Sep 15 13:45:06.466424 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:45:06.466396    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f80514d_701e_4963_a345_48c7d8796057.slice/crio-66919064232fa7ceeb22160bd23a44220e6b99e9ccbb89d7e256eabebb48d38c WatchSource:0}: Error finding container 66919064232fa7ceeb22160bd23a44220e6b99e9ccbb89d7e256eabebb48d38c: Status 404 returned error can't find the container with id 66919064232fa7ceeb22160bd23a44220e6b99e9ccbb89d7e256eabebb48d38c
Sep 15 13:45:06.526325 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:06.526273    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-78hrh" event={"ID":"0f80514d-701e-4963-a345-48c7d8796057","Type":"ContainerStarted","Data":"66919064232fa7ceeb22160bd23a44220e6b99e9ccbb89d7e256eabebb48d38c"}
Sep 15 13:45:06.528534 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:06.528432    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cn944f" event={"ID":"c36a0b6f-a495-4981-a50c-116c85318be0","Type":"ContainerStarted","Data":"fc51385a953bb6da840c9a48f9ccf7cfb3345fba3cbf122b0238ca85e46584a5"}
Sep 15 13:45:06.529992 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:06.529963    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-5r2sc" event={"ID":"116b8837-faa3-4205-a545-74d5d324da96","Type":"ContainerStarted","Data":"4342fd916617d1d7707ca6931101dcb1392b66132448e4f1625b54eec9bdd5dc"}
Sep 15 13:45:06.533469 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:06.533438    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cn944f"
Sep 15 13:45:06.538620 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:06.538599    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cn944f"
Sep 15 13:45:06.550940 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:06.550879    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cn944f" podStartSLOduration=1.660241336 podStartE2EDuration="5.550863361s" totalImagesPullingTime="3.890622025s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:45:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:45:06.548560953 +0000 UTC m=+393.307687244" watchObservedRunningTime="2026-09-15 13:45:06.550863361 +0000 UTC m=+393.309989704"
Sep 15 13:45:07.537118 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:07.537091    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cn944f"
Sep 15 13:45:07.538427 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:07.538368    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cn944f"
Sep 15 13:45:09.548368 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:09.548330    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-5r2sc" event={"ID":"116b8837-faa3-4205-a545-74d5d324da96","Type":"ContainerStarted","Data":"b66339470642ba798b1e99818a974fcf7af82e4e1fc165ad535e48bf6e96fe85"}
Sep 15 13:45:09.548851 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:09.548395    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-5r2sc"
Sep 15 13:45:09.550007 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:09.549974    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-78hrh" event={"ID":"0f80514d-701e-4963-a345-48c7d8796057","Type":"ContainerStarted","Data":"918a20240a4c285bc83a5f0ef9a8774f38f1fc7260d6dc80362c90db89825498"}
Sep 15 13:45:09.550179 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:09.550161    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-78hrh"
Sep 15 13:45:09.565569 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:09.565525    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-5r2sc" podStartSLOduration=2.521982944 podStartE2EDuration="5.565509888s" totalImagesPullingTime="3.043526944s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:45:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:45:09.564187365 +0000 UTC m=+396.323313853" watchObservedRunningTime="2026-09-15 13:45:09.565509888 +0000 UTC m=+396.324636217"
Sep 15 13:45:09.582178 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:09.582113    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-78hrh" podStartSLOduration=2.08940429 podStartE2EDuration="4.582096796s" totalImagesPullingTime="2.492692506s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:45:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:45:09.580497663 +0000 UTC m=+396.339623949" watchObservedRunningTime="2026-09-15 13:45:09.582096796 +0000 UTC m=+396.341223396"
Sep 15 13:45:12.340794 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:12.340758    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6445fb96b-7t5vn"]
Sep 15 13:45:12.345904 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:12.345884    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6445fb96b-7t5vn"
Sep 15 13:45:12.349923 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:12.349904    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 15 13:45:12.350036 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:12.350019    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 15 13:45:12.355258 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:12.355242    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-rnhvs\""
Sep 15 13:45:12.355390 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:12.355375    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 15 13:45:12.361706 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:12.361682    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6445fb96b-7t5vn"]
Sep 15 13:45:12.414388 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:12.414355    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/28bf48a5-85e3-471e-be49-742bee0e1b7a-cert\") pod \"lws-controller-manager-6445fb96b-7t5vn\" (UID: \"28bf48a5-85e3-471e-be49-742bee0e1b7a\") " pod="openshift-lws-operator/lws-controller-manager-6445fb96b-7t5vn"
Sep 15 13:45:12.414388 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:12.414387    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnzcc\" (UniqueName: \"kubernetes.io/projected/28bf48a5-85e3-471e-be49-742bee0e1b7a-kube-api-access-hnzcc\") pod \"lws-controller-manager-6445fb96b-7t5vn\" (UID: \"28bf48a5-85e3-471e-be49-742bee0e1b7a\") " pod="openshift-lws-operator/lws-controller-manager-6445fb96b-7t5vn"
Sep 15 13:45:12.414611 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:12.414489    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/28bf48a5-85e3-471e-be49-742bee0e1b7a-manager-config\") pod \"lws-controller-manager-6445fb96b-7t5vn\" (UID: \"28bf48a5-85e3-471e-be49-742bee0e1b7a\") " pod="openshift-lws-operator/lws-controller-manager-6445fb96b-7t5vn"
Sep 15 13:45:12.414611 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:12.414572    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/28bf48a5-85e3-471e-be49-742bee0e1b7a-metrics-cert\") pod \"lws-controller-manager-6445fb96b-7t5vn\" (UID: \"28bf48a5-85e3-471e-be49-742bee0e1b7a\") " pod="openshift-lws-operator/lws-controller-manager-6445fb96b-7t5vn"
Sep 15 13:45:12.515698 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:12.515665    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnzcc\" (UniqueName: \"kubernetes.io/projected/28bf48a5-85e3-471e-be49-742bee0e1b7a-kube-api-access-hnzcc\") pod \"lws-controller-manager-6445fb96b-7t5vn\" (UID: \"28bf48a5-85e3-471e-be49-742bee0e1b7a\") " pod="openshift-lws-operator/lws-controller-manager-6445fb96b-7t5vn"
Sep 15 13:45:12.515856 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:12.515746    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/28bf48a5-85e3-471e-be49-742bee0e1b7a-manager-config\") pod \"lws-controller-manager-6445fb96b-7t5vn\" (UID: \"28bf48a5-85e3-471e-be49-742bee0e1b7a\") " pod="openshift-lws-operator/lws-controller-manager-6445fb96b-7t5vn"
Sep 15 13:45:12.515856 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:12.515821    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/28bf48a5-85e3-471e-be49-742bee0e1b7a-metrics-cert\") pod \"lws-controller-manager-6445fb96b-7t5vn\" (UID: \"28bf48a5-85e3-471e-be49-742bee0e1b7a\") " pod="openshift-lws-operator/lws-controller-manager-6445fb96b-7t5vn"
Sep 15 13:45:12.515856 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:12.515849    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/28bf48a5-85e3-471e-be49-742bee0e1b7a-cert\") pod \"lws-controller-manager-6445fb96b-7t5vn\" (UID: \"28bf48a5-85e3-471e-be49-742bee0e1b7a\") " pod="openshift-lws-operator/lws-controller-manager-6445fb96b-7t5vn"
Sep 15 13:45:12.516434 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:12.516402    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/28bf48a5-85e3-471e-be49-742bee0e1b7a-manager-config\") pod \"lws-controller-manager-6445fb96b-7t5vn\" (UID: \"28bf48a5-85e3-471e-be49-742bee0e1b7a\") " pod="openshift-lws-operator/lws-controller-manager-6445fb96b-7t5vn"
Sep 15 13:45:12.518624 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:12.518601    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/28bf48a5-85e3-471e-be49-742bee0e1b7a-metrics-cert\") pod \"lws-controller-manager-6445fb96b-7t5vn\" (UID: \"28bf48a5-85e3-471e-be49-742bee0e1b7a\") " pod="openshift-lws-operator/lws-controller-manager-6445fb96b-7t5vn"
Sep 15 13:45:12.518710 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:12.518654    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/28bf48a5-85e3-471e-be49-742bee0e1b7a-cert\") pod \"lws-controller-manager-6445fb96b-7t5vn\" (UID: \"28bf48a5-85e3-471e-be49-742bee0e1b7a\") " pod="openshift-lws-operator/lws-controller-manager-6445fb96b-7t5vn"
Sep 15 13:45:12.524340 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:12.524320    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnzcc\" (UniqueName: \"kubernetes.io/projected/28bf48a5-85e3-471e-be49-742bee0e1b7a-kube-api-access-hnzcc\") pod \"lws-controller-manager-6445fb96b-7t5vn\" (UID: \"28bf48a5-85e3-471e-be49-742bee0e1b7a\") " pod="openshift-lws-operator/lws-controller-manager-6445fb96b-7t5vn"
Sep 15 13:45:12.655549 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:12.655464    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6445fb96b-7t5vn"
Sep 15 13:45:12.958889 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:12.958869    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6445fb96b-7t5vn"]
Sep 15 13:45:12.960646 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:45:12.960622    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28bf48a5_85e3_471e_be49_742bee0e1b7a.slice/crio-3ea55e05982a5c74891b40c678c92b1f02f9d3f9fa9ce3d9147059cd77b154bc WatchSource:0}: Error finding container 3ea55e05982a5c74891b40c678c92b1f02f9d3f9fa9ce3d9147059cd77b154bc: Status 404 returned error can't find the container with id 3ea55e05982a5c74891b40c678c92b1f02f9d3f9fa9ce3d9147059cd77b154bc
Sep 15 13:45:13.570180 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:13.570144    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6445fb96b-7t5vn" event={"ID":"28bf48a5-85e3-471e-be49-742bee0e1b7a","Type":"ContainerStarted","Data":"3ea55e05982a5c74891b40c678c92b1f02f9d3f9fa9ce3d9147059cd77b154bc"}
Sep 15 13:45:15.582211 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:15.582173    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6445fb96b-7t5vn" event={"ID":"28bf48a5-85e3-471e-be49-742bee0e1b7a","Type":"ContainerStarted","Data":"6278bdc9cac2b1762d0faf844eb93f7da5e80b63cddd7432f421536792824e43"}
Sep 15 13:45:15.582659 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:15.582289    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6445fb96b-7t5vn"
Sep 15 13:45:15.631361 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:15.631306    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6445fb96b-7t5vn" podStartSLOduration=1.8654741910000001 podStartE2EDuration="3.631291092s" totalImagesPullingTime="1.765816901s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:45:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:45:15.629240261 +0000 UTC m=+402.388366546" watchObservedRunningTime="2026-09-15 13:45:15.631291092 +0000 UTC m=+402.390417379"
Sep 15 13:45:20.556510 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:20.556474    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-5r2sc"
Sep 15 13:45:20.558300 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:20.558279    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-78hrh"
Sep 15 13:45:26.588932 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:26.588895    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6445fb96b-7t5vn"
Sep 15 13:45:30.598742 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:30.598699    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-846b8bbf66-952lx" podUID="7ca8f112-ac2a-4653-896f-f09c53976903" containerName="console" containerID="cri-o://6963934d88a155ef16a1af0981647ebababb6ed454e7869b0a6ecf043a4e5067" gracePeriod=15
Sep 15 13:45:30.840895 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:30.840875    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-846b8bbf66-952lx"
Sep 15 13:45:30.978352 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:30.978276    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7ca8f112-ac2a-4653-896f-f09c53976903-service-ca\") pod \"7ca8f112-ac2a-4653-896f-f09c53976903\" (UID: \"7ca8f112-ac2a-4653-896f-f09c53976903\") "
Sep 15 13:45:30.978352 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:30.978314    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7ca8f112-ac2a-4653-896f-f09c53976903-console-config\") pod \"7ca8f112-ac2a-4653-896f-f09c53976903\" (UID: \"7ca8f112-ac2a-4653-896f-f09c53976903\") "
Sep 15 13:45:30.978352 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:30.978334    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7ca8f112-ac2a-4653-896f-f09c53976903-console-serving-cert\") pod \"7ca8f112-ac2a-4653-896f-f09c53976903\" (UID: \"7ca8f112-ac2a-4653-896f-f09c53976903\") "
Sep 15 13:45:30.978352 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:30.978353    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6vkvt\" (UniqueName: \"kubernetes.io/projected/7ca8f112-ac2a-4653-896f-f09c53976903-kube-api-access-6vkvt\") pod \"7ca8f112-ac2a-4653-896f-f09c53976903\" (UID: \"7ca8f112-ac2a-4653-896f-f09c53976903\") "
Sep 15 13:45:30.978605 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:30.978483    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7ca8f112-ac2a-4653-896f-f09c53976903-console-oauth-config\") pod \"7ca8f112-ac2a-4653-896f-f09c53976903\" (UID: \"7ca8f112-ac2a-4653-896f-f09c53976903\") "
Sep 15 13:45:30.978605 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:30.978537    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7ca8f112-ac2a-4653-896f-f09c53976903-oauth-serving-cert\") pod \"7ca8f112-ac2a-4653-896f-f09c53976903\" (UID: \"7ca8f112-ac2a-4653-896f-f09c53976903\") "
Sep 15 13:45:30.978605 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:30.978585    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ca8f112-ac2a-4653-896f-f09c53976903-trusted-ca-bundle\") pod \"7ca8f112-ac2a-4653-896f-f09c53976903\" (UID: \"7ca8f112-ac2a-4653-896f-f09c53976903\") "
Sep 15 13:45:30.978755 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:30.978656    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ca8f112-ac2a-4653-896f-f09c53976903-service-ca" (OuterVolumeSpecName: "service-ca") pod "7ca8f112-ac2a-4653-896f-f09c53976903" (UID: "7ca8f112-ac2a-4653-896f-f09c53976903"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 13:45:30.978755 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:30.978721    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ca8f112-ac2a-4653-896f-f09c53976903-console-config" (OuterVolumeSpecName: "console-config") pod "7ca8f112-ac2a-4653-896f-f09c53976903" (UID: "7ca8f112-ac2a-4653-896f-f09c53976903"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 13:45:30.978879 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:30.978860    2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7ca8f112-ac2a-4653-896f-f09c53976903-console-config\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:45:30.978937 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:30.978887    2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7ca8f112-ac2a-4653-896f-f09c53976903-service-ca\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:45:30.979023 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:30.978991    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ca8f112-ac2a-4653-896f-f09c53976903-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "7ca8f112-ac2a-4653-896f-f09c53976903" (UID: "7ca8f112-ac2a-4653-896f-f09c53976903"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 13:45:30.979324 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:30.979302    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ca8f112-ac2a-4653-896f-f09c53976903-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "7ca8f112-ac2a-4653-896f-f09c53976903" (UID: "7ca8f112-ac2a-4653-896f-f09c53976903"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 13:45:30.980669 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:30.980644    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ca8f112-ac2a-4653-896f-f09c53976903-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "7ca8f112-ac2a-4653-896f-f09c53976903" (UID: "7ca8f112-ac2a-4653-896f-f09c53976903"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 13:45:30.981057 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:30.981022    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ca8f112-ac2a-4653-896f-f09c53976903-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "7ca8f112-ac2a-4653-896f-f09c53976903" (UID: "7ca8f112-ac2a-4653-896f-f09c53976903"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 13:45:30.981057 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:30.981036    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ca8f112-ac2a-4653-896f-f09c53976903-kube-api-access-6vkvt" (OuterVolumeSpecName: "kube-api-access-6vkvt") pod "7ca8f112-ac2a-4653-896f-f09c53976903" (UID: "7ca8f112-ac2a-4653-896f-f09c53976903"). InnerVolumeSpecName "kube-api-access-6vkvt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:45:31.079517 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:31.079484    2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7ca8f112-ac2a-4653-896f-f09c53976903-oauth-serving-cert\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:45:31.079517 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:31.079511    2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ca8f112-ac2a-4653-896f-f09c53976903-trusted-ca-bundle\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:45:31.079517 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:31.079520    2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7ca8f112-ac2a-4653-896f-f09c53976903-console-serving-cert\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:45:31.079740 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:31.079529    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6vkvt\" (UniqueName: \"kubernetes.io/projected/7ca8f112-ac2a-4653-896f-f09c53976903-kube-api-access-6vkvt\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:45:31.079740 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:31.079538    2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7ca8f112-ac2a-4653-896f-f09c53976903-console-oauth-config\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:45:31.662722 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:31.662680    2578 generic.go:356] "Generic (PLEG): container finished" podID="7ca8f112-ac2a-4653-896f-f09c53976903" containerID="6963934d88a155ef16a1af0981647ebababb6ed454e7869b0a6ecf043a4e5067" exitCode=0
Sep 15 13:45:31.663199 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:31.662730    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-846b8bbf66-952lx"
Sep 15 13:45:31.663199 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:31.662771    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-846b8bbf66-952lx" event={"ID":"7ca8f112-ac2a-4653-896f-f09c53976903","Type":"ContainerDied","Data":"6963934d88a155ef16a1af0981647ebababb6ed454e7869b0a6ecf043a4e5067"}
Sep 15 13:45:31.663199 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:31.662828    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-846b8bbf66-952lx" event={"ID":"7ca8f112-ac2a-4653-896f-f09c53976903","Type":"ContainerDied","Data":"d0d2f6118ef1f3be1bf8ce6e8f958a8b5a1e1ded34eec12800eb31e840638046"}
Sep 15 13:45:31.663199 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:31.662858    2578 scope.go:117] "RemoveContainer" containerID="6963934d88a155ef16a1af0981647ebababb6ed454e7869b0a6ecf043a4e5067"
Sep 15 13:45:31.671810 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:31.671796    2578 scope.go:117] "RemoveContainer" containerID="6963934d88a155ef16a1af0981647ebababb6ed454e7869b0a6ecf043a4e5067"
Sep 15 13:45:31.672074 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:45:31.672059    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6963934d88a155ef16a1af0981647ebababb6ed454e7869b0a6ecf043a4e5067\": container with ID starting with 6963934d88a155ef16a1af0981647ebababb6ed454e7869b0a6ecf043a4e5067 not found: ID does not exist" containerID="6963934d88a155ef16a1af0981647ebababb6ed454e7869b0a6ecf043a4e5067"
Sep 15 13:45:31.672118 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:31.672081    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6963934d88a155ef16a1af0981647ebababb6ed454e7869b0a6ecf043a4e5067"} err="failed to get container status \"6963934d88a155ef16a1af0981647ebababb6ed454e7869b0a6ecf043a4e5067\": rpc error: code = NotFound desc = could not find container \"6963934d88a155ef16a1af0981647ebababb6ed454e7869b0a6ecf043a4e5067\": container with ID starting with 6963934d88a155ef16a1af0981647ebababb6ed454e7869b0a6ecf043a4e5067 not found: ID does not exist"
Sep 15 13:45:31.683159 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:31.683138    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-846b8bbf66-952lx"]
Sep 15 13:45:31.688515 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:31.688495    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-846b8bbf66-952lx"]
Sep 15 13:45:31.757453 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:45:31.757422    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ca8f112-ac2a-4653-896f-f09c53976903" path="/var/lib/kubelet/pods/7ca8f112-ac2a-4653-896f-f09c53976903/volumes"
Sep 15 13:46:10.493886 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:10.493810    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6q7fsj"]
Sep 15 13:46:10.494324 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:10.494113    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ca8f112-ac2a-4653-896f-f09c53976903" containerName="console"
Sep 15 13:46:10.494324 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:10.494137    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ca8f112-ac2a-4653-896f-f09c53976903" containerName="console"
Sep 15 13:46:10.494324 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:10.494201    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ca8f112-ac2a-4653-896f-f09c53976903" containerName="console"
Sep 15 13:46:10.497192 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:10.497176    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6q7fsj"
Sep 15 13:46:10.499522 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:10.499504    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 15 13:46:10.499522 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:10.499517    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 15 13:46:10.500199 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:10.500185    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-bjmkq\""
Sep 15 13:46:10.505702 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:10.505676    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6q7fsj"]
Sep 15 13:46:10.588869 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:10.588837    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847akvz5r"]
Sep 15 13:46:10.592244 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:10.592228    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847akvz5r"
Sep 15 13:46:10.601985 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:10.601963    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847akvz5r"]
Sep 15 13:46:10.607110 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:10.607089    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bad73676-cbae-4246-a15b-500d4cb1e10f-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6q7fsj\" (UID: \"bad73676-cbae-4246-a15b-500d4cb1e10f\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6q7fsj"
Sep 15 13:46:10.607241 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:10.607148    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zt95\" (UniqueName: \"kubernetes.io/projected/bad73676-cbae-4246-a15b-500d4cb1e10f-kube-api-access-6zt95\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6q7fsj\" (UID: \"bad73676-cbae-4246-a15b-500d4cb1e10f\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6q7fsj"
Sep 15 13:46:10.607241 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:10.607188    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bad73676-cbae-4246-a15b-500d4cb1e10f-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6q7fsj\" (UID: \"bad73676-cbae-4246-a15b-500d4cb1e10f\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6q7fsj"
Sep 15 13:46:10.690997 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:10.690962    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vggjg"]
Sep 15 13:46:10.694532 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:10.694516    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vggjg"
Sep 15 13:46:10.703393 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:10.703368    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vggjg"]
Sep 15 13:46:10.708563 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:10.708541    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a2767eb7-33a7-40b7-a2ca-49834ecd40cc-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847akvz5r\" (UID: \"a2767eb7-33a7-40b7-a2ca-49834ecd40cc\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847akvz5r"
Sep 15 13:46:10.708681 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:10.708571    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bad73676-cbae-4246-a15b-500d4cb1e10f-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6q7fsj\" (UID: \"bad73676-cbae-4246-a15b-500d4cb1e10f\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6q7fsj"
Sep 15 13:46:10.708681 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:10.708608    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zt95\" (UniqueName: \"kubernetes.io/projected/bad73676-cbae-4246-a15b-500d4cb1e10f-kube-api-access-6zt95\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6q7fsj\" (UID: \"bad73676-cbae-4246-a15b-500d4cb1e10f\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6q7fsj"
Sep 15 13:46:10.708780 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:10.708670    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9jhh\" (UniqueName: \"kubernetes.io/projected/a2767eb7-33a7-40b7-a2ca-49834ecd40cc-kube-api-access-j9jhh\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847akvz5r\" (UID: \"a2767eb7-33a7-40b7-a2ca-49834ecd40cc\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847akvz5r"
Sep 15 13:46:10.708780 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:10.708742    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a2767eb7-33a7-40b7-a2ca-49834ecd40cc-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847akvz5r\" (UID: \"a2767eb7-33a7-40b7-a2ca-49834ecd40cc\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847akvz5r"
Sep 15 13:46:10.708862 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:10.708797    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bad73676-cbae-4246-a15b-500d4cb1e10f-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6q7fsj\" (UID: \"bad73676-cbae-4246-a15b-500d4cb1e10f\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6q7fsj"
Sep 15 13:46:10.708940 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:10.708922    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bad73676-cbae-4246-a15b-500d4cb1e10f-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6q7fsj\" (UID: \"bad73676-cbae-4246-a15b-500d4cb1e10f\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6q7fsj"
Sep 15 13:46:10.709058 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:10.709042    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bad73676-cbae-4246-a15b-500d4cb1e10f-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6q7fsj\" (UID: \"bad73676-cbae-4246-a15b-500d4cb1e10f\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6q7fsj"
Sep 15 13:46:10.716895 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:10.716871    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zt95\" (UniqueName: \"kubernetes.io/projected/bad73676-cbae-4246-a15b-500d4cb1e10f-kube-api-access-6zt95\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6q7fsj\" (UID: \"bad73676-cbae-4246-a15b-500d4cb1e10f\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6q7fsj"
Sep 15 13:46:10.797268 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:10.797235    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crckc8"]
Sep 15 13:46:10.800819 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:10.800803    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crckc8"
Sep 15 13:46:10.806643 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:10.806622    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6q7fsj"
Sep 15 13:46:10.810236 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:10.809744    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fc3569ef-2d3d-4ec3-925e-8eea936a94e1-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vggjg\" (UID: \"fc3569ef-2d3d-4ec3-925e-8eea936a94e1\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vggjg"
Sep 15 13:46:10.810236 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:10.809786    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9jhh\" (UniqueName: \"kubernetes.io/projected/a2767eb7-33a7-40b7-a2ca-49834ecd40cc-kube-api-access-j9jhh\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847akvz5r\" (UID: \"a2767eb7-33a7-40b7-a2ca-49834ecd40cc\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847akvz5r"
Sep 15 13:46:10.810236 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:10.809825    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a2767eb7-33a7-40b7-a2ca-49834ecd40cc-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847akvz5r\" (UID: \"a2767eb7-33a7-40b7-a2ca-49834ecd40cc\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847akvz5r"
Sep 15 13:46:10.810236 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:10.809924    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a2767eb7-33a7-40b7-a2ca-49834ecd40cc-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847akvz5r\" (UID: \"a2767eb7-33a7-40b7-a2ca-49834ecd40cc\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847akvz5r"
Sep 15 13:46:10.810236 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:10.809958    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dtmh\" (UniqueName: \"kubernetes.io/projected/fc3569ef-2d3d-4ec3-925e-8eea936a94e1-kube-api-access-5dtmh\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vggjg\" (UID: \"fc3569ef-2d3d-4ec3-925e-8eea936a94e1\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vggjg"
Sep 15 13:46:10.810236 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:10.809994    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fc3569ef-2d3d-4ec3-925e-8eea936a94e1-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vggjg\" (UID: \"fc3569ef-2d3d-4ec3-925e-8eea936a94e1\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vggjg"
Sep 15 13:46:10.810656 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:10.810632    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a2767eb7-33a7-40b7-a2ca-49834ecd40cc-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847akvz5r\" (UID: \"a2767eb7-33a7-40b7-a2ca-49834ecd40cc\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847akvz5r"
Sep 15 13:46:10.810732 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:10.810677    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a2767eb7-33a7-40b7-a2ca-49834ecd40cc-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847akvz5r\" (UID: \"a2767eb7-33a7-40b7-a2ca-49834ecd40cc\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847akvz5r"
Sep 15 13:46:10.811312 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:10.811284    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crckc8"]
Sep 15 13:46:10.821780 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:10.821759    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9jhh\" (UniqueName: \"kubernetes.io/projected/a2767eb7-33a7-40b7-a2ca-49834ecd40cc-kube-api-access-j9jhh\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847akvz5r\" (UID: \"a2767eb7-33a7-40b7-a2ca-49834ecd40cc\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847akvz5r"
Sep 15 13:46:10.901299 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:10.901262    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847akvz5r"
Sep 15 13:46:10.910695 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:10.910672    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5dtmh\" (UniqueName: \"kubernetes.io/projected/fc3569ef-2d3d-4ec3-925e-8eea936a94e1-kube-api-access-5dtmh\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vggjg\" (UID: \"fc3569ef-2d3d-4ec3-925e-8eea936a94e1\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vggjg"
Sep 15 13:46:10.910828 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:10.910707    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fc3569ef-2d3d-4ec3-925e-8eea936a94e1-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vggjg\" (UID: \"fc3569ef-2d3d-4ec3-925e-8eea936a94e1\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vggjg"
Sep 15 13:46:10.910828 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:10.910752    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/03d5cf30-0b3f-42ff-b6f4-50e510aa9e6f-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crckc8\" (UID: \"03d5cf30-0b3f-42ff-b6f4-50e510aa9e6f\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crckc8"
Sep 15 13:46:10.910828 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:10.910784    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fc3569ef-2d3d-4ec3-925e-8eea936a94e1-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vggjg\" (UID: \"fc3569ef-2d3d-4ec3-925e-8eea936a94e1\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vggjg"
Sep 15 13:46:10.910828 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:10.910817    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgsf4\" (UniqueName: \"kubernetes.io/projected/03d5cf30-0b3f-42ff-b6f4-50e510aa9e6f-kube-api-access-tgsf4\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crckc8\" (UID: \"03d5cf30-0b3f-42ff-b6f4-50e510aa9e6f\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crckc8"
Sep 15 13:46:10.911032 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:10.910894    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/03d5cf30-0b3f-42ff-b6f4-50e510aa9e6f-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crckc8\" (UID: \"03d5cf30-0b3f-42ff-b6f4-50e510aa9e6f\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crckc8"
Sep 15 13:46:10.911244 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:10.911226    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fc3569ef-2d3d-4ec3-925e-8eea936a94e1-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vggjg\" (UID: \"fc3569ef-2d3d-4ec3-925e-8eea936a94e1\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vggjg"
Sep 15 13:46:10.911301 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:10.911262    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fc3569ef-2d3d-4ec3-925e-8eea936a94e1-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vggjg\" (UID: \"fc3569ef-2d3d-4ec3-925e-8eea936a94e1\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vggjg"
Sep 15 13:46:10.919937 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:10.919914    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dtmh\" (UniqueName: \"kubernetes.io/projected/fc3569ef-2d3d-4ec3-925e-8eea936a94e1-kube-api-access-5dtmh\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vggjg\" (UID: \"fc3569ef-2d3d-4ec3-925e-8eea936a94e1\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vggjg"
Sep 15 13:46:11.003564 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:11.003533    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vggjg"
Sep 15 13:46:11.011973 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:11.011946    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/03d5cf30-0b3f-42ff-b6f4-50e510aa9e6f-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crckc8\" (UID: \"03d5cf30-0b3f-42ff-b6f4-50e510aa9e6f\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crckc8"
Sep 15 13:46:11.012093 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:11.011986    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgsf4\" (UniqueName: \"kubernetes.io/projected/03d5cf30-0b3f-42ff-b6f4-50e510aa9e6f-kube-api-access-tgsf4\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crckc8\" (UID: \"03d5cf30-0b3f-42ff-b6f4-50e510aa9e6f\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crckc8"
Sep 15 13:46:11.012093 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:11.012011    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/03d5cf30-0b3f-42ff-b6f4-50e510aa9e6f-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crckc8\" (UID: \"03d5cf30-0b3f-42ff-b6f4-50e510aa9e6f\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crckc8"
Sep 15 13:46:11.012359 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:11.012338    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/03d5cf30-0b3f-42ff-b6f4-50e510aa9e6f-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crckc8\" (UID: \"03d5cf30-0b3f-42ff-b6f4-50e510aa9e6f\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crckc8"
Sep 15 13:46:11.012425 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:11.012408    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/03d5cf30-0b3f-42ff-b6f4-50e510aa9e6f-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crckc8\" (UID: \"03d5cf30-0b3f-42ff-b6f4-50e510aa9e6f\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crckc8"
Sep 15 13:46:11.020427 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:11.020408    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgsf4\" (UniqueName: \"kubernetes.io/projected/03d5cf30-0b3f-42ff-b6f4-50e510aa9e6f-kube-api-access-tgsf4\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crckc8\" (UID: \"03d5cf30-0b3f-42ff-b6f4-50e510aa9e6f\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crckc8"
Sep 15 13:46:11.084389 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:11.084366    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6q7fsj"]
Sep 15 13:46:11.086203 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:46:11.086178    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbad73676_cbae_4246_a15b_500d4cb1e10f.slice/crio-4595258f0401efea559ec6d17893cca60fde86af3182b1c539e185b4917c5734 WatchSource:0}: Error finding container 4595258f0401efea559ec6d17893cca60fde86af3182b1c539e185b4917c5734: Status 404 returned error can't find the container with id 4595258f0401efea559ec6d17893cca60fde86af3182b1c539e185b4917c5734
Sep 15 13:46:11.111117 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:11.111096    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crckc8"
Sep 15 13:46:11.177744 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:11.177686    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847akvz5r"]
Sep 15 13:46:11.179821 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:46:11.179789    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2767eb7_33a7_40b7_a2ca_49834ecd40cc.slice/crio-744796b19dc2bf4e5e6dec0c29c85f3157b9d9d14893341b1f82bc5d17bdbf88 WatchSource:0}: Error finding container 744796b19dc2bf4e5e6dec0c29c85f3157b9d9d14893341b1f82bc5d17bdbf88: Status 404 returned error can't find the container with id 744796b19dc2bf4e5e6dec0c29c85f3157b9d9d14893341b1f82bc5d17bdbf88
Sep 15 13:46:11.275958 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:11.275935    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vggjg"]
Sep 15 13:46:11.277576 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:46:11.277550    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc3569ef_2d3d_4ec3_925e_8eea936a94e1.slice/crio-757447a2bd191dc23749b8d4622c3b33c06f896167d71bffda08b48971c381e1 WatchSource:0}: Error finding container 757447a2bd191dc23749b8d4622c3b33c06f896167d71bffda08b48971c381e1: Status 404 returned error can't find the container with id 757447a2bd191dc23749b8d4622c3b33c06f896167d71bffda08b48971c381e1
Sep 15 13:46:11.388909 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:11.388881    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crckc8"]
Sep 15 13:46:11.438043 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:46:11.438009    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03d5cf30_0b3f_42ff_b6f4_50e510aa9e6f.slice/crio-f835e542df69a94221c8a65a6ed9f21b8a7b1ff985b3215066aa29656d9728ae WatchSource:0}: Error finding container f835e542df69a94221c8a65a6ed9f21b8a7b1ff985b3215066aa29656d9728ae: Status 404 returned error can't find the container with id f835e542df69a94221c8a65a6ed9f21b8a7b1ff985b3215066aa29656d9728ae
Sep 15 13:46:11.848461 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:11.848427    2578 generic.go:356] "Generic (PLEG): container finished" podID="fc3569ef-2d3d-4ec3-925e-8eea936a94e1" containerID="931a13856c50bfada861e7eea5eb9039e68bbe5afae9d77999e6650f8da58cf1" exitCode=0
Sep 15 13:46:11.848894 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:11.848477    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vggjg" event={"ID":"fc3569ef-2d3d-4ec3-925e-8eea936a94e1","Type":"ContainerDied","Data":"931a13856c50bfada861e7eea5eb9039e68bbe5afae9d77999e6650f8da58cf1"}
Sep 15 13:46:11.848894 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:11.848531    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vggjg" event={"ID":"fc3569ef-2d3d-4ec3-925e-8eea936a94e1","Type":"ContainerStarted","Data":"757447a2bd191dc23749b8d4622c3b33c06f896167d71bffda08b48971c381e1"}
Sep 15 13:46:11.850303 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:11.850285    2578 generic.go:356] "Generic (PLEG): container finished" podID="a2767eb7-33a7-40b7-a2ca-49834ecd40cc" containerID="a6375bf6b18724642272cb86ab098054910e9e894829bb01a0e434971df0b337" exitCode=0
Sep 15 13:46:11.850388 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:11.850370    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847akvz5r" event={"ID":"a2767eb7-33a7-40b7-a2ca-49834ecd40cc","Type":"ContainerDied","Data":"a6375bf6b18724642272cb86ab098054910e9e894829bb01a0e434971df0b337"}
Sep 15 13:46:11.850445 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:11.850423    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847akvz5r" event={"ID":"a2767eb7-33a7-40b7-a2ca-49834ecd40cc","Type":"ContainerStarted","Data":"744796b19dc2bf4e5e6dec0c29c85f3157b9d9d14893341b1f82bc5d17bdbf88"}
Sep 15 13:46:11.852109 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:11.852085    2578 generic.go:356] "Generic (PLEG): container finished" podID="bad73676-cbae-4246-a15b-500d4cb1e10f" containerID="98ddfeaa373f40e4ab43d2b56b735aabc81f7c008339bfdf5725ae8e04ab4304" exitCode=0
Sep 15 13:46:11.852204 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:11.852169    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6q7fsj" event={"ID":"bad73676-cbae-4246-a15b-500d4cb1e10f","Type":"ContainerDied","Data":"98ddfeaa373f40e4ab43d2b56b735aabc81f7c008339bfdf5725ae8e04ab4304"}
Sep 15 13:46:11.852271 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:11.852209    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6q7fsj" event={"ID":"bad73676-cbae-4246-a15b-500d4cb1e10f","Type":"ContainerStarted","Data":"4595258f0401efea559ec6d17893cca60fde86af3182b1c539e185b4917c5734"}
Sep 15 13:46:11.854009 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:11.853992    2578 generic.go:356] "Generic (PLEG): container finished" podID="03d5cf30-0b3f-42ff-b6f4-50e510aa9e6f" containerID="79d0601fdb5477f902207e2d733843c1649c9f403359caa7591afa8a566518ed" exitCode=0
Sep 15 13:46:11.854093 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:11.854054    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crckc8" event={"ID":"03d5cf30-0b3f-42ff-b6f4-50e510aa9e6f","Type":"ContainerDied","Data":"79d0601fdb5477f902207e2d733843c1649c9f403359caa7591afa8a566518ed"}
Sep 15 13:46:11.854093 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:11.854080    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crckc8" event={"ID":"03d5cf30-0b3f-42ff-b6f4-50e510aa9e6f","Type":"ContainerStarted","Data":"f835e542df69a94221c8a65a6ed9f21b8a7b1ff985b3215066aa29656d9728ae"}
Sep 15 13:46:12.861648 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:12.861618    2578 generic.go:356] "Generic (PLEG): container finished" podID="fc3569ef-2d3d-4ec3-925e-8eea936a94e1" containerID="0540199b95fa941f08cb18070cc9b2cd3f8433381bf0cf342cf959ffabd022d6" exitCode=0
Sep 15 13:46:12.862049 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:12.861693    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vggjg" event={"ID":"fc3569ef-2d3d-4ec3-925e-8eea936a94e1","Type":"ContainerDied","Data":"0540199b95fa941f08cb18070cc9b2cd3f8433381bf0cf342cf959ffabd022d6"}
Sep 15 13:46:12.863615 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:12.863589    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847akvz5r" event={"ID":"a2767eb7-33a7-40b7-a2ca-49834ecd40cc","Type":"ContainerStarted","Data":"d70cf639ed60be88a2b97a5c09fcdcb5e1d7f87127cfd91bd0150ec538eadde7"}
Sep 15 13:46:13.870057 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:13.870018    2578 generic.go:356] "Generic (PLEG): container finished" podID="03d5cf30-0b3f-42ff-b6f4-50e510aa9e6f" containerID="f3b1b1235e65d91ccb41724fab6eebff8c80beb13485eef1aa76dda27b020fef" exitCode=0
Sep 15 13:46:13.870517 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:13.870097    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crckc8" event={"ID":"03d5cf30-0b3f-42ff-b6f4-50e510aa9e6f","Type":"ContainerDied","Data":"f3b1b1235e65d91ccb41724fab6eebff8c80beb13485eef1aa76dda27b020fef"}
Sep 15 13:46:13.872343 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:13.872319    2578 generic.go:356] "Generic (PLEG): container finished" podID="fc3569ef-2d3d-4ec3-925e-8eea936a94e1" containerID="d4b752aa2ef376c1f2e9ce3c74d49d9e76dbe60a4aca5bfdb89d688a8784b34a" exitCode=0
Sep 15 13:46:13.872454 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:13.872404    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vggjg" event={"ID":"fc3569ef-2d3d-4ec3-925e-8eea936a94e1","Type":"ContainerDied","Data":"d4b752aa2ef376c1f2e9ce3c74d49d9e76dbe60a4aca5bfdb89d688a8784b34a"}
Sep 15 13:46:13.874163 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:13.874141    2578 generic.go:356] "Generic (PLEG): container finished" podID="a2767eb7-33a7-40b7-a2ca-49834ecd40cc" containerID="d70cf639ed60be88a2b97a5c09fcdcb5e1d7f87127cfd91bd0150ec538eadde7" exitCode=0
Sep 15 13:46:13.874252 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:13.874169    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847akvz5r" event={"ID":"a2767eb7-33a7-40b7-a2ca-49834ecd40cc","Type":"ContainerDied","Data":"d70cf639ed60be88a2b97a5c09fcdcb5e1d7f87127cfd91bd0150ec538eadde7"}
Sep 15 13:46:14.882022 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:14.881989    2578 generic.go:356] "Generic (PLEG): container finished" podID="a2767eb7-33a7-40b7-a2ca-49834ecd40cc" containerID="2083d0f1aac16bcb0feaa5a47628fb9ccd4e83d96ea2d921df253b21804746ad" exitCode=0
Sep 15 13:46:14.882463 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:14.882065    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847akvz5r" event={"ID":"a2767eb7-33a7-40b7-a2ca-49834ecd40cc","Type":"ContainerDied","Data":"2083d0f1aac16bcb0feaa5a47628fb9ccd4e83d96ea2d921df253b21804746ad"}
Sep 15 13:46:14.884378 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:14.884353    2578 generic.go:356] "Generic (PLEG): container finished" podID="03d5cf30-0b3f-42ff-b6f4-50e510aa9e6f" containerID="7e6ec2fb720b0c4ede41c1c99008d804c011395fced32c9f0cd628c80fb901a8" exitCode=0
Sep 15 13:46:14.884493 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:14.884423    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crckc8" event={"ID":"03d5cf30-0b3f-42ff-b6f4-50e510aa9e6f","Type":"ContainerDied","Data":"7e6ec2fb720b0c4ede41c1c99008d804c011395fced32c9f0cd628c80fb901a8"}
Sep 15 13:46:15.012435 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:15.012412    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vggjg"
Sep 15 13:46:15.148763 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:15.148672    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fc3569ef-2d3d-4ec3-925e-8eea936a94e1-util\") pod \"fc3569ef-2d3d-4ec3-925e-8eea936a94e1\" (UID: \"fc3569ef-2d3d-4ec3-925e-8eea936a94e1\") "
Sep 15 13:46:15.148763 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:15.148760    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5dtmh\" (UniqueName: \"kubernetes.io/projected/fc3569ef-2d3d-4ec3-925e-8eea936a94e1-kube-api-access-5dtmh\") pod \"fc3569ef-2d3d-4ec3-925e-8eea936a94e1\" (UID: \"fc3569ef-2d3d-4ec3-925e-8eea936a94e1\") "
Sep 15 13:46:15.149006 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:15.148821    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fc3569ef-2d3d-4ec3-925e-8eea936a94e1-bundle\") pod \"fc3569ef-2d3d-4ec3-925e-8eea936a94e1\" (UID: \"fc3569ef-2d3d-4ec3-925e-8eea936a94e1\") "
Sep 15 13:46:15.149305 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:15.149282    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc3569ef-2d3d-4ec3-925e-8eea936a94e1-bundle" (OuterVolumeSpecName: "bundle") pod "fc3569ef-2d3d-4ec3-925e-8eea936a94e1" (UID: "fc3569ef-2d3d-4ec3-925e-8eea936a94e1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:46:15.151004 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:15.150981    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc3569ef-2d3d-4ec3-925e-8eea936a94e1-kube-api-access-5dtmh" (OuterVolumeSpecName: "kube-api-access-5dtmh") pod "fc3569ef-2d3d-4ec3-925e-8eea936a94e1" (UID: "fc3569ef-2d3d-4ec3-925e-8eea936a94e1"). InnerVolumeSpecName "kube-api-access-5dtmh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:46:15.153761 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:15.153743    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc3569ef-2d3d-4ec3-925e-8eea936a94e1-util" (OuterVolumeSpecName: "util") pod "fc3569ef-2d3d-4ec3-925e-8eea936a94e1" (UID: "fc3569ef-2d3d-4ec3-925e-8eea936a94e1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:46:15.250054 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:15.249998    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fc3569ef-2d3d-4ec3-925e-8eea936a94e1-bundle\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:46:15.250054 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:15.250048    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fc3569ef-2d3d-4ec3-925e-8eea936a94e1-util\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:46:15.250054 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:15.250058    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5dtmh\" (UniqueName: \"kubernetes.io/projected/fc3569ef-2d3d-4ec3-925e-8eea936a94e1-kube-api-access-5dtmh\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:46:15.891114 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:15.891075    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vggjg" event={"ID":"fc3569ef-2d3d-4ec3-925e-8eea936a94e1","Type":"ContainerDied","Data":"757447a2bd191dc23749b8d4622c3b33c06f896167d71bffda08b48971c381e1"}
Sep 15 13:46:15.891625 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:15.891141    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="757447a2bd191dc23749b8d4622c3b33c06f896167d71bffda08b48971c381e1"
Sep 15 13:46:15.891625 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:15.891140    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vggjg"
Sep 15 13:46:16.024638 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:16.024581    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847akvz5r"
Sep 15 13:46:16.061935 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:16.061913    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crckc8"
Sep 15 13:46:16.157271 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:16.157238    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/03d5cf30-0b3f-42ff-b6f4-50e510aa9e6f-util\") pod \"03d5cf30-0b3f-42ff-b6f4-50e510aa9e6f\" (UID: \"03d5cf30-0b3f-42ff-b6f4-50e510aa9e6f\") "
Sep 15 13:46:16.157470 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:16.157313    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j9jhh\" (UniqueName: \"kubernetes.io/projected/a2767eb7-33a7-40b7-a2ca-49834ecd40cc-kube-api-access-j9jhh\") pod \"a2767eb7-33a7-40b7-a2ca-49834ecd40cc\" (UID: \"a2767eb7-33a7-40b7-a2ca-49834ecd40cc\") "
Sep 15 13:46:16.157470 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:16.157358    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tgsf4\" (UniqueName: \"kubernetes.io/projected/03d5cf30-0b3f-42ff-b6f4-50e510aa9e6f-kube-api-access-tgsf4\") pod \"03d5cf30-0b3f-42ff-b6f4-50e510aa9e6f\" (UID: \"03d5cf30-0b3f-42ff-b6f4-50e510aa9e6f\") "
Sep 15 13:46:16.157470 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:16.157395    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a2767eb7-33a7-40b7-a2ca-49834ecd40cc-bundle\") pod \"a2767eb7-33a7-40b7-a2ca-49834ecd40cc\" (UID: \"a2767eb7-33a7-40b7-a2ca-49834ecd40cc\") "
Sep 15 13:46:16.157648 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:16.157570    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/03d5cf30-0b3f-42ff-b6f4-50e510aa9e6f-bundle\") pod \"03d5cf30-0b3f-42ff-b6f4-50e510aa9e6f\" (UID: \"03d5cf30-0b3f-42ff-b6f4-50e510aa9e6f\") "
Sep 15 13:46:16.157648 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:16.157619    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a2767eb7-33a7-40b7-a2ca-49834ecd40cc-util\") pod \"a2767eb7-33a7-40b7-a2ca-49834ecd40cc\" (UID: \"a2767eb7-33a7-40b7-a2ca-49834ecd40cc\") "
Sep 15 13:46:16.158303 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:16.158212    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03d5cf30-0b3f-42ff-b6f4-50e510aa9e6f-bundle" (OuterVolumeSpecName: "bundle") pod "03d5cf30-0b3f-42ff-b6f4-50e510aa9e6f" (UID: "03d5cf30-0b3f-42ff-b6f4-50e510aa9e6f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:46:16.158434 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:16.158285    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2767eb7-33a7-40b7-a2ca-49834ecd40cc-bundle" (OuterVolumeSpecName: "bundle") pod "a2767eb7-33a7-40b7-a2ca-49834ecd40cc" (UID: "a2767eb7-33a7-40b7-a2ca-49834ecd40cc"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:46:16.160271 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:16.160244    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03d5cf30-0b3f-42ff-b6f4-50e510aa9e6f-kube-api-access-tgsf4" (OuterVolumeSpecName: "kube-api-access-tgsf4") pod "03d5cf30-0b3f-42ff-b6f4-50e510aa9e6f" (UID: "03d5cf30-0b3f-42ff-b6f4-50e510aa9e6f"). InnerVolumeSpecName "kube-api-access-tgsf4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:46:16.160271 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:16.160251    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2767eb7-33a7-40b7-a2ca-49834ecd40cc-kube-api-access-j9jhh" (OuterVolumeSpecName: "kube-api-access-j9jhh") pod "a2767eb7-33a7-40b7-a2ca-49834ecd40cc" (UID: "a2767eb7-33a7-40b7-a2ca-49834ecd40cc"). InnerVolumeSpecName "kube-api-access-j9jhh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:46:16.163320 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:16.163298    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03d5cf30-0b3f-42ff-b6f4-50e510aa9e6f-util" (OuterVolumeSpecName: "util") pod "03d5cf30-0b3f-42ff-b6f4-50e510aa9e6f" (UID: "03d5cf30-0b3f-42ff-b6f4-50e510aa9e6f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:46:16.163587 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:16.163565    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2767eb7-33a7-40b7-a2ca-49834ecd40cc-util" (OuterVolumeSpecName: "util") pod "a2767eb7-33a7-40b7-a2ca-49834ecd40cc" (UID: "a2767eb7-33a7-40b7-a2ca-49834ecd40cc"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:46:16.258324 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:16.258275    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a2767eb7-33a7-40b7-a2ca-49834ecd40cc-util\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:46:16.258324 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:16.258316    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/03d5cf30-0b3f-42ff-b6f4-50e510aa9e6f-util\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:46:16.258324 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:16.258325    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j9jhh\" (UniqueName: \"kubernetes.io/projected/a2767eb7-33a7-40b7-a2ca-49834ecd40cc-kube-api-access-j9jhh\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:46:16.258324 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:16.258337    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tgsf4\" (UniqueName: \"kubernetes.io/projected/03d5cf30-0b3f-42ff-b6f4-50e510aa9e6f-kube-api-access-tgsf4\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:46:16.258587 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:16.258347    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a2767eb7-33a7-40b7-a2ca-49834ecd40cc-bundle\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:46:16.258587 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:16.258355    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/03d5cf30-0b3f-42ff-b6f4-50e510aa9e6f-bundle\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:46:16.903045 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:16.903006    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crckc8"
Sep 15 13:46:16.903505 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:16.903038    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crckc8" event={"ID":"03d5cf30-0b3f-42ff-b6f4-50e510aa9e6f","Type":"ContainerDied","Data":"f835e542df69a94221c8a65a6ed9f21b8a7b1ff985b3215066aa29656d9728ae"}
Sep 15 13:46:16.903505 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:16.903112    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f835e542df69a94221c8a65a6ed9f21b8a7b1ff985b3215066aa29656d9728ae"
Sep 15 13:46:16.905312 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:16.905285    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847akvz5r" event={"ID":"a2767eb7-33a7-40b7-a2ca-49834ecd40cc","Type":"ContainerDied","Data":"744796b19dc2bf4e5e6dec0c29c85f3157b9d9d14893341b1f82bc5d17bdbf88"}
Sep 15 13:46:16.905418 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:16.905325    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="744796b19dc2bf4e5e6dec0c29c85f3157b9d9d14893341b1f82bc5d17bdbf88"
Sep 15 13:46:16.905418 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:16.905324    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847akvz5r"
Sep 15 13:46:17.912101 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:17.912068    2578 generic.go:356] "Generic (PLEG): container finished" podID="bad73676-cbae-4246-a15b-500d4cb1e10f" containerID="2bd54876f0ae81a9c023d4794baca782c5a8995e8a1a3eb4d68879b3dc6f1f46" exitCode=0
Sep 15 13:46:17.912584 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:17.912145    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6q7fsj" event={"ID":"bad73676-cbae-4246-a15b-500d4cb1e10f","Type":"ContainerDied","Data":"2bd54876f0ae81a9c023d4794baca782c5a8995e8a1a3eb4d68879b3dc6f1f46"}
Sep 15 13:46:18.919196 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:18.919163    2578 generic.go:356] "Generic (PLEG): container finished" podID="bad73676-cbae-4246-a15b-500d4cb1e10f" containerID="99badb2ad0a6e1c15e45d00dcc198b8274c57fc9b645e1ba31b9a654d01a9426" exitCode=0
Sep 15 13:46:18.919647 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:18.919216    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6q7fsj" event={"ID":"bad73676-cbae-4246-a15b-500d4cb1e10f","Type":"ContainerDied","Data":"99badb2ad0a6e1c15e45d00dcc198b8274c57fc9b645e1ba31b9a654d01a9426"}
Sep 15 13:46:20.063245 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:20.063223    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6q7fsj"
Sep 15 13:46:20.195024 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:20.194924    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bad73676-cbae-4246-a15b-500d4cb1e10f-util\") pod \"bad73676-cbae-4246-a15b-500d4cb1e10f\" (UID: \"bad73676-cbae-4246-a15b-500d4cb1e10f\") "
Sep 15 13:46:20.195024 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:20.194971    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6zt95\" (UniqueName: \"kubernetes.io/projected/bad73676-cbae-4246-a15b-500d4cb1e10f-kube-api-access-6zt95\") pod \"bad73676-cbae-4246-a15b-500d4cb1e10f\" (UID: \"bad73676-cbae-4246-a15b-500d4cb1e10f\") "
Sep 15 13:46:20.195275 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:20.195029    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bad73676-cbae-4246-a15b-500d4cb1e10f-bundle\") pod \"bad73676-cbae-4246-a15b-500d4cb1e10f\" (UID: \"bad73676-cbae-4246-a15b-500d4cb1e10f\") "
Sep 15 13:46:20.195543 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:20.195512    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bad73676-cbae-4246-a15b-500d4cb1e10f-bundle" (OuterVolumeSpecName: "bundle") pod "bad73676-cbae-4246-a15b-500d4cb1e10f" (UID: "bad73676-cbae-4246-a15b-500d4cb1e10f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:46:20.197246 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:20.197223    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bad73676-cbae-4246-a15b-500d4cb1e10f-kube-api-access-6zt95" (OuterVolumeSpecName: "kube-api-access-6zt95") pod "bad73676-cbae-4246-a15b-500d4cb1e10f" (UID: "bad73676-cbae-4246-a15b-500d4cb1e10f"). InnerVolumeSpecName "kube-api-access-6zt95". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:46:20.200042 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:20.200021    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bad73676-cbae-4246-a15b-500d4cb1e10f-util" (OuterVolumeSpecName: "util") pod "bad73676-cbae-4246-a15b-500d4cb1e10f" (UID: "bad73676-cbae-4246-a15b-500d4cb1e10f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:46:20.296199 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:20.296172    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bad73676-cbae-4246-a15b-500d4cb1e10f-util\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:46:20.296199 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:20.296196    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6zt95\" (UniqueName: \"kubernetes.io/projected/bad73676-cbae-4246-a15b-500d4cb1e10f-kube-api-access-6zt95\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:46:20.296199 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:20.296205    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bad73676-cbae-4246-a15b-500d4cb1e10f-bundle\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:46:20.931541 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:20.931512    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6q7fsj"
Sep 15 13:46:20.931709 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:20.931510    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6q7fsj" event={"ID":"bad73676-cbae-4246-a15b-500d4cb1e10f","Type":"ContainerDied","Data":"4595258f0401efea559ec6d17893cca60fde86af3182b1c539e185b4917c5734"}
Sep 15 13:46:20.931709 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:46:20.931627    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4595258f0401efea559ec6d17893cca60fde86af3182b1c539e185b4917c5734"
Sep 15 13:47:36.801253 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:47:36.801170    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-9kdxw"]
Sep 15 13:47:36.801715 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:47:36.801483    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2767eb7-33a7-40b7-a2ca-49834ecd40cc" containerName="extract"
Sep 15 13:47:36.801715 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:47:36.801495    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2767eb7-33a7-40b7-a2ca-49834ecd40cc" containerName="extract"
Sep 15 13:47:36.801715 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:47:36.801506    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03d5cf30-0b3f-42ff-b6f4-50e510aa9e6f" containerName="pull"
Sep 15 13:47:36.801715 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:47:36.801512    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="03d5cf30-0b3f-42ff-b6f4-50e510aa9e6f" containerName="pull"
Sep 15 13:47:36.801715 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:47:36.801519    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc3569ef-2d3d-4ec3-925e-8eea936a94e1" containerName="pull"
Sep 15 13:47:36.801715 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:47:36.801524    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc3569ef-2d3d-4ec3-925e-8eea936a94e1" containerName="pull"
Sep 15 13:47:36.801715 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:47:36.801530    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc3569ef-2d3d-4ec3-925e-8eea936a94e1" containerName="extract"
Sep 15 13:47:36.801715 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:47:36.801535    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc3569ef-2d3d-4ec3-925e-8eea936a94e1" containerName="extract"
Sep 15 13:47:36.801715 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:47:36.801546    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2767eb7-33a7-40b7-a2ca-49834ecd40cc" containerName="pull"
Sep 15 13:47:36.801715 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:47:36.801550    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2767eb7-33a7-40b7-a2ca-49834ecd40cc" containerName="pull"
Sep 15 13:47:36.801715 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:47:36.801555    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bad73676-cbae-4246-a15b-500d4cb1e10f" containerName="extract"
Sep 15 13:47:36.801715 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:47:36.801560    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="bad73676-cbae-4246-a15b-500d4cb1e10f" containerName="extract"
Sep 15 13:47:36.801715 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:47:36.801567    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2767eb7-33a7-40b7-a2ca-49834ecd40cc" containerName="util"
Sep 15 13:47:36.801715 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:47:36.801571    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2767eb7-33a7-40b7-a2ca-49834ecd40cc" containerName="util"
Sep 15 13:47:36.801715 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:47:36.801576    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03d5cf30-0b3f-42ff-b6f4-50e510aa9e6f" containerName="extract"
Sep 15 13:47:36.801715 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:47:36.801581    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="03d5cf30-0b3f-42ff-b6f4-50e510aa9e6f" containerName="extract"
Sep 15 13:47:36.801715 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:47:36.801586    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bad73676-cbae-4246-a15b-500d4cb1e10f" containerName="util"
Sep 15 13:47:36.801715 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:47:36.801591    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="bad73676-cbae-4246-a15b-500d4cb1e10f" containerName="util"
Sep 15 13:47:36.801715 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:47:36.801598    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03d5cf30-0b3f-42ff-b6f4-50e510aa9e6f" containerName="util"
Sep 15 13:47:36.801715 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:47:36.801602    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="03d5cf30-0b3f-42ff-b6f4-50e510aa9e6f" containerName="util"
Sep 15 13:47:36.801715 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:47:36.801609    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc3569ef-2d3d-4ec3-925e-8eea936a94e1" containerName="util"
Sep 15 13:47:36.801715 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:47:36.801613    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc3569ef-2d3d-4ec3-925e-8eea936a94e1" containerName="util"
Sep 15 13:47:36.801715 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:47:36.801618    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bad73676-cbae-4246-a15b-500d4cb1e10f" containerName="pull"
Sep 15 13:47:36.801715 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:47:36.801623    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="bad73676-cbae-4246-a15b-500d4cb1e10f" containerName="pull"
Sep 15 13:47:36.801715 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:47:36.801674    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="bad73676-cbae-4246-a15b-500d4cb1e10f" containerName="extract"
Sep 15 13:47:36.801715 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:47:36.801683    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="03d5cf30-0b3f-42ff-b6f4-50e510aa9e6f" containerName="extract"
Sep 15 13:47:36.801715 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:47:36.801689    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2767eb7-33a7-40b7-a2ca-49834ecd40cc" containerName="extract"
Sep 15 13:47:36.801715 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:47:36.801695    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc3569ef-2d3d-4ec3-925e-8eea936a94e1" containerName="extract"
Sep 15 13:47:36.804599 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:47:36.804582    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-9kdxw"
Sep 15 13:47:36.806875 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:47:36.806853    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-gwbvq\""
Sep 15 13:47:36.807295 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:47:36.807279    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 15 13:47:36.807353 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:47:36.807309    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 15 13:47:36.813467 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:47:36.813440    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-9kdxw"]
Sep 15 13:47:36.862888 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:47:36.862856    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lv445\" (UniqueName: \"kubernetes.io/projected/dd039efb-2811-47be-899e-8c1bbfe37ca0-kube-api-access-lv445\") pod \"authorino-7bcfd8f9cd-9kdxw\" (UID: \"dd039efb-2811-47be-899e-8c1bbfe37ca0\") " pod="kuadrant-system/authorino-7bcfd8f9cd-9kdxw"
Sep 15 13:47:36.953617 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:47:36.953586    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-59c974bd48-77zd5"]
Sep 15 13:47:36.956880 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:47:36.956863    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-77zd5"
Sep 15 13:47:36.963330 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:47:36.963306    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lv445\" (UniqueName: \"kubernetes.io/projected/dd039efb-2811-47be-899e-8c1bbfe37ca0-kube-api-access-lv445\") pod \"authorino-7bcfd8f9cd-9kdxw\" (UID: \"dd039efb-2811-47be-899e-8c1bbfe37ca0\") " pod="kuadrant-system/authorino-7bcfd8f9cd-9kdxw"
Sep 15 13:47:36.963459 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:47:36.963390    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-77zd5"]
Sep 15 13:47:36.975186 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:47:36.975162    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lv445\" (UniqueName: \"kubernetes.io/projected/dd039efb-2811-47be-899e-8c1bbfe37ca0-kube-api-access-lv445\") pod \"authorino-7bcfd8f9cd-9kdxw\" (UID: \"dd039efb-2811-47be-899e-8c1bbfe37ca0\") " pod="kuadrant-system/authorino-7bcfd8f9cd-9kdxw"
Sep 15 13:47:37.064234 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:47:37.064148    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfhzz\" (UniqueName: \"kubernetes.io/projected/ca853c9d-cbc2-4f6a-8119-173bd16feb3f-kube-api-access-hfhzz\") pod \"authorino-59c974bd48-77zd5\" (UID: \"ca853c9d-cbc2-4f6a-8119-173bd16feb3f\") " pod="kuadrant-system/authorino-59c974bd48-77zd5"
Sep 15 13:47:37.114420 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:47:37.114384    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-9kdxw"
Sep 15 13:47:37.165633 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:47:37.165595    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfhzz\" (UniqueName: \"kubernetes.io/projected/ca853c9d-cbc2-4f6a-8119-173bd16feb3f-kube-api-access-hfhzz\") pod \"authorino-59c974bd48-77zd5\" (UID: \"ca853c9d-cbc2-4f6a-8119-173bd16feb3f\") " pod="kuadrant-system/authorino-59c974bd48-77zd5"
Sep 15 13:47:37.175031 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:47:37.175000    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfhzz\" (UniqueName: \"kubernetes.io/projected/ca853c9d-cbc2-4f6a-8119-173bd16feb3f-kube-api-access-hfhzz\") pod \"authorino-59c974bd48-77zd5\" (UID: \"ca853c9d-cbc2-4f6a-8119-173bd16feb3f\") " pod="kuadrant-system/authorino-59c974bd48-77zd5"
Sep 15 13:47:37.266199 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:47:37.266167    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-77zd5"
Sep 15 13:47:37.387795 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:47:37.387760    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-9kdxw"]
Sep 15 13:47:37.391498 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:47:37.391471    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddd039efb_2811_47be_899e_8c1bbfe37ca0.slice/crio-ee654ca3c380723461235b377efd3d2d15d47738c7d1c745bc5b4884311adc6b WatchSource:0}: Error finding container ee654ca3c380723461235b377efd3d2d15d47738c7d1c745bc5b4884311adc6b: Status 404 returned error can't find the container with id ee654ca3c380723461235b377efd3d2d15d47738c7d1c745bc5b4884311adc6b
Sep 15 13:47:37.535206 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:47:37.535031    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-77zd5"]
Sep 15 13:47:37.537148 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:47:37.537100    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podca853c9d_cbc2_4f6a_8119_173bd16feb3f.slice/crio-ddb706af32459bb4ee761a536028f31d033479c23d73149ba18a7c21636a1d84 WatchSource:0}: Error finding container ddb706af32459bb4ee761a536028f31d033479c23d73149ba18a7c21636a1d84: Status 404 returned error can't find the container with id ddb706af32459bb4ee761a536028f31d033479c23d73149ba18a7c21636a1d84
Sep 15 13:47:38.312067 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:47:38.311995    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-77zd5" event={"ID":"ca853c9d-cbc2-4f6a-8119-173bd16feb3f","Type":"ContainerStarted","Data":"ddb706af32459bb4ee761a536028f31d033479c23d73149ba18a7c21636a1d84"}
Sep 15 13:47:38.314019 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:47:38.313987    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-9kdxw" event={"ID":"dd039efb-2811-47be-899e-8c1bbfe37ca0","Type":"ContainerStarted","Data":"ee654ca3c380723461235b377efd3d2d15d47738c7d1c745bc5b4884311adc6b"}
Sep 15 13:47:40.326312 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:47:40.326281    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-77zd5" event={"ID":"ca853c9d-cbc2-4f6a-8119-173bd16feb3f","Type":"ContainerStarted","Data":"1a7bb960239d075ff8b8d34227d19ec7b528a8742e30fe64a43ea53e8c08d987"}
Sep 15 13:47:40.327824 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:47:40.327801    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-9kdxw" event={"ID":"dd039efb-2811-47be-899e-8c1bbfe37ca0","Type":"ContainerStarted","Data":"184d7e8f6c6d020ce3766ee340a1572261a08fb85012a83d7489c78f5b96aae5"}
Sep 15 13:47:40.344292 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:47:40.344250    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-59c974bd48-77zd5" podStartSLOduration=1.70827171 podStartE2EDuration="4.344237195s" totalImagesPullingTime="2.635965485s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:47:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:47:40.342940987 +0000 UTC m=+547.102067270" watchObservedRunningTime="2026-09-15 13:47:40.344237195 +0000 UTC m=+547.103363532"
Sep 15 13:47:40.358761 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:47:40.358640    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7bcfd8f9cd-9kdxw" podStartSLOduration=1.5878295040000001 podStartE2EDuration="4.358620916s" totalImagesPullingTime="2.770791412s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:47:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:47:40.358307821 +0000 UTC m=+547.117434108" watchObservedRunningTime="2026-09-15 13:47:40.358620916 +0000 UTC m=+547.117747202"
Sep 15 13:47:40.397139 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:47:40.397099    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-9kdxw"]
Sep 15 13:47:42.340727 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:47:42.340689    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7bcfd8f9cd-9kdxw" podUID="dd039efb-2811-47be-899e-8c1bbfe37ca0" containerName="authorino" containerID="cri-o://184d7e8f6c6d020ce3766ee340a1572261a08fb85012a83d7489c78f5b96aae5" gracePeriod=30
Sep 15 13:47:42.583989 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:47:42.583967    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-9kdxw"
Sep 15 13:47:42.711808 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:47:42.711720    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lv445\" (UniqueName: \"kubernetes.io/projected/dd039efb-2811-47be-899e-8c1bbfe37ca0-kube-api-access-lv445\") pod \"dd039efb-2811-47be-899e-8c1bbfe37ca0\" (UID: \"dd039efb-2811-47be-899e-8c1bbfe37ca0\") "
Sep 15 13:47:42.714035 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:47:42.714004    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd039efb-2811-47be-899e-8c1bbfe37ca0-kube-api-access-lv445" (OuterVolumeSpecName: "kube-api-access-lv445") pod "dd039efb-2811-47be-899e-8c1bbfe37ca0" (UID: "dd039efb-2811-47be-899e-8c1bbfe37ca0"). InnerVolumeSpecName "kube-api-access-lv445". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:47:42.812740 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:47:42.812706    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lv445\" (UniqueName: \"kubernetes.io/projected/dd039efb-2811-47be-899e-8c1bbfe37ca0-kube-api-access-lv445\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:47:43.352603 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:47:43.352566    2578 generic.go:356] "Generic (PLEG): container finished" podID="dd039efb-2811-47be-899e-8c1bbfe37ca0" containerID="184d7e8f6c6d020ce3766ee340a1572261a08fb85012a83d7489c78f5b96aae5" exitCode=0
Sep 15 13:47:43.353092 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:47:43.352616    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-9kdxw"
Sep 15 13:47:43.353092 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:47:43.352653    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-9kdxw" event={"ID":"dd039efb-2811-47be-899e-8c1bbfe37ca0","Type":"ContainerDied","Data":"184d7e8f6c6d020ce3766ee340a1572261a08fb85012a83d7489c78f5b96aae5"}
Sep 15 13:47:43.353092 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:47:43.352699    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-9kdxw" event={"ID":"dd039efb-2811-47be-899e-8c1bbfe37ca0","Type":"ContainerDied","Data":"ee654ca3c380723461235b377efd3d2d15d47738c7d1c745bc5b4884311adc6b"}
Sep 15 13:47:43.353092 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:47:43.352723    2578 scope.go:117] "RemoveContainer" containerID="184d7e8f6c6d020ce3766ee340a1572261a08fb85012a83d7489c78f5b96aae5"
Sep 15 13:47:43.361518 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:47:43.361499    2578 scope.go:117] "RemoveContainer" containerID="184d7e8f6c6d020ce3766ee340a1572261a08fb85012a83d7489c78f5b96aae5"
Sep 15 13:47:43.361800 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:47:43.361782    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"184d7e8f6c6d020ce3766ee340a1572261a08fb85012a83d7489c78f5b96aae5\": container with ID starting with 184d7e8f6c6d020ce3766ee340a1572261a08fb85012a83d7489c78f5b96aae5 not found: ID does not exist" containerID="184d7e8f6c6d020ce3766ee340a1572261a08fb85012a83d7489c78f5b96aae5"
Sep 15 13:47:43.361864 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:47:43.361811    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"184d7e8f6c6d020ce3766ee340a1572261a08fb85012a83d7489c78f5b96aae5"} err="failed to get container status \"184d7e8f6c6d020ce3766ee340a1572261a08fb85012a83d7489c78f5b96aae5\": rpc error: code = NotFound desc = could not find container \"184d7e8f6c6d020ce3766ee340a1572261a08fb85012a83d7489c78f5b96aae5\": container with ID starting with 184d7e8f6c6d020ce3766ee340a1572261a08fb85012a83d7489c78f5b96aae5 not found: ID does not exist"
Sep 15 13:47:43.373555 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:47:43.373535    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-9kdxw"]
Sep 15 13:47:43.376403 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:47:43.376383    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-9kdxw"]
Sep 15 13:47:43.758532 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:47:43.758454    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd039efb-2811-47be-899e-8c1bbfe37ca0" path="/var/lib/kubelet/pods/dd039efb-2811-47be-899e-8c1bbfe37ca0/volumes"
Sep 15 13:48:05.430082 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:48:05.430049    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-557f876f69-mngkh"]
Sep 15 13:48:05.430527 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:48:05.430369    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd039efb-2811-47be-899e-8c1bbfe37ca0" containerName="authorino"
Sep 15 13:48:05.430527 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:48:05.430380    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd039efb-2811-47be-899e-8c1bbfe37ca0" containerName="authorino"
Sep 15 13:48:05.430527 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:48:05.430444    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd039efb-2811-47be-899e-8c1bbfe37ca0" containerName="authorino"
Sep 15 13:48:05.433235 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:48:05.433221    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-mngkh"
Sep 15 13:48:05.440841 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:48:05.440812    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-557f876f69-mngkh"]
Sep 15 13:48:05.547447 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:48:05.547416    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-mngkh"]
Sep 15 13:48:05.547664 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:48:05.547645    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-rrgs7], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-557f876f69-mngkh" podUID="fddf3d24-4404-4131-9c19-c01bd8ee287a"
Sep 15 13:48:05.576935 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:48:05.576911    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-769rx"]
Sep 15 13:48:05.580217 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:48:05.580202    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-769rx"
Sep 15 13:48:05.582767 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:48:05.582744    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Sep 15 13:48:05.588144 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:48:05.588107    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-769rx"]
Sep 15 13:48:05.618559 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:48:05.618526    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrgs7\" (UniqueName: \"kubernetes.io/projected/fddf3d24-4404-4131-9c19-c01bd8ee287a-kube-api-access-rrgs7\") pod \"authorino-557f876f69-mngkh\" (UID: \"fddf3d24-4404-4131-9c19-c01bd8ee287a\") " pod="kuadrant-system/authorino-557f876f69-mngkh"
Sep 15 13:48:05.649194 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:48:05.649162    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-769rx"]
Sep 15 13:48:05.649455 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:48:05.649432    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-9sxb7 tls-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-6d4dfc649f-769rx" podUID="029161db-5486-4168-a945-157342c54685"
Sep 15 13:48:05.685090 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:48:05.685016    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-85dfd58bdd-9dmf2"]
Sep 15 13:48:05.688307 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:48:05.688292    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-85dfd58bdd-9dmf2"
Sep 15 13:48:05.703994 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:48:05.703973    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-85dfd58bdd-9dmf2"]
Sep 15 13:48:05.719215 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:48:05.719191    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrgs7\" (UniqueName: \"kubernetes.io/projected/fddf3d24-4404-4131-9c19-c01bd8ee287a-kube-api-access-rrgs7\") pod \"authorino-557f876f69-mngkh\" (UID: \"fddf3d24-4404-4131-9c19-c01bd8ee287a\") " pod="kuadrant-system/authorino-557f876f69-mngkh"
Sep 15 13:48:05.719313 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:48:05.719255    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/029161db-5486-4168-a945-157342c54685-tls-cert\") pod \"authorino-6d4dfc649f-769rx\" (UID: \"029161db-5486-4168-a945-157342c54685\") " pod="kuadrant-system/authorino-6d4dfc649f-769rx"
Sep 15 13:48:05.719313 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:48:05.719284    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9sxb7\" (UniqueName: \"kubernetes.io/projected/029161db-5486-4168-a945-157342c54685-kube-api-access-9sxb7\") pod \"authorino-6d4dfc649f-769rx\" (UID: \"029161db-5486-4168-a945-157342c54685\") " pod="kuadrant-system/authorino-6d4dfc649f-769rx"
Sep 15 13:48:05.727304 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:48:05.727281    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrgs7\" (UniqueName: \"kubernetes.io/projected/fddf3d24-4404-4131-9c19-c01bd8ee287a-kube-api-access-rrgs7\") pod \"authorino-557f876f69-mngkh\" (UID: \"fddf3d24-4404-4131-9c19-c01bd8ee287a\") " pod="kuadrant-system/authorino-557f876f69-mngkh"
Sep 15 13:48:05.820315 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:48:05.820283    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64qd2\" (UniqueName: \"kubernetes.io/projected/a2610c95-7b7e-4ae2-80f9-19584d9ac170-kube-api-access-64qd2\") pod \"authorino-85dfd58bdd-9dmf2\" (UID: \"a2610c95-7b7e-4ae2-80f9-19584d9ac170\") " pod="kuadrant-system/authorino-85dfd58bdd-9dmf2"
Sep 15 13:48:05.820476 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:48:05.820330    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a2610c95-7b7e-4ae2-80f9-19584d9ac170-tls-cert\") pod \"authorino-85dfd58bdd-9dmf2\" (UID: \"a2610c95-7b7e-4ae2-80f9-19584d9ac170\") " pod="kuadrant-system/authorino-85dfd58bdd-9dmf2"
Sep 15 13:48:05.820476 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:48:05.820408    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/029161db-5486-4168-a945-157342c54685-tls-cert\") pod \"authorino-6d4dfc649f-769rx\" (UID: \"029161db-5486-4168-a945-157342c54685\") " pod="kuadrant-system/authorino-6d4dfc649f-769rx"
Sep 15 13:48:05.820476 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:48:05.820429    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9sxb7\" (UniqueName: \"kubernetes.io/projected/029161db-5486-4168-a945-157342c54685-kube-api-access-9sxb7\") pod \"authorino-6d4dfc649f-769rx\" (UID: \"029161db-5486-4168-a945-157342c54685\") " pod="kuadrant-system/authorino-6d4dfc649f-769rx"
Sep 15 13:48:05.822924 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:48:05.822901    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/029161db-5486-4168-a945-157342c54685-tls-cert\") pod \"authorino-6d4dfc649f-769rx\" (UID: \"029161db-5486-4168-a945-157342c54685\") " pod="kuadrant-system/authorino-6d4dfc649f-769rx"
Sep 15 13:48:05.829325 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:48:05.829306    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9sxb7\" (UniqueName: \"kubernetes.io/projected/029161db-5486-4168-a945-157342c54685-kube-api-access-9sxb7\") pod \"authorino-6d4dfc649f-769rx\" (UID: \"029161db-5486-4168-a945-157342c54685\") " pod="kuadrant-system/authorino-6d4dfc649f-769rx"
Sep 15 13:48:05.921384 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:48:05.921354    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64qd2\" (UniqueName: \"kubernetes.io/projected/a2610c95-7b7e-4ae2-80f9-19584d9ac170-kube-api-access-64qd2\") pod \"authorino-85dfd58bdd-9dmf2\" (UID: \"a2610c95-7b7e-4ae2-80f9-19584d9ac170\") " pod="kuadrant-system/authorino-85dfd58bdd-9dmf2"
Sep 15 13:48:05.921554 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:48:05.921397    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a2610c95-7b7e-4ae2-80f9-19584d9ac170-tls-cert\") pod \"authorino-85dfd58bdd-9dmf2\" (UID: \"a2610c95-7b7e-4ae2-80f9-19584d9ac170\") " pod="kuadrant-system/authorino-85dfd58bdd-9dmf2"
Sep 15 13:48:05.923822 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:48:05.923797    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a2610c95-7b7e-4ae2-80f9-19584d9ac170-tls-cert\") pod \"authorino-85dfd58bdd-9dmf2\" (UID: \"a2610c95-7b7e-4ae2-80f9-19584d9ac170\") " pod="kuadrant-system/authorino-85dfd58bdd-9dmf2"
Sep 15 13:48:05.930103 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:48:05.930076    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-64qd2\" (UniqueName: \"kubernetes.io/projected/a2610c95-7b7e-4ae2-80f9-19584d9ac170-kube-api-access-64qd2\") pod \"authorino-85dfd58bdd-9dmf2\" (UID: \"a2610c95-7b7e-4ae2-80f9-19584d9ac170\") " pod="kuadrant-system/authorino-85dfd58bdd-9dmf2"
Sep 15 13:48:05.998059 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:48:05.997976    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-85dfd58bdd-9dmf2"
Sep 15 13:48:06.270436 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:48:06.270412    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-85dfd58bdd-9dmf2"]
Sep 15 13:48:06.271760 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:48:06.271734    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda2610c95_7b7e_4ae2_80f9_19584d9ac170.slice/crio-cb05b83cd44738d35e88eb0c34badb2a957c3b1bb64b7c6c3271ed5ee9478cbb WatchSource:0}: Error finding container cb05b83cd44738d35e88eb0c34badb2a957c3b1bb64b7c6c3271ed5ee9478cbb: Status 404 returned error can't find the container with id cb05b83cd44738d35e88eb0c34badb2a957c3b1bb64b7c6c3271ed5ee9478cbb
Sep 15 13:48:06.472154 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:48:06.472100    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-85dfd58bdd-9dmf2" event={"ID":"a2610c95-7b7e-4ae2-80f9-19584d9ac170","Type":"ContainerStarted","Data":"cb05b83cd44738d35e88eb0c34badb2a957c3b1bb64b7c6c3271ed5ee9478cbb"}
Sep 15 13:48:06.472558 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:48:06.472172    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-mngkh"
Sep 15 13:48:06.472558 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:48:06.472172    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-769rx"
Sep 15 13:48:06.480657 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:48:06.480639    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-mngkh"
Sep 15 13:48:06.482680 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:48:06.482666    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-769rx"
Sep 15 13:48:06.628587 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:48:06.628556    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rrgs7\" (UniqueName: \"kubernetes.io/projected/fddf3d24-4404-4131-9c19-c01bd8ee287a-kube-api-access-rrgs7\") pod \"fddf3d24-4404-4131-9c19-c01bd8ee287a\" (UID: \"fddf3d24-4404-4131-9c19-c01bd8ee287a\") "
Sep 15 13:48:06.628587 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:48:06.628588    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9sxb7\" (UniqueName: \"kubernetes.io/projected/029161db-5486-4168-a945-157342c54685-kube-api-access-9sxb7\") pod \"029161db-5486-4168-a945-157342c54685\" (UID: \"029161db-5486-4168-a945-157342c54685\") "
Sep 15 13:48:06.628797 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:48:06.628613    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/029161db-5486-4168-a945-157342c54685-tls-cert\") pod \"029161db-5486-4168-a945-157342c54685\" (UID: \"029161db-5486-4168-a945-157342c54685\") "
Sep 15 13:48:06.630875 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:48:06.630847    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/029161db-5486-4168-a945-157342c54685-kube-api-access-9sxb7" (OuterVolumeSpecName: "kube-api-access-9sxb7") pod "029161db-5486-4168-a945-157342c54685" (UID: "029161db-5486-4168-a945-157342c54685"). InnerVolumeSpecName "kube-api-access-9sxb7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:48:06.630984 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:48:06.630885    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/029161db-5486-4168-a945-157342c54685-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "029161db-5486-4168-a945-157342c54685" (UID: "029161db-5486-4168-a945-157342c54685"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 13:48:06.630984 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:48:06.630884    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fddf3d24-4404-4131-9c19-c01bd8ee287a-kube-api-access-rrgs7" (OuterVolumeSpecName: "kube-api-access-rrgs7") pod "fddf3d24-4404-4131-9c19-c01bd8ee287a" (UID: "fddf3d24-4404-4131-9c19-c01bd8ee287a"). InnerVolumeSpecName "kube-api-access-rrgs7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:48:06.729677 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:48:06.729643    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rrgs7\" (UniqueName: \"kubernetes.io/projected/fddf3d24-4404-4131-9c19-c01bd8ee287a-kube-api-access-rrgs7\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:48:06.729820 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:48:06.729670    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9sxb7\" (UniqueName: \"kubernetes.io/projected/029161db-5486-4168-a945-157342c54685-kube-api-access-9sxb7\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:48:06.729820 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:48:06.729696    2578 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/029161db-5486-4168-a945-157342c54685-tls-cert\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:48:07.479484 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:48:07.479452    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-85dfd58bdd-9dmf2" event={"ID":"a2610c95-7b7e-4ae2-80f9-19584d9ac170","Type":"ContainerStarted","Data":"a52adcf7960a6d05ad8efdb948b618214bcfbabcfc4f788159328b77d284577d"}
Sep 15 13:48:07.479484 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:48:07.479468    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-mngkh"
Sep 15 13:48:07.479889 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:48:07.479492    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-769rx"
Sep 15 13:48:07.496551 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:48:07.496499    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-85dfd58bdd-9dmf2" podStartSLOduration=1.854246941 podStartE2EDuration="2.496480658s" totalImagesPullingTime="642.233717ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:48:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:48:07.494103165 +0000 UTC m=+574.253229452" watchObservedRunningTime="2026-09-15 13:48:07.496480658 +0000 UTC m=+574.255606945"
Sep 15 13:48:07.526974 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:48:07.526918    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-mngkh"]
Sep 15 13:48:07.529011 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:48:07.528992    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-77zd5"]
Sep 15 13:48:07.529224 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:48:07.529203    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-59c974bd48-77zd5" podUID="ca853c9d-cbc2-4f6a-8119-173bd16feb3f" containerName="authorino" containerID="cri-o://1a7bb960239d075ff8b8d34227d19ec7b528a8742e30fe64a43ea53e8c08d987" gracePeriod=30
Sep 15 13:48:07.531005 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:48:07.530982    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-557f876f69-mngkh"]
Sep 15 13:48:07.552605 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:48:07.552574    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-769rx"]
Sep 15 13:48:07.554344 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:48:07.554323    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-769rx"]
Sep 15 13:48:07.758522 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:48:07.758498    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="029161db-5486-4168-a945-157342c54685" path="/var/lib/kubelet/pods/029161db-5486-4168-a945-157342c54685/volumes"
Sep 15 13:48:07.758809 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:48:07.758792    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fddf3d24-4404-4131-9c19-c01bd8ee287a" path="/var/lib/kubelet/pods/fddf3d24-4404-4131-9c19-c01bd8ee287a/volumes"
Sep 15 13:48:07.777144 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:48:07.777103    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-77zd5"
Sep 15 13:48:07.840444 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:48:07.840408    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hfhzz\" (UniqueName: \"kubernetes.io/projected/ca853c9d-cbc2-4f6a-8119-173bd16feb3f-kube-api-access-hfhzz\") pod \"ca853c9d-cbc2-4f6a-8119-173bd16feb3f\" (UID: \"ca853c9d-cbc2-4f6a-8119-173bd16feb3f\") "
Sep 15 13:48:07.842577 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:48:07.842554    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca853c9d-cbc2-4f6a-8119-173bd16feb3f-kube-api-access-hfhzz" (OuterVolumeSpecName: "kube-api-access-hfhzz") pod "ca853c9d-cbc2-4f6a-8119-173bd16feb3f" (UID: "ca853c9d-cbc2-4f6a-8119-173bd16feb3f"). InnerVolumeSpecName "kube-api-access-hfhzz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:48:07.941059 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:48:07.941025    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hfhzz\" (UniqueName: \"kubernetes.io/projected/ca853c9d-cbc2-4f6a-8119-173bd16feb3f-kube-api-access-hfhzz\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:48:08.485834 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:48:08.485797    2578 generic.go:356] "Generic (PLEG): container finished" podID="ca853c9d-cbc2-4f6a-8119-173bd16feb3f" containerID="1a7bb960239d075ff8b8d34227d19ec7b528a8742e30fe64a43ea53e8c08d987" exitCode=0
Sep 15 13:48:08.486300 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:48:08.485840    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-77zd5"
Sep 15 13:48:08.486300 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:48:08.485874    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-77zd5" event={"ID":"ca853c9d-cbc2-4f6a-8119-173bd16feb3f","Type":"ContainerDied","Data":"1a7bb960239d075ff8b8d34227d19ec7b528a8742e30fe64a43ea53e8c08d987"}
Sep 15 13:48:08.486300 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:48:08.485911    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-77zd5" event={"ID":"ca853c9d-cbc2-4f6a-8119-173bd16feb3f","Type":"ContainerDied","Data":"ddb706af32459bb4ee761a536028f31d033479c23d73149ba18a7c21636a1d84"}
Sep 15 13:48:08.486300 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:48:08.485931    2578 scope.go:117] "RemoveContainer" containerID="1a7bb960239d075ff8b8d34227d19ec7b528a8742e30fe64a43ea53e8c08d987"
Sep 15 13:48:08.495596 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:48:08.495577    2578 scope.go:117] "RemoveContainer" containerID="1a7bb960239d075ff8b8d34227d19ec7b528a8742e30fe64a43ea53e8c08d987"
Sep 15 13:48:08.495860 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:48:08.495840    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a7bb960239d075ff8b8d34227d19ec7b528a8742e30fe64a43ea53e8c08d987\": container with ID starting with 1a7bb960239d075ff8b8d34227d19ec7b528a8742e30fe64a43ea53e8c08d987 not found: ID does not exist" containerID="1a7bb960239d075ff8b8d34227d19ec7b528a8742e30fe64a43ea53e8c08d987"
Sep 15 13:48:08.495921 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:48:08.495869    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a7bb960239d075ff8b8d34227d19ec7b528a8742e30fe64a43ea53e8c08d987"} err="failed to get container status \"1a7bb960239d075ff8b8d34227d19ec7b528a8742e30fe64a43ea53e8c08d987\": rpc error: code = NotFound desc = could not find container \"1a7bb960239d075ff8b8d34227d19ec7b528a8742e30fe64a43ea53e8c08d987\": container with ID starting with 1a7bb960239d075ff8b8d34227d19ec7b528a8742e30fe64a43ea53e8c08d987 not found: ID does not exist"
Sep 15 13:48:08.506620 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:48:08.506599    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-77zd5"]
Sep 15 13:48:08.511136 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:48:08.511099    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-59c974bd48-77zd5"]
Sep 15 13:48:09.757627 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:48:09.757591    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca853c9d-cbc2-4f6a-8119-173bd16feb3f" path="/var/lib/kubelet/pods/ca853c9d-cbc2-4f6a-8119-173bd16feb3f/volumes"
Sep 15 13:49:35.239857 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:49:35.239820    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-gxtfg"]
Sep 15 13:49:35.240281 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:49:35.240222    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca853c9d-cbc2-4f6a-8119-173bd16feb3f" containerName="authorino"
Sep 15 13:49:35.240281 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:49:35.240235    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca853c9d-cbc2-4f6a-8119-173bd16feb3f" containerName="authorino"
Sep 15 13:49:35.240352 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:49:35.240303    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca853c9d-cbc2-4f6a-8119-173bd16feb3f" containerName="authorino"
Sep 15 13:49:35.242206 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:49:35.242190    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gxtfg"
Sep 15 13:49:35.245604 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:49:35.245576    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 15 13:49:35.245709 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:49:35.245581    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Sep 15 13:49:35.246257 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:49:35.246242    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-5mmvf\""
Sep 15 13:49:35.248693 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:49:35.248548    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 15 13:49:35.265594 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:49:35.265569    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-gxtfg"]
Sep 15 13:49:35.425498 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:49:35.425468    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7aad3aa3-c750-4d41-bc78-9069c4b04a83-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gxtfg\" (UID: \"7aad3aa3-c750-4d41-bc78-9069c4b04a83\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gxtfg"
Sep 15 13:49:35.425668 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:49:35.425513    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7aad3aa3-c750-4d41-bc78-9069c4b04a83-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gxtfg\" (UID: \"7aad3aa3-c750-4d41-bc78-9069c4b04a83\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gxtfg"
Sep 15 13:49:35.425668 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:49:35.425602    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7aad3aa3-c750-4d41-bc78-9069c4b04a83-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gxtfg\" (UID: \"7aad3aa3-c750-4d41-bc78-9069c4b04a83\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gxtfg"
Sep 15 13:49:35.425668 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:49:35.425629    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpkpn\" (UniqueName: \"kubernetes.io/projected/7aad3aa3-c750-4d41-bc78-9069c4b04a83-kube-api-access-bpkpn\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gxtfg\" (UID: \"7aad3aa3-c750-4d41-bc78-9069c4b04a83\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gxtfg"
Sep 15 13:49:35.425777 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:49:35.425672    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7aad3aa3-c750-4d41-bc78-9069c4b04a83-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gxtfg\" (UID: \"7aad3aa3-c750-4d41-bc78-9069c4b04a83\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gxtfg"
Sep 15 13:49:35.425777 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:49:35.425687    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7aad3aa3-c750-4d41-bc78-9069c4b04a83-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gxtfg\" (UID: \"7aad3aa3-c750-4d41-bc78-9069c4b04a83\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gxtfg"
Sep 15 13:49:35.526316 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:49:35.526292    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7aad3aa3-c750-4d41-bc78-9069c4b04a83-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gxtfg\" (UID: \"7aad3aa3-c750-4d41-bc78-9069c4b04a83\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gxtfg"
Sep 15 13:49:35.526470 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:49:35.526323    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7aad3aa3-c750-4d41-bc78-9069c4b04a83-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gxtfg\" (UID: \"7aad3aa3-c750-4d41-bc78-9069c4b04a83\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gxtfg"
Sep 15 13:49:35.526470 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:49:35.526363    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7aad3aa3-c750-4d41-bc78-9069c4b04a83-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gxtfg\" (UID: \"7aad3aa3-c750-4d41-bc78-9069c4b04a83\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gxtfg"
Sep 15 13:49:35.526470 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:49:35.526401    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7aad3aa3-c750-4d41-bc78-9069c4b04a83-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gxtfg\" (UID: \"7aad3aa3-c750-4d41-bc78-9069c4b04a83\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gxtfg"
Sep 15 13:49:35.526470 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:49:35.526463    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7aad3aa3-c750-4d41-bc78-9069c4b04a83-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gxtfg\" (UID: \"7aad3aa3-c750-4d41-bc78-9069c4b04a83\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gxtfg"
Sep 15 13:49:35.526684 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:49:35.526490    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpkpn\" (UniqueName: \"kubernetes.io/projected/7aad3aa3-c750-4d41-bc78-9069c4b04a83-kube-api-access-bpkpn\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gxtfg\" (UID: \"7aad3aa3-c750-4d41-bc78-9069c4b04a83\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gxtfg"
Sep 15 13:49:35.526743 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:49:35.526710    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7aad3aa3-c750-4d41-bc78-9069c4b04a83-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gxtfg\" (UID: \"7aad3aa3-c750-4d41-bc78-9069c4b04a83\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gxtfg"
Sep 15 13:49:35.526814 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:49:35.526785    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7aad3aa3-c750-4d41-bc78-9069c4b04a83-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gxtfg\" (UID: \"7aad3aa3-c750-4d41-bc78-9069c4b04a83\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gxtfg"
Sep 15 13:49:35.526863 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:49:35.526812    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7aad3aa3-c750-4d41-bc78-9069c4b04a83-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gxtfg\" (UID: \"7aad3aa3-c750-4d41-bc78-9069c4b04a83\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gxtfg"
Sep 15 13:49:35.528755 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:49:35.528734    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7aad3aa3-c750-4d41-bc78-9069c4b04a83-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gxtfg\" (UID: \"7aad3aa3-c750-4d41-bc78-9069c4b04a83\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gxtfg"
Sep 15 13:49:35.528912 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:49:35.528897    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7aad3aa3-c750-4d41-bc78-9069c4b04a83-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gxtfg\" (UID: \"7aad3aa3-c750-4d41-bc78-9069c4b04a83\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gxtfg"
Sep 15 13:49:35.536886 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:49:35.536861    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpkpn\" (UniqueName: \"kubernetes.io/projected/7aad3aa3-c750-4d41-bc78-9069c4b04a83-kube-api-access-bpkpn\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gxtfg\" (UID: \"7aad3aa3-c750-4d41-bc78-9069c4b04a83\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gxtfg"
Sep 15 13:49:35.551732 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:49:35.551711    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gxtfg"
Sep 15 13:49:35.825697 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:49:35.825668    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-gxtfg"]
Sep 15 13:49:35.827368 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:49:35.827343    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7aad3aa3_c750_4d41_bc78_9069c4b04a83.slice/crio-ba8d7bd4c006dd68039307908fb1b344d4b36048793f309d14a90bd4e5a9579c WatchSource:0}: Error finding container ba8d7bd4c006dd68039307908fb1b344d4b36048793f309d14a90bd4e5a9579c: Status 404 returned error can't find the container with id ba8d7bd4c006dd68039307908fb1b344d4b36048793f309d14a90bd4e5a9579c
Sep 15 13:49:35.828664 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:49:35.828648    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 13:49:35.920717 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:49:35.920680    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gxtfg" event={"ID":"7aad3aa3-c750-4d41-bc78-9069c4b04a83","Type":"ContainerStarted","Data":"ba8d7bd4c006dd68039307908fb1b344d4b36048793f309d14a90bd4e5a9579c"}
Sep 15 13:49:37.933238 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:49:37.933200    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gxtfg" event={"ID":"7aad3aa3-c750-4d41-bc78-9069c4b04a83","Type":"ContainerStarted","Data":"49e4bca95d509a4cbfccc6ad2245e437319484f5c17e128016ee00e9c3cd7bc3"}
Sep 15 13:49:37.952939 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:49:37.952896    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gxtfg" podStartSLOduration=1.811053855 podStartE2EDuration="2.952881274s" totalImagesPullingTime="1.141827419s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:49:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:49:37.950457164 +0000 UTC m=+664.709583450" watchObservedRunningTime="2026-09-15 13:49:37.952881274 +0000 UTC m=+664.712007561"
Sep 15 13:49:45.552318 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:49:45.552285    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gxtfg"
Sep 15 13:49:45.552771 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:49:45.552373    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gxtfg"
Sep 15 13:49:45.564782 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:49:45.564753    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gxtfg"
Sep 15 13:49:45.984649 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:49:45.984571    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gxtfg"
Sep 15 13:50:11.223515 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:50:11.223485    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-4jbgx"]
Sep 15 13:50:11.226758 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:50:11.226742    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4jbgx"
Sep 15 13:50:11.229469 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:50:11.229440    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Sep 15 13:50:11.237937 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:50:11.237914    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-4jbgx"]
Sep 15 13:50:11.319561 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:50:11.319521    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d2caea43-db92-4736-a8ae-5253f944fbeb-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-4jbgx\" (UID: \"d2caea43-db92-4736-a8ae-5253f944fbeb\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4jbgx"
Sep 15 13:50:11.319731 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:50:11.319574    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2caea43-db92-4736-a8ae-5253f944fbeb-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-4jbgx\" (UID: \"d2caea43-db92-4736-a8ae-5253f944fbeb\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4jbgx"
Sep 15 13:50:11.319731 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:50:11.319591    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d2caea43-db92-4736-a8ae-5253f944fbeb-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-4jbgx\" (UID: \"d2caea43-db92-4736-a8ae-5253f944fbeb\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4jbgx"
Sep 15 13:50:11.319731 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:50:11.319663    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d2caea43-db92-4736-a8ae-5253f944fbeb-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-4jbgx\" (UID: \"d2caea43-db92-4736-a8ae-5253f944fbeb\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4jbgx"
Sep 15 13:50:11.319731 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:50:11.319694    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d2caea43-db92-4736-a8ae-5253f944fbeb-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-4jbgx\" (UID: \"d2caea43-db92-4736-a8ae-5253f944fbeb\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4jbgx"
Sep 15 13:50:11.319731 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:50:11.319728    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hcd6n\" (UniqueName: \"kubernetes.io/projected/d2caea43-db92-4736-a8ae-5253f944fbeb-kube-api-access-hcd6n\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-4jbgx\" (UID: \"d2caea43-db92-4736-a8ae-5253f944fbeb\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4jbgx"
Sep 15 13:50:11.420342 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:50:11.420306    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d2caea43-db92-4736-a8ae-5253f944fbeb-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-4jbgx\" (UID: \"d2caea43-db92-4736-a8ae-5253f944fbeb\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4jbgx"
Sep 15 13:50:11.420494 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:50:11.420354    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2caea43-db92-4736-a8ae-5253f944fbeb-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-4jbgx\" (UID: \"d2caea43-db92-4736-a8ae-5253f944fbeb\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4jbgx"
Sep 15 13:50:11.420494 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:50:11.420465    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d2caea43-db92-4736-a8ae-5253f944fbeb-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-4jbgx\" (UID: \"d2caea43-db92-4736-a8ae-5253f944fbeb\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4jbgx"
Sep 15 13:50:11.420575 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:50:11.420509    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d2caea43-db92-4736-a8ae-5253f944fbeb-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-4jbgx\" (UID: \"d2caea43-db92-4736-a8ae-5253f944fbeb\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4jbgx"
Sep 15 13:50:11.420656 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:50:11.420636    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d2caea43-db92-4736-a8ae-5253f944fbeb-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-4jbgx\" (UID: \"d2caea43-db92-4736-a8ae-5253f944fbeb\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4jbgx"
Sep 15 13:50:11.420704 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:50:11.420684    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2caea43-db92-4736-a8ae-5253f944fbeb-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-4jbgx\" (UID: \"d2caea43-db92-4736-a8ae-5253f944fbeb\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4jbgx"
Sep 15 13:50:11.420704 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:50:11.420695    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hcd6n\" (UniqueName: \"kubernetes.io/projected/d2caea43-db92-4736-a8ae-5253f944fbeb-kube-api-access-hcd6n\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-4jbgx\" (UID: \"d2caea43-db92-4736-a8ae-5253f944fbeb\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4jbgx"
Sep 15 13:50:11.420830 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:50:11.420809    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d2caea43-db92-4736-a8ae-5253f944fbeb-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-4jbgx\" (UID: \"d2caea43-db92-4736-a8ae-5253f944fbeb\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4jbgx"
Sep 15 13:50:11.420830 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:50:11.420821    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d2caea43-db92-4736-a8ae-5253f944fbeb-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-4jbgx\" (UID: \"d2caea43-db92-4736-a8ae-5253f944fbeb\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4jbgx"
Sep 15 13:50:11.422818 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:50:11.422800    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d2caea43-db92-4736-a8ae-5253f944fbeb-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-4jbgx\" (UID: \"d2caea43-db92-4736-a8ae-5253f944fbeb\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4jbgx"
Sep 15 13:50:11.423162 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:50:11.423141    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d2caea43-db92-4736-a8ae-5253f944fbeb-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-4jbgx\" (UID: \"d2caea43-db92-4736-a8ae-5253f944fbeb\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4jbgx"
Sep 15 13:50:11.428267 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:50:11.428246    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcd6n\" (UniqueName: \"kubernetes.io/projected/d2caea43-db92-4736-a8ae-5253f944fbeb-kube-api-access-hcd6n\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-4jbgx\" (UID: \"d2caea43-db92-4736-a8ae-5253f944fbeb\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4jbgx"
Sep 15 13:50:11.536438 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:50:11.536402    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4jbgx"
Sep 15 13:50:11.809020 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:50:11.808991    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-4jbgx"]
Sep 15 13:50:11.810646 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:50:11.810619    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd2caea43_db92_4736_a8ae_5253f944fbeb.slice/crio-57576bc8faee7710862e9e47d1e3325c704cfb8e237772ab14906db3fe54658f WatchSource:0}: Error finding container 57576bc8faee7710862e9e47d1e3325c704cfb8e237772ab14906db3fe54658f: Status 404 returned error can't find the container with id 57576bc8faee7710862e9e47d1e3325c704cfb8e237772ab14906db3fe54658f
Sep 15 13:50:12.105149 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:50:12.105055    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4jbgx" event={"ID":"d2caea43-db92-4736-a8ae-5253f944fbeb","Type":"ContainerStarted","Data":"57576bc8faee7710862e9e47d1e3325c704cfb8e237772ab14906db3fe54658f"}
Sep 15 13:50:13.111849 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:50:13.111812    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4jbgx" event={"ID":"d2caea43-db92-4736-a8ae-5253f944fbeb","Type":"ContainerStarted","Data":"2a2c13a5c84d81ea893df07bc8cac9fce2b093e8e9c880f6f9f96f6d4c62195d"}
Sep 15 13:50:13.129708 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:50:13.129659    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4jbgx" podStartSLOduration=1.816389051 podStartE2EDuration="2.129645083s" totalImagesPullingTime="313.256032ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:50:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:50:13.127400854 +0000 UTC m=+699.886527143" watchObservedRunningTime="2026-09-15 13:50:13.129645083 +0000 UTC m=+699.888771369"
Sep 15 13:50:21.536720 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:50:21.536684    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4jbgx"
Sep 15 13:50:21.537240 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:50:21.536741    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4jbgx"
Sep 15 13:50:21.549624 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:50:21.549601    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4jbgx"
Sep 15 13:50:22.166950 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:50:22.166920    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4jbgx"
Sep 15 13:51:31.250208 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:31.250172    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-686679fc85-dg5w9"]
Sep 15 13:51:31.253404 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:31.253389    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-686679fc85-dg5w9"
Sep 15 13:51:31.261020 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:31.260996    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-686679fc85-dg5w9"]
Sep 15 13:51:31.316302 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:31.316267    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d90b63db-0b97-4168-be57-977b7a8b93da-tls-cert\") pod \"authorino-686679fc85-dg5w9\" (UID: \"d90b63db-0b97-4168-be57-977b7a8b93da\") " pod="kuadrant-system/authorino-686679fc85-dg5w9"
Sep 15 13:51:31.316302 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:31.316300    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-blm9n\" (UniqueName: \"kubernetes.io/projected/d90b63db-0b97-4168-be57-977b7a8b93da-kube-api-access-blm9n\") pod \"authorino-686679fc85-dg5w9\" (UID: \"d90b63db-0b97-4168-be57-977b7a8b93da\") " pod="kuadrant-system/authorino-686679fc85-dg5w9"
Sep 15 13:51:31.417343 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:31.417309    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d90b63db-0b97-4168-be57-977b7a8b93da-tls-cert\") pod \"authorino-686679fc85-dg5w9\" (UID: \"d90b63db-0b97-4168-be57-977b7a8b93da\") " pod="kuadrant-system/authorino-686679fc85-dg5w9"
Sep 15 13:51:31.417343 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:31.417343    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-blm9n\" (UniqueName: \"kubernetes.io/projected/d90b63db-0b97-4168-be57-977b7a8b93da-kube-api-access-blm9n\") pod \"authorino-686679fc85-dg5w9\" (UID: \"d90b63db-0b97-4168-be57-977b7a8b93da\") " pod="kuadrant-system/authorino-686679fc85-dg5w9"
Sep 15 13:51:31.419860 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:31.419838    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d90b63db-0b97-4168-be57-977b7a8b93da-tls-cert\") pod \"authorino-686679fc85-dg5w9\" (UID: \"d90b63db-0b97-4168-be57-977b7a8b93da\") " pod="kuadrant-system/authorino-686679fc85-dg5w9"
Sep 15 13:51:31.425371 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:31.425349    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-blm9n\" (UniqueName: \"kubernetes.io/projected/d90b63db-0b97-4168-be57-977b7a8b93da-kube-api-access-blm9n\") pod \"authorino-686679fc85-dg5w9\" (UID: \"d90b63db-0b97-4168-be57-977b7a8b93da\") " pod="kuadrant-system/authorino-686679fc85-dg5w9"
Sep 15 13:51:31.563631 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:31.563602    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-686679fc85-dg5w9"
Sep 15 13:51:31.832004 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:31.831967    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-686679fc85-dg5w9"]
Sep 15 13:51:31.833685 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:51:31.833661    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd90b63db_0b97_4168_be57_977b7a8b93da.slice/crio-947deceb84737b1aaff7f02b0ffd684434c49e79633ba9edc087a961596734d8 WatchSource:0}: Error finding container 947deceb84737b1aaff7f02b0ffd684434c49e79633ba9edc087a961596734d8: Status 404 returned error can't find the container with id 947deceb84737b1aaff7f02b0ffd684434c49e79633ba9edc087a961596734d8
Sep 15 13:51:32.502650 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:32.502612    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-686679fc85-dg5w9" event={"ID":"d90b63db-0b97-4168-be57-977b7a8b93da","Type":"ContainerStarted","Data":"947deceb84737b1aaff7f02b0ffd684434c49e79633ba9edc087a961596734d8"}
Sep 15 13:51:33.511981 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:33.511881    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-686679fc85-dg5w9" event={"ID":"d90b63db-0b97-4168-be57-977b7a8b93da","Type":"ContainerStarted","Data":"04717283f09299c7134813259e306644fb2ee824a65869c9e8dffdba27daace1"}
Sep 15 13:51:33.535081 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:33.535010    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-686679fc85-dg5w9" podStartSLOduration=1.2316880669999999 podStartE2EDuration="2.53498713s" totalImagesPullingTime="1.303299063s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:51:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:51:33.530966859 +0000 UTC m=+780.290093147" watchObservedRunningTime="2026-09-15 13:51:33.53498713 +0000 UTC m=+780.294113417"
Sep 15 13:51:33.559981 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:33.559945    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-85dfd58bdd-9dmf2"]
Sep 15 13:51:33.560217 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:33.560183    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-85dfd58bdd-9dmf2" podUID="a2610c95-7b7e-4ae2-80f9-19584d9ac170" containerName="authorino" containerID="cri-o://a52adcf7960a6d05ad8efdb948b618214bcfbabcfc4f788159328b77d284577d" gracePeriod=30
Sep 15 13:51:33.820624 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:33.820601    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-85dfd58bdd-9dmf2"
Sep 15 13:51:33.941179 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:33.941149    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a2610c95-7b7e-4ae2-80f9-19584d9ac170-tls-cert\") pod \"a2610c95-7b7e-4ae2-80f9-19584d9ac170\" (UID: \"a2610c95-7b7e-4ae2-80f9-19584d9ac170\") "
Sep 15 13:51:33.941341 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:33.941211    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-64qd2\" (UniqueName: \"kubernetes.io/projected/a2610c95-7b7e-4ae2-80f9-19584d9ac170-kube-api-access-64qd2\") pod \"a2610c95-7b7e-4ae2-80f9-19584d9ac170\" (UID: \"a2610c95-7b7e-4ae2-80f9-19584d9ac170\") "
Sep 15 13:51:33.943376 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:33.943346    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2610c95-7b7e-4ae2-80f9-19584d9ac170-kube-api-access-64qd2" (OuterVolumeSpecName: "kube-api-access-64qd2") pod "a2610c95-7b7e-4ae2-80f9-19584d9ac170" (UID: "a2610c95-7b7e-4ae2-80f9-19584d9ac170"). InnerVolumeSpecName "kube-api-access-64qd2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:51:33.952369 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:33.952344    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a2610c95-7b7e-4ae2-80f9-19584d9ac170-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "a2610c95-7b7e-4ae2-80f9-19584d9ac170" (UID: "a2610c95-7b7e-4ae2-80f9-19584d9ac170"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 13:51:34.042156 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:34.042083    2578 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a2610c95-7b7e-4ae2-80f9-19584d9ac170-tls-cert\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:51:34.042156 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:34.042114    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-64qd2\" (UniqueName: \"kubernetes.io/projected/a2610c95-7b7e-4ae2-80f9-19584d9ac170-kube-api-access-64qd2\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:51:34.519201 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:34.519097    2578 generic.go:356] "Generic (PLEG): container finished" podID="a2610c95-7b7e-4ae2-80f9-19584d9ac170" containerID="a52adcf7960a6d05ad8efdb948b618214bcfbabcfc4f788159328b77d284577d" exitCode=0
Sep 15 13:51:34.519201 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:34.519158    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-85dfd58bdd-9dmf2"
Sep 15 13:51:34.519201 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:34.519175    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-85dfd58bdd-9dmf2" event={"ID":"a2610c95-7b7e-4ae2-80f9-19584d9ac170","Type":"ContainerDied","Data":"a52adcf7960a6d05ad8efdb948b618214bcfbabcfc4f788159328b77d284577d"}
Sep 15 13:51:34.519689 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:34.519216    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-85dfd58bdd-9dmf2" event={"ID":"a2610c95-7b7e-4ae2-80f9-19584d9ac170","Type":"ContainerDied","Data":"cb05b83cd44738d35e88eb0c34badb2a957c3b1bb64b7c6c3271ed5ee9478cbb"}
Sep 15 13:51:34.519689 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:34.519232    2578 scope.go:117] "RemoveContainer" containerID="a52adcf7960a6d05ad8efdb948b618214bcfbabcfc4f788159328b77d284577d"
Sep 15 13:51:34.530718 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:34.530695    2578 scope.go:117] "RemoveContainer" containerID="a52adcf7960a6d05ad8efdb948b618214bcfbabcfc4f788159328b77d284577d"
Sep 15 13:51:34.531217 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:51:34.531194    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a52adcf7960a6d05ad8efdb948b618214bcfbabcfc4f788159328b77d284577d\": container with ID starting with a52adcf7960a6d05ad8efdb948b618214bcfbabcfc4f788159328b77d284577d not found: ID does not exist" containerID="a52adcf7960a6d05ad8efdb948b618214bcfbabcfc4f788159328b77d284577d"
Sep 15 13:51:34.531295 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:34.531225    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a52adcf7960a6d05ad8efdb948b618214bcfbabcfc4f788159328b77d284577d"} err="failed to get container status \"a52adcf7960a6d05ad8efdb948b618214bcfbabcfc4f788159328b77d284577d\": rpc error: code = NotFound desc = could not find container \"a52adcf7960a6d05ad8efdb948b618214bcfbabcfc4f788159328b77d284577d\": container with ID starting with a52adcf7960a6d05ad8efdb948b618214bcfbabcfc4f788159328b77d284577d not found: ID does not exist"
Sep 15 13:51:34.541629 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:34.541604    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-85dfd58bdd-9dmf2"]
Sep 15 13:51:34.548700 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:34.548674    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-85dfd58bdd-9dmf2"]
Sep 15 13:51:35.757706 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:35.757674    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a2610c95-7b7e-4ae2-80f9-19584d9ac170" path="/var/lib/kubelet/pods/a2610c95-7b7e-4ae2-80f9-19584d9ac170/volumes"
Sep 15 13:51:51.305888 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:51.305859    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-1293e7-openshift-default-567dbc6586-qk4jn"]
Sep 15 13:51:51.306382 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:51.306269    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2610c95-7b7e-4ae2-80f9-19584d9ac170" containerName="authorino"
Sep 15 13:51:51.306382 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:51.306283    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2610c95-7b7e-4ae2-80f9-19584d9ac170" containerName="authorino"
Sep 15 13:51:51.306382 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:51.306352    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2610c95-7b7e-4ae2-80f9-19584d9ac170" containerName="authorino"
Sep 15 13:51:51.311018 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:51.310998    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-1293e7-openshift-default-567dbc6586-qk4jn"
Sep 15 13:51:51.313609 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:51.313581    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w0-1293e7-openshift-default-dockercfg-hzfd5\""
Sep 15 13:51:51.325146 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:51.325103    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-1293e7-openshift-default-567dbc6586-qk4jn"]
Sep 15 13:51:51.379187 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:51.379160    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-66261e-openshift-default-86bd889684-6v7ph"]
Sep 15 13:51:51.382607 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:51.382581    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-66261e-openshift-default-86bd889684-6v7ph"
Sep 15 13:51:51.384955 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:51.384931    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w4-66261e-openshift-default-dockercfg-w2fbs\""
Sep 15 13:51:51.394603 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:51.394578    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-66261e-openshift-default-86bd889684-6v7ph"]
Sep 15 13:51:51.398092 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:51.398068    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8e97cfd-1e47-4397-9cfc-179f6cf158b4-workload-socket\") pod \"e2e-worker-w0-1293e7-openshift-default-567dbc6586-qk4jn\" (UID: \"b8e97cfd-1e47-4397-9cfc-179f6cf158b4\") " pod="openshift-ingress/e2e-worker-w0-1293e7-openshift-default-567dbc6586-qk4jn"
Sep 15 13:51:51.398246 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:51.398097    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8e97cfd-1e47-4397-9cfc-179f6cf158b4-istio-data\") pod \"e2e-worker-w0-1293e7-openshift-default-567dbc6586-qk4jn\" (UID: \"b8e97cfd-1e47-4397-9cfc-179f6cf158b4\") " pod="openshift-ingress/e2e-worker-w0-1293e7-openshift-default-567dbc6586-qk4jn"
Sep 15 13:51:51.398246 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:51.398118    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8e97cfd-1e47-4397-9cfc-179f6cf158b4-istio-token\") pod \"e2e-worker-w0-1293e7-openshift-default-567dbc6586-qk4jn\" (UID: \"b8e97cfd-1e47-4397-9cfc-179f6cf158b4\") " pod="openshift-ingress/e2e-worker-w0-1293e7-openshift-default-567dbc6586-qk4jn"
Sep 15 13:51:51.398246 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:51.398197    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8e97cfd-1e47-4397-9cfc-179f6cf158b4-istiod-ca-cert\") pod \"e2e-worker-w0-1293e7-openshift-default-567dbc6586-qk4jn\" (UID: \"b8e97cfd-1e47-4397-9cfc-179f6cf158b4\") " pod="openshift-ingress/e2e-worker-w0-1293e7-openshift-default-567dbc6586-qk4jn"
Sep 15 13:51:51.398367 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:51.398256    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8e97cfd-1e47-4397-9cfc-179f6cf158b4-istio-podinfo\") pod \"e2e-worker-w0-1293e7-openshift-default-567dbc6586-qk4jn\" (UID: \"b8e97cfd-1e47-4397-9cfc-179f6cf158b4\") " pod="openshift-ingress/e2e-worker-w0-1293e7-openshift-default-567dbc6586-qk4jn"
Sep 15 13:51:51.398367 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:51.398339    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8e97cfd-1e47-4397-9cfc-179f6cf158b4-istio-envoy\") pod \"e2e-worker-w0-1293e7-openshift-default-567dbc6586-qk4jn\" (UID: \"b8e97cfd-1e47-4397-9cfc-179f6cf158b4\") " pod="openshift-ingress/e2e-worker-w0-1293e7-openshift-default-567dbc6586-qk4jn"
Sep 15 13:51:51.398367 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:51.398360    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8e97cfd-1e47-4397-9cfc-179f6cf158b4-workload-certs\") pod \"e2e-worker-w0-1293e7-openshift-default-567dbc6586-qk4jn\" (UID: \"b8e97cfd-1e47-4397-9cfc-179f6cf158b4\") " pod="openshift-ingress/e2e-worker-w0-1293e7-openshift-default-567dbc6586-qk4jn"
Sep 15 13:51:51.398481 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:51.398376    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-slg2n\" (UniqueName: \"kubernetes.io/projected/b8e97cfd-1e47-4397-9cfc-179f6cf158b4-kube-api-access-slg2n\") pod \"e2e-worker-w0-1293e7-openshift-default-567dbc6586-qk4jn\" (UID: \"b8e97cfd-1e47-4397-9cfc-179f6cf158b4\") " pod="openshift-ingress/e2e-worker-w0-1293e7-openshift-default-567dbc6586-qk4jn"
Sep 15 13:51:51.398481 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:51.398400    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8e97cfd-1e47-4397-9cfc-179f6cf158b4-credential-socket\") pod \"e2e-worker-w0-1293e7-openshift-default-567dbc6586-qk4jn\" (UID: \"b8e97cfd-1e47-4397-9cfc-179f6cf158b4\") " pod="openshift-ingress/e2e-worker-w0-1293e7-openshift-default-567dbc6586-qk4jn"
Sep 15 13:51:51.499447 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:51.499416    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8e97cfd-1e47-4397-9cfc-179f6cf158b4-istio-token\") pod \"e2e-worker-w0-1293e7-openshift-default-567dbc6586-qk4jn\" (UID: \"b8e97cfd-1e47-4397-9cfc-179f6cf158b4\") " pod="openshift-ingress/e2e-worker-w0-1293e7-openshift-default-567dbc6586-qk4jn"
Sep 15 13:51:51.499624 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:51.499466    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a46634e7-1982-4116-a42e-2075f7d3cd72-istiod-ca-cert\") pod \"e2e-worker-w4-66261e-openshift-default-86bd889684-6v7ph\" (UID: \"a46634e7-1982-4116-a42e-2075f7d3cd72\") " pod="openshift-ingress/e2e-worker-w4-66261e-openshift-default-86bd889684-6v7ph"
Sep 15 13:51:51.499624 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:51.499499    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8e97cfd-1e47-4397-9cfc-179f6cf158b4-istiod-ca-cert\") pod \"e2e-worker-w0-1293e7-openshift-default-567dbc6586-qk4jn\" (UID: \"b8e97cfd-1e47-4397-9cfc-179f6cf158b4\") " pod="openshift-ingress/e2e-worker-w0-1293e7-openshift-default-567dbc6586-qk4jn"
Sep 15 13:51:51.499624 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:51.499528    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a46634e7-1982-4116-a42e-2075f7d3cd72-istio-data\") pod \"e2e-worker-w4-66261e-openshift-default-86bd889684-6v7ph\" (UID: \"a46634e7-1982-4116-a42e-2075f7d3cd72\") " pod="openshift-ingress/e2e-worker-w4-66261e-openshift-default-86bd889684-6v7ph"
Sep 15 13:51:51.499624 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:51.499556    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8e97cfd-1e47-4397-9cfc-179f6cf158b4-istio-podinfo\") pod \"e2e-worker-w0-1293e7-openshift-default-567dbc6586-qk4jn\" (UID: \"b8e97cfd-1e47-4397-9cfc-179f6cf158b4\") " pod="openshift-ingress/e2e-worker-w0-1293e7-openshift-default-567dbc6586-qk4jn"
Sep 15 13:51:51.499815 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:51.499656    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lp5mq\" (UniqueName: \"kubernetes.io/projected/a46634e7-1982-4116-a42e-2075f7d3cd72-kube-api-access-lp5mq\") pod \"e2e-worker-w4-66261e-openshift-default-86bd889684-6v7ph\" (UID: \"a46634e7-1982-4116-a42e-2075f7d3cd72\") " pod="openshift-ingress/e2e-worker-w4-66261e-openshift-default-86bd889684-6v7ph"
Sep 15 13:51:51.499815 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:51.499695    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a46634e7-1982-4116-a42e-2075f7d3cd72-workload-socket\") pod \"e2e-worker-w4-66261e-openshift-default-86bd889684-6v7ph\" (UID: \"a46634e7-1982-4116-a42e-2075f7d3cd72\") " pod="openshift-ingress/e2e-worker-w4-66261e-openshift-default-86bd889684-6v7ph"
Sep 15 13:51:51.499815 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:51.499782    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8e97cfd-1e47-4397-9cfc-179f6cf158b4-istio-envoy\") pod \"e2e-worker-w0-1293e7-openshift-default-567dbc6586-qk4jn\" (UID: \"b8e97cfd-1e47-4397-9cfc-179f6cf158b4\") " pod="openshift-ingress/e2e-worker-w0-1293e7-openshift-default-567dbc6586-qk4jn"
Sep 15 13:51:51.499815 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:51.499803    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a46634e7-1982-4116-a42e-2075f7d3cd72-credential-socket\") pod \"e2e-worker-w4-66261e-openshift-default-86bd889684-6v7ph\" (UID: \"a46634e7-1982-4116-a42e-2075f7d3cd72\") " pod="openshift-ingress/e2e-worker-w4-66261e-openshift-default-86bd889684-6v7ph"
Sep 15 13:51:51.500007 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:51.499822    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a46634e7-1982-4116-a42e-2075f7d3cd72-istio-token\") pod \"e2e-worker-w4-66261e-openshift-default-86bd889684-6v7ph\" (UID: \"a46634e7-1982-4116-a42e-2075f7d3cd72\") " pod="openshift-ingress/e2e-worker-w4-66261e-openshift-default-86bd889684-6v7ph"
Sep 15 13:51:51.500007 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:51.499841    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8e97cfd-1e47-4397-9cfc-179f6cf158b4-workload-certs\") pod \"e2e-worker-w0-1293e7-openshift-default-567dbc6586-qk4jn\" (UID: \"b8e97cfd-1e47-4397-9cfc-179f6cf158b4\") " pod="openshift-ingress/e2e-worker-w0-1293e7-openshift-default-567dbc6586-qk4jn"
Sep 15 13:51:51.500007 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:51.499855    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slg2n\" (UniqueName: \"kubernetes.io/projected/b8e97cfd-1e47-4397-9cfc-179f6cf158b4-kube-api-access-slg2n\") pod \"e2e-worker-w0-1293e7-openshift-default-567dbc6586-qk4jn\" (UID: \"b8e97cfd-1e47-4397-9cfc-179f6cf158b4\") " pod="openshift-ingress/e2e-worker-w0-1293e7-openshift-default-567dbc6586-qk4jn"
Sep 15 13:51:51.500007 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:51.499989    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a46634e7-1982-4116-a42e-2075f7d3cd72-istio-envoy\") pod \"e2e-worker-w4-66261e-openshift-default-86bd889684-6v7ph\" (UID: \"a46634e7-1982-4116-a42e-2075f7d3cd72\") " pod="openshift-ingress/e2e-worker-w4-66261e-openshift-default-86bd889684-6v7ph"
Sep 15 13:51:51.500252 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:51.500061    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8e97cfd-1e47-4397-9cfc-179f6cf158b4-credential-socket\") pod \"e2e-worker-w0-1293e7-openshift-default-567dbc6586-qk4jn\" (UID: \"b8e97cfd-1e47-4397-9cfc-179f6cf158b4\") " pod="openshift-ingress/e2e-worker-w0-1293e7-openshift-default-567dbc6586-qk4jn"
Sep 15 13:51:51.500252 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:51.500088    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a46634e7-1982-4116-a42e-2075f7d3cd72-workload-certs\") pod \"e2e-worker-w4-66261e-openshift-default-86bd889684-6v7ph\" (UID: \"a46634e7-1982-4116-a42e-2075f7d3cd72\") " pod="openshift-ingress/e2e-worker-w4-66261e-openshift-default-86bd889684-6v7ph"
Sep 15 13:51:51.500252 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:51.500150    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8e97cfd-1e47-4397-9cfc-179f6cf158b4-workload-socket\") pod \"e2e-worker-w0-1293e7-openshift-default-567dbc6586-qk4jn\" (UID: \"b8e97cfd-1e47-4397-9cfc-179f6cf158b4\") " pod="openshift-ingress/e2e-worker-w0-1293e7-openshift-default-567dbc6586-qk4jn"
Sep 15 13:51:51.500252 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:51.500179    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8e97cfd-1e47-4397-9cfc-179f6cf158b4-istio-data\") pod \"e2e-worker-w0-1293e7-openshift-default-567dbc6586-qk4jn\" (UID: \"b8e97cfd-1e47-4397-9cfc-179f6cf158b4\") " pod="openshift-ingress/e2e-worker-w0-1293e7-openshift-default-567dbc6586-qk4jn"
Sep 15 13:51:51.500252 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:51.500210    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a46634e7-1982-4116-a42e-2075f7d3cd72-istio-podinfo\") pod \"e2e-worker-w4-66261e-openshift-default-86bd889684-6v7ph\" (UID: \"a46634e7-1982-4116-a42e-2075f7d3cd72\") " pod="openshift-ingress/e2e-worker-w4-66261e-openshift-default-86bd889684-6v7ph"
Sep 15 13:51:51.500877 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:51.500289    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8e97cfd-1e47-4397-9cfc-179f6cf158b4-workload-certs\") pod \"e2e-worker-w0-1293e7-openshift-default-567dbc6586-qk4jn\" (UID: \"b8e97cfd-1e47-4397-9cfc-179f6cf158b4\") " pod="openshift-ingress/e2e-worker-w0-1293e7-openshift-default-567dbc6586-qk4jn"
Sep 15 13:51:51.500877 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:51.500451    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8e97cfd-1e47-4397-9cfc-179f6cf158b4-workload-socket\") pod \"e2e-worker-w0-1293e7-openshift-default-567dbc6586-qk4jn\" (UID: \"b8e97cfd-1e47-4397-9cfc-179f6cf158b4\") " pod="openshift-ingress/e2e-worker-w0-1293e7-openshift-default-567dbc6586-qk4jn"
Sep 15 13:51:51.500877 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:51.500540    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8e97cfd-1e47-4397-9cfc-179f6cf158b4-istio-data\") pod \"e2e-worker-w0-1293e7-openshift-default-567dbc6586-qk4jn\" (UID: \"b8e97cfd-1e47-4397-9cfc-179f6cf158b4\") " pod="openshift-ingress/e2e-worker-w0-1293e7-openshift-default-567dbc6586-qk4jn"
Sep 15 13:51:51.500877 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:51.500547    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8e97cfd-1e47-4397-9cfc-179f6cf158b4-istiod-ca-cert\") pod \"e2e-worker-w0-1293e7-openshift-default-567dbc6586-qk4jn\" (UID: \"b8e97cfd-1e47-4397-9cfc-179f6cf158b4\") " pod="openshift-ingress/e2e-worker-w0-1293e7-openshift-default-567dbc6586-qk4jn"
Sep 15 13:51:51.500877 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:51.500704    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8e97cfd-1e47-4397-9cfc-179f6cf158b4-credential-socket\") pod \"e2e-worker-w0-1293e7-openshift-default-567dbc6586-qk4jn\" (UID: \"b8e97cfd-1e47-4397-9cfc-179f6cf158b4\") " pod="openshift-ingress/e2e-worker-w0-1293e7-openshift-default-567dbc6586-qk4jn"
Sep 15 13:51:51.502184 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:51.502162    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8e97cfd-1e47-4397-9cfc-179f6cf158b4-istio-podinfo\") pod \"e2e-worker-w0-1293e7-openshift-default-567dbc6586-qk4jn\" (UID: \"b8e97cfd-1e47-4397-9cfc-179f6cf158b4\") " pod="openshift-ingress/e2e-worker-w0-1293e7-openshift-default-567dbc6586-qk4jn"
Sep 15 13:51:51.502351 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:51.502332    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8e97cfd-1e47-4397-9cfc-179f6cf158b4-istio-envoy\") pod \"e2e-worker-w0-1293e7-openshift-default-567dbc6586-qk4jn\" (UID: \"b8e97cfd-1e47-4397-9cfc-179f6cf158b4\") " pod="openshift-ingress/e2e-worker-w0-1293e7-openshift-default-567dbc6586-qk4jn"
Sep 15 13:51:51.511518 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:51.511494    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8e97cfd-1e47-4397-9cfc-179f6cf158b4-istio-token\") pod \"e2e-worker-w0-1293e7-openshift-default-567dbc6586-qk4jn\" (UID: \"b8e97cfd-1e47-4397-9cfc-179f6cf158b4\") " pod="openshift-ingress/e2e-worker-w0-1293e7-openshift-default-567dbc6586-qk4jn"
Sep 15 13:51:51.511833 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:51.511813    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-slg2n\" (UniqueName: \"kubernetes.io/projected/b8e97cfd-1e47-4397-9cfc-179f6cf158b4-kube-api-access-slg2n\") pod \"e2e-worker-w0-1293e7-openshift-default-567dbc6586-qk4jn\" (UID: \"b8e97cfd-1e47-4397-9cfc-179f6cf158b4\") " pod="openshift-ingress/e2e-worker-w0-1293e7-openshift-default-567dbc6586-qk4jn"
Sep 15 13:51:51.601397 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:51.601308    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lp5mq\" (UniqueName: \"kubernetes.io/projected/a46634e7-1982-4116-a42e-2075f7d3cd72-kube-api-access-lp5mq\") pod \"e2e-worker-w4-66261e-openshift-default-86bd889684-6v7ph\" (UID: \"a46634e7-1982-4116-a42e-2075f7d3cd72\") " pod="openshift-ingress/e2e-worker-w4-66261e-openshift-default-86bd889684-6v7ph"
Sep 15 13:51:51.601397 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:51.601341    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a46634e7-1982-4116-a42e-2075f7d3cd72-workload-socket\") pod \"e2e-worker-w4-66261e-openshift-default-86bd889684-6v7ph\" (UID: \"a46634e7-1982-4116-a42e-2075f7d3cd72\") " pod="openshift-ingress/e2e-worker-w4-66261e-openshift-default-86bd889684-6v7ph"
Sep 15 13:51:51.601639 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:51.601399    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a46634e7-1982-4116-a42e-2075f7d3cd72-credential-socket\") pod \"e2e-worker-w4-66261e-openshift-default-86bd889684-6v7ph\" (UID: \"a46634e7-1982-4116-a42e-2075f7d3cd72\") " pod="openshift-ingress/e2e-worker-w4-66261e-openshift-default-86bd889684-6v7ph"
Sep 15 13:51:51.601639 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:51.601427    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a46634e7-1982-4116-a42e-2075f7d3cd72-istio-token\") pod \"e2e-worker-w4-66261e-openshift-default-86bd889684-6v7ph\" (UID: \"a46634e7-1982-4116-a42e-2075f7d3cd72\") " pod="openshift-ingress/e2e-worker-w4-66261e-openshift-default-86bd889684-6v7ph"
Sep 15 13:51:51.601639 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:51.601469    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a46634e7-1982-4116-a42e-2075f7d3cd72-istio-envoy\") pod \"e2e-worker-w4-66261e-openshift-default-86bd889684-6v7ph\" (UID: \"a46634e7-1982-4116-a42e-2075f7d3cd72\") " pod="openshift-ingress/e2e-worker-w4-66261e-openshift-default-86bd889684-6v7ph"
Sep 15 13:51:51.601639 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:51.601500    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a46634e7-1982-4116-a42e-2075f7d3cd72-workload-certs\") pod \"e2e-worker-w4-66261e-openshift-default-86bd889684-6v7ph\" (UID: \"a46634e7-1982-4116-a42e-2075f7d3cd72\") " pod="openshift-ingress/e2e-worker-w4-66261e-openshift-default-86bd889684-6v7ph"
Sep 15 13:51:51.601639 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:51.601582    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a46634e7-1982-4116-a42e-2075f7d3cd72-istio-podinfo\") pod \"e2e-worker-w4-66261e-openshift-default-86bd889684-6v7ph\" (UID: \"a46634e7-1982-4116-a42e-2075f7d3cd72\") " pod="openshift-ingress/e2e-worker-w4-66261e-openshift-default-86bd889684-6v7ph"
Sep 15 13:51:51.601639 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:51.601622    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a46634e7-1982-4116-a42e-2075f7d3cd72-istiod-ca-cert\") pod \"e2e-worker-w4-66261e-openshift-default-86bd889684-6v7ph\" (UID: \"a46634e7-1982-4116-a42e-2075f7d3cd72\") " pod="openshift-ingress/e2e-worker-w4-66261e-openshift-default-86bd889684-6v7ph"
Sep 15 13:51:51.601942 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:51.601659    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a46634e7-1982-4116-a42e-2075f7d3cd72-istio-data\") pod \"e2e-worker-w4-66261e-openshift-default-86bd889684-6v7ph\" (UID: \"a46634e7-1982-4116-a42e-2075f7d3cd72\") " pod="openshift-ingress/e2e-worker-w4-66261e-openshift-default-86bd889684-6v7ph"
Sep 15 13:51:51.601942 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:51.601890    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a46634e7-1982-4116-a42e-2075f7d3cd72-credential-socket\") pod \"e2e-worker-w4-66261e-openshift-default-86bd889684-6v7ph\" (UID: \"a46634e7-1982-4116-a42e-2075f7d3cd72\") " pod="openshift-ingress/e2e-worker-w4-66261e-openshift-default-86bd889684-6v7ph"
Sep 15 13:51:51.601942 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:51.601931    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a46634e7-1982-4116-a42e-2075f7d3cd72-workload-socket\") pod \"e2e-worker-w4-66261e-openshift-default-86bd889684-6v7ph\" (UID: \"a46634e7-1982-4116-a42e-2075f7d3cd72\") " pod="openshift-ingress/e2e-worker-w4-66261e-openshift-default-86bd889684-6v7ph"
Sep 15 13:51:51.602089 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:51.601957    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a46634e7-1982-4116-a42e-2075f7d3cd72-workload-certs\") pod \"e2e-worker-w4-66261e-openshift-default-86bd889684-6v7ph\" (UID: \"a46634e7-1982-4116-a42e-2075f7d3cd72\") " pod="openshift-ingress/e2e-worker-w4-66261e-openshift-default-86bd889684-6v7ph"
Sep 15 13:51:51.602169 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:51.602095    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a46634e7-1982-4116-a42e-2075f7d3cd72-istio-data\") pod \"e2e-worker-w4-66261e-openshift-default-86bd889684-6v7ph\" (UID: \"a46634e7-1982-4116-a42e-2075f7d3cd72\") " pod="openshift-ingress/e2e-worker-w4-66261e-openshift-default-86bd889684-6v7ph"
Sep 15 13:51:51.602569 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:51.602529    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a46634e7-1982-4116-a42e-2075f7d3cd72-istiod-ca-cert\") pod \"e2e-worker-w4-66261e-openshift-default-86bd889684-6v7ph\" (UID: \"a46634e7-1982-4116-a42e-2075f7d3cd72\") " pod="openshift-ingress/e2e-worker-w4-66261e-openshift-default-86bd889684-6v7ph"
Sep 15 13:51:51.604271 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:51.604245    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a46634e7-1982-4116-a42e-2075f7d3cd72-istio-envoy\") pod \"e2e-worker-w4-66261e-openshift-default-86bd889684-6v7ph\" (UID: \"a46634e7-1982-4116-a42e-2075f7d3cd72\") " pod="openshift-ingress/e2e-worker-w4-66261e-openshift-default-86bd889684-6v7ph"
Sep 15 13:51:51.604416 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:51.604385    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a46634e7-1982-4116-a42e-2075f7d3cd72-istio-podinfo\") pod \"e2e-worker-w4-66261e-openshift-default-86bd889684-6v7ph\" (UID: \"a46634e7-1982-4116-a42e-2075f7d3cd72\") " pod="openshift-ingress/e2e-worker-w4-66261e-openshift-default-86bd889684-6v7ph"
Sep 15 13:51:51.610227 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:51.610205    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lp5mq\" (UniqueName: \"kubernetes.io/projected/a46634e7-1982-4116-a42e-2075f7d3cd72-kube-api-access-lp5mq\") pod \"e2e-worker-w4-66261e-openshift-default-86bd889684-6v7ph\" (UID: \"a46634e7-1982-4116-a42e-2075f7d3cd72\") " pod="openshift-ingress/e2e-worker-w4-66261e-openshift-default-86bd889684-6v7ph"
Sep 15 13:51:51.615411 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:51.615390    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a46634e7-1982-4116-a42e-2075f7d3cd72-istio-token\") pod \"e2e-worker-w4-66261e-openshift-default-86bd889684-6v7ph\" (UID: \"a46634e7-1982-4116-a42e-2075f7d3cd72\") " pod="openshift-ingress/e2e-worker-w4-66261e-openshift-default-86bd889684-6v7ph"
Sep 15 13:51:51.621410 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:51.621392    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-1293e7-openshift-default-567dbc6586-qk4jn"
Sep 15 13:51:51.694729 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:51.694673    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-66261e-openshift-default-86bd889684-6v7ph"
Sep 15 13:51:51.900832 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:51.900797    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-1293e7-openshift-default-567dbc6586-qk4jn"]
Sep 15 13:51:51.902062 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:51:51.902035    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8e97cfd_1e47_4397_9cfc_179f6cf158b4.slice/crio-e347001360884cf3e7a036343c55f29fd709f8fc9e1bf33a031524349fbecb20 WatchSource:0}: Error finding container e347001360884cf3e7a036343c55f29fd709f8fc9e1bf33a031524349fbecb20: Status 404 returned error can't find the container with id e347001360884cf3e7a036343c55f29fd709f8fc9e1bf33a031524349fbecb20
Sep 15 13:51:51.904230 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:51.904199    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 15 13:51:51.904300 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:51.904264    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 15 13:51:51.904342 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:51.904296    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 15 13:51:51.971596 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:51.971571    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-66261e-openshift-default-86bd889684-6v7ph"]
Sep 15 13:51:51.973083 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:51:51.973059    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda46634e7_1982_4116_a42e_2075f7d3cd72.slice/crio-b6fcf05c9f2db5c373bbea9006e3cc2b672a9c6db588e80a429753cb3805bb82 WatchSource:0}: Error finding container b6fcf05c9f2db5c373bbea9006e3cc2b672a9c6db588e80a429753cb3805bb82: Status 404 returned error can't find the container with id b6fcf05c9f2db5c373bbea9006e3cc2b672a9c6db588e80a429753cb3805bb82
Sep 15 13:51:51.975296 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:51.975266    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 15 13:51:51.975362 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:51.975327    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 15 13:51:51.975362 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:51.975357    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 15 13:51:52.613363 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:52.613325    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-1293e7-openshift-default-567dbc6586-qk4jn" event={"ID":"b8e97cfd-1e47-4397-9cfc-179f6cf158b4","Type":"ContainerStarted","Data":"0c03e306be1606962d321e6f41d45b0fdce44cd93106409c29b76c0cf8aefb77"}
Sep 15 13:51:52.613831 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:52.613383    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-1293e7-openshift-default-567dbc6586-qk4jn" event={"ID":"b8e97cfd-1e47-4397-9cfc-179f6cf158b4","Type":"ContainerStarted","Data":"e347001360884cf3e7a036343c55f29fd709f8fc9e1bf33a031524349fbecb20"}
Sep 15 13:51:52.614939 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:52.614911    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-66261e-openshift-default-86bd889684-6v7ph" event={"ID":"a46634e7-1982-4116-a42e-2075f7d3cd72","Type":"ContainerStarted","Data":"ee4d55fb0ecd9bf838123efb3d9d3d60c022a5d86226dc964280f8cce76e78bb"}
Sep 15 13:51:52.615047 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:52.614956    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-66261e-openshift-default-86bd889684-6v7ph" event={"ID":"a46634e7-1982-4116-a42e-2075f7d3cd72","Type":"ContainerStarted","Data":"b6fcf05c9f2db5c373bbea9006e3cc2b672a9c6db588e80a429753cb3805bb82"}
Sep 15 13:51:52.622453 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:52.622433    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-1293e7-openshift-default-567dbc6586-qk4jn"
Sep 15 13:51:52.623741 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:52.623712    2578 patch_prober.go:28] interesting pod/e2e-worker-w0-1293e7-openshift-default-567dbc6586-qk4jn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Sep 15 13:51:52.623835 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:52.623751    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-1293e7-openshift-default-567dbc6586-qk4jn" podUID="b8e97cfd-1e47-4397-9cfc-179f6cf158b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Sep 15 13:51:52.637934 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:52.637893    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-1293e7-openshift-default-567dbc6586-qk4jn" podStartSLOduration=1.637879976 podStartE2EDuration="1.637879976s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:51:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:51:52.634800022 +0000 UTC m=+799.393926307" watchObservedRunningTime="2026-09-15 13:51:52.637879976 +0000 UTC m=+799.397006263"
Sep 15 13:51:52.655513 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:52.655476    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-66261e-openshift-default-86bd889684-6v7ph" podStartSLOduration=1.655462785 podStartE2EDuration="1.655462785s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:51:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:51:52.653539974 +0000 UTC m=+799.412666260" watchObservedRunningTime="2026-09-15 13:51:52.655462785 +0000 UTC m=+799.414589071"
Sep 15 13:51:52.695221 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:52.695189    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-66261e-openshift-default-86bd889684-6v7ph"
Sep 15 13:51:52.912413 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:52.912321    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7723-c2830e"]
Sep 15 13:51:52.915771 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:52.915755    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7723-c2830e"
Sep 15 13:51:52.918234 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:52.918215    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-4xtjh\""
Sep 15 13:51:52.923732 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:52.923710    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7723-c2830e"]
Sep 15 13:51:53.015784 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:53.015742    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkqn7\" (UniqueName: \"kubernetes.io/projected/eb9e7c90-5a79-406a-852c-716128dc585e-kube-api-access-mkqn7\") pod \"test-curl-7723-c2830e\" (UID: \"eb9e7c90-5a79-406a-852c-716128dc585e\") " pod="opendatahub/test-curl-7723-c2830e"
Sep 15 13:51:53.117356 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:53.117326    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkqn7\" (UniqueName: \"kubernetes.io/projected/eb9e7c90-5a79-406a-852c-716128dc585e-kube-api-access-mkqn7\") pod \"test-curl-7723-c2830e\" (UID: \"eb9e7c90-5a79-406a-852c-716128dc585e\") " pod="opendatahub/test-curl-7723-c2830e"
Sep 15 13:51:53.125873 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:53.125842    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkqn7\" (UniqueName: \"kubernetes.io/projected/eb9e7c90-5a79-406a-852c-716128dc585e-kube-api-access-mkqn7\") pod \"test-curl-7723-c2830e\" (UID: \"eb9e7c90-5a79-406a-852c-716128dc585e\") " pod="opendatahub/test-curl-7723-c2830e"
Sep 15 13:51:53.225943 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:53.225862    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7723-c2830e"
Sep 15 13:51:53.498700 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:53.498673    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7723-c2830e"]
Sep 15 13:51:53.500446 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:51:53.500417    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeb9e7c90_5a79_406a_852c_716128dc585e.slice/crio-928755e0323f7c0df69ecc3daae429e8f3a2b38fd729557143bf9d7c53e581ce WatchSource:0}: Error finding container 928755e0323f7c0df69ecc3daae429e8f3a2b38fd729557143bf9d7c53e581ce: Status 404 returned error can't find the container with id 928755e0323f7c0df69ecc3daae429e8f3a2b38fd729557143bf9d7c53e581ce
Sep 15 13:51:53.621689 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:53.621656    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7723-c2830e" event={"ID":"eb9e7c90-5a79-406a-852c-716128dc585e","Type":"ContainerStarted","Data":"928755e0323f7c0df69ecc3daae429e8f3a2b38fd729557143bf9d7c53e581ce"}
Sep 15 13:51:53.625920 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:53.625888    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-1293e7-openshift-default-567dbc6586-qk4jn"
Sep 15 13:51:53.700074 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:53.700049    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-66261e-openshift-default-86bd889684-6v7ph"
Sep 15 13:51:54.628570 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:54.628459    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7723-c2830e" event={"ID":"eb9e7c90-5a79-406a-852c-716128dc585e","Type":"ContainerStarted","Data":"2437053b72efacd76f09cbd012bb3c4d581d6506a1e8d9b0f288b9d53bf772f7"}
Sep 15 13:51:54.628982 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:54.628655    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-1293e7-openshift-default-567dbc6586-qk4jn"
Sep 15 13:51:54.628982 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:54.628873    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-66261e-openshift-default-86bd889684-6v7ph"
Sep 15 13:51:54.629624 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:54.629602    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-1293e7-openshift-default-567dbc6586-qk4jn"
Sep 15 13:51:54.629740 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:54.629655    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-66261e-openshift-default-86bd889684-6v7ph"
Sep 15 13:51:54.654953 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:54.654901    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7723-c2830e" podStartSLOduration=1.8180186630000001 podStartE2EDuration="2.654885032s" totalImagesPullingTime="836.866369ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:51:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:51:54.653386112 +0000 UTC m=+801.412512402" watchObservedRunningTime="2026-09-15 13:51:54.654885032 +0000 UTC m=+801.414011317"
Sep 15 13:51:55.253824 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:55.253785    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7723-c2830e"]
Sep 15 13:51:55.261248 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:55.261218    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7723-c2830e"]
Sep 15 13:51:55.380704 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:55.380627    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7723-80d8fd"]
Sep 15 13:51:55.380995 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:55.380982    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb9e7c90-5a79-406a-852c-716128dc585e" containerName="test-curl-7723-c2830e"
Sep 15 13:51:55.381043 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:55.380997    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb9e7c90-5a79-406a-852c-716128dc585e" containerName="test-curl-7723-c2830e"
Sep 15 13:51:55.381075 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:55.381059    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb9e7c90-5a79-406a-852c-716128dc585e" containerName="test-curl-7723-c2830e"
Sep 15 13:51:55.384168 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:55.384154    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7723-80d8fd"
Sep 15 13:51:55.389234 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:55.389202    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7723-80d8fd"]
Sep 15 13:51:55.537447 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:55.537410    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6cct\" (UniqueName: \"kubernetes.io/projected/84cdec8a-5f9f-4341-81f7-68047088b964-kube-api-access-g6cct\") pod \"test-curl-7723-80d8fd\" (UID: \"84cdec8a-5f9f-4341-81f7-68047088b964\") " pod="opendatahub/test-curl-7723-80d8fd"
Sep 15 13:51:55.634029 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:51:55.633947    2578 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7723-c2830e" container="test-curl-7723-c2830e"
Sep 15 13:51:55.637950 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:55.637930    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6cct\" (UniqueName: \"kubernetes.io/projected/84cdec8a-5f9f-4341-81f7-68047088b964-kube-api-access-g6cct\") pod \"test-curl-7723-80d8fd\" (UID: \"84cdec8a-5f9f-4341-81f7-68047088b964\") " pod="opendatahub/test-curl-7723-80d8fd"
Sep 15 13:51:55.647741 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:55.647716    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6cct\" (UniqueName: \"kubernetes.io/projected/84cdec8a-5f9f-4341-81f7-68047088b964-kube-api-access-g6cct\") pod \"test-curl-7723-80d8fd\" (UID: \"84cdec8a-5f9f-4341-81f7-68047088b964\") " pod="opendatahub/test-curl-7723-80d8fd"
Sep 15 13:51:55.695222 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:55.695196    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7723-80d8fd"
Sep 15 13:51:55.968428 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:55.968406    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7723-80d8fd"]
Sep 15 13:51:55.970115 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:51:55.970085    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod84cdec8a_5f9f_4341_81f7_68047088b964.slice/crio-89df874bf6299f97a2a628c8dce6c1a7866fca90c9b5d1162e573f305318bbda WatchSource:0}: Error finding container 89df874bf6299f97a2a628c8dce6c1a7866fca90c9b5d1162e573f305318bbda: Status 404 returned error can't find the container with id 89df874bf6299f97a2a628c8dce6c1a7866fca90c9b5d1162e573f305318bbda
Sep 15 13:51:56.640505 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:56.640464    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7723-80d8fd" event={"ID":"84cdec8a-5f9f-4341-81f7-68047088b964","Type":"ContainerStarted","Data":"cef2617a3bc493cc2bbda08e2c494bca96796f98bd4543c5763f0efd44e53820"}
Sep 15 13:51:56.640957 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:56.640515    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7723-80d8fd" event={"ID":"84cdec8a-5f9f-4341-81f7-68047088b964","Type":"ContainerStarted","Data":"89df874bf6299f97a2a628c8dce6c1a7866fca90c9b5d1162e573f305318bbda"}
Sep 15 13:51:56.640957 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:56.640806    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7723-c2830e" podUID="eb9e7c90-5a79-406a-852c-716128dc585e" containerName="test-curl-7723-c2830e" containerID="cri-o://2437053b72efacd76f09cbd012bb3c4d581d6506a1e8d9b0f288b9d53bf772f7" gracePeriod=2
Sep 15 13:51:56.656411 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:56.656351    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7723-80d8fd" podStartSLOduration=1.656335592 podStartE2EDuration="1.656335592s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:51:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:51:56.654152754 +0000 UTC m=+803.413279032" watchObservedRunningTime="2026-09-15 13:51:56.656335592 +0000 UTC m=+803.415461896"
Sep 15 13:51:57.230591 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:57.230558    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7723-80d8fd"]
Sep 15 13:51:57.235441 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:57.235418    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7723-80d8fd"]
Sep 15 13:51:57.645863 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:51:57.645823    2578 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7723-80d8fd" container="test-curl-7723-80d8fd"
Sep 15 13:51:58.043961 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:58.043933    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-autores-80a7cc-openshift-default-5f789585f4-bpw9x"]
Sep 15 13:51:58.044380 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:58.044363    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84cdec8a-5f9f-4341-81f7-68047088b964" containerName="test-curl-7723-80d8fd"
Sep 15 13:51:58.044475 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:58.044383    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="84cdec8a-5f9f-4341-81f7-68047088b964" containerName="test-curl-7723-80d8fd"
Sep 15 13:51:58.044536 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:58.044484    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="84cdec8a-5f9f-4341-81f7-68047088b964" containerName="test-curl-7723-80d8fd"
Sep 15 13:51:58.047458 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:58.047440    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-80a7cc-openshift-default-5f789585f4-bpw9x"
Sep 15 13:51:58.049776 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:58.049761    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-autores-80a7cc-openshift-default-dockercfg-6g9vt\""
Sep 15 13:51:58.061970 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:58.061949    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-80a7cc-openshift-default-5f789585f4-bpw9x"]
Sep 15 13:51:58.162427 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:58.162394    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/300413ac-ddff-4342-a863-82e20c29deeb-istio-token\") pod \"e2e-autores-80a7cc-openshift-default-5f789585f4-bpw9x\" (UID: \"300413ac-ddff-4342-a863-82e20c29deeb\") " pod="openshift-ingress/e2e-autores-80a7cc-openshift-default-5f789585f4-bpw9x"
Sep 15 13:51:58.162598 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:58.162439    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/300413ac-ddff-4342-a863-82e20c29deeb-credential-socket\") pod \"e2e-autores-80a7cc-openshift-default-5f789585f4-bpw9x\" (UID: \"300413ac-ddff-4342-a863-82e20c29deeb\") " pod="openshift-ingress/e2e-autores-80a7cc-openshift-default-5f789585f4-bpw9x"
Sep 15 13:51:58.162598 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:58.162467    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/300413ac-ddff-4342-a863-82e20c29deeb-istio-data\") pod \"e2e-autores-80a7cc-openshift-default-5f789585f4-bpw9x\" (UID: \"300413ac-ddff-4342-a863-82e20c29deeb\") " pod="openshift-ingress/e2e-autores-80a7cc-openshift-default-5f789585f4-bpw9x"
Sep 15 13:51:58.162598 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:58.162535    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8bll\" (UniqueName: \"kubernetes.io/projected/300413ac-ddff-4342-a863-82e20c29deeb-kube-api-access-k8bll\") pod \"e2e-autores-80a7cc-openshift-default-5f789585f4-bpw9x\" (UID: \"300413ac-ddff-4342-a863-82e20c29deeb\") " pod="openshift-ingress/e2e-autores-80a7cc-openshift-default-5f789585f4-bpw9x"
Sep 15 13:51:58.162598 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:58.162572    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/300413ac-ddff-4342-a863-82e20c29deeb-istio-envoy\") pod \"e2e-autores-80a7cc-openshift-default-5f789585f4-bpw9x\" (UID: \"300413ac-ddff-4342-a863-82e20c29deeb\") " pod="openshift-ingress/e2e-autores-80a7cc-openshift-default-5f789585f4-bpw9x"
Sep 15 13:51:58.162598 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:58.162590    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/300413ac-ddff-4342-a863-82e20c29deeb-istio-podinfo\") pod \"e2e-autores-80a7cc-openshift-default-5f789585f4-bpw9x\" (UID: \"300413ac-ddff-4342-a863-82e20c29deeb\") " pod="openshift-ingress/e2e-autores-80a7cc-openshift-default-5f789585f4-bpw9x"
Sep 15 13:51:58.162811 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:58.162667    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/300413ac-ddff-4342-a863-82e20c29deeb-istiod-ca-cert\") pod \"e2e-autores-80a7cc-openshift-default-5f789585f4-bpw9x\" (UID: \"300413ac-ddff-4342-a863-82e20c29deeb\") " pod="openshift-ingress/e2e-autores-80a7cc-openshift-default-5f789585f4-bpw9x"
Sep 15 13:51:58.162811 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:58.162697    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/300413ac-ddff-4342-a863-82e20c29deeb-workload-socket\") pod \"e2e-autores-80a7cc-openshift-default-5f789585f4-bpw9x\" (UID: \"300413ac-ddff-4342-a863-82e20c29deeb\") " pod="openshift-ingress/e2e-autores-80a7cc-openshift-default-5f789585f4-bpw9x"
Sep 15 13:51:58.162811 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:58.162739    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/300413ac-ddff-4342-a863-82e20c29deeb-workload-certs\") pod \"e2e-autores-80a7cc-openshift-default-5f789585f4-bpw9x\" (UID: \"300413ac-ddff-4342-a863-82e20c29deeb\") " pod="openshift-ingress/e2e-autores-80a7cc-openshift-default-5f789585f4-bpw9x"
Sep 15 13:51:58.263526 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:58.263492    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/300413ac-ddff-4342-a863-82e20c29deeb-istio-token\") pod \"e2e-autores-80a7cc-openshift-default-5f789585f4-bpw9x\" (UID: \"300413ac-ddff-4342-a863-82e20c29deeb\") " pod="openshift-ingress/e2e-autores-80a7cc-openshift-default-5f789585f4-bpw9x"
Sep 15 13:51:58.263526 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:58.263534    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/300413ac-ddff-4342-a863-82e20c29deeb-credential-socket\") pod \"e2e-autores-80a7cc-openshift-default-5f789585f4-bpw9x\" (UID: \"300413ac-ddff-4342-a863-82e20c29deeb\") " pod="openshift-ingress/e2e-autores-80a7cc-openshift-default-5f789585f4-bpw9x"
Sep 15 13:51:58.263798 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:58.263550    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/300413ac-ddff-4342-a863-82e20c29deeb-istio-data\") pod \"e2e-autores-80a7cc-openshift-default-5f789585f4-bpw9x\" (UID: \"300413ac-ddff-4342-a863-82e20c29deeb\") " pod="openshift-ingress/e2e-autores-80a7cc-openshift-default-5f789585f4-bpw9x"
Sep 15 13:51:58.263957 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:58.263929    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/300413ac-ddff-4342-a863-82e20c29deeb-credential-socket\") pod \"e2e-autores-80a7cc-openshift-default-5f789585f4-bpw9x\" (UID: \"300413ac-ddff-4342-a863-82e20c29deeb\") " pod="openshift-ingress/e2e-autores-80a7cc-openshift-default-5f789585f4-bpw9x"
Sep 15 13:51:58.264107 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:58.263960    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/300413ac-ddff-4342-a863-82e20c29deeb-istio-data\") pod \"e2e-autores-80a7cc-openshift-default-5f789585f4-bpw9x\" (UID: \"300413ac-ddff-4342-a863-82e20c29deeb\") " pod="openshift-ingress/e2e-autores-80a7cc-openshift-default-5f789585f4-bpw9x"
Sep 15 13:51:58.264107 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:58.263932    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8bll\" (UniqueName: \"kubernetes.io/projected/300413ac-ddff-4342-a863-82e20c29deeb-kube-api-access-k8bll\") pod \"e2e-autores-80a7cc-openshift-default-5f789585f4-bpw9x\" (UID: \"300413ac-ddff-4342-a863-82e20c29deeb\") " pod="openshift-ingress/e2e-autores-80a7cc-openshift-default-5f789585f4-bpw9x"
Sep 15 13:51:58.264107 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:58.264013    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/300413ac-ddff-4342-a863-82e20c29deeb-istio-envoy\") pod \"e2e-autores-80a7cc-openshift-default-5f789585f4-bpw9x\" (UID: \"300413ac-ddff-4342-a863-82e20c29deeb\") " pod="openshift-ingress/e2e-autores-80a7cc-openshift-default-5f789585f4-bpw9x"
Sep 15 13:51:58.264107 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:58.264041    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/300413ac-ddff-4342-a863-82e20c29deeb-istio-podinfo\") pod \"e2e-autores-80a7cc-openshift-default-5f789585f4-bpw9x\" (UID: \"300413ac-ddff-4342-a863-82e20c29deeb\") " pod="openshift-ingress/e2e-autores-80a7cc-openshift-default-5f789585f4-bpw9x"
Sep 15 13:51:58.264107 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:58.264097    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/300413ac-ddff-4342-a863-82e20c29deeb-istiod-ca-cert\") pod \"e2e-autores-80a7cc-openshift-default-5f789585f4-bpw9x\" (UID: \"300413ac-ddff-4342-a863-82e20c29deeb\") " pod="openshift-ingress/e2e-autores-80a7cc-openshift-default-5f789585f4-bpw9x"
Sep 15 13:51:58.264435 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:58.264170    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/300413ac-ddff-4342-a863-82e20c29deeb-workload-socket\") pod \"e2e-autores-80a7cc-openshift-default-5f789585f4-bpw9x\" (UID: \"300413ac-ddff-4342-a863-82e20c29deeb\") " pod="openshift-ingress/e2e-autores-80a7cc-openshift-default-5f789585f4-bpw9x"
Sep 15 13:51:58.264435 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:58.264214    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/300413ac-ddff-4342-a863-82e20c29deeb-workload-certs\") pod \"e2e-autores-80a7cc-openshift-default-5f789585f4-bpw9x\" (UID: \"300413ac-ddff-4342-a863-82e20c29deeb\") " pod="openshift-ingress/e2e-autores-80a7cc-openshift-default-5f789585f4-bpw9x"
Sep 15 13:51:58.264567 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:58.264541    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/300413ac-ddff-4342-a863-82e20c29deeb-workload-certs\") pod \"e2e-autores-80a7cc-openshift-default-5f789585f4-bpw9x\" (UID: \"300413ac-ddff-4342-a863-82e20c29deeb\") " pod="openshift-ingress/e2e-autores-80a7cc-openshift-default-5f789585f4-bpw9x"
Sep 15 13:51:58.264808 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:58.264781    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/300413ac-ddff-4342-a863-82e20c29deeb-workload-socket\") pod \"e2e-autores-80a7cc-openshift-default-5f789585f4-bpw9x\" (UID: \"300413ac-ddff-4342-a863-82e20c29deeb\") " pod="openshift-ingress/e2e-autores-80a7cc-openshift-default-5f789585f4-bpw9x"
Sep 15 13:51:58.265244 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:58.265201    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/300413ac-ddff-4342-a863-82e20c29deeb-istiod-ca-cert\") pod \"e2e-autores-80a7cc-openshift-default-5f789585f4-bpw9x\" (UID: \"300413ac-ddff-4342-a863-82e20c29deeb\") " pod="openshift-ingress/e2e-autores-80a7cc-openshift-default-5f789585f4-bpw9x"
Sep 15 13:51:58.267308 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:58.267263    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/300413ac-ddff-4342-a863-82e20c29deeb-istio-envoy\") pod \"e2e-autores-80a7cc-openshift-default-5f789585f4-bpw9x\" (UID: \"300413ac-ddff-4342-a863-82e20c29deeb\") " pod="openshift-ingress/e2e-autores-80a7cc-openshift-default-5f789585f4-bpw9x"
Sep 15 13:51:58.267765 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:58.267743    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/300413ac-ddff-4342-a863-82e20c29deeb-istio-podinfo\") pod \"e2e-autores-80a7cc-openshift-default-5f789585f4-bpw9x\" (UID: \"300413ac-ddff-4342-a863-82e20c29deeb\") " pod="openshift-ingress/e2e-autores-80a7cc-openshift-default-5f789585f4-bpw9x"
Sep 15 13:51:58.276649 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:58.276621    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8bll\" (UniqueName: \"kubernetes.io/projected/300413ac-ddff-4342-a863-82e20c29deeb-kube-api-access-k8bll\") pod \"e2e-autores-80a7cc-openshift-default-5f789585f4-bpw9x\" (UID: \"300413ac-ddff-4342-a863-82e20c29deeb\") " pod="openshift-ingress/e2e-autores-80a7cc-openshift-default-5f789585f4-bpw9x"
Sep 15 13:51:58.276878 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:58.276843    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/300413ac-ddff-4342-a863-82e20c29deeb-istio-token\") pod \"e2e-autores-80a7cc-openshift-default-5f789585f4-bpw9x\" (UID: \"300413ac-ddff-4342-a863-82e20c29deeb\") " pod="openshift-ingress/e2e-autores-80a7cc-openshift-default-5f789585f4-bpw9x"
Sep 15 13:51:58.359016 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:58.358934    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-80a7cc-openshift-default-5f789585f4-bpw9x"
Sep 15 13:51:58.646494 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:58.646466    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-80a7cc-openshift-default-5f789585f4-bpw9x"]
Sep 15 13:51:58.657063 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:51:58.650066    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod300413ac_ddff_4342_a863_82e20c29deeb.slice/crio-0f1879e30500bb2c1d20275b35e150c72f075c989c55ca015f84de16adb980a5 WatchSource:0}: Error finding container 0f1879e30500bb2c1d20275b35e150c72f075c989c55ca015f84de16adb980a5: Status 404 returned error can't find the container with id 0f1879e30500bb2c1d20275b35e150c72f075c989c55ca015f84de16adb980a5
Sep 15 13:51:58.663561 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:58.663471    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 15 13:51:58.663717 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:58.663643    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 15 13:51:58.663782 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:58.663738    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 15 13:51:58.665197 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:58.665114    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7723-80d8fd" podUID="84cdec8a-5f9f-4341-81f7-68047088b964" containerName="test-curl-7723-80d8fd" containerID="cri-o://cef2617a3bc493cc2bbda08e2c494bca96796f98bd4543c5763f0efd44e53820" gracePeriod=2
Sep 15 13:51:58.786215 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:58.786075    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7723-c2830e"
Sep 15 13:51:58.871014 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:58.870982    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mkqn7\" (UniqueName: \"kubernetes.io/projected/eb9e7c90-5a79-406a-852c-716128dc585e-kube-api-access-mkqn7\") pod \"eb9e7c90-5a79-406a-852c-716128dc585e\" (UID: \"eb9e7c90-5a79-406a-852c-716128dc585e\") "
Sep 15 13:51:58.873369 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:58.873338    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb9e7c90-5a79-406a-852c-716128dc585e-kube-api-access-mkqn7" (OuterVolumeSpecName: "kube-api-access-mkqn7") pod "eb9e7c90-5a79-406a-852c-716128dc585e" (UID: "eb9e7c90-5a79-406a-852c-716128dc585e"). InnerVolumeSpecName "kube-api-access-mkqn7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:51:58.972246 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:58.972172    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mkqn7\" (UniqueName: \"kubernetes.io/projected/eb9e7c90-5a79-406a-852c-716128dc585e-kube-api-access-mkqn7\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:51:59.672302 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:59.672268    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-80a7cc-openshift-default-5f789585f4-bpw9x" event={"ID":"300413ac-ddff-4342-a863-82e20c29deeb","Type":"ContainerStarted","Data":"596cc9674199435774c79ab0bafd76077bc0cdc3b94a93c94c5ea57116c478b1"}
Sep 15 13:51:59.672737 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:59.672328    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-80a7cc-openshift-default-5f789585f4-bpw9x" event={"ID":"300413ac-ddff-4342-a863-82e20c29deeb","Type":"ContainerStarted","Data":"0f1879e30500bb2c1d20275b35e150c72f075c989c55ca015f84de16adb980a5"}
Sep 15 13:51:59.673535 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:59.673508    2578 generic.go:356] "Generic (PLEG): container finished" podID="eb9e7c90-5a79-406a-852c-716128dc585e" containerID="2437053b72efacd76f09cbd012bb3c4d581d6506a1e8d9b0f288b9d53bf772f7" exitCode=137
Sep 15 13:51:59.673649 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:59.673535    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7723-c2830e"
Sep 15 13:51:59.673649 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:59.673605    2578 scope.go:117] "RemoveContainer" containerID="2437053b72efacd76f09cbd012bb3c4d581d6506a1e8d9b0f288b9d53bf772f7"
Sep 15 13:51:59.683184 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:59.683169    2578 scope.go:117] "RemoveContainer" containerID="2437053b72efacd76f09cbd012bb3c4d581d6506a1e8d9b0f288b9d53bf772f7"
Sep 15 13:51:59.683457 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:51:59.683440    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2437053b72efacd76f09cbd012bb3c4d581d6506a1e8d9b0f288b9d53bf772f7\": container with ID starting with 2437053b72efacd76f09cbd012bb3c4d581d6506a1e8d9b0f288b9d53bf772f7 not found: ID does not exist" containerID="2437053b72efacd76f09cbd012bb3c4d581d6506a1e8d9b0f288b9d53bf772f7"
Sep 15 13:51:59.683497 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:59.683466    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2437053b72efacd76f09cbd012bb3c4d581d6506a1e8d9b0f288b9d53bf772f7"} err="failed to get container status \"2437053b72efacd76f09cbd012bb3c4d581d6506a1e8d9b0f288b9d53bf772f7\": rpc error: code = NotFound desc = could not find container \"2437053b72efacd76f09cbd012bb3c4d581d6506a1e8d9b0f288b9d53bf772f7\": container with ID starting with 2437053b72efacd76f09cbd012bb3c4d581d6506a1e8d9b0f288b9d53bf772f7 not found: ID does not exist"
Sep 15 13:51:59.696345 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:59.696298    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-autores-80a7cc-openshift-default-5f789585f4-bpw9x" podStartSLOduration=1.696286605 podStartE2EDuration="1.696286605s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:51:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:51:59.694983616 +0000 UTC m=+806.454109904" watchObservedRunningTime="2026-09-15 13:51:59.696286605 +0000 UTC m=+806.455412891"
Sep 15 13:51:59.696838 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:51:59.696817    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7723-c2830e\" is forbidden: User \"system:node:ip-10-0-128-41.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-128-41.ec2.internal' and this object" podUID="eb9e7c90-5a79-406a-852c-716128dc585e" pod="opendatahub/test-curl-7723-c2830e"
Sep 15 13:51:59.758427 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:51:59.758388    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb9e7c90-5a79-406a-852c-716128dc585e" path="/var/lib/kubelet/pods/eb9e7c90-5a79-406a-852c-716128dc585e/volumes"
Sep 15 13:52:00.359509 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:00.359477    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-80a7cc-openshift-default-5f789585f4-bpw9x"
Sep 15 13:52:00.364194 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:00.364169    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-80a7cc-openshift-default-5f789585f4-bpw9x"
Sep 15 13:52:00.386704 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:00.386673    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-8e248304-openshift-default-84c6c598b4-gd56x"]
Sep 15 13:52:00.391375 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:00.391353    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8e248304-openshift-default-84c6c598b4-gd56x"
Sep 15 13:52:00.393603 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:00.393582    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-8e248304-openshift-default-dockercfg-r2hxv\""
Sep 15 13:52:00.406825 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:00.406802    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-8e248304-openshift-default-84c6c598b4-gd56x"]
Sep 15 13:52:00.487343 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:00.487304    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/919cf8d9-0892-49a5-a5c4-7463192b1540-istio-podinfo\") pod \"e2e-ait-8e248304-openshift-default-84c6c598b4-gd56x\" (UID: \"919cf8d9-0892-49a5-a5c4-7463192b1540\") " pod="openshift-ingress/e2e-ait-8e248304-openshift-default-84c6c598b4-gd56x"
Sep 15 13:52:00.487558 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:00.487448    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/919cf8d9-0892-49a5-a5c4-7463192b1540-workload-socket\") pod \"e2e-ait-8e248304-openshift-default-84c6c598b4-gd56x\" (UID: \"919cf8d9-0892-49a5-a5c4-7463192b1540\") " pod="openshift-ingress/e2e-ait-8e248304-openshift-default-84c6c598b4-gd56x"
Sep 15 13:52:00.487558 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:00.487479    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/919cf8d9-0892-49a5-a5c4-7463192b1540-credential-socket\") pod \"e2e-ait-8e248304-openshift-default-84c6c598b4-gd56x\" (UID: \"919cf8d9-0892-49a5-a5c4-7463192b1540\") " pod="openshift-ingress/e2e-ait-8e248304-openshift-default-84c6c598b4-gd56x"
Sep 15 13:52:00.487558 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:00.487551    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/919cf8d9-0892-49a5-a5c4-7463192b1540-workload-certs\") pod \"e2e-ait-8e248304-openshift-default-84c6c598b4-gd56x\" (UID: \"919cf8d9-0892-49a5-a5c4-7463192b1540\") " pod="openshift-ingress/e2e-ait-8e248304-openshift-default-84c6c598b4-gd56x"
Sep 15 13:52:00.487729 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:00.487679    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/919cf8d9-0892-49a5-a5c4-7463192b1540-istiod-ca-cert\") pod \"e2e-ait-8e248304-openshift-default-84c6c598b4-gd56x\" (UID: \"919cf8d9-0892-49a5-a5c4-7463192b1540\") " pod="openshift-ingress/e2e-ait-8e248304-openshift-default-84c6c598b4-gd56x"
Sep 15 13:52:00.487781 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:00.487767    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/919cf8d9-0892-49a5-a5c4-7463192b1540-istio-token\") pod \"e2e-ait-8e248304-openshift-default-84c6c598b4-gd56x\" (UID: \"919cf8d9-0892-49a5-a5c4-7463192b1540\") " pod="openshift-ingress/e2e-ait-8e248304-openshift-default-84c6c598b4-gd56x"
Sep 15 13:52:00.487849 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:00.487831    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/919cf8d9-0892-49a5-a5c4-7463192b1540-istio-data\") pod \"e2e-ait-8e248304-openshift-default-84c6c598b4-gd56x\" (UID: \"919cf8d9-0892-49a5-a5c4-7463192b1540\") " pod="openshift-ingress/e2e-ait-8e248304-openshift-default-84c6c598b4-gd56x"
Sep 15 13:52:00.488108 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:00.488086    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d959c\" (UniqueName: \"kubernetes.io/projected/919cf8d9-0892-49a5-a5c4-7463192b1540-kube-api-access-d959c\") pod \"e2e-ait-8e248304-openshift-default-84c6c598b4-gd56x\" (UID: \"919cf8d9-0892-49a5-a5c4-7463192b1540\") " pod="openshift-ingress/e2e-ait-8e248304-openshift-default-84c6c598b4-gd56x"
Sep 15 13:52:00.488227 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:00.488173    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/919cf8d9-0892-49a5-a5c4-7463192b1540-istio-envoy\") pod \"e2e-ait-8e248304-openshift-default-84c6c598b4-gd56x\" (UID: \"919cf8d9-0892-49a5-a5c4-7463192b1540\") " pod="openshift-ingress/e2e-ait-8e248304-openshift-default-84c6c598b4-gd56x"
Sep 15 13:52:00.589349 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:00.589317    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/919cf8d9-0892-49a5-a5c4-7463192b1540-istio-podinfo\") pod \"e2e-ait-8e248304-openshift-default-84c6c598b4-gd56x\" (UID: \"919cf8d9-0892-49a5-a5c4-7463192b1540\") " pod="openshift-ingress/e2e-ait-8e248304-openshift-default-84c6c598b4-gd56x"
Sep 15 13:52:00.589537 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:00.589366    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/919cf8d9-0892-49a5-a5c4-7463192b1540-workload-socket\") pod \"e2e-ait-8e248304-openshift-default-84c6c598b4-gd56x\" (UID: \"919cf8d9-0892-49a5-a5c4-7463192b1540\") " pod="openshift-ingress/e2e-ait-8e248304-openshift-default-84c6c598b4-gd56x"
Sep 15 13:52:00.589537 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:00.589384    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/919cf8d9-0892-49a5-a5c4-7463192b1540-credential-socket\") pod \"e2e-ait-8e248304-openshift-default-84c6c598b4-gd56x\" (UID: \"919cf8d9-0892-49a5-a5c4-7463192b1540\") " pod="openshift-ingress/e2e-ait-8e248304-openshift-default-84c6c598b4-gd56x"
Sep 15 13:52:00.589537 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:00.589494    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/919cf8d9-0892-49a5-a5c4-7463192b1540-workload-certs\") pod \"e2e-ait-8e248304-openshift-default-84c6c598b4-gd56x\" (UID: \"919cf8d9-0892-49a5-a5c4-7463192b1540\") " pod="openshift-ingress/e2e-ait-8e248304-openshift-default-84c6c598b4-gd56x"
Sep 15 13:52:00.589713 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:00.589559    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/919cf8d9-0892-49a5-a5c4-7463192b1540-istiod-ca-cert\") pod \"e2e-ait-8e248304-openshift-default-84c6c598b4-gd56x\" (UID: \"919cf8d9-0892-49a5-a5c4-7463192b1540\") " pod="openshift-ingress/e2e-ait-8e248304-openshift-default-84c6c598b4-gd56x"
Sep 15 13:52:00.589713 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:00.589588    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/919cf8d9-0892-49a5-a5c4-7463192b1540-istio-token\") pod \"e2e-ait-8e248304-openshift-default-84c6c598b4-gd56x\" (UID: \"919cf8d9-0892-49a5-a5c4-7463192b1540\") " pod="openshift-ingress/e2e-ait-8e248304-openshift-default-84c6c598b4-gd56x"
Sep 15 13:52:00.589713 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:00.589613    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/919cf8d9-0892-49a5-a5c4-7463192b1540-istio-data\") pod \"e2e-ait-8e248304-openshift-default-84c6c598b4-gd56x\" (UID: \"919cf8d9-0892-49a5-a5c4-7463192b1540\") " pod="openshift-ingress/e2e-ait-8e248304-openshift-default-84c6c598b4-gd56x"
Sep 15 13:52:00.589713 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:00.589646    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d959c\" (UniqueName: \"kubernetes.io/projected/919cf8d9-0892-49a5-a5c4-7463192b1540-kube-api-access-d959c\") pod \"e2e-ait-8e248304-openshift-default-84c6c598b4-gd56x\" (UID: \"919cf8d9-0892-49a5-a5c4-7463192b1540\") " pod="openshift-ingress/e2e-ait-8e248304-openshift-default-84c6c598b4-gd56x"
Sep 15 13:52:00.589713 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:00.589701    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/919cf8d9-0892-49a5-a5c4-7463192b1540-istio-envoy\") pod \"e2e-ait-8e248304-openshift-default-84c6c598b4-gd56x\" (UID: \"919cf8d9-0892-49a5-a5c4-7463192b1540\") " pod="openshift-ingress/e2e-ait-8e248304-openshift-default-84c6c598b4-gd56x"
Sep 15 13:52:00.589992 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:00.589729    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/919cf8d9-0892-49a5-a5c4-7463192b1540-workload-socket\") pod \"e2e-ait-8e248304-openshift-default-84c6c598b4-gd56x\" (UID: \"919cf8d9-0892-49a5-a5c4-7463192b1540\") " pod="openshift-ingress/e2e-ait-8e248304-openshift-default-84c6c598b4-gd56x"
Sep 15 13:52:00.589992 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:00.589770    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/919cf8d9-0892-49a5-a5c4-7463192b1540-credential-socket\") pod \"e2e-ait-8e248304-openshift-default-84c6c598b4-gd56x\" (UID: \"919cf8d9-0892-49a5-a5c4-7463192b1540\") " pod="openshift-ingress/e2e-ait-8e248304-openshift-default-84c6c598b4-gd56x"
Sep 15 13:52:00.589992 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:00.589867    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/919cf8d9-0892-49a5-a5c4-7463192b1540-workload-certs\") pod \"e2e-ait-8e248304-openshift-default-84c6c598b4-gd56x\" (UID: \"919cf8d9-0892-49a5-a5c4-7463192b1540\") " pod="openshift-ingress/e2e-ait-8e248304-openshift-default-84c6c598b4-gd56x"
Sep 15 13:52:00.589992 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:00.589972    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/919cf8d9-0892-49a5-a5c4-7463192b1540-istio-data\") pod \"e2e-ait-8e248304-openshift-default-84c6c598b4-gd56x\" (UID: \"919cf8d9-0892-49a5-a5c4-7463192b1540\") " pod="openshift-ingress/e2e-ait-8e248304-openshift-default-84c6c598b4-gd56x"
Sep 15 13:52:00.590618 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:00.590590    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/919cf8d9-0892-49a5-a5c4-7463192b1540-istiod-ca-cert\") pod \"e2e-ait-8e248304-openshift-default-84c6c598b4-gd56x\" (UID: \"919cf8d9-0892-49a5-a5c4-7463192b1540\") " pod="openshift-ingress/e2e-ait-8e248304-openshift-default-84c6c598b4-gd56x"
Sep 15 13:52:00.592070 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:00.592040    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/919cf8d9-0892-49a5-a5c4-7463192b1540-istio-envoy\") pod \"e2e-ait-8e248304-openshift-default-84c6c598b4-gd56x\" (UID: \"919cf8d9-0892-49a5-a5c4-7463192b1540\") " pod="openshift-ingress/e2e-ait-8e248304-openshift-default-84c6c598b4-gd56x"
Sep 15 13:52:00.592204 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:00.592149    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/919cf8d9-0892-49a5-a5c4-7463192b1540-istio-podinfo\") pod \"e2e-ait-8e248304-openshift-default-84c6c598b4-gd56x\" (UID: \"919cf8d9-0892-49a5-a5c4-7463192b1540\") " pod="openshift-ingress/e2e-ait-8e248304-openshift-default-84c6c598b4-gd56x"
Sep 15 13:52:00.597942 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:00.597922    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/919cf8d9-0892-49a5-a5c4-7463192b1540-istio-token\") pod \"e2e-ait-8e248304-openshift-default-84c6c598b4-gd56x\" (UID: \"919cf8d9-0892-49a5-a5c4-7463192b1540\") " pod="openshift-ingress/e2e-ait-8e248304-openshift-default-84c6c598b4-gd56x"
Sep 15 13:52:00.598105 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:00.598088    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d959c\" (UniqueName: \"kubernetes.io/projected/919cf8d9-0892-49a5-a5c4-7463192b1540-kube-api-access-d959c\") pod \"e2e-ait-8e248304-openshift-default-84c6c598b4-gd56x\" (UID: \"919cf8d9-0892-49a5-a5c4-7463192b1540\") " pod="openshift-ingress/e2e-ait-8e248304-openshift-default-84c6c598b4-gd56x"
Sep 15 13:52:00.680268 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:00.680247    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-80a7cc-openshift-default-5f789585f4-bpw9x"
Sep 15 13:52:00.681270 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:00.681113    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-80a7cc-openshift-default-5f789585f4-bpw9x"
Sep 15 13:52:00.703047 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:00.703024    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8e248304-openshift-default-84c6c598b4-gd56x"
Sep 15 13:52:00.863079 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:00.863059    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7723-80d8fd"
Sep 15 13:52:00.989088 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:00.989068    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-8e248304-openshift-default-84c6c598b4-gd56x"]
Sep 15 13:52:00.990717 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:52:00.990687    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod919cf8d9_0892_49a5_a5c4_7463192b1540.slice/crio-c6e8e02c1a09604826092d245de5c1935183a0092054142f08cc018e64b09326 WatchSource:0}: Error finding container c6e8e02c1a09604826092d245de5c1935183a0092054142f08cc018e64b09326: Status 404 returned error can't find the container with id c6e8e02c1a09604826092d245de5c1935183a0092054142f08cc018e64b09326
Sep 15 13:52:00.992873 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:00.992847    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 15 13:52:00.992930 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:00.992907    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 15 13:52:00.992967 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:00.992940    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 15 13:52:00.993933 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:00.993913    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g6cct\" (UniqueName: \"kubernetes.io/projected/84cdec8a-5f9f-4341-81f7-68047088b964-kube-api-access-g6cct\") pod \"84cdec8a-5f9f-4341-81f7-68047088b964\" (UID: \"84cdec8a-5f9f-4341-81f7-68047088b964\") "
Sep 15 13:52:00.996063 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:00.996042    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84cdec8a-5f9f-4341-81f7-68047088b964-kube-api-access-g6cct" (OuterVolumeSpecName: "kube-api-access-g6cct") pod "84cdec8a-5f9f-4341-81f7-68047088b964" (UID: "84cdec8a-5f9f-4341-81f7-68047088b964"). InnerVolumeSpecName "kube-api-access-g6cct". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:52:01.095368 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:01.095339    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g6cct\" (UniqueName: \"kubernetes.io/projected/84cdec8a-5f9f-4341-81f7-68047088b964-kube-api-access-g6cct\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:52:01.687450 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:01.687416    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8e248304-openshift-default-84c6c598b4-gd56x" event={"ID":"919cf8d9-0892-49a5-a5c4-7463192b1540","Type":"ContainerStarted","Data":"eccca466ec2af5e5b665bf503334dfd93705ec1299f421da79840ca033babb4e"}
Sep 15 13:52:01.687879 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:01.687477    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8e248304-openshift-default-84c6c598b4-gd56x" event={"ID":"919cf8d9-0892-49a5-a5c4-7463192b1540","Type":"ContainerStarted","Data":"c6e8e02c1a09604826092d245de5c1935183a0092054142f08cc018e64b09326"}
Sep 15 13:52:01.688751 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:01.688713    2578 generic.go:356] "Generic (PLEG): container finished" podID="84cdec8a-5f9f-4341-81f7-68047088b964" containerID="cef2617a3bc493cc2bbda08e2c494bca96796f98bd4543c5763f0efd44e53820" exitCode=137
Sep 15 13:52:01.688881 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:01.688749    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7723-80d8fd"
Sep 15 13:52:01.688881 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:01.688821    2578 scope.go:117] "RemoveContainer" containerID="cef2617a3bc493cc2bbda08e2c494bca96796f98bd4543c5763f0efd44e53820"
Sep 15 13:52:01.698634 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:01.698614    2578 scope.go:117] "RemoveContainer" containerID="cef2617a3bc493cc2bbda08e2c494bca96796f98bd4543c5763f0efd44e53820"
Sep 15 13:52:01.698882 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:52:01.698865    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cef2617a3bc493cc2bbda08e2c494bca96796f98bd4543c5763f0efd44e53820\": container with ID starting with cef2617a3bc493cc2bbda08e2c494bca96796f98bd4543c5763f0efd44e53820 not found: ID does not exist" containerID="cef2617a3bc493cc2bbda08e2c494bca96796f98bd4543c5763f0efd44e53820"
Sep 15 13:52:01.698932 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:01.698890    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cef2617a3bc493cc2bbda08e2c494bca96796f98bd4543c5763f0efd44e53820"} err="failed to get container status \"cef2617a3bc493cc2bbda08e2c494bca96796f98bd4543c5763f0efd44e53820\": rpc error: code = NotFound desc = could not find container \"cef2617a3bc493cc2bbda08e2c494bca96796f98bd4543c5763f0efd44e53820\": container with ID starting with cef2617a3bc493cc2bbda08e2c494bca96796f98bd4543c5763f0efd44e53820 not found: ID does not exist"
Sep 15 13:52:01.704106 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:01.704087    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-8e248304-openshift-default-84c6c598b4-gd56x"
Sep 15 13:52:01.714622 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:52:01.714590    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7723-80d8fd\" is forbidden: User \"system:node:ip-10-0-128-41.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-128-41.ec2.internal' and this object" podUID="84cdec8a-5f9f-4341-81f7-68047088b964" pod="opendatahub/test-curl-7723-80d8fd"
Sep 15 13:52:01.715396 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:01.715359    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-8e248304-openshift-default-84c6c598b4-gd56x" podStartSLOduration=1.715343965 podStartE2EDuration="1.715343965s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:52:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:52:01.712319084 +0000 UTC m=+808.471445371" watchObservedRunningTime="2026-09-15 13:52:01.715343965 +0000 UTC m=+808.474470252"
Sep 15 13:52:01.758179 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:01.758119    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="84cdec8a-5f9f-4341-81f7-68047088b964" path="/var/lib/kubelet/pods/84cdec8a-5f9f-4341-81f7-68047088b964/volumes"
Sep 15 13:52:02.709258 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:02.709228    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-8e248304-openshift-default-84c6c598b4-gd56x"
Sep 15 13:52:03.702583 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:03.702546    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-8e248304-openshift-default-84c6c598b4-gd56x"
Sep 15 13:52:03.703694 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:03.703674    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-8e248304-openshift-default-84c6c598b4-gd56x"
Sep 15 13:52:06.333411 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:06.333383    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-8e248304-565bbc66bc-sgmfn"]
Sep 15 13:52:06.338563 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:06.338544    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-8e248304-565bbc66bc-sgmfn"
Sep 15 13:52:06.340973 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:06.340949    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-8e248304-dockercfg-nrq5j\""
Sep 15 13:52:06.341272 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:06.341255    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-8e248304\""
Sep 15 13:52:06.346786 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:06.346766    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-8e248304-565bbc66bc-sgmfn"]
Sep 15 13:52:06.449763 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:06.449730    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c7bfb401-b4c1-4028-8ebc-86623b0b56cb-plugins-config-volume\") pod \"payload-processing-e2e-ait-8e248304-565bbc66bc-sgmfn\" (UID: \"c7bfb401-b4c1-4028-8ebc-86623b0b56cb\") " pod="openshift-ingress/payload-processing-e2e-ait-8e248304-565bbc66bc-sgmfn"
Sep 15 13:52:06.450095 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:06.450080    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xmx5\" (UniqueName: \"kubernetes.io/projected/c7bfb401-b4c1-4028-8ebc-86623b0b56cb-kube-api-access-8xmx5\") pod \"payload-processing-e2e-ait-8e248304-565bbc66bc-sgmfn\" (UID: \"c7bfb401-b4c1-4028-8ebc-86623b0b56cb\") " pod="openshift-ingress/payload-processing-e2e-ait-8e248304-565bbc66bc-sgmfn"
Sep 15 13:52:06.551300 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:06.551267    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xmx5\" (UniqueName: \"kubernetes.io/projected/c7bfb401-b4c1-4028-8ebc-86623b0b56cb-kube-api-access-8xmx5\") pod \"payload-processing-e2e-ait-8e248304-565bbc66bc-sgmfn\" (UID: \"c7bfb401-b4c1-4028-8ebc-86623b0b56cb\") " pod="openshift-ingress/payload-processing-e2e-ait-8e248304-565bbc66bc-sgmfn"
Sep 15 13:52:06.551503 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:06.551341    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c7bfb401-b4c1-4028-8ebc-86623b0b56cb-plugins-config-volume\") pod \"payload-processing-e2e-ait-8e248304-565bbc66bc-sgmfn\" (UID: \"c7bfb401-b4c1-4028-8ebc-86623b0b56cb\") " pod="openshift-ingress/payload-processing-e2e-ait-8e248304-565bbc66bc-sgmfn"
Sep 15 13:52:06.552235 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:06.552210    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c7bfb401-b4c1-4028-8ebc-86623b0b56cb-plugins-config-volume\") pod \"payload-processing-e2e-ait-8e248304-565bbc66bc-sgmfn\" (UID: \"c7bfb401-b4c1-4028-8ebc-86623b0b56cb\") " pod="openshift-ingress/payload-processing-e2e-ait-8e248304-565bbc66bc-sgmfn"
Sep 15 13:52:06.559710 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:06.559656    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xmx5\" (UniqueName: \"kubernetes.io/projected/c7bfb401-b4c1-4028-8ebc-86623b0b56cb-kube-api-access-8xmx5\") pod \"payload-processing-e2e-ait-8e248304-565bbc66bc-sgmfn\" (UID: \"c7bfb401-b4c1-4028-8ebc-86623b0b56cb\") " pod="openshift-ingress/payload-processing-e2e-ait-8e248304-565bbc66bc-sgmfn"
Sep 15 13:52:06.649794 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:06.649701    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-8e248304-565bbc66bc-sgmfn"
Sep 15 13:52:06.964504 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:06.964470    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-8e248304-565bbc66bc-sgmfn"]
Sep 15 13:52:06.966176 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:52:06.966107    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7bfb401_b4c1_4028_8ebc_86623b0b56cb.slice/crio-2b1de951707bb44cd540303c69cced2a7342486cc151bb3319bf5ffe9430bb81 WatchSource:0}: Error finding container 2b1de951707bb44cd540303c69cced2a7342486cc151bb3319bf5ffe9430bb81: Status 404 returned error can't find the container with id 2b1de951707bb44cd540303c69cced2a7342486cc151bb3319bf5ffe9430bb81
Sep 15 13:52:07.742406 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:07.742376    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-8e248304-565bbc66bc-sgmfn" event={"ID":"c7bfb401-b4c1-4028-8ebc-86623b0b56cb","Type":"ContainerStarted","Data":"2b1de951707bb44cd540303c69cced2a7342486cc151bb3319bf5ffe9430bb81"}
Sep 15 13:52:09.758154 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:09.758058    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-8e248304-565bbc66bc-sgmfn" event={"ID":"c7bfb401-b4c1-4028-8ebc-86623b0b56cb","Type":"ContainerStarted","Data":"b19ddb43646dc0358561e5a7c117d46296cc4a22d74400c0ca64527639a1e34e"}
Sep 15 13:52:09.758154 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:09.758114    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-8e248304-565bbc66bc-sgmfn"
Sep 15 13:52:09.791859 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:09.791799    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-8e248304-565bbc66bc-sgmfn" podStartSLOduration=1.953055039 podStartE2EDuration="3.791778781s" totalImagesPullingTime="1.838723742s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:52:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:52:09.789678465 +0000 UTC m=+816.548804752" watchObservedRunningTime="2026-09-15 13:52:09.791778781 +0000 UTC m=+816.550905068"
Sep 15 13:52:10.278880 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:10.278841    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-2aa332-openshift-default-b94f494dd-x48k9"]
Sep 15 13:52:10.283269 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:10.283243    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-2aa332-openshift-default-b94f494dd-x48k9"
Sep 15 13:52:10.290557 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:10.290527    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-2aa332-openshift-default-dockercfg-djjqn\""
Sep 15 13:52:10.302941 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:10.302912    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-2aa332-openshift-default-b94f494dd-x48k9"]
Sep 15 13:52:10.413828 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:10.413788    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d43fec5-9d61-43bf-a663-a1341b804332-istio-token\") pod \"e2e-inf-b-2aa332-openshift-default-b94f494dd-x48k9\" (UID: \"5d43fec5-9d61-43bf-a663-a1341b804332\") " pod="openshift-ingress/e2e-inf-b-2aa332-openshift-default-b94f494dd-x48k9"
Sep 15 13:52:10.413997 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:10.413836    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d43fec5-9d61-43bf-a663-a1341b804332-workload-socket\") pod \"e2e-inf-b-2aa332-openshift-default-b94f494dd-x48k9\" (UID: \"5d43fec5-9d61-43bf-a663-a1341b804332\") " pod="openshift-ingress/e2e-inf-b-2aa332-openshift-default-b94f494dd-x48k9"
Sep 15 13:52:10.413997 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:10.413957    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snsvj\" (UniqueName: \"kubernetes.io/projected/5d43fec5-9d61-43bf-a663-a1341b804332-kube-api-access-snsvj\") pod \"e2e-inf-b-2aa332-openshift-default-b94f494dd-x48k9\" (UID: \"5d43fec5-9d61-43bf-a663-a1341b804332\") " pod="openshift-ingress/e2e-inf-b-2aa332-openshift-default-b94f494dd-x48k9"
Sep 15 13:52:10.414097 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:10.414003    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5d43fec5-9d61-43bf-a663-a1341b804332-istiod-ca-cert\") pod \"e2e-inf-b-2aa332-openshift-default-b94f494dd-x48k9\" (UID: \"5d43fec5-9d61-43bf-a663-a1341b804332\") " pod="openshift-ingress/e2e-inf-b-2aa332-openshift-default-b94f494dd-x48k9"
Sep 15 13:52:10.414097 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:10.414037    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5d43fec5-9d61-43bf-a663-a1341b804332-istio-podinfo\") pod \"e2e-inf-b-2aa332-openshift-default-b94f494dd-x48k9\" (UID: \"5d43fec5-9d61-43bf-a663-a1341b804332\") " pod="openshift-ingress/e2e-inf-b-2aa332-openshift-default-b94f494dd-x48k9"
Sep 15 13:52:10.414097 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:10.414067    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d43fec5-9d61-43bf-a663-a1341b804332-workload-certs\") pod \"e2e-inf-b-2aa332-openshift-default-b94f494dd-x48k9\" (UID: \"5d43fec5-9d61-43bf-a663-a1341b804332\") " pod="openshift-ingress/e2e-inf-b-2aa332-openshift-default-b94f494dd-x48k9"
Sep 15 13:52:10.414262 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:10.414172    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5d43fec5-9d61-43bf-a663-a1341b804332-istio-envoy\") pod \"e2e-inf-b-2aa332-openshift-default-b94f494dd-x48k9\" (UID: \"5d43fec5-9d61-43bf-a663-a1341b804332\") " pod="openshift-ingress/e2e-inf-b-2aa332-openshift-default-b94f494dd-x48k9"
Sep 15 13:52:10.414262 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:10.414196    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5d43fec5-9d61-43bf-a663-a1341b804332-istio-data\") pod \"e2e-inf-b-2aa332-openshift-default-b94f494dd-x48k9\" (UID: \"5d43fec5-9d61-43bf-a663-a1341b804332\") " pod="openshift-ingress/e2e-inf-b-2aa332-openshift-default-b94f494dd-x48k9"
Sep 15 13:52:10.414262 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:10.414248    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d43fec5-9d61-43bf-a663-a1341b804332-credential-socket\") pod \"e2e-inf-b-2aa332-openshift-default-b94f494dd-x48k9\" (UID: \"5d43fec5-9d61-43bf-a663-a1341b804332\") " pod="openshift-ingress/e2e-inf-b-2aa332-openshift-default-b94f494dd-x48k9"
Sep 15 13:52:10.515816 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:10.515712    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d43fec5-9d61-43bf-a663-a1341b804332-workload-socket\") pod \"e2e-inf-b-2aa332-openshift-default-b94f494dd-x48k9\" (UID: \"5d43fec5-9d61-43bf-a663-a1341b804332\") " pod="openshift-ingress/e2e-inf-b-2aa332-openshift-default-b94f494dd-x48k9"
Sep 15 13:52:10.515816 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:10.515809    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-snsvj\" (UniqueName: \"kubernetes.io/projected/5d43fec5-9d61-43bf-a663-a1341b804332-kube-api-access-snsvj\") pod \"e2e-inf-b-2aa332-openshift-default-b94f494dd-x48k9\" (UID: \"5d43fec5-9d61-43bf-a663-a1341b804332\") " pod="openshift-ingress/e2e-inf-b-2aa332-openshift-default-b94f494dd-x48k9"
Sep 15 13:52:10.516045 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:10.515846    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5d43fec5-9d61-43bf-a663-a1341b804332-istiod-ca-cert\") pod \"e2e-inf-b-2aa332-openshift-default-b94f494dd-x48k9\" (UID: \"5d43fec5-9d61-43bf-a663-a1341b804332\") " pod="openshift-ingress/e2e-inf-b-2aa332-openshift-default-b94f494dd-x48k9"
Sep 15 13:52:10.516045 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:10.515874    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5d43fec5-9d61-43bf-a663-a1341b804332-istio-podinfo\") pod \"e2e-inf-b-2aa332-openshift-default-b94f494dd-x48k9\" (UID: \"5d43fec5-9d61-43bf-a663-a1341b804332\") " pod="openshift-ingress/e2e-inf-b-2aa332-openshift-default-b94f494dd-x48k9"
Sep 15 13:52:10.516045 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:10.515905    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d43fec5-9d61-43bf-a663-a1341b804332-workload-certs\") pod \"e2e-inf-b-2aa332-openshift-default-b94f494dd-x48k9\" (UID: \"5d43fec5-9d61-43bf-a663-a1341b804332\") " pod="openshift-ingress/e2e-inf-b-2aa332-openshift-default-b94f494dd-x48k9"
Sep 15 13:52:10.516045 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:10.515967    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5d43fec5-9d61-43bf-a663-a1341b804332-istio-envoy\") pod \"e2e-inf-b-2aa332-openshift-default-b94f494dd-x48k9\" (UID: \"5d43fec5-9d61-43bf-a663-a1341b804332\") " pod="openshift-ingress/e2e-inf-b-2aa332-openshift-default-b94f494dd-x48k9"
Sep 15 13:52:10.516045 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:10.515992    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5d43fec5-9d61-43bf-a663-a1341b804332-istio-data\") pod \"e2e-inf-b-2aa332-openshift-default-b94f494dd-x48k9\" (UID: \"5d43fec5-9d61-43bf-a663-a1341b804332\") " pod="openshift-ingress/e2e-inf-b-2aa332-openshift-default-b94f494dd-x48k9"
Sep 15 13:52:10.516348 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:10.516056    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d43fec5-9d61-43bf-a663-a1341b804332-credential-socket\") pod \"e2e-inf-b-2aa332-openshift-default-b94f494dd-x48k9\" (UID: \"5d43fec5-9d61-43bf-a663-a1341b804332\") " pod="openshift-ingress/e2e-inf-b-2aa332-openshift-default-b94f494dd-x48k9"
Sep 15 13:52:10.516348 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:10.516111    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d43fec5-9d61-43bf-a663-a1341b804332-istio-token\") pod \"e2e-inf-b-2aa332-openshift-default-b94f494dd-x48k9\" (UID: \"5d43fec5-9d61-43bf-a663-a1341b804332\") " pod="openshift-ingress/e2e-inf-b-2aa332-openshift-default-b94f494dd-x48k9"
Sep 15 13:52:10.517296 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:10.516873    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5d43fec5-9d61-43bf-a663-a1341b804332-istio-data\") pod \"e2e-inf-b-2aa332-openshift-default-b94f494dd-x48k9\" (UID: \"5d43fec5-9d61-43bf-a663-a1341b804332\") " pod="openshift-ingress/e2e-inf-b-2aa332-openshift-default-b94f494dd-x48k9"
Sep 15 13:52:10.517296 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:10.517247    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d43fec5-9d61-43bf-a663-a1341b804332-credential-socket\") pod \"e2e-inf-b-2aa332-openshift-default-b94f494dd-x48k9\" (UID: \"5d43fec5-9d61-43bf-a663-a1341b804332\") " pod="openshift-ingress/e2e-inf-b-2aa332-openshift-default-b94f494dd-x48k9"
Sep 15 13:52:10.517296 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:10.517278    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d43fec5-9d61-43bf-a663-a1341b804332-workload-certs\") pod \"e2e-inf-b-2aa332-openshift-default-b94f494dd-x48k9\" (UID: \"5d43fec5-9d61-43bf-a663-a1341b804332\") " pod="openshift-ingress/e2e-inf-b-2aa332-openshift-default-b94f494dd-x48k9"
Sep 15 13:52:10.517296 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:10.517295    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d43fec5-9d61-43bf-a663-a1341b804332-workload-socket\") pod \"e2e-inf-b-2aa332-openshift-default-b94f494dd-x48k9\" (UID: \"5d43fec5-9d61-43bf-a663-a1341b804332\") " pod="openshift-ingress/e2e-inf-b-2aa332-openshift-default-b94f494dd-x48k9"
Sep 15 13:52:10.518110 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:10.518068    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5d43fec5-9d61-43bf-a663-a1341b804332-istiod-ca-cert\") pod \"e2e-inf-b-2aa332-openshift-default-b94f494dd-x48k9\" (UID: \"5d43fec5-9d61-43bf-a663-a1341b804332\") " pod="openshift-ingress/e2e-inf-b-2aa332-openshift-default-b94f494dd-x48k9"
Sep 15 13:52:10.520396 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:10.520326    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5d43fec5-9d61-43bf-a663-a1341b804332-istio-podinfo\") pod \"e2e-inf-b-2aa332-openshift-default-b94f494dd-x48k9\" (UID: \"5d43fec5-9d61-43bf-a663-a1341b804332\") " pod="openshift-ingress/e2e-inf-b-2aa332-openshift-default-b94f494dd-x48k9"
Sep 15 13:52:10.526563 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:10.526535    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-snsvj\" (UniqueName: \"kubernetes.io/projected/5d43fec5-9d61-43bf-a663-a1341b804332-kube-api-access-snsvj\") pod \"e2e-inf-b-2aa332-openshift-default-b94f494dd-x48k9\" (UID: \"5d43fec5-9d61-43bf-a663-a1341b804332\") " pod="openshift-ingress/e2e-inf-b-2aa332-openshift-default-b94f494dd-x48k9"
Sep 15 13:52:10.527306 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:10.527281    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d43fec5-9d61-43bf-a663-a1341b804332-istio-token\") pod \"e2e-inf-b-2aa332-openshift-default-b94f494dd-x48k9\" (UID: \"5d43fec5-9d61-43bf-a663-a1341b804332\") " pod="openshift-ingress/e2e-inf-b-2aa332-openshift-default-b94f494dd-x48k9"
Sep 15 13:52:10.529311 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:10.529285    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5d43fec5-9d61-43bf-a663-a1341b804332-istio-envoy\") pod \"e2e-inf-b-2aa332-openshift-default-b94f494dd-x48k9\" (UID: \"5d43fec5-9d61-43bf-a663-a1341b804332\") " pod="openshift-ingress/e2e-inf-b-2aa332-openshift-default-b94f494dd-x48k9"
Sep 15 13:52:10.594616 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:10.594576    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-2aa332-openshift-default-b94f494dd-x48k9"
Sep 15 13:52:10.674797 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:10.672308    2578 patch_prober.go:28] interesting pod/e2e-worker-w4-66261e-openshift-default-86bd889684-6v7ph container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 15 13:52:10.674797 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:10.672375    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-66261e-openshift-default-86bd889684-6v7ph" podUID="a46634e7-1982-4116-a42e-2075f7d3cd72" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 15 13:52:10.882242 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:10.882212    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-2aa332-openshift-default-b94f494dd-x48k9"]
Sep 15 13:52:10.884396 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:52:10.884364    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d43fec5_9d61_43bf_a663_a1341b804332.slice/crio-33d081a592e119a3ea40d80020988f673166984f9a6a4d5fb428e66ed32638a2 WatchSource:0}: Error finding container 33d081a592e119a3ea40d80020988f673166984f9a6a4d5fb428e66ed32638a2: Status 404 returned error can't find the container with id 33d081a592e119a3ea40d80020988f673166984f9a6a4d5fb428e66ed32638a2
Sep 15 13:52:10.887201 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:10.887162    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 15 13:52:10.887281 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:10.887257    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 15 13:52:10.887334 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:10.887301    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 15 13:52:11.772833 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:11.772795    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-2aa332-openshift-default-b94f494dd-x48k9" event={"ID":"5d43fec5-9d61-43bf-a663-a1341b804332","Type":"ContainerStarted","Data":"aa4cab93d82837f55caaf08fe4dea6d1acc657fbc7512f26283009bdf78cf10c"}
Sep 15 13:52:11.773020 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:11.772857    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-2aa332-openshift-default-b94f494dd-x48k9" event={"ID":"5d43fec5-9d61-43bf-a663-a1341b804332","Type":"ContainerStarted","Data":"33d081a592e119a3ea40d80020988f673166984f9a6a4d5fb428e66ed32638a2"}
Sep 15 13:52:11.795465 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:11.795416    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-2aa332-openshift-default-b94f494dd-x48k9" podStartSLOduration=1.795400274 podStartE2EDuration="1.795400274s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:52:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:52:11.79199147 +0000 UTC m=+818.551117759" watchObservedRunningTime="2026-09-15 13:52:11.795400274 +0000 UTC m=+818.554526563"
Sep 15 13:52:12.594814 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:12.594769    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-2aa332-openshift-default-b94f494dd-x48k9"
Sep 15 13:52:12.625850 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:12.625815    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-2aa332-openshift-default-b94f494dd-x48k9"
Sep 15 13:52:12.781094 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:12.781061    2578 generic.go:356] "Generic (PLEG): container finished" podID="a46634e7-1982-4116-a42e-2075f7d3cd72" containerID="ee4d55fb0ecd9bf838123efb3d9d3d60c022a5d86226dc964280f8cce76e78bb" exitCode=0
Sep 15 13:52:12.781309 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:12.781155    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-66261e-openshift-default-86bd889684-6v7ph" event={"ID":"a46634e7-1982-4116-a42e-2075f7d3cd72","Type":"ContainerDied","Data":"ee4d55fb0ecd9bf838123efb3d9d3d60c022a5d86226dc964280f8cce76e78bb"}
Sep 15 13:52:12.782200 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:12.781518    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-2aa332-openshift-default-b94f494dd-x48k9"
Sep 15 13:52:12.782200 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:12.781810    2578 scope.go:117] "RemoveContainer" containerID="ee4d55fb0ecd9bf838123efb3d9d3d60c022a5d86226dc964280f8cce76e78bb"
Sep 15 13:52:12.782755 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:12.782537    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-2aa332-openshift-default-b94f494dd-x48k9"
Sep 15 13:52:12.783075 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:12.783049    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 15 13:52:12.783208 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:12.783153    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 15 13:52:12.783208 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:12.783195    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 15 13:52:13.790502 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:13.790471    2578 generic.go:356] "Generic (PLEG): container finished" podID="b8e97cfd-1e47-4397-9cfc-179f6cf158b4" containerID="0c03e306be1606962d321e6f41d45b0fdce44cd93106409c29b76c0cf8aefb77" exitCode=0
Sep 15 13:52:13.790981 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:13.790555    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-1293e7-openshift-default-567dbc6586-qk4jn" event={"ID":"b8e97cfd-1e47-4397-9cfc-179f6cf158b4","Type":"ContainerDied","Data":"0c03e306be1606962d321e6f41d45b0fdce44cd93106409c29b76c0cf8aefb77"}
Sep 15 13:52:13.791057 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:13.791022    2578 scope.go:117] "RemoveContainer" containerID="0c03e306be1606962d321e6f41d45b0fdce44cd93106409c29b76c0cf8aefb77"
Sep 15 13:52:13.792371 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:13.792337    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 15 13:52:13.792491 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:13.792406    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 15 13:52:13.792491 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:13.792438    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 15 13:52:13.793089 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:13.793064    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-66261e-openshift-default-86bd889684-6v7ph" event={"ID":"a46634e7-1982-4116-a42e-2075f7d3cd72","Type":"ContainerStarted","Data":"ce4d105fff7a28e1557941cbb7a7e1109df1586a69b94d809cc26bcda035d471"}
Sep 15 13:52:14.695822 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:14.695777    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-66261e-openshift-default-86bd889684-6v7ph"
Sep 15 13:52:14.696035 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:14.695915    2578 patch_prober.go:28] interesting pod/e2e-worker-w4-66261e-openshift-default-86bd889684-6v7ph container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Sep 15 13:52:14.696035 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:14.695958    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-66261e-openshift-default-86bd889684-6v7ph" podUID="a46634e7-1982-4116-a42e-2075f7d3cd72" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Sep 15 13:52:14.810936 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:14.810893    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-1293e7-openshift-default-567dbc6586-qk4jn" event={"ID":"b8e97cfd-1e47-4397-9cfc-179f6cf158b4","Type":"ContainerStarted","Data":"aac16bed7a959d2ed5f3f8d132f4b43c54b7e8d121fff698407321aa4fdc769e"}
Sep 15 13:52:15.623000 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:15.622462    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-1293e7-openshift-default-567dbc6586-qk4jn"
Sep 15 13:52:15.623000 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:15.622590    2578 patch_prober.go:28] interesting pod/e2e-worker-w0-1293e7-openshift-default-567dbc6586-qk4jn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Sep 15 13:52:15.623000 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:15.622633    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-1293e7-openshift-default-567dbc6586-qk4jn" podUID="b8e97cfd-1e47-4397-9cfc-179f6cf158b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Sep 15 13:52:15.696208 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:15.696171    2578 patch_prober.go:28] interesting pod/e2e-worker-w4-66261e-openshift-default-86bd889684-6v7ph container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Sep 15 13:52:15.696539 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:15.696492    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-66261e-openshift-default-86bd889684-6v7ph" podUID="a46634e7-1982-4116-a42e-2075f7d3cd72" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Sep 15 13:52:16.622616 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:16.622570    2578 patch_prober.go:28] interesting pod/e2e-worker-w0-1293e7-openshift-default-567dbc6586-qk4jn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Sep 15 13:52:16.623143 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:16.622641    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-1293e7-openshift-default-567dbc6586-qk4jn" podUID="b8e97cfd-1e47-4397-9cfc-179f6cf158b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Sep 15 13:52:16.696018 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:16.695980    2578 patch_prober.go:28] interesting pod/e2e-worker-w4-66261e-openshift-default-86bd889684-6v7ph container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Sep 15 13:52:16.696333 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:16.696300    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-66261e-openshift-default-86bd889684-6v7ph" podUID="a46634e7-1982-4116-a42e-2075f7d3cd72" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Sep 15 13:52:17.623599 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:17.623559    2578 patch_prober.go:28] interesting pod/e2e-worker-w0-1293e7-openshift-default-567dbc6586-qk4jn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Sep 15 13:52:17.624218 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:17.624172    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-1293e7-openshift-default-567dbc6586-qk4jn" podUID="b8e97cfd-1e47-4397-9cfc-179f6cf158b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Sep 15 13:52:17.695743 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:17.695707    2578 patch_prober.go:28] interesting pod/e2e-worker-w4-66261e-openshift-default-86bd889684-6v7ph container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Sep 15 13:52:17.696036 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:17.695994    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-66261e-openshift-default-86bd889684-6v7ph" podUID="a46634e7-1982-4116-a42e-2075f7d3cd72" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Sep 15 13:52:18.622383 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:18.622337    2578 patch_prober.go:28] interesting pod/e2e-worker-w0-1293e7-openshift-default-567dbc6586-qk4jn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Sep 15 13:52:18.622617 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:18.622406    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-1293e7-openshift-default-567dbc6586-qk4jn" podUID="b8e97cfd-1e47-4397-9cfc-179f6cf158b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Sep 15 13:52:18.696192 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:18.696153    2578 patch_prober.go:28] interesting pod/e2e-worker-w4-66261e-openshift-default-86bd889684-6v7ph container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Sep 15 13:52:18.696813 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:18.696756    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-66261e-openshift-default-86bd889684-6v7ph" podUID="a46634e7-1982-4116-a42e-2075f7d3cd72" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Sep 15 13:52:19.622566 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:19.622527    2578 patch_prober.go:28] interesting pod/e2e-worker-w0-1293e7-openshift-default-567dbc6586-qk4jn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Sep 15 13:52:19.622859 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:19.622825    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-1293e7-openshift-default-567dbc6586-qk4jn" podUID="b8e97cfd-1e47-4397-9cfc-179f6cf158b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Sep 15 13:52:19.695238 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:19.695201    2578 patch_prober.go:28] interesting pod/e2e-worker-w4-66261e-openshift-default-86bd889684-6v7ph container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Sep 15 13:52:19.695561 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:19.695532    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-66261e-openshift-default-86bd889684-6v7ph" podUID="a46634e7-1982-4116-a42e-2075f7d3cd72" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Sep 15 13:52:20.181620 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:20.181581    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-2aa332-59b4cfbf86-4lt9q"]
Sep 15 13:52:20.193676 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:20.192957    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-2aa332-59b4cfbf86-4lt9q"
Sep 15 13:52:20.193676 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:20.193586    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-2aa332-59b4cfbf86-4lt9q"]
Sep 15 13:52:20.197389 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:20.196921    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-2aa332\""
Sep 15 13:52:20.197389 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:20.197225    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-2aa332-dockercfg-wjlv2\""
Sep 15 13:52:20.360811 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:20.360604    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/00a7d446-8d28-4465-a461-350f03c78426-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-2aa332-59b4cfbf86-4lt9q\" (UID: \"00a7d446-8d28-4465-a461-350f03c78426\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-2aa332-59b4cfbf86-4lt9q"
Sep 15 13:52:20.360811 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:20.360666    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jb5wg\" (UniqueName: \"kubernetes.io/projected/00a7d446-8d28-4465-a461-350f03c78426-kube-api-access-jb5wg\") pod \"payload-pre-processing-e2e-inf-b-2aa332-59b4cfbf86-4lt9q\" (UID: \"00a7d446-8d28-4465-a461-350f03c78426\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-2aa332-59b4cfbf86-4lt9q"
Sep 15 13:52:20.463198 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:20.461736    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jb5wg\" (UniqueName: \"kubernetes.io/projected/00a7d446-8d28-4465-a461-350f03c78426-kube-api-access-jb5wg\") pod \"payload-pre-processing-e2e-inf-b-2aa332-59b4cfbf86-4lt9q\" (UID: \"00a7d446-8d28-4465-a461-350f03c78426\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-2aa332-59b4cfbf86-4lt9q"
Sep 15 13:52:20.463198 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:20.461928    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/00a7d446-8d28-4465-a461-350f03c78426-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-2aa332-59b4cfbf86-4lt9q\" (UID: \"00a7d446-8d28-4465-a461-350f03c78426\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-2aa332-59b4cfbf86-4lt9q"
Sep 15 13:52:20.463198 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:20.462829    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/00a7d446-8d28-4465-a461-350f03c78426-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-2aa332-59b4cfbf86-4lt9q\" (UID: \"00a7d446-8d28-4465-a461-350f03c78426\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-2aa332-59b4cfbf86-4lt9q"
Sep 15 13:52:20.472424 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:20.472362    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jb5wg\" (UniqueName: \"kubernetes.io/projected/00a7d446-8d28-4465-a461-350f03c78426-kube-api-access-jb5wg\") pod \"payload-pre-processing-e2e-inf-b-2aa332-59b4cfbf86-4lt9q\" (UID: \"00a7d446-8d28-4465-a461-350f03c78426\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-2aa332-59b4cfbf86-4lt9q"
Sep 15 13:52:20.507104 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:20.507056    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-2aa332-59b4cfbf86-4lt9q"
Sep 15 13:52:20.622511 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:20.622427    2578 patch_prober.go:28] interesting pod/e2e-worker-w0-1293e7-openshift-default-567dbc6586-qk4jn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Sep 15 13:52:20.622511 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:20.622490    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-1293e7-openshift-default-567dbc6586-qk4jn" podUID="b8e97cfd-1e47-4397-9cfc-179f6cf158b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Sep 15 13:52:20.699113 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:20.699081    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-66261e-openshift-default-86bd889684-6v7ph"
Sep 15 13:52:20.699505 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:20.699480    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-66261e-openshift-default-86bd889684-6v7ph"
Sep 15 13:52:20.700155 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:20.700115    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-66261e-openshift-default-86bd889684-6v7ph"
Sep 15 13:52:20.790150 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:20.789269    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-8e248304-565bbc66bc-sgmfn"
Sep 15 13:52:20.813469 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:20.813429    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-2aa332-59b4cfbf86-4lt9q"]
Sep 15 13:52:20.814789 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:52:20.814763    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00a7d446_8d28_4465_a461_350f03c78426.slice/crio-e12dcb1ea7f0e41c7928cbc4376b86ddbf399675970a09a59247bef1a34d5718 WatchSource:0}: Error finding container e12dcb1ea7f0e41c7928cbc4376b86ddbf399675970a09a59247bef1a34d5718: Status 404 returned error can't find the container with id e12dcb1ea7f0e41c7928cbc4376b86ddbf399675970a09a59247bef1a34d5718
Sep 15 13:52:20.869070 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:20.869000    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-2aa332-59b4cfbf86-4lt9q" event={"ID":"00a7d446-8d28-4465-a461-350f03c78426","Type":"ContainerStarted","Data":"e12dcb1ea7f0e41c7928cbc4376b86ddbf399675970a09a59247bef1a34d5718"}
Sep 15 13:52:21.628043 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:21.628004    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-1293e7-openshift-default-567dbc6586-qk4jn"
Sep 15 13:52:21.628633 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:21.628612    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-1293e7-openshift-default-567dbc6586-qk4jn"
Sep 15 13:52:21.629583 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:21.629560    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-1293e7-openshift-default-567dbc6586-qk4jn"
Sep 15 13:52:21.878200 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:21.878078    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-2aa332-59b4cfbf86-4lt9q" event={"ID":"00a7d446-8d28-4465-a461-350f03c78426","Type":"ContainerStarted","Data":"4f7858ac019f37a3d4d94d2bb851a14d3b33f67c897acf3b67784a61eee6173f"}
Sep 15 13:52:21.895206 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:21.895119    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-2aa332-59b4cfbf86-4lt9q" podStartSLOduration=1.8951021030000001 podStartE2EDuration="1.895102103s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:52:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:52:21.894250597 +0000 UTC m=+828.653376882" watchObservedRunningTime="2026-09-15 13:52:21.895102103 +0000 UTC m=+828.654228390"
Sep 15 13:52:22.883883 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:22.883850    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-2aa332-59b4cfbf86-4lt9q"
Sep 15 13:52:23.361377 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:23.361339    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8e248304-gv5mw"]
Sep 15 13:52:23.364515 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:23.364493    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8e248304-gv5mw"
Sep 15 13:52:23.366688 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:23.366664    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 15 13:52:23.367431 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:23.367406    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qzmkv\""
Sep 15 13:52:23.367431 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:23.367420    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 13:52:23.372576 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:23.372539    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8e248304-gv5mw"]
Sep 15 13:52:23.410508 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:23.410464    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghl6c\" (UniqueName: \"kubernetes.io/projected/a73b2b61-b492-453e-97ef-d2b2253cc272-kube-api-access-ghl6c\") pod \"maas-api-revoke-keys-e2e-ait-8e248304-gv5mw\" (UID: \"a73b2b61-b492-453e-97ef-d2b2253cc272\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8e248304-gv5mw"
Sep 15 13:52:23.410714 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:23.410540    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a73b2b61-b492-453e-97ef-d2b2253cc272-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-8e248304-gv5mw\" (UID: \"a73b2b61-b492-453e-97ef-d2b2253cc272\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8e248304-gv5mw"
Sep 15 13:52:23.511635 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:23.511593    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghl6c\" (UniqueName: \"kubernetes.io/projected/a73b2b61-b492-453e-97ef-d2b2253cc272-kube-api-access-ghl6c\") pod \"maas-api-revoke-keys-e2e-ait-8e248304-gv5mw\" (UID: \"a73b2b61-b492-453e-97ef-d2b2253cc272\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8e248304-gv5mw"
Sep 15 13:52:23.511811 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:23.511678    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a73b2b61-b492-453e-97ef-d2b2253cc272-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-8e248304-gv5mw\" (UID: \"a73b2b61-b492-453e-97ef-d2b2253cc272\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8e248304-gv5mw"
Sep 15 13:52:23.512357 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:23.512332    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a73b2b61-b492-453e-97ef-d2b2253cc272-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-8e248304-gv5mw\" (UID: \"a73b2b61-b492-453e-97ef-d2b2253cc272\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8e248304-gv5mw"
Sep 15 13:52:23.520897 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:23.519710    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghl6c\" (UniqueName: \"kubernetes.io/projected/a73b2b61-b492-453e-97ef-d2b2253cc272-kube-api-access-ghl6c\") pod \"maas-api-revoke-keys-e2e-ait-8e248304-gv5mw\" (UID: \"a73b2b61-b492-453e-97ef-d2b2253cc272\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8e248304-gv5mw"
Sep 15 13:52:23.679620 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:23.679597    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8e248304-gv5mw"
Sep 15 13:52:23.729413 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:52:23.729382    2578 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/system.slice/system-systemd\\\\x2dcoredump.slice/systemd-coredump@3-12654-0.service\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod919cf8d9_0892_49a5_a5c4_7463192b1540.slice/crio-eccca466ec2af5e5b665bf503334dfd93705ec1299f421da79840ca033babb4e.scope\": RecentStats: unable to find data in memory cache]"
Sep 15 13:52:23.890693 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:23.890660    2578 generic.go:356] "Generic (PLEG): container finished" podID="919cf8d9-0892-49a5-a5c4-7463192b1540" containerID="eccca466ec2af5e5b665bf503334dfd93705ec1299f421da79840ca033babb4e" exitCode=0
Sep 15 13:52:23.891167 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:23.890735    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8e248304-openshift-default-84c6c598b4-gd56x" event={"ID":"919cf8d9-0892-49a5-a5c4-7463192b1540","Type":"ContainerDied","Data":"eccca466ec2af5e5b665bf503334dfd93705ec1299f421da79840ca033babb4e"}
Sep 15 13:52:23.891265 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:23.891249    2578 scope.go:117] "RemoveContainer" containerID="eccca466ec2af5e5b665bf503334dfd93705ec1299f421da79840ca033babb4e"
Sep 15 13:52:23.892588 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:23.892501    2578 generic.go:356] "Generic (PLEG): container finished" podID="300413ac-ddff-4342-a863-82e20c29deeb" containerID="596cc9674199435774c79ab0bafd76077bc0cdc3b94a93c94c5ea57116c478b1" exitCode=0
Sep 15 13:52:23.892588 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:23.892547    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 15 13:52:23.892588 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:23.892574    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-80a7cc-openshift-default-5f789585f4-bpw9x" event={"ID":"300413ac-ddff-4342-a863-82e20c29deeb","Type":"ContainerDied","Data":"596cc9674199435774c79ab0bafd76077bc0cdc3b94a93c94c5ea57116c478b1"}
Sep 15 13:52:23.892798 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:23.892631    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 15 13:52:23.892798 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:23.892671    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 15 13:52:23.893061 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:23.893044    2578 scope.go:117] "RemoveContainer" containerID="596cc9674199435774c79ab0bafd76077bc0cdc3b94a93c94c5ea57116c478b1"
Sep 15 13:52:23.894363 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:23.894333    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 15 13:52:23.894467 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:23.894402    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 15 13:52:23.894467 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:23.894452    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 15 13:52:23.966158 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:23.966116    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8e248304-gv5mw"]
Sep 15 13:52:23.967694 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:52:23.967658    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda73b2b61_b492_453e_97ef_d2b2253cc272.slice/crio-95162ae6a2725e32241dcf4934666ad37d6f41f429951e36a1fcd53b49422701 WatchSource:0}: Error finding container 95162ae6a2725e32241dcf4934666ad37d6f41f429951e36a1fcd53b49422701: Status 404 returned error can't find the container with id 95162ae6a2725e32241dcf4934666ad37d6f41f429951e36a1fcd53b49422701
Sep 15 13:52:24.905012 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:24.904964    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-80a7cc-openshift-default-5f789585f4-bpw9x" event={"ID":"300413ac-ddff-4342-a863-82e20c29deeb","Type":"ContainerStarted","Data":"643c6d7c797b367a69cda737781891490cfa709325443f6c2a9a2c85a1d43a9c"}
Sep 15 13:52:24.907591 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:24.907552    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8e248304-gv5mw" event={"ID":"a73b2b61-b492-453e-97ef-d2b2253cc272","Type":"ContainerStarted","Data":"95162ae6a2725e32241dcf4934666ad37d6f41f429951e36a1fcd53b49422701"}
Sep 15 13:52:24.910917 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:24.910881    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8e248304-openshift-default-84c6c598b4-gd56x" event={"ID":"919cf8d9-0892-49a5-a5c4-7463192b1540","Type":"ContainerStarted","Data":"e17eea9a0ec07f1338654e244704decd138a4a47c2817540f0a106f51f118a87"}
Sep 15 13:52:25.359194 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:25.359166    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-80a7cc-openshift-default-5f789585f4-bpw9x"
Sep 15 13:52:25.359632 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:25.359372    2578 patch_prober.go:28] interesting pod/e2e-autores-80a7cc-openshift-default-5f789585f4-bpw9x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Sep 15 13:52:25.359632 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:25.359428    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-80a7cc-openshift-default-5f789585f4-bpw9x" podUID="300413ac-ddff-4342-a863-82e20c29deeb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Sep 15 13:52:25.705039 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:25.704534    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-8e248304-openshift-default-84c6c598b4-gd56x"
Sep 15 13:52:25.705039 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:25.704665    2578 patch_prober.go:28] interesting pod/e2e-ait-8e248304-openshift-default-84c6c598b4-gd56x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Sep 15 13:52:25.705039 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:25.704711    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-8e248304-openshift-default-84c6c598b4-gd56x" podUID="919cf8d9-0892-49a5-a5c4-7463192b1540" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Sep 15 13:52:26.359329 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:26.359294    2578 patch_prober.go:28] interesting pod/e2e-autores-80a7cc-openshift-default-5f789585f4-bpw9x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Sep 15 13:52:26.359792 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:26.359353    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-80a7cc-openshift-default-5f789585f4-bpw9x" podUID="300413ac-ddff-4342-a863-82e20c29deeb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Sep 15 13:52:26.706645 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:26.706556    2578 patch_prober.go:28] interesting pod/e2e-ait-8e248304-openshift-default-84c6c598b4-gd56x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Sep 15 13:52:26.706927 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:26.706892    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-8e248304-openshift-default-84c6c598b4-gd56x" podUID="919cf8d9-0892-49a5-a5c4-7463192b1540" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Sep 15 13:52:27.360421 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:27.360385    2578 patch_prober.go:28] interesting pod/e2e-autores-80a7cc-openshift-default-5f789585f4-bpw9x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Sep 15 13:52:27.362096 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:27.361643    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-80a7cc-openshift-default-5f789585f4-bpw9x" podUID="300413ac-ddff-4342-a863-82e20c29deeb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Sep 15 13:52:27.704066 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:27.703841    2578 patch_prober.go:28] interesting pod/e2e-ait-8e248304-openshift-default-84c6c598b4-gd56x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Sep 15 13:52:27.704066 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:27.703904    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-8e248304-openshift-default-84c6c598b4-gd56x" podUID="919cf8d9-0892-49a5-a5c4-7463192b1540" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Sep 15 13:52:28.359964 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:28.359880    2578 patch_prober.go:28] interesting pod/e2e-autores-80a7cc-openshift-default-5f789585f4-bpw9x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Sep 15 13:52:28.359964 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:28.359930    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-80a7cc-openshift-default-5f789585f4-bpw9x" podUID="300413ac-ddff-4342-a863-82e20c29deeb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Sep 15 13:52:28.703776 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:28.703670    2578 patch_prober.go:28] interesting pod/e2e-ait-8e248304-openshift-default-84c6c598b4-gd56x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Sep 15 13:52:28.703776 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:28.703739    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-8e248304-openshift-default-84c6c598b4-gd56x" podUID="919cf8d9-0892-49a5-a5c4-7463192b1540" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Sep 15 13:52:28.939470 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:28.939434    2578 generic.go:356] "Generic (PLEG): container finished" podID="a73b2b61-b492-453e-97ef-d2b2253cc272" containerID="0fc4d8730855664ccdb933e3f76d8fcd9379409b1ce4e149228ca72a785bae87" exitCode=0
Sep 15 13:52:28.939627 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:28.939491    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8e248304-gv5mw" event={"ID":"a73b2b61-b492-453e-97ef-d2b2253cc272","Type":"ContainerDied","Data":"0fc4d8730855664ccdb933e3f76d8fcd9379409b1ce4e149228ca72a785bae87"}
Sep 15 13:52:29.360159 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:29.360081    2578 patch_prober.go:28] interesting pod/e2e-autores-80a7cc-openshift-default-5f789585f4-bpw9x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Sep 15 13:52:29.360376 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:29.360192    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-80a7cc-openshift-default-5f789585f4-bpw9x" podUID="300413ac-ddff-4342-a863-82e20c29deeb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Sep 15 13:52:29.704302 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:29.704187    2578 patch_prober.go:28] interesting pod/e2e-ait-8e248304-openshift-default-84c6c598b4-gd56x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Sep 15 13:52:29.704302 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:29.704259    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-8e248304-openshift-default-84c6c598b4-gd56x" podUID="919cf8d9-0892-49a5-a5c4-7463192b1540" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Sep 15 13:52:30.172605 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:30.172301    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8e248304-gv5mw"
Sep 15 13:52:30.316698 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:30.316601    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ghl6c\" (UniqueName: \"kubernetes.io/projected/a73b2b61-b492-453e-97ef-d2b2253cc272-kube-api-access-ghl6c\") pod \"a73b2b61-b492-453e-97ef-d2b2253cc272\" (UID: \"a73b2b61-b492-453e-97ef-d2b2253cc272\") "
Sep 15 13:52:30.316870 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:30.316748    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a73b2b61-b492-453e-97ef-d2b2253cc272-maas-api-service-ca\") pod \"a73b2b61-b492-453e-97ef-d2b2253cc272\" (UID: \"a73b2b61-b492-453e-97ef-d2b2253cc272\") "
Sep 15 13:52:30.317069 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:30.317044    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a73b2b61-b492-453e-97ef-d2b2253cc272-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a73b2b61-b492-453e-97ef-d2b2253cc272" (UID: "a73b2b61-b492-453e-97ef-d2b2253cc272"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 13:52:30.319070 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:30.319035    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a73b2b61-b492-453e-97ef-d2b2253cc272-kube-api-access-ghl6c" (OuterVolumeSpecName: "kube-api-access-ghl6c") pod "a73b2b61-b492-453e-97ef-d2b2253cc272" (UID: "a73b2b61-b492-453e-97ef-d2b2253cc272"). InnerVolumeSpecName "kube-api-access-ghl6c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:52:30.359404 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:30.359372    2578 patch_prober.go:28] interesting pod/e2e-autores-80a7cc-openshift-default-5f789585f4-bpw9x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Sep 15 13:52:30.359564 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:30.359428    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-80a7cc-openshift-default-5f789585f4-bpw9x" podUID="300413ac-ddff-4342-a863-82e20c29deeb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Sep 15 13:52:30.417924 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:30.417891    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a73b2b61-b492-453e-97ef-d2b2253cc272-maas-api-service-ca\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:52:30.417924 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:30.417919    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ghl6c\" (UniqueName: \"kubernetes.io/projected/a73b2b61-b492-453e-97ef-d2b2253cc272-kube-api-access-ghl6c\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:52:30.680623 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:30.680541    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-80a7cc-openshift-default-5f789585f4-bpw9x"
Sep 15 13:52:30.707881 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:30.707852    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-8e248304-openshift-default-84c6c598b4-gd56x"
Sep 15 13:52:30.708335 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:30.708162    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-8e248304-openshift-default-84c6c598b4-gd56x"
Sep 15 13:52:30.708954 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:30.708922    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-8e248304-openshift-default-84c6c598b4-gd56x"
Sep 15 13:52:30.953237 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:30.953158    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8e248304-gv5mw"
Sep 15 13:52:30.953237 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:30.953171    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8e248304-gv5mw" event={"ID":"a73b2b61-b492-453e-97ef-d2b2253cc272","Type":"ContainerDied","Data":"95162ae6a2725e32241dcf4934666ad37d6f41f429951e36a1fcd53b49422701"}
Sep 15 13:52:30.953237 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:30.953219    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="95162ae6a2725e32241dcf4934666ad37d6f41f429951e36a1fcd53b49422701"
Sep 15 13:52:31.363719 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:31.363687    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-80a7cc-openshift-default-5f789585f4-bpw9x"
Sep 15 13:52:31.364640 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:31.364619    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-80a7cc-openshift-default-5f789585f4-bpw9x"
Sep 15 13:52:33.894912 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:33.894872    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-2aa332-59b4cfbf86-4lt9q"
Sep 15 13:52:34.200481 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:34.200452    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-8e248304-565bbc66bc-sgmfn"]
Sep 15 13:52:34.200706 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:34.200662    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-8e248304-565bbc66bc-sgmfn" podUID="c7bfb401-b4c1-4028-8ebc-86623b0b56cb" containerName="payload-processing" containerID="cri-o://b19ddb43646dc0358561e5a7c117d46296cc4a22d74400c0ca64527639a1e34e" gracePeriod=30
Sep 15 13:52:34.392209 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:34.392140    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8e248304-gv5mw"]
Sep 15 13:52:34.396445 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:34.396411    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8e248304-gv5mw"]
Sep 15 13:52:34.519731 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:34.518328    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-8e248304-565bbc66bc-sgmfn"
Sep 15 13:52:34.524039 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:34.520093    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-8e248304-openshift-default-84c6c598b4-gd56x"]
Sep 15 13:52:34.524039 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:34.520320    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-8e248304-openshift-default-84c6c598b4-gd56x" podUID="919cf8d9-0892-49a5-a5c4-7463192b1540" containerName="istio-proxy" containerID="cri-o://e17eea9a0ec07f1338654e244704decd138a4a47c2817540f0a106f51f118a87" gracePeriod=30
Sep 15 13:52:34.581676 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:34.581639    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8xmx5\" (UniqueName: \"kubernetes.io/projected/c7bfb401-b4c1-4028-8ebc-86623b0b56cb-kube-api-access-8xmx5\") pod \"c7bfb401-b4c1-4028-8ebc-86623b0b56cb\" (UID: \"c7bfb401-b4c1-4028-8ebc-86623b0b56cb\") "
Sep 15 13:52:34.582042 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:34.582023    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c7bfb401-b4c1-4028-8ebc-86623b0b56cb-plugins-config-volume\") pod \"c7bfb401-b4c1-4028-8ebc-86623b0b56cb\" (UID: \"c7bfb401-b4c1-4028-8ebc-86623b0b56cb\") "
Sep 15 13:52:34.583056 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:34.583035    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7bfb401-b4c1-4028-8ebc-86623b0b56cb-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c7bfb401-b4c1-4028-8ebc-86623b0b56cb" (UID: "c7bfb401-b4c1-4028-8ebc-86623b0b56cb"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 13:52:34.594305 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:34.594248    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7bfb401-b4c1-4028-8ebc-86623b0b56cb-kube-api-access-8xmx5" (OuterVolumeSpecName: "kube-api-access-8xmx5") pod "c7bfb401-b4c1-4028-8ebc-86623b0b56cb" (UID: "c7bfb401-b4c1-4028-8ebc-86623b0b56cb"). InnerVolumeSpecName "kube-api-access-8xmx5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:52:34.684149 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:34.683672    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8xmx5\" (UniqueName: \"kubernetes.io/projected/c7bfb401-b4c1-4028-8ebc-86623b0b56cb-kube-api-access-8xmx5\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:52:34.684149 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:34.683712    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c7bfb401-b4c1-4028-8ebc-86623b0b56cb-plugins-config-volume\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:52:34.989713 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:34.989679    2578 generic.go:356] "Generic (PLEG): container finished" podID="c7bfb401-b4c1-4028-8ebc-86623b0b56cb" containerID="b19ddb43646dc0358561e5a7c117d46296cc4a22d74400c0ca64527639a1e34e" exitCode=0
Sep 15 13:52:34.990216 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:34.989729    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-8e248304-565bbc66bc-sgmfn"
Sep 15 13:52:34.990216 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:34.989768    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-8e248304-565bbc66bc-sgmfn" event={"ID":"c7bfb401-b4c1-4028-8ebc-86623b0b56cb","Type":"ContainerDied","Data":"b19ddb43646dc0358561e5a7c117d46296cc4a22d74400c0ca64527639a1e34e"}
Sep 15 13:52:34.990216 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:34.989825    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-8e248304-565bbc66bc-sgmfn" event={"ID":"c7bfb401-b4c1-4028-8ebc-86623b0b56cb","Type":"ContainerDied","Data":"2b1de951707bb44cd540303c69cced2a7342486cc151bb3319bf5ffe9430bb81"}
Sep 15 13:52:34.990216 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:34.989853    2578 scope.go:117] "RemoveContainer" containerID="b19ddb43646dc0358561e5a7c117d46296cc4a22d74400c0ca64527639a1e34e"
Sep 15 13:52:34.999828 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:34.999810    2578 scope.go:117] "RemoveContainer" containerID="b19ddb43646dc0358561e5a7c117d46296cc4a22d74400c0ca64527639a1e34e"
Sep 15 13:52:35.000116 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:52:35.000097    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b19ddb43646dc0358561e5a7c117d46296cc4a22d74400c0ca64527639a1e34e\": container with ID starting with b19ddb43646dc0358561e5a7c117d46296cc4a22d74400c0ca64527639a1e34e not found: ID does not exist" containerID="b19ddb43646dc0358561e5a7c117d46296cc4a22d74400c0ca64527639a1e34e"
Sep 15 13:52:35.000261 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:35.000155    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b19ddb43646dc0358561e5a7c117d46296cc4a22d74400c0ca64527639a1e34e"} err="failed to get container status \"b19ddb43646dc0358561e5a7c117d46296cc4a22d74400c0ca64527639a1e34e\": rpc error: code = NotFound desc = could not find container \"b19ddb43646dc0358561e5a7c117d46296cc4a22d74400c0ca64527639a1e34e\": container with ID starting with b19ddb43646dc0358561e5a7c117d46296cc4a22d74400c0ca64527639a1e34e not found: ID does not exist"
Sep 15 13:52:35.024477 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:35.024443    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-8e248304-565bbc66bc-sgmfn"]
Sep 15 13:52:35.033730 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:35.033696    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-8e248304-565bbc66bc-sgmfn"]
Sep 15 13:52:35.484150 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:35.478724    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-a5a300cf-gw-openshift-default-d9695ff5b-cl4wp"]
Sep 15 13:52:35.491374 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:35.491341    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a73b2b61-b492-453e-97ef-d2b2253cc272" containerName="revoke-keys"
Sep 15 13:52:35.491374 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:35.491370    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a73b2b61-b492-453e-97ef-d2b2253cc272" containerName="revoke-keys"
Sep 15 13:52:35.491616 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:35.491389    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7bfb401-b4c1-4028-8ebc-86623b0b56cb" containerName="payload-processing"
Sep 15 13:52:35.491616 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:35.491398    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7bfb401-b4c1-4028-8ebc-86623b0b56cb" containerName="payload-processing"
Sep 15 13:52:35.491616 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:35.491533    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7bfb401-b4c1-4028-8ebc-86623b0b56cb" containerName="payload-processing"
Sep 15 13:52:35.491616 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:35.491544    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a73b2b61-b492-453e-97ef-d2b2253cc272" containerName="revoke-keys"
Sep 15 13:52:35.495095 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:35.494602    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-a5a300cf-gw-openshift-default-d9695ff5b-cl4wp"
Sep 15 13:52:35.495095 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:35.494753    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-a5a300cf-gw-openshift-default-d9695ff5b-cl4wp"]
Sep 15 13:52:35.497212 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:35.497095    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-a5a300cf-gw-openshift-default-dockercfg-mdsxv\""
Sep 15 13:52:35.593150 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:35.592697    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85cee838-2c15-4d06-9c2c-835bcf29d1d8-istiod-ca-cert\") pod \"e2e-migrate-a5a300cf-gw-openshift-default-d9695ff5b-cl4wp\" (UID: \"85cee838-2c15-4d06-9c2c-835bcf29d1d8\") " pod="openshift-ingress/e2e-migrate-a5a300cf-gw-openshift-default-d9695ff5b-cl4wp"
Sep 15 13:52:35.593150 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:35.592764    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85cee838-2c15-4d06-9c2c-835bcf29d1d8-credential-socket\") pod \"e2e-migrate-a5a300cf-gw-openshift-default-d9695ff5b-cl4wp\" (UID: \"85cee838-2c15-4d06-9c2c-835bcf29d1d8\") " pod="openshift-ingress/e2e-migrate-a5a300cf-gw-openshift-default-d9695ff5b-cl4wp"
Sep 15 13:52:35.593150 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:35.592817    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85cee838-2c15-4d06-9c2c-835bcf29d1d8-istio-data\") pod \"e2e-migrate-a5a300cf-gw-openshift-default-d9695ff5b-cl4wp\" (UID: \"85cee838-2c15-4d06-9c2c-835bcf29d1d8\") " pod="openshift-ingress/e2e-migrate-a5a300cf-gw-openshift-default-d9695ff5b-cl4wp"
Sep 15 13:52:35.593150 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:35.592844    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85cee838-2c15-4d06-9c2c-835bcf29d1d8-workload-socket\") pod \"e2e-migrate-a5a300cf-gw-openshift-default-d9695ff5b-cl4wp\" (UID: \"85cee838-2c15-4d06-9c2c-835bcf29d1d8\") " pod="openshift-ingress/e2e-migrate-a5a300cf-gw-openshift-default-d9695ff5b-cl4wp"
Sep 15 13:52:35.593150 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:35.592895    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85cee838-2c15-4d06-9c2c-835bcf29d1d8-workload-certs\") pod \"e2e-migrate-a5a300cf-gw-openshift-default-d9695ff5b-cl4wp\" (UID: \"85cee838-2c15-4d06-9c2c-835bcf29d1d8\") " pod="openshift-ingress/e2e-migrate-a5a300cf-gw-openshift-default-d9695ff5b-cl4wp"
Sep 15 13:52:35.593150 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:35.592937    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nm2hx\" (UniqueName: \"kubernetes.io/projected/85cee838-2c15-4d06-9c2c-835bcf29d1d8-kube-api-access-nm2hx\") pod \"e2e-migrate-a5a300cf-gw-openshift-default-d9695ff5b-cl4wp\" (UID: \"85cee838-2c15-4d06-9c2c-835bcf29d1d8\") " pod="openshift-ingress/e2e-migrate-a5a300cf-gw-openshift-default-d9695ff5b-cl4wp"
Sep 15 13:52:35.593150 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:35.592968    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85cee838-2c15-4d06-9c2c-835bcf29d1d8-istio-token\") pod \"e2e-migrate-a5a300cf-gw-openshift-default-d9695ff5b-cl4wp\" (UID: \"85cee838-2c15-4d06-9c2c-835bcf29d1d8\") " pod="openshift-ingress/e2e-migrate-a5a300cf-gw-openshift-default-d9695ff5b-cl4wp"
Sep 15 13:52:35.593150 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:35.593011    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85cee838-2c15-4d06-9c2c-835bcf29d1d8-istio-envoy\") pod \"e2e-migrate-a5a300cf-gw-openshift-default-d9695ff5b-cl4wp\" (UID: \"85cee838-2c15-4d06-9c2c-835bcf29d1d8\") " pod="openshift-ingress/e2e-migrate-a5a300cf-gw-openshift-default-d9695ff5b-cl4wp"
Sep 15 13:52:35.593150 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:35.593036    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85cee838-2c15-4d06-9c2c-835bcf29d1d8-istio-podinfo\") pod \"e2e-migrate-a5a300cf-gw-openshift-default-d9695ff5b-cl4wp\" (UID: \"85cee838-2c15-4d06-9c2c-835bcf29d1d8\") " pod="openshift-ingress/e2e-migrate-a5a300cf-gw-openshift-default-d9695ff5b-cl4wp"
Sep 15 13:52:35.694402 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:35.694360    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85cee838-2c15-4d06-9c2c-835bcf29d1d8-workload-certs\") pod \"e2e-migrate-a5a300cf-gw-openshift-default-d9695ff5b-cl4wp\" (UID: \"85cee838-2c15-4d06-9c2c-835bcf29d1d8\") " pod="openshift-ingress/e2e-migrate-a5a300cf-gw-openshift-default-d9695ff5b-cl4wp"
Sep 15 13:52:35.694402 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:35.694412    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nm2hx\" (UniqueName: \"kubernetes.io/projected/85cee838-2c15-4d06-9c2c-835bcf29d1d8-kube-api-access-nm2hx\") pod \"e2e-migrate-a5a300cf-gw-openshift-default-d9695ff5b-cl4wp\" (UID: \"85cee838-2c15-4d06-9c2c-835bcf29d1d8\") " pod="openshift-ingress/e2e-migrate-a5a300cf-gw-openshift-default-d9695ff5b-cl4wp"
Sep 15 13:52:35.694671 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:35.694578    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85cee838-2c15-4d06-9c2c-835bcf29d1d8-istio-token\") pod \"e2e-migrate-a5a300cf-gw-openshift-default-d9695ff5b-cl4wp\" (UID: \"85cee838-2c15-4d06-9c2c-835bcf29d1d8\") " pod="openshift-ingress/e2e-migrate-a5a300cf-gw-openshift-default-d9695ff5b-cl4wp"
Sep 15 13:52:35.694671 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:35.694629    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85cee838-2c15-4d06-9c2c-835bcf29d1d8-istio-envoy\") pod \"e2e-migrate-a5a300cf-gw-openshift-default-d9695ff5b-cl4wp\" (UID: \"85cee838-2c15-4d06-9c2c-835bcf29d1d8\") " pod="openshift-ingress/e2e-migrate-a5a300cf-gw-openshift-default-d9695ff5b-cl4wp"
Sep 15 13:52:35.694671 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:35.694658    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85cee838-2c15-4d06-9c2c-835bcf29d1d8-istio-podinfo\") pod \"e2e-migrate-a5a300cf-gw-openshift-default-d9695ff5b-cl4wp\" (UID: \"85cee838-2c15-4d06-9c2c-835bcf29d1d8\") " pod="openshift-ingress/e2e-migrate-a5a300cf-gw-openshift-default-d9695ff5b-cl4wp"
Sep 15 13:52:35.694839 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:35.694733    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85cee838-2c15-4d06-9c2c-835bcf29d1d8-istiod-ca-cert\") pod \"e2e-migrate-a5a300cf-gw-openshift-default-d9695ff5b-cl4wp\" (UID: \"85cee838-2c15-4d06-9c2c-835bcf29d1d8\") " pod="openshift-ingress/e2e-migrate-a5a300cf-gw-openshift-default-d9695ff5b-cl4wp"
Sep 15 13:52:35.694839 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:35.694785    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85cee838-2c15-4d06-9c2c-835bcf29d1d8-credential-socket\") pod \"e2e-migrate-a5a300cf-gw-openshift-default-d9695ff5b-cl4wp\" (UID: \"85cee838-2c15-4d06-9c2c-835bcf29d1d8\") " pod="openshift-ingress/e2e-migrate-a5a300cf-gw-openshift-default-d9695ff5b-cl4wp"
Sep 15 13:52:35.694839 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:35.694817    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85cee838-2c15-4d06-9c2c-835bcf29d1d8-workload-certs\") pod \"e2e-migrate-a5a300cf-gw-openshift-default-d9695ff5b-cl4wp\" (UID: \"85cee838-2c15-4d06-9c2c-835bcf29d1d8\") " pod="openshift-ingress/e2e-migrate-a5a300cf-gw-openshift-default-d9695ff5b-cl4wp"
Sep 15 13:52:35.695005 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:35.694861    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85cee838-2c15-4d06-9c2c-835bcf29d1d8-istio-data\") pod \"e2e-migrate-a5a300cf-gw-openshift-default-d9695ff5b-cl4wp\" (UID: \"85cee838-2c15-4d06-9c2c-835bcf29d1d8\") " pod="openshift-ingress/e2e-migrate-a5a300cf-gw-openshift-default-d9695ff5b-cl4wp"
Sep 15 13:52:35.695005 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:35.694902    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85cee838-2c15-4d06-9c2c-835bcf29d1d8-workload-socket\") pod \"e2e-migrate-a5a300cf-gw-openshift-default-d9695ff5b-cl4wp\" (UID: \"85cee838-2c15-4d06-9c2c-835bcf29d1d8\") " pod="openshift-ingress/e2e-migrate-a5a300cf-gw-openshift-default-d9695ff5b-cl4wp"
Sep 15 13:52:35.695112 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:35.695087    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85cee838-2c15-4d06-9c2c-835bcf29d1d8-credential-socket\") pod \"e2e-migrate-a5a300cf-gw-openshift-default-d9695ff5b-cl4wp\" (UID: \"85cee838-2c15-4d06-9c2c-835bcf29d1d8\") " pod="openshift-ingress/e2e-migrate-a5a300cf-gw-openshift-default-d9695ff5b-cl4wp"
Sep 15 13:52:35.695259 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:35.695229    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85cee838-2c15-4d06-9c2c-835bcf29d1d8-istio-data\") pod \"e2e-migrate-a5a300cf-gw-openshift-default-d9695ff5b-cl4wp\" (UID: \"85cee838-2c15-4d06-9c2c-835bcf29d1d8\") " pod="openshift-ingress/e2e-migrate-a5a300cf-gw-openshift-default-d9695ff5b-cl4wp"
Sep 15 13:52:35.695325 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:35.695282    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85cee838-2c15-4d06-9c2c-835bcf29d1d8-workload-socket\") pod \"e2e-migrate-a5a300cf-gw-openshift-default-d9695ff5b-cl4wp\" (UID: \"85cee838-2c15-4d06-9c2c-835bcf29d1d8\") " pod="openshift-ingress/e2e-migrate-a5a300cf-gw-openshift-default-d9695ff5b-cl4wp"
Sep 15 13:52:35.695509 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:35.695491    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85cee838-2c15-4d06-9c2c-835bcf29d1d8-istiod-ca-cert\") pod \"e2e-migrate-a5a300cf-gw-openshift-default-d9695ff5b-cl4wp\" (UID: \"85cee838-2c15-4d06-9c2c-835bcf29d1d8\") " pod="openshift-ingress/e2e-migrate-a5a300cf-gw-openshift-default-d9695ff5b-cl4wp"
Sep 15 13:52:35.697012 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:35.696989    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85cee838-2c15-4d06-9c2c-835bcf29d1d8-istio-envoy\") pod \"e2e-migrate-a5a300cf-gw-openshift-default-d9695ff5b-cl4wp\" (UID: \"85cee838-2c15-4d06-9c2c-835bcf29d1d8\") " pod="openshift-ingress/e2e-migrate-a5a300cf-gw-openshift-default-d9695ff5b-cl4wp"
Sep 15 13:52:35.697282 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:35.697264    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85cee838-2c15-4d06-9c2c-835bcf29d1d8-istio-podinfo\") pod \"e2e-migrate-a5a300cf-gw-openshift-default-d9695ff5b-cl4wp\" (UID: \"85cee838-2c15-4d06-9c2c-835bcf29d1d8\") " pod="openshift-ingress/e2e-migrate-a5a300cf-gw-openshift-default-d9695ff5b-cl4wp"
Sep 15 13:52:35.703273 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:35.703252    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nm2hx\" (UniqueName: \"kubernetes.io/projected/85cee838-2c15-4d06-9c2c-835bcf29d1d8-kube-api-access-nm2hx\") pod \"e2e-migrate-a5a300cf-gw-openshift-default-d9695ff5b-cl4wp\" (UID: \"85cee838-2c15-4d06-9c2c-835bcf29d1d8\") " pod="openshift-ingress/e2e-migrate-a5a300cf-gw-openshift-default-d9695ff5b-cl4wp"
Sep 15 13:52:35.703456 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:35.703439    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85cee838-2c15-4d06-9c2c-835bcf29d1d8-istio-token\") pod \"e2e-migrate-a5a300cf-gw-openshift-default-d9695ff5b-cl4wp\" (UID: \"85cee838-2c15-4d06-9c2c-835bcf29d1d8\") " pod="openshift-ingress/e2e-migrate-a5a300cf-gw-openshift-default-d9695ff5b-cl4wp"
Sep 15 13:52:35.758437 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:35.758347    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a73b2b61-b492-453e-97ef-d2b2253cc272" path="/var/lib/kubelet/pods/a73b2b61-b492-453e-97ef-d2b2253cc272/volumes"
Sep 15 13:52:35.758791 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:35.758771    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c7bfb401-b4c1-4028-8ebc-86623b0b56cb" path="/var/lib/kubelet/pods/c7bfb401-b4c1-4028-8ebc-86623b0b56cb/volumes"
Sep 15 13:52:35.807573 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:35.807542    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-a5a300cf-gw-openshift-default-d9695ff5b-cl4wp"
Sep 15 13:52:36.099197 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:36.099169    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-a5a300cf-gw-openshift-default-d9695ff5b-cl4wp"]
Sep 15 13:52:36.101720 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:52:36.101688    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85cee838_2c15_4d06_9c2c_835bcf29d1d8.slice/crio-0222f1a27f39b63c73417b37cebdbc22b4473bec46bbe003cc4132299fdf57b3 WatchSource:0}: Error finding container 0222f1a27f39b63c73417b37cebdbc22b4473bec46bbe003cc4132299fdf57b3: Status 404 returned error can't find the container with id 0222f1a27f39b63c73417b37cebdbc22b4473bec46bbe003cc4132299fdf57b3
Sep 15 13:52:36.104216 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:36.104172    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 15 13:52:36.104293 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:36.104266    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 15 13:52:36.104328 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:36.104312    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 15 13:52:37.004450 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:37.004417    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-a5a300cf-gw-openshift-default-d9695ff5b-cl4wp" event={"ID":"85cee838-2c15-4d06-9c2c-835bcf29d1d8","Type":"ContainerStarted","Data":"80029d6278becf43ebf60075363f9c6f61a3d681a9a92157a85018d9b4f5b2a7"}
Sep 15 13:52:37.004602 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:37.004470    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-a5a300cf-gw-openshift-default-d9695ff5b-cl4wp" event={"ID":"85cee838-2c15-4d06-9c2c-835bcf29d1d8","Type":"ContainerStarted","Data":"0222f1a27f39b63c73417b37cebdbc22b4473bec46bbe003cc4132299fdf57b3"}
Sep 15 13:52:37.026492 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:37.026428    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-a5a300cf-gw-openshift-default-d9695ff5b-cl4wp" podStartSLOduration=2.02640817 podStartE2EDuration="2.02640817s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:52:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:52:37.024304871 +0000 UTC m=+843.783431153" watchObservedRunningTime="2026-09-15 13:52:37.02640817 +0000 UTC m=+843.785534457"
Sep 15 13:52:37.808734 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:37.808706    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-a5a300cf-gw-openshift-default-d9695ff5b-cl4wp"
Sep 15 13:52:37.814011 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:37.813989    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-a5a300cf-gw-openshift-default-d9695ff5b-cl4wp"
Sep 15 13:52:38.011601 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:38.011570    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-a5a300cf-gw-openshift-default-d9695ff5b-cl4wp"
Sep 15 13:52:38.012882 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:38.012855    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-a5a300cf-gw-openshift-default-d9695ff5b-cl4wp"
Sep 15 13:52:39.875619 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:39.875588    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8e248304-openshift-default-84c6c598b4-gd56x"
Sep 15 13:52:40.025913 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:40.025883    2578 generic.go:356] "Generic (PLEG): container finished" podID="919cf8d9-0892-49a5-a5c4-7463192b1540" containerID="e17eea9a0ec07f1338654e244704decd138a4a47c2817540f0a106f51f118a87" exitCode=0
Sep 15 13:52:40.026095 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:40.025930    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8e248304-openshift-default-84c6c598b4-gd56x"
Sep 15 13:52:40.026095 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:40.025962    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8e248304-openshift-default-84c6c598b4-gd56x" event={"ID":"919cf8d9-0892-49a5-a5c4-7463192b1540","Type":"ContainerDied","Data":"e17eea9a0ec07f1338654e244704decd138a4a47c2817540f0a106f51f118a87"}
Sep 15 13:52:40.026095 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:40.026018    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8e248304-openshift-default-84c6c598b4-gd56x" event={"ID":"919cf8d9-0892-49a5-a5c4-7463192b1540","Type":"ContainerDied","Data":"c6e8e02c1a09604826092d245de5c1935183a0092054142f08cc018e64b09326"}
Sep 15 13:52:40.026095 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:40.026046    2578 scope.go:117] "RemoveContainer" containerID="e17eea9a0ec07f1338654e244704decd138a4a47c2817540f0a106f51f118a87"
Sep 15 13:52:40.035231 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:40.035214    2578 scope.go:117] "RemoveContainer" containerID="eccca466ec2af5e5b665bf503334dfd93705ec1299f421da79840ca033babb4e"
Sep 15 13:52:40.039467 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:40.039447    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/919cf8d9-0892-49a5-a5c4-7463192b1540-workload-socket\") pod \"919cf8d9-0892-49a5-a5c4-7463192b1540\" (UID: \"919cf8d9-0892-49a5-a5c4-7463192b1540\") "
Sep 15 13:52:40.039561 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:40.039501    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/919cf8d9-0892-49a5-a5c4-7463192b1540-istio-podinfo\") pod \"919cf8d9-0892-49a5-a5c4-7463192b1540\" (UID: \"919cf8d9-0892-49a5-a5c4-7463192b1540\") "
Sep 15 13:52:40.039561 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:40.039536    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/919cf8d9-0892-49a5-a5c4-7463192b1540-istio-token\") pod \"919cf8d9-0892-49a5-a5c4-7463192b1540\" (UID: \"919cf8d9-0892-49a5-a5c4-7463192b1540\") "
Sep 15 13:52:40.039681 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:40.039570    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/919cf8d9-0892-49a5-a5c4-7463192b1540-credential-socket\") pod \"919cf8d9-0892-49a5-a5c4-7463192b1540\" (UID: \"919cf8d9-0892-49a5-a5c4-7463192b1540\") "
Sep 15 13:52:40.039681 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:40.039651    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/919cf8d9-0892-49a5-a5c4-7463192b1540-workload-certs\") pod \"919cf8d9-0892-49a5-a5c4-7463192b1540\" (UID: \"919cf8d9-0892-49a5-a5c4-7463192b1540\") "
Sep 15 13:52:40.039780 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:40.039715    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/919cf8d9-0892-49a5-a5c4-7463192b1540-istio-envoy\") pod \"919cf8d9-0892-49a5-a5c4-7463192b1540\" (UID: \"919cf8d9-0892-49a5-a5c4-7463192b1540\") "
Sep 15 13:52:40.039780 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:40.039722    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/919cf8d9-0892-49a5-a5c4-7463192b1540-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "919cf8d9-0892-49a5-a5c4-7463192b1540" (UID: "919cf8d9-0892-49a5-a5c4-7463192b1540"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:52:40.039780 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:40.039743    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/919cf8d9-0892-49a5-a5c4-7463192b1540-istiod-ca-cert\") pod \"919cf8d9-0892-49a5-a5c4-7463192b1540\" (UID: \"919cf8d9-0892-49a5-a5c4-7463192b1540\") "
Sep 15 13:52:40.039933 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:40.039805    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/919cf8d9-0892-49a5-a5c4-7463192b1540-istio-data\") pod \"919cf8d9-0892-49a5-a5c4-7463192b1540\" (UID: \"919cf8d9-0892-49a5-a5c4-7463192b1540\") "
Sep 15 13:52:40.039933 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:40.039923    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d959c\" (UniqueName: \"kubernetes.io/projected/919cf8d9-0892-49a5-a5c4-7463192b1540-kube-api-access-d959c\") pod \"919cf8d9-0892-49a5-a5c4-7463192b1540\" (UID: \"919cf8d9-0892-49a5-a5c4-7463192b1540\") "
Sep 15 13:52:40.040039 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:40.039936    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/919cf8d9-0892-49a5-a5c4-7463192b1540-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "919cf8d9-0892-49a5-a5c4-7463192b1540" (UID: "919cf8d9-0892-49a5-a5c4-7463192b1540"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:52:40.040039 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:40.039949    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/919cf8d9-0892-49a5-a5c4-7463192b1540-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "919cf8d9-0892-49a5-a5c4-7463192b1540" (UID: "919cf8d9-0892-49a5-a5c4-7463192b1540"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:52:40.040365 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:40.040338    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/919cf8d9-0892-49a5-a5c4-7463192b1540-istio-data" (OuterVolumeSpecName: "istio-data") pod "919cf8d9-0892-49a5-a5c4-7463192b1540" (UID: "919cf8d9-0892-49a5-a5c4-7463192b1540"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:52:40.040494 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:40.040350    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/919cf8d9-0892-49a5-a5c4-7463192b1540-workload-certs\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:52:40.040494 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:40.040394    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/919cf8d9-0892-49a5-a5c4-7463192b1540-workload-socket\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:52:40.040494 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:40.040410    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/919cf8d9-0892-49a5-a5c4-7463192b1540-credential-socket\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:52:40.040494 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:40.040448    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/919cf8d9-0892-49a5-a5c4-7463192b1540-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "919cf8d9-0892-49a5-a5c4-7463192b1540" (UID: "919cf8d9-0892-49a5-a5c4-7463192b1540"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 13:52:40.042382 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:40.042351    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/919cf8d9-0892-49a5-a5c4-7463192b1540-kube-api-access-d959c" (OuterVolumeSpecName: "kube-api-access-d959c") pod "919cf8d9-0892-49a5-a5c4-7463192b1540" (UID: "919cf8d9-0892-49a5-a5c4-7463192b1540"). InnerVolumeSpecName "kube-api-access-d959c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:52:40.042576 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:40.042552    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/919cf8d9-0892-49a5-a5c4-7463192b1540-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "919cf8d9-0892-49a5-a5c4-7463192b1540" (UID: "919cf8d9-0892-49a5-a5c4-7463192b1540"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:52:40.042645 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:40.042628    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/919cf8d9-0892-49a5-a5c4-7463192b1540-istio-token" (OuterVolumeSpecName: "istio-token") pod "919cf8d9-0892-49a5-a5c4-7463192b1540" (UID: "919cf8d9-0892-49a5-a5c4-7463192b1540"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:52:40.042807 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:40.042788    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/919cf8d9-0892-49a5-a5c4-7463192b1540-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "919cf8d9-0892-49a5-a5c4-7463192b1540" (UID: "919cf8d9-0892-49a5-a5c4-7463192b1540"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 13:52:40.045463 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:40.045433    2578 scope.go:117] "RemoveContainer" containerID="e17eea9a0ec07f1338654e244704decd138a4a47c2817540f0a106f51f118a87"
Sep 15 13:52:40.045813 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:52:40.045775    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e17eea9a0ec07f1338654e244704decd138a4a47c2817540f0a106f51f118a87\": container with ID starting with e17eea9a0ec07f1338654e244704decd138a4a47c2817540f0a106f51f118a87 not found: ID does not exist" containerID="e17eea9a0ec07f1338654e244704decd138a4a47c2817540f0a106f51f118a87"
Sep 15 13:52:40.045873 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:40.045821    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e17eea9a0ec07f1338654e244704decd138a4a47c2817540f0a106f51f118a87"} err="failed to get container status \"e17eea9a0ec07f1338654e244704decd138a4a47c2817540f0a106f51f118a87\": rpc error: code = NotFound desc = could not find container \"e17eea9a0ec07f1338654e244704decd138a4a47c2817540f0a106f51f118a87\": container with ID starting with e17eea9a0ec07f1338654e244704decd138a4a47c2817540f0a106f51f118a87 not found: ID does not exist"
Sep 15 13:52:40.045873 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:40.045840    2578 scope.go:117] "RemoveContainer" containerID="eccca466ec2af5e5b665bf503334dfd93705ec1299f421da79840ca033babb4e"
Sep 15 13:52:40.046101 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:52:40.046082    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eccca466ec2af5e5b665bf503334dfd93705ec1299f421da79840ca033babb4e\": container with ID starting with eccca466ec2af5e5b665bf503334dfd93705ec1299f421da79840ca033babb4e not found: ID does not exist" containerID="eccca466ec2af5e5b665bf503334dfd93705ec1299f421da79840ca033babb4e"
Sep 15 13:52:40.046174 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:40.046106    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eccca466ec2af5e5b665bf503334dfd93705ec1299f421da79840ca033babb4e"} err="failed to get container status \"eccca466ec2af5e5b665bf503334dfd93705ec1299f421da79840ca033babb4e\": rpc error: code = NotFound desc = could not find container \"eccca466ec2af5e5b665bf503334dfd93705ec1299f421da79840ca033babb4e\": container with ID starting with eccca466ec2af5e5b665bf503334dfd93705ec1299f421da79840ca033babb4e not found: ID does not exist"
Sep 15 13:52:40.141222 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:40.141193    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/919cf8d9-0892-49a5-a5c4-7463192b1540-istio-envoy\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:52:40.141222 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:40.141219    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/919cf8d9-0892-49a5-a5c4-7463192b1540-istiod-ca-cert\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:52:40.141222 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:40.141227    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/919cf8d9-0892-49a5-a5c4-7463192b1540-istio-data\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:52:40.141517 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:40.141235    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d959c\" (UniqueName: \"kubernetes.io/projected/919cf8d9-0892-49a5-a5c4-7463192b1540-kube-api-access-d959c\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:52:40.141517 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:40.141248    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/919cf8d9-0892-49a5-a5c4-7463192b1540-istio-podinfo\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:52:40.141517 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:40.141261    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/919cf8d9-0892-49a5-a5c4-7463192b1540-istio-token\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:52:40.350249 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:40.350223    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-8e248304-openshift-default-84c6c598b4-gd56x"]
Sep 15 13:52:40.354307 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:40.354285    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-8e248304-openshift-default-84c6c598b4-gd56x"]
Sep 15 13:52:41.034269 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:41.034238    2578 generic.go:356] "Generic (PLEG): container finished" podID="5d43fec5-9d61-43bf-a663-a1341b804332" containerID="aa4cab93d82837f55caaf08fe4dea6d1acc657fbc7512f26283009bdf78cf10c" exitCode=0
Sep 15 13:52:41.034715 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:41.034313    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-2aa332-openshift-default-b94f494dd-x48k9" event={"ID":"5d43fec5-9d61-43bf-a663-a1341b804332","Type":"ContainerDied","Data":"aa4cab93d82837f55caaf08fe4dea6d1acc657fbc7512f26283009bdf78cf10c"}
Sep 15 13:52:41.034761 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:41.034736    2578 scope.go:117] "RemoveContainer" containerID="aa4cab93d82837f55caaf08fe4dea6d1acc657fbc7512f26283009bdf78cf10c"
Sep 15 13:52:41.035921 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:41.035897    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 15 13:52:41.035984 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:41.035962    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 15 13:52:41.036022 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:41.035991    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 15 13:52:41.225507 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:41.225471    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-a5a300cf-57cb548b8b-86qjc"]
Sep 15 13:52:41.226055 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:41.226033    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="919cf8d9-0892-49a5-a5c4-7463192b1540" containerName="istio-proxy"
Sep 15 13:52:41.226107 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:41.226063    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="919cf8d9-0892-49a5-a5c4-7463192b1540" containerName="istio-proxy"
Sep 15 13:52:41.226107 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:41.226091    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="919cf8d9-0892-49a5-a5c4-7463192b1540" containerName="istio-proxy"
Sep 15 13:52:41.226107 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:41.226100    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="919cf8d9-0892-49a5-a5c4-7463192b1540" containerName="istio-proxy"
Sep 15 13:52:41.226268 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:41.226256    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="919cf8d9-0892-49a5-a5c4-7463192b1540" containerName="istio-proxy"
Sep 15 13:52:41.226304 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:41.226271    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="919cf8d9-0892-49a5-a5c4-7463192b1540" containerName="istio-proxy"
Sep 15 13:52:41.228772 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:41.228754    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-a5a300cf-57cb548b8b-86qjc"
Sep 15 13:52:41.231227 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:41.231198    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-a5a300cf\""
Sep 15 13:52:41.231342 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:41.231284    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-a5a300cf-dockercfg-7j9v9\""
Sep 15 13:52:41.237953 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:41.237931    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-a5a300cf-57cb548b8b-86qjc"]
Sep 15 13:52:41.276772 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:41.276743    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-a5a300cf-77d5c8f794-28lv7"]
Sep 15 13:52:41.279184 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:41.279166    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-a5a300cf-77d5c8f794-28lv7"
Sep 15 13:52:41.290998 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:41.290974    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-a5a300cf-77d5c8f794-28lv7"]
Sep 15 13:52:41.354328 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:41.354276    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjzxb\" (UniqueName: \"kubernetes.io/projected/ca42f547-d621-425b-a46a-a1543f1b1494-kube-api-access-bjzxb\") pod \"payload-processing-e2e-migrate-a5a300cf-57cb548b8b-86qjc\" (UID: \"ca42f547-d621-425b-a46a-a1543f1b1494\") " pod="openshift-ingress/payload-processing-e2e-migrate-a5a300cf-57cb548b8b-86qjc"
Sep 15 13:52:41.354546 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:41.354446    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ca42f547-d621-425b-a46a-a1543f1b1494-plugins-config-volume\") pod \"payload-processing-e2e-migrate-a5a300cf-57cb548b8b-86qjc\" (UID: \"ca42f547-d621-425b-a46a-a1543f1b1494\") " pod="openshift-ingress/payload-processing-e2e-migrate-a5a300cf-57cb548b8b-86qjc"
Sep 15 13:52:41.455531 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:41.455497    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjzxb\" (UniqueName: \"kubernetes.io/projected/ca42f547-d621-425b-a46a-a1543f1b1494-kube-api-access-bjzxb\") pod \"payload-processing-e2e-migrate-a5a300cf-57cb548b8b-86qjc\" (UID: \"ca42f547-d621-425b-a46a-a1543f1b1494\") " pod="openshift-ingress/payload-processing-e2e-migrate-a5a300cf-57cb548b8b-86qjc"
Sep 15 13:52:41.455736 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:41.455564    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvbb4\" (UniqueName: \"kubernetes.io/projected/f5609399-f50e-414d-8003-e6fdad8b05c5-kube-api-access-pvbb4\") pod \"payload-pre-processing-e2e-migrate-a5a300cf-77d5c8f794-28lv7\" (UID: \"f5609399-f50e-414d-8003-e6fdad8b05c5\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-a5a300cf-77d5c8f794-28lv7"
Sep 15 13:52:41.455736 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:41.455669    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ca42f547-d621-425b-a46a-a1543f1b1494-plugins-config-volume\") pod \"payload-processing-e2e-migrate-a5a300cf-57cb548b8b-86qjc\" (UID: \"ca42f547-d621-425b-a46a-a1543f1b1494\") " pod="openshift-ingress/payload-processing-e2e-migrate-a5a300cf-57cb548b8b-86qjc"
Sep 15 13:52:41.455736 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:41.455701    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f5609399-f50e-414d-8003-e6fdad8b05c5-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-a5a300cf-77d5c8f794-28lv7\" (UID: \"f5609399-f50e-414d-8003-e6fdad8b05c5\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-a5a300cf-77d5c8f794-28lv7"
Sep 15 13:52:41.456360 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:41.456340    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ca42f547-d621-425b-a46a-a1543f1b1494-plugins-config-volume\") pod \"payload-processing-e2e-migrate-a5a300cf-57cb548b8b-86qjc\" (UID: \"ca42f547-d621-425b-a46a-a1543f1b1494\") " pod="openshift-ingress/payload-processing-e2e-migrate-a5a300cf-57cb548b8b-86qjc"
Sep 15 13:52:41.464698 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:41.464679    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjzxb\" (UniqueName: \"kubernetes.io/projected/ca42f547-d621-425b-a46a-a1543f1b1494-kube-api-access-bjzxb\") pod \"payload-processing-e2e-migrate-a5a300cf-57cb548b8b-86qjc\" (UID: \"ca42f547-d621-425b-a46a-a1543f1b1494\") " pod="openshift-ingress/payload-processing-e2e-migrate-a5a300cf-57cb548b8b-86qjc"
Sep 15 13:52:41.541225 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:41.541142    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-a5a300cf-57cb548b8b-86qjc"
Sep 15 13:52:41.556808 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:41.556762    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvbb4\" (UniqueName: \"kubernetes.io/projected/f5609399-f50e-414d-8003-e6fdad8b05c5-kube-api-access-pvbb4\") pod \"payload-pre-processing-e2e-migrate-a5a300cf-77d5c8f794-28lv7\" (UID: \"f5609399-f50e-414d-8003-e6fdad8b05c5\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-a5a300cf-77d5c8f794-28lv7"
Sep 15 13:52:41.556935 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:41.556808    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f5609399-f50e-414d-8003-e6fdad8b05c5-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-a5a300cf-77d5c8f794-28lv7\" (UID: \"f5609399-f50e-414d-8003-e6fdad8b05c5\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-a5a300cf-77d5c8f794-28lv7"
Sep 15 13:52:41.557698 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:41.557670    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f5609399-f50e-414d-8003-e6fdad8b05c5-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-a5a300cf-77d5c8f794-28lv7\" (UID: \"f5609399-f50e-414d-8003-e6fdad8b05c5\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-a5a300cf-77d5c8f794-28lv7"
Sep 15 13:52:41.566169 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:41.566111    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvbb4\" (UniqueName: \"kubernetes.io/projected/f5609399-f50e-414d-8003-e6fdad8b05c5-kube-api-access-pvbb4\") pod \"payload-pre-processing-e2e-migrate-a5a300cf-77d5c8f794-28lv7\" (UID: \"f5609399-f50e-414d-8003-e6fdad8b05c5\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-a5a300cf-77d5c8f794-28lv7"
Sep 15 13:52:41.590311 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:41.590277    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-a5a300cf-77d5c8f794-28lv7"
Sep 15 13:52:41.758566 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:41.758532    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="919cf8d9-0892-49a5-a5c4-7463192b1540" path="/var/lib/kubelet/pods/919cf8d9-0892-49a5-a5c4-7463192b1540/volumes"
Sep 15 13:52:41.822548 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:41.822522    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-a5a300cf-57cb548b8b-86qjc"]
Sep 15 13:52:41.824234 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:52:41.824206    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca42f547_d621_425b_a46a_a1543f1b1494.slice/crio-dff4859cb2949dfde72f8188bc1d578b01a0a8c146baa5f547a0518c613bd59c WatchSource:0}: Error finding container dff4859cb2949dfde72f8188bc1d578b01a0a8c146baa5f547a0518c613bd59c: Status 404 returned error can't find the container with id dff4859cb2949dfde72f8188bc1d578b01a0a8c146baa5f547a0518c613bd59c
Sep 15 13:52:41.876912 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:41.876825    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-a5a300cf-77d5c8f794-28lv7"]
Sep 15 13:52:42.042039 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:42.042003    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-2aa332-openshift-default-b94f494dd-x48k9" event={"ID":"5d43fec5-9d61-43bf-a663-a1341b804332","Type":"ContainerStarted","Data":"9c364ab606b7861e0ab3b529f118cdf3034a59e46df126e10022a925b4b4bbb1"}
Sep 15 13:52:42.043636 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:42.043613    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-a5a300cf-77d5c8f794-28lv7" event={"ID":"f5609399-f50e-414d-8003-e6fdad8b05c5","Type":"ContainerStarted","Data":"2b01d595f0bf84809eed5ecd7aeabf89d8c6d03cddfb915dfe4e5db89a393b4c"}
Sep 15 13:52:42.043774 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:42.043664    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-a5a300cf-77d5c8f794-28lv7"
Sep 15 13:52:42.043774 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:42.043688    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-a5a300cf-77d5c8f794-28lv7" event={"ID":"f5609399-f50e-414d-8003-e6fdad8b05c5","Type":"ContainerStarted","Data":"b4253dee293831c81c46a1cecdf987ad5ff3d35e9bba9041422f36ba609d0f39"}
Sep 15 13:52:42.045303 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:42.045283    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-a5a300cf-57cb548b8b-86qjc" event={"ID":"ca42f547-d621-425b-a46a-a1543f1b1494","Type":"ContainerStarted","Data":"1c34934deb8592575f459f8c432504d0cdcd028bab1116b56040455b5a3f67f9"}
Sep 15 13:52:42.045400 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:42.045317    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-a5a300cf-57cb548b8b-86qjc" event={"ID":"ca42f547-d621-425b-a46a-a1543f1b1494","Type":"ContainerStarted","Data":"dff4859cb2949dfde72f8188bc1d578b01a0a8c146baa5f547a0518c613bd59c"}
Sep 15 13:52:42.045400 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:42.045339    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-a5a300cf-57cb548b8b-86qjc"
Sep 15 13:52:42.099374 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:42.099271    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-a5a300cf-57cb548b8b-86qjc" podStartSLOduration=1.099253328 podStartE2EDuration="1.099253328s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:52:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:52:42.079445243 +0000 UTC m=+848.838571530" watchObservedRunningTime="2026-09-15 13:52:42.099253328 +0000 UTC m=+848.858379614"
Sep 15 13:52:42.099374 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:42.099355    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-a5a300cf-77d5c8f794-28lv7" podStartSLOduration=1.099350509 podStartE2EDuration="1.099350509s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:52:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:52:42.095207169 +0000 UTC m=+848.854333468" watchObservedRunningTime="2026-09-15 13:52:42.099350509 +0000 UTC m=+848.858476795"
Sep 15 13:52:42.595519 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:42.595456    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-2aa332-openshift-default-b94f494dd-x48k9"
Sep 15 13:52:42.596863 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:42.596834    2578 patch_prober.go:28] interesting pod/e2e-inf-b-2aa332-openshift-default-b94f494dd-x48k9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Sep 15 13:52:42.597009 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:42.596894    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-2aa332-openshift-default-b94f494dd-x48k9" podUID="5d43fec5-9d61-43bf-a663-a1341b804332" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Sep 15 13:52:42.781685 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:42.781647    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-2aa332-openshift-default-b94f494dd-x48k9"
Sep 15 13:52:43.595657 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:43.595617    2578 patch_prober.go:28] interesting pod/e2e-inf-b-2aa332-openshift-default-b94f494dd-x48k9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Sep 15 13:52:43.596063 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:43.595687    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-2aa332-openshift-default-b94f494dd-x48k9" podUID="5d43fec5-9d61-43bf-a663-a1341b804332" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Sep 15 13:52:44.595981 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:44.595946    2578 patch_prober.go:28] interesting pod/e2e-inf-b-2aa332-openshift-default-b94f494dd-x48k9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Sep 15 13:52:44.596425 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:44.596003    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-2aa332-openshift-default-b94f494dd-x48k9" podUID="5d43fec5-9d61-43bf-a663-a1341b804332" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Sep 15 13:52:45.595526 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:45.595485    2578 patch_prober.go:28] interesting pod/e2e-inf-b-2aa332-openshift-default-b94f494dd-x48k9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Sep 15 13:52:45.595699 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:45.595552    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-2aa332-openshift-default-b94f494dd-x48k9" podUID="5d43fec5-9d61-43bf-a663-a1341b804332" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Sep 15 13:52:46.595459 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:46.595429    2578 patch_prober.go:28] interesting pod/e2e-inf-b-2aa332-openshift-default-b94f494dd-x48k9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Sep 15 13:52:46.595842 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:46.595479    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-2aa332-openshift-default-b94f494dd-x48k9" podUID="5d43fec5-9d61-43bf-a663-a1341b804332" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Sep 15 13:52:47.599500 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:47.599464    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-2aa332-openshift-default-b94f494dd-x48k9"
Sep 15 13:52:47.600368 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:47.600349    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-2aa332-openshift-default-b94f494dd-x48k9"
Sep 15 13:52:53.054545 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:53.054518    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-a5a300cf-57cb548b8b-86qjc"
Sep 15 13:52:53.054950 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:52:53.054584    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-a5a300cf-77d5c8f794-28lv7"
Sep 15 13:53:01.176467 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:01.176433    2578 generic.go:356] "Generic (PLEG): container finished" podID="85cee838-2c15-4d06-9c2c-835bcf29d1d8" containerID="80029d6278becf43ebf60075363f9c6f61a3d681a9a92157a85018d9b4f5b2a7" exitCode=0
Sep 15 13:53:01.176936 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:01.176507    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-a5a300cf-gw-openshift-default-d9695ff5b-cl4wp" event={"ID":"85cee838-2c15-4d06-9c2c-835bcf29d1d8","Type":"ContainerDied","Data":"80029d6278becf43ebf60075363f9c6f61a3d681a9a92157a85018d9b4f5b2a7"}
Sep 15 13:53:01.176936 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:01.176875    2578 scope.go:117] "RemoveContainer" containerID="80029d6278becf43ebf60075363f9c6f61a3d681a9a92157a85018d9b4f5b2a7"
Sep 15 13:53:01.178074 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:01.178047    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 15 13:53:01.178144 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:01.178118    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 15 13:53:01.178186 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:01.178170    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 15 13:53:02.188629 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:02.188588    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-a5a300cf-gw-openshift-default-d9695ff5b-cl4wp" event={"ID":"85cee838-2c15-4d06-9c2c-835bcf29d1d8","Type":"ContainerStarted","Data":"e839006154fc5caa777561ef509cea1c028bfd615f24dd9dbd29de56b868f1e8"}
Sep 15 13:53:02.807746 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:02.807711    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-a5a300cf-gw-openshift-default-d9695ff5b-cl4wp"
Sep 15 13:53:02.808091 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:02.808065    2578 patch_prober.go:28] interesting pod/e2e-migrate-a5a300cf-gw-openshift-default-d9695ff5b-cl4wp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Sep 15 13:53:02.808239 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:02.808162    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-a5a300cf-gw-openshift-default-d9695ff5b-cl4wp" podUID="85cee838-2c15-4d06-9c2c-835bcf29d1d8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Sep 15 13:53:03.457803 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:03.457765    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a5a300cf-dh6wb"]
Sep 15 13:53:03.461632 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:03.461601    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a5a300cf-dh6wb"
Sep 15 13:53:03.464560 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:03.464535    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 13:53:03.464734 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:03.464562    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 15 13:53:03.465351 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:03.465328    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qzmkv\""
Sep 15 13:53:03.470326 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:03.470299    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a5a300cf-dh6wb"]
Sep 15 13:53:03.595833 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:03.595797    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/62a1edf7-8854-4668-99cc-f105df47ad21-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-a5a300cf-dh6wb\" (UID: \"62a1edf7-8854-4668-99cc-f105df47ad21\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a5a300cf-dh6wb"
Sep 15 13:53:03.596028 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:03.595858    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pc7j\" (UniqueName: \"kubernetes.io/projected/62a1edf7-8854-4668-99cc-f105df47ad21-kube-api-access-6pc7j\") pod \"maas-api-revoke-keys-e2e-migrate-a5a300cf-dh6wb\" (UID: \"62a1edf7-8854-4668-99cc-f105df47ad21\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a5a300cf-dh6wb"
Sep 15 13:53:03.697251 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:03.697218    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/62a1edf7-8854-4668-99cc-f105df47ad21-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-a5a300cf-dh6wb\" (UID: \"62a1edf7-8854-4668-99cc-f105df47ad21\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a5a300cf-dh6wb"
Sep 15 13:53:03.697432 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:03.697274    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6pc7j\" (UniqueName: \"kubernetes.io/projected/62a1edf7-8854-4668-99cc-f105df47ad21-kube-api-access-6pc7j\") pod \"maas-api-revoke-keys-e2e-migrate-a5a300cf-dh6wb\" (UID: \"62a1edf7-8854-4668-99cc-f105df47ad21\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a5a300cf-dh6wb"
Sep 15 13:53:03.697874 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:03.697853    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/62a1edf7-8854-4668-99cc-f105df47ad21-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-a5a300cf-dh6wb\" (UID: \"62a1edf7-8854-4668-99cc-f105df47ad21\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a5a300cf-dh6wb"
Sep 15 13:53:03.704996 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:03.704965    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pc7j\" (UniqueName: \"kubernetes.io/projected/62a1edf7-8854-4668-99cc-f105df47ad21-kube-api-access-6pc7j\") pod \"maas-api-revoke-keys-e2e-migrate-a5a300cf-dh6wb\" (UID: \"62a1edf7-8854-4668-99cc-f105df47ad21\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a5a300cf-dh6wb"
Sep 15 13:53:03.782181 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:03.782149    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a5a300cf-dh6wb"
Sep 15 13:53:03.808323 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:03.808287    2578 patch_prober.go:28] interesting pod/e2e-migrate-a5a300cf-gw-openshift-default-d9695ff5b-cl4wp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Sep 15 13:53:03.808491 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:03.808355    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-a5a300cf-gw-openshift-default-d9695ff5b-cl4wp" podUID="85cee838-2c15-4d06-9c2c-835bcf29d1d8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Sep 15 13:53:04.058362 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:04.058334    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a5a300cf-dh6wb"]
Sep 15 13:53:04.059908 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:53:04.059886    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62a1edf7_8854_4668_99cc_f105df47ad21.slice/crio-1be3f159b2a006cd3b77c8a2a6d2180c17c58635b6e6a968b48c74df73f495df WatchSource:0}: Error finding container 1be3f159b2a006cd3b77c8a2a6d2180c17c58635b6e6a968b48c74df73f495df: Status 404 returned error can't find the container with id 1be3f159b2a006cd3b77c8a2a6d2180c17c58635b6e6a968b48c74df73f495df
Sep 15 13:53:04.201305 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:04.201267    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a5a300cf-dh6wb" event={"ID":"62a1edf7-8854-4668-99cc-f105df47ad21","Type":"ContainerStarted","Data":"1be3f159b2a006cd3b77c8a2a6d2180c17c58635b6e6a968b48c74df73f495df"}
Sep 15 13:53:04.808175 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:04.808105    2578 patch_prober.go:28] interesting pod/e2e-migrate-a5a300cf-gw-openshift-default-d9695ff5b-cl4wp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Sep 15 13:53:04.808597 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:04.808196    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-a5a300cf-gw-openshift-default-d9695ff5b-cl4wp" podUID="85cee838-2c15-4d06-9c2c-835bcf29d1d8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Sep 15 13:53:05.208162 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:05.208107    2578 generic.go:356] "Generic (PLEG): container finished" podID="62a1edf7-8854-4668-99cc-f105df47ad21" containerID="bf0bddb43d703038fc03f13978b300c2c813eed681f75b7bcbf1b6736d65c151" exitCode=0
Sep 15 13:53:05.208314 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:05.208184    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a5a300cf-dh6wb" event={"ID":"62a1edf7-8854-4668-99cc-f105df47ad21","Type":"ContainerDied","Data":"bf0bddb43d703038fc03f13978b300c2c813eed681f75b7bcbf1b6736d65c151"}
Sep 15 13:53:05.808679 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:05.808639    2578 patch_prober.go:28] interesting pod/e2e-migrate-a5a300cf-gw-openshift-default-d9695ff5b-cl4wp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Sep 15 13:53:05.809069 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:05.808697    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-a5a300cf-gw-openshift-default-d9695ff5b-cl4wp" podUID="85cee838-2c15-4d06-9c2c-835bcf29d1d8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Sep 15 13:53:06.391850 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:06.391823    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a5a300cf-dh6wb"
Sep 15 13:53:06.526729 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:06.526703    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6pc7j\" (UniqueName: \"kubernetes.io/projected/62a1edf7-8854-4668-99cc-f105df47ad21-kube-api-access-6pc7j\") pod \"62a1edf7-8854-4668-99cc-f105df47ad21\" (UID: \"62a1edf7-8854-4668-99cc-f105df47ad21\") "
Sep 15 13:53:06.526883 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:06.526833    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/62a1edf7-8854-4668-99cc-f105df47ad21-maas-api-service-ca\") pod \"62a1edf7-8854-4668-99cc-f105df47ad21\" (UID: \"62a1edf7-8854-4668-99cc-f105df47ad21\") "
Sep 15 13:53:06.527209 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:06.527171    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62a1edf7-8854-4668-99cc-f105df47ad21-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "62a1edf7-8854-4668-99cc-f105df47ad21" (UID: "62a1edf7-8854-4668-99cc-f105df47ad21"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 13:53:06.527567 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:06.527545    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/62a1edf7-8854-4668-99cc-f105df47ad21-maas-api-service-ca\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:53:06.528924 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:06.528904    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62a1edf7-8854-4668-99cc-f105df47ad21-kube-api-access-6pc7j" (OuterVolumeSpecName: "kube-api-access-6pc7j") pod "62a1edf7-8854-4668-99cc-f105df47ad21" (UID: "62a1edf7-8854-4668-99cc-f105df47ad21"). InnerVolumeSpecName "kube-api-access-6pc7j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:53:06.628888 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:06.628856    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6pc7j\" (UniqueName: \"kubernetes.io/projected/62a1edf7-8854-4668-99cc-f105df47ad21-kube-api-access-6pc7j\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:53:06.808253 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:06.808163    2578 patch_prober.go:28] interesting pod/e2e-migrate-a5a300cf-gw-openshift-default-d9695ff5b-cl4wp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Sep 15 13:53:06.808253 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:06.808228    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-a5a300cf-gw-openshift-default-d9695ff5b-cl4wp" podUID="85cee838-2c15-4d06-9c2c-835bcf29d1d8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Sep 15 13:53:07.221986 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:07.221900    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a5a300cf-dh6wb"
Sep 15 13:53:07.221986 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:07.221938    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a5a300cf-dh6wb" event={"ID":"62a1edf7-8854-4668-99cc-f105df47ad21","Type":"ContainerDied","Data":"1be3f159b2a006cd3b77c8a2a6d2180c17c58635b6e6a968b48c74df73f495df"}
Sep 15 13:53:07.221986 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:07.221983    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1be3f159b2a006cd3b77c8a2a6d2180c17c58635b6e6a968b48c74df73f495df"
Sep 15 13:53:07.812748 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:07.812717    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-a5a300cf-gw-openshift-default-d9695ff5b-cl4wp"
Sep 15 13:53:07.813176 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:07.813153    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-a5a300cf-gw-openshift-default-d9695ff5b-cl4wp"
Sep 15 13:53:07.813711 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:07.813695    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-a5a300cf-gw-openshift-default-d9695ff5b-cl4wp"
Sep 15 13:53:10.369203 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:10.369158    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-a5a300cf-57cb548b8b-86qjc"]
Sep 15 13:53:10.370000 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:10.369965    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-a5a300cf-57cb548b8b-86qjc" podUID="ca42f547-d621-425b-a46a-a1543f1b1494" containerName="payload-processing" containerID="cri-o://1c34934deb8592575f459f8c432504d0cdcd028bab1116b56040455b5a3f67f9" gracePeriod=30
Sep 15 13:53:10.377434 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:10.377409    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-a5a300cf-77d5c8f794-28lv7"]
Sep 15 13:53:10.377623 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:10.377602    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-a5a300cf-77d5c8f794-28lv7" podUID="f5609399-f50e-414d-8003-e6fdad8b05c5" containerName="payload-pre-processing" containerID="cri-o://2b01d595f0bf84809eed5ecd7aeabf89d8c6d03cddfb915dfe4e5db89a393b4c" gracePeriod=30
Sep 15 13:53:10.544914 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:10.544846    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a5a300cf-dh6wb"]
Sep 15 13:53:10.547691 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:10.547667    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a5a300cf-dh6wb"]
Sep 15 13:53:10.626956 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:10.626888    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-a5a300cf-57cb548b8b-86qjc"
Sep 15 13:53:10.669099 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:10.669065    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-a5a300cf-77d5c8f794-28lv7"
Sep 15 13:53:10.669273 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:10.669187    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-a5a300cf-gw-openshift-default-d9695ff5b-cl4wp"]
Sep 15 13:53:10.669624 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:10.669590    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-a5a300cf-gw-openshift-default-d9695ff5b-cl4wp" podUID="85cee838-2c15-4d06-9c2c-835bcf29d1d8" containerName="istio-proxy" containerID="cri-o://e839006154fc5caa777561ef509cea1c028bfd615f24dd9dbd29de56b868f1e8" gracePeriod=30
Sep 15 13:53:10.775158 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:10.773558    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f5609399-f50e-414d-8003-e6fdad8b05c5-plugins-config-volume\") pod \"f5609399-f50e-414d-8003-e6fdad8b05c5\" (UID: \"f5609399-f50e-414d-8003-e6fdad8b05c5\") "
Sep 15 13:53:10.775158 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:10.773616    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pvbb4\" (UniqueName: \"kubernetes.io/projected/f5609399-f50e-414d-8003-e6fdad8b05c5-kube-api-access-pvbb4\") pod \"f5609399-f50e-414d-8003-e6fdad8b05c5\" (UID: \"f5609399-f50e-414d-8003-e6fdad8b05c5\") "
Sep 15 13:53:10.775158 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:10.773669    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bjzxb\" (UniqueName: \"kubernetes.io/projected/ca42f547-d621-425b-a46a-a1543f1b1494-kube-api-access-bjzxb\") pod \"ca42f547-d621-425b-a46a-a1543f1b1494\" (UID: \"ca42f547-d621-425b-a46a-a1543f1b1494\") "
Sep 15 13:53:10.775158 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:10.773748    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ca42f547-d621-425b-a46a-a1543f1b1494-plugins-config-volume\") pod \"ca42f547-d621-425b-a46a-a1543f1b1494\" (UID: \"ca42f547-d621-425b-a46a-a1543f1b1494\") "
Sep 15 13:53:10.775158 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:10.774502    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca42f547-d621-425b-a46a-a1543f1b1494-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ca42f547-d621-425b-a46a-a1543f1b1494" (UID: "ca42f547-d621-425b-a46a-a1543f1b1494"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 13:53:10.775158 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:10.774862    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f5609399-f50e-414d-8003-e6fdad8b05c5-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f5609399-f50e-414d-8003-e6fdad8b05c5" (UID: "f5609399-f50e-414d-8003-e6fdad8b05c5"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 13:53:10.777781 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:10.777746    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca42f547-d621-425b-a46a-a1543f1b1494-kube-api-access-bjzxb" (OuterVolumeSpecName: "kube-api-access-bjzxb") pod "ca42f547-d621-425b-a46a-a1543f1b1494" (UID: "ca42f547-d621-425b-a46a-a1543f1b1494"). InnerVolumeSpecName "kube-api-access-bjzxb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:53:10.778274 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:10.778244    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5609399-f50e-414d-8003-e6fdad8b05c5-kube-api-access-pvbb4" (OuterVolumeSpecName: "kube-api-access-pvbb4") pod "f5609399-f50e-414d-8003-e6fdad8b05c5" (UID: "f5609399-f50e-414d-8003-e6fdad8b05c5"). InnerVolumeSpecName "kube-api-access-pvbb4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:53:10.874890 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:10.874851    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f5609399-f50e-414d-8003-e6fdad8b05c5-plugins-config-volume\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:53:10.874890 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:10.874886    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pvbb4\" (UniqueName: \"kubernetes.io/projected/f5609399-f50e-414d-8003-e6fdad8b05c5-kube-api-access-pvbb4\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:53:10.875194 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:10.874900    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bjzxb\" (UniqueName: \"kubernetes.io/projected/ca42f547-d621-425b-a46a-a1543f1b1494-kube-api-access-bjzxb\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:53:10.875194 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:10.874916    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ca42f547-d621-425b-a46a-a1543f1b1494-plugins-config-volume\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:53:11.246390 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:11.246352    2578 generic.go:356] "Generic (PLEG): container finished" podID="f5609399-f50e-414d-8003-e6fdad8b05c5" containerID="2b01d595f0bf84809eed5ecd7aeabf89d8c6d03cddfb915dfe4e5db89a393b4c" exitCode=0
Sep 15 13:53:11.246601 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:11.246397    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-a5a300cf-77d5c8f794-28lv7"
Sep 15 13:53:11.246601 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:11.246431    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-a5a300cf-77d5c8f794-28lv7" event={"ID":"f5609399-f50e-414d-8003-e6fdad8b05c5","Type":"ContainerDied","Data":"2b01d595f0bf84809eed5ecd7aeabf89d8c6d03cddfb915dfe4e5db89a393b4c"}
Sep 15 13:53:11.246601 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:11.246478    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-a5a300cf-77d5c8f794-28lv7" event={"ID":"f5609399-f50e-414d-8003-e6fdad8b05c5","Type":"ContainerDied","Data":"b4253dee293831c81c46a1cecdf987ad5ff3d35e9bba9041422f36ba609d0f39"}
Sep 15 13:53:11.246601 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:11.246504    2578 scope.go:117] "RemoveContainer" containerID="2b01d595f0bf84809eed5ecd7aeabf89d8c6d03cddfb915dfe4e5db89a393b4c"
Sep 15 13:53:11.247873 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:11.247845    2578 generic.go:356] "Generic (PLEG): container finished" podID="ca42f547-d621-425b-a46a-a1543f1b1494" containerID="1c34934deb8592575f459f8c432504d0cdcd028bab1116b56040455b5a3f67f9" exitCode=0
Sep 15 13:53:11.247983 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:11.247879    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-a5a300cf-57cb548b8b-86qjc" event={"ID":"ca42f547-d621-425b-a46a-a1543f1b1494","Type":"ContainerDied","Data":"1c34934deb8592575f459f8c432504d0cdcd028bab1116b56040455b5a3f67f9"}
Sep 15 13:53:11.247983 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:11.247907    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-a5a300cf-57cb548b8b-86qjc"
Sep 15 13:53:11.247983 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:11.247945    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-a5a300cf-57cb548b8b-86qjc" event={"ID":"ca42f547-d621-425b-a46a-a1543f1b1494","Type":"ContainerDied","Data":"dff4859cb2949dfde72f8188bc1d578b01a0a8c146baa5f547a0518c613bd59c"}
Sep 15 13:53:11.259319 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:11.259303    2578 scope.go:117] "RemoveContainer" containerID="2b01d595f0bf84809eed5ecd7aeabf89d8c6d03cddfb915dfe4e5db89a393b4c"
Sep 15 13:53:11.259616 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:53:11.259591    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b01d595f0bf84809eed5ecd7aeabf89d8c6d03cddfb915dfe4e5db89a393b4c\": container with ID starting with 2b01d595f0bf84809eed5ecd7aeabf89d8c6d03cddfb915dfe4e5db89a393b4c not found: ID does not exist" containerID="2b01d595f0bf84809eed5ecd7aeabf89d8c6d03cddfb915dfe4e5db89a393b4c"
Sep 15 13:53:11.259705 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:11.259622    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b01d595f0bf84809eed5ecd7aeabf89d8c6d03cddfb915dfe4e5db89a393b4c"} err="failed to get container status \"2b01d595f0bf84809eed5ecd7aeabf89d8c6d03cddfb915dfe4e5db89a393b4c\": rpc error: code = NotFound desc = could not find container \"2b01d595f0bf84809eed5ecd7aeabf89d8c6d03cddfb915dfe4e5db89a393b4c\": container with ID starting with 2b01d595f0bf84809eed5ecd7aeabf89d8c6d03cddfb915dfe4e5db89a393b4c not found: ID does not exist"
Sep 15 13:53:11.259705 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:11.259640    2578 scope.go:117] "RemoveContainer" containerID="1c34934deb8592575f459f8c432504d0cdcd028bab1116b56040455b5a3f67f9"
Sep 15 13:53:11.267715 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:11.267698    2578 scope.go:117] "RemoveContainer" containerID="1c34934deb8592575f459f8c432504d0cdcd028bab1116b56040455b5a3f67f9"
Sep 15 13:53:11.267962 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:53:11.267944    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c34934deb8592575f459f8c432504d0cdcd028bab1116b56040455b5a3f67f9\": container with ID starting with 1c34934deb8592575f459f8c432504d0cdcd028bab1116b56040455b5a3f67f9 not found: ID does not exist" containerID="1c34934deb8592575f459f8c432504d0cdcd028bab1116b56040455b5a3f67f9"
Sep 15 13:53:11.268010 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:11.267968    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c34934deb8592575f459f8c432504d0cdcd028bab1116b56040455b5a3f67f9"} err="failed to get container status \"1c34934deb8592575f459f8c432504d0cdcd028bab1116b56040455b5a3f67f9\": rpc error: code = NotFound desc = could not find container \"1c34934deb8592575f459f8c432504d0cdcd028bab1116b56040455b5a3f67f9\": container with ID starting with 1c34934deb8592575f459f8c432504d0cdcd028bab1116b56040455b5a3f67f9 not found: ID does not exist"
Sep 15 13:53:11.282881 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:11.282861    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-a5a300cf-57cb548b8b-86qjc"]
Sep 15 13:53:11.288887 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:11.288866    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-a5a300cf-57cb548b8b-86qjc"]
Sep 15 13:53:11.298589 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:11.298561    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-a5a300cf-77d5c8f794-28lv7"]
Sep 15 13:53:11.308614 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:11.308593    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-a5a300cf-77d5c8f794-28lv7"]
Sep 15 13:53:11.413224 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:11.413195    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-707dcc5c-openshift-default-77c978f868-64lt8"]
Sep 15 13:53:11.413756 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:11.413736    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca42f547-d621-425b-a46a-a1543f1b1494" containerName="payload-processing"
Sep 15 13:53:11.413840 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:11.413758    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca42f547-d621-425b-a46a-a1543f1b1494" containerName="payload-processing"
Sep 15 13:53:11.413840 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:11.413773    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5609399-f50e-414d-8003-e6fdad8b05c5" containerName="payload-pre-processing"
Sep 15 13:53:11.413840 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:11.413781    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5609399-f50e-414d-8003-e6fdad8b05c5" containerName="payload-pre-processing"
Sep 15 13:53:11.413840 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:11.413800    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62a1edf7-8854-4668-99cc-f105df47ad21" containerName="revoke-keys"
Sep 15 13:53:11.413840 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:11.413809    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="62a1edf7-8854-4668-99cc-f105df47ad21" containerName="revoke-keys"
Sep 15 13:53:11.414160 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:11.413916    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5609399-f50e-414d-8003-e6fdad8b05c5" containerName="payload-pre-processing"
Sep 15 13:53:11.414160 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:11.413930    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="62a1edf7-8854-4668-99cc-f105df47ad21" containerName="revoke-keys"
Sep 15 13:53:11.414160 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:11.413942    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca42f547-d621-425b-a46a-a1543f1b1494" containerName="payload-processing"
Sep 15 13:53:11.417149 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:11.417114    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-707dcc5c-openshift-default-77c978f868-64lt8"
Sep 15 13:53:11.419541 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:11.419521    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-707dcc5c-openshift-default-dockercfg-f62jg\""
Sep 15 13:53:11.431060 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:11.431036    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-707dcc5c-openshift-default-77c978f868-64lt8"]
Sep 15 13:53:11.480736 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:11.480706    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/616223cb-65a2-4eb8-bdc9-8fe948702e5b-istiod-ca-cert\") pod \"e2e-ait-707dcc5c-openshift-default-77c978f868-64lt8\" (UID: \"616223cb-65a2-4eb8-bdc9-8fe948702e5b\") " pod="openshift-ingress/e2e-ait-707dcc5c-openshift-default-77c978f868-64lt8"
Sep 15 13:53:11.480882 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:11.480772    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/616223cb-65a2-4eb8-bdc9-8fe948702e5b-workload-socket\") pod \"e2e-ait-707dcc5c-openshift-default-77c978f868-64lt8\" (UID: \"616223cb-65a2-4eb8-bdc9-8fe948702e5b\") " pod="openshift-ingress/e2e-ait-707dcc5c-openshift-default-77c978f868-64lt8"
Sep 15 13:53:11.480882 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:11.480814    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/616223cb-65a2-4eb8-bdc9-8fe948702e5b-credential-socket\") pod \"e2e-ait-707dcc5c-openshift-default-77c978f868-64lt8\" (UID: \"616223cb-65a2-4eb8-bdc9-8fe948702e5b\") " pod="openshift-ingress/e2e-ait-707dcc5c-openshift-default-77c978f868-64lt8"
Sep 15 13:53:11.480960 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:11.480894    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/616223cb-65a2-4eb8-bdc9-8fe948702e5b-istio-envoy\") pod \"e2e-ait-707dcc5c-openshift-default-77c978f868-64lt8\" (UID: \"616223cb-65a2-4eb8-bdc9-8fe948702e5b\") " pod="openshift-ingress/e2e-ait-707dcc5c-openshift-default-77c978f868-64lt8"
Sep 15 13:53:11.480960 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:11.480926    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/616223cb-65a2-4eb8-bdc9-8fe948702e5b-istio-podinfo\") pod \"e2e-ait-707dcc5c-openshift-default-77c978f868-64lt8\" (UID: \"616223cb-65a2-4eb8-bdc9-8fe948702e5b\") " pod="openshift-ingress/e2e-ait-707dcc5c-openshift-default-77c978f868-64lt8"
Sep 15 13:53:11.480960 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:11.480954    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/616223cb-65a2-4eb8-bdc9-8fe948702e5b-istio-data\") pod \"e2e-ait-707dcc5c-openshift-default-77c978f868-64lt8\" (UID: \"616223cb-65a2-4eb8-bdc9-8fe948702e5b\") " pod="openshift-ingress/e2e-ait-707dcc5c-openshift-default-77c978f868-64lt8"
Sep 15 13:53:11.481056 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:11.480996    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/616223cb-65a2-4eb8-bdc9-8fe948702e5b-istio-token\") pod \"e2e-ait-707dcc5c-openshift-default-77c978f868-64lt8\" (UID: \"616223cb-65a2-4eb8-bdc9-8fe948702e5b\") " pod="openshift-ingress/e2e-ait-707dcc5c-openshift-default-77c978f868-64lt8"
Sep 15 13:53:11.481056 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:11.481033    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/616223cb-65a2-4eb8-bdc9-8fe948702e5b-workload-certs\") pod \"e2e-ait-707dcc5c-openshift-default-77c978f868-64lt8\" (UID: \"616223cb-65a2-4eb8-bdc9-8fe948702e5b\") " pod="openshift-ingress/e2e-ait-707dcc5c-openshift-default-77c978f868-64lt8"
Sep 15 13:53:11.481056 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:11.481050    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kw5pf\" (UniqueName: \"kubernetes.io/projected/616223cb-65a2-4eb8-bdc9-8fe948702e5b-kube-api-access-kw5pf\") pod \"e2e-ait-707dcc5c-openshift-default-77c978f868-64lt8\" (UID: \"616223cb-65a2-4eb8-bdc9-8fe948702e5b\") " pod="openshift-ingress/e2e-ait-707dcc5c-openshift-default-77c978f868-64lt8"
Sep 15 13:53:11.581732 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:11.581689    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/616223cb-65a2-4eb8-bdc9-8fe948702e5b-istio-envoy\") pod \"e2e-ait-707dcc5c-openshift-default-77c978f868-64lt8\" (UID: \"616223cb-65a2-4eb8-bdc9-8fe948702e5b\") " pod="openshift-ingress/e2e-ait-707dcc5c-openshift-default-77c978f868-64lt8"
Sep 15 13:53:11.581732 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:11.581730    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/616223cb-65a2-4eb8-bdc9-8fe948702e5b-istio-podinfo\") pod \"e2e-ait-707dcc5c-openshift-default-77c978f868-64lt8\" (UID: \"616223cb-65a2-4eb8-bdc9-8fe948702e5b\") " pod="openshift-ingress/e2e-ait-707dcc5c-openshift-default-77c978f868-64lt8"
Sep 15 13:53:11.581986 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:11.581850    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/616223cb-65a2-4eb8-bdc9-8fe948702e5b-istio-data\") pod \"e2e-ait-707dcc5c-openshift-default-77c978f868-64lt8\" (UID: \"616223cb-65a2-4eb8-bdc9-8fe948702e5b\") " pod="openshift-ingress/e2e-ait-707dcc5c-openshift-default-77c978f868-64lt8"
Sep 15 13:53:11.581986 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:11.581909    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/616223cb-65a2-4eb8-bdc9-8fe948702e5b-istio-token\") pod \"e2e-ait-707dcc5c-openshift-default-77c978f868-64lt8\" (UID: \"616223cb-65a2-4eb8-bdc9-8fe948702e5b\") " pod="openshift-ingress/e2e-ait-707dcc5c-openshift-default-77c978f868-64lt8"
Sep 15 13:53:11.581986 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:11.581932    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/616223cb-65a2-4eb8-bdc9-8fe948702e5b-workload-certs\") pod \"e2e-ait-707dcc5c-openshift-default-77c978f868-64lt8\" (UID: \"616223cb-65a2-4eb8-bdc9-8fe948702e5b\") " pod="openshift-ingress/e2e-ait-707dcc5c-openshift-default-77c978f868-64lt8"
Sep 15 13:53:11.581986 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:11.581948    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kw5pf\" (UniqueName: \"kubernetes.io/projected/616223cb-65a2-4eb8-bdc9-8fe948702e5b-kube-api-access-kw5pf\") pod \"e2e-ait-707dcc5c-openshift-default-77c978f868-64lt8\" (UID: \"616223cb-65a2-4eb8-bdc9-8fe948702e5b\") " pod="openshift-ingress/e2e-ait-707dcc5c-openshift-default-77c978f868-64lt8"
Sep 15 13:53:11.581986 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:11.581974    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/616223cb-65a2-4eb8-bdc9-8fe948702e5b-istiod-ca-cert\") pod \"e2e-ait-707dcc5c-openshift-default-77c978f868-64lt8\" (UID: \"616223cb-65a2-4eb8-bdc9-8fe948702e5b\") " pod="openshift-ingress/e2e-ait-707dcc5c-openshift-default-77c978f868-64lt8"
Sep 15 13:53:11.582309 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:11.582090    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/616223cb-65a2-4eb8-bdc9-8fe948702e5b-workload-socket\") pod \"e2e-ait-707dcc5c-openshift-default-77c978f868-64lt8\" (UID: \"616223cb-65a2-4eb8-bdc9-8fe948702e5b\") " pod="openshift-ingress/e2e-ait-707dcc5c-openshift-default-77c978f868-64lt8"
Sep 15 13:53:11.582309 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:11.582148    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/616223cb-65a2-4eb8-bdc9-8fe948702e5b-credential-socket\") pod \"e2e-ait-707dcc5c-openshift-default-77c978f868-64lt8\" (UID: \"616223cb-65a2-4eb8-bdc9-8fe948702e5b\") " pod="openshift-ingress/e2e-ait-707dcc5c-openshift-default-77c978f868-64lt8"
Sep 15 13:53:11.582309 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:11.582241    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/616223cb-65a2-4eb8-bdc9-8fe948702e5b-istio-data\") pod \"e2e-ait-707dcc5c-openshift-default-77c978f868-64lt8\" (UID: \"616223cb-65a2-4eb8-bdc9-8fe948702e5b\") " pod="openshift-ingress/e2e-ait-707dcc5c-openshift-default-77c978f868-64lt8"
Sep 15 13:53:11.582309 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:11.582293    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/616223cb-65a2-4eb8-bdc9-8fe948702e5b-workload-certs\") pod \"e2e-ait-707dcc5c-openshift-default-77c978f868-64lt8\" (UID: \"616223cb-65a2-4eb8-bdc9-8fe948702e5b\") " pod="openshift-ingress/e2e-ait-707dcc5c-openshift-default-77c978f868-64lt8"
Sep 15 13:53:11.582683 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:11.582529    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/616223cb-65a2-4eb8-bdc9-8fe948702e5b-workload-socket\") pod \"e2e-ait-707dcc5c-openshift-default-77c978f868-64lt8\" (UID: \"616223cb-65a2-4eb8-bdc9-8fe948702e5b\") " pod="openshift-ingress/e2e-ait-707dcc5c-openshift-default-77c978f868-64lt8"
Sep 15 13:53:11.582683 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:11.582569    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/616223cb-65a2-4eb8-bdc9-8fe948702e5b-credential-socket\") pod \"e2e-ait-707dcc5c-openshift-default-77c978f868-64lt8\" (UID: \"616223cb-65a2-4eb8-bdc9-8fe948702e5b\") " pod="openshift-ingress/e2e-ait-707dcc5c-openshift-default-77c978f868-64lt8"
Sep 15 13:53:11.582853 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:11.582835    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/616223cb-65a2-4eb8-bdc9-8fe948702e5b-istiod-ca-cert\") pod \"e2e-ait-707dcc5c-openshift-default-77c978f868-64lt8\" (UID: \"616223cb-65a2-4eb8-bdc9-8fe948702e5b\") " pod="openshift-ingress/e2e-ait-707dcc5c-openshift-default-77c978f868-64lt8"
Sep 15 13:53:11.584179 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:11.584160    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/616223cb-65a2-4eb8-bdc9-8fe948702e5b-istio-envoy\") pod \"e2e-ait-707dcc5c-openshift-default-77c978f868-64lt8\" (UID: \"616223cb-65a2-4eb8-bdc9-8fe948702e5b\") " pod="openshift-ingress/e2e-ait-707dcc5c-openshift-default-77c978f868-64lt8"
Sep 15 13:53:11.584416 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:11.584396    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/616223cb-65a2-4eb8-bdc9-8fe948702e5b-istio-podinfo\") pod \"e2e-ait-707dcc5c-openshift-default-77c978f868-64lt8\" (UID: \"616223cb-65a2-4eb8-bdc9-8fe948702e5b\") " pod="openshift-ingress/e2e-ait-707dcc5c-openshift-default-77c978f868-64lt8"
Sep 15 13:53:11.591956 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:11.591934    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/616223cb-65a2-4eb8-bdc9-8fe948702e5b-istio-token\") pod \"e2e-ait-707dcc5c-openshift-default-77c978f868-64lt8\" (UID: \"616223cb-65a2-4eb8-bdc9-8fe948702e5b\") " pod="openshift-ingress/e2e-ait-707dcc5c-openshift-default-77c978f868-64lt8"
Sep 15 13:53:11.592078 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:11.592061    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kw5pf\" (UniqueName: \"kubernetes.io/projected/616223cb-65a2-4eb8-bdc9-8fe948702e5b-kube-api-access-kw5pf\") pod \"e2e-ait-707dcc5c-openshift-default-77c978f868-64lt8\" (UID: \"616223cb-65a2-4eb8-bdc9-8fe948702e5b\") " pod="openshift-ingress/e2e-ait-707dcc5c-openshift-default-77c978f868-64lt8"
Sep 15 13:53:11.727375 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:11.727343    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-707dcc5c-openshift-default-77c978f868-64lt8"
Sep 15 13:53:11.758157 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:11.758098    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="62a1edf7-8854-4668-99cc-f105df47ad21" path="/var/lib/kubelet/pods/62a1edf7-8854-4668-99cc-f105df47ad21/volumes"
Sep 15 13:53:11.758591 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:11.758569    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca42f547-d621-425b-a46a-a1543f1b1494" path="/var/lib/kubelet/pods/ca42f547-d621-425b-a46a-a1543f1b1494/volumes"
Sep 15 13:53:11.758951 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:11.758932    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f5609399-f50e-414d-8003-e6fdad8b05c5" path="/var/lib/kubelet/pods/f5609399-f50e-414d-8003-e6fdad8b05c5/volumes"
Sep 15 13:53:12.008835 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:12.008809    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-707dcc5c-openshift-default-77c978f868-64lt8"]
Sep 15 13:53:12.010901 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:53:12.010876    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod616223cb_65a2_4eb8_bdc9_8fe948702e5b.slice/crio-63bf26e6d44e56a8cb6c2083000c2342e5f0574c2eda942b1607a84572ce5e9c WatchSource:0}: Error finding container 63bf26e6d44e56a8cb6c2083000c2342e5f0574c2eda942b1607a84572ce5e9c: Status 404 returned error can't find the container with id 63bf26e6d44e56a8cb6c2083000c2342e5f0574c2eda942b1607a84572ce5e9c
Sep 15 13:53:12.013265 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:12.013235    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 15 13:53:12.013330 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:12.013296    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 15 13:53:12.013330 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:12.013323    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 15 13:53:12.257495 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:12.257457    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-707dcc5c-openshift-default-77c978f868-64lt8" event={"ID":"616223cb-65a2-4eb8-bdc9-8fe948702e5b","Type":"ContainerStarted","Data":"34c73a8bf6672d292aee1275ed437e1560e60da966d89174d9c5e0a2e7521c13"}
Sep 15 13:53:12.257668 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:12.257515    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-707dcc5c-openshift-default-77c978f868-64lt8" event={"ID":"616223cb-65a2-4eb8-bdc9-8fe948702e5b","Type":"ContainerStarted","Data":"63bf26e6d44e56a8cb6c2083000c2342e5f0574c2eda942b1607a84572ce5e9c"}
Sep 15 13:53:12.278300 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:12.278246    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-707dcc5c-openshift-default-77c978f868-64lt8" podStartSLOduration=1.2782252760000001 podStartE2EDuration="1.278225276s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:53:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:53:12.276046174 +0000 UTC m=+879.035172473" watchObservedRunningTime="2026-09-15 13:53:12.278225276 +0000 UTC m=+879.037351563"
Sep 15 13:53:12.728325 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:12.728291    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-707dcc5c-openshift-default-77c978f868-64lt8"
Sep 15 13:53:13.733377 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:13.733351    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-707dcc5c-openshift-default-77c978f868-64lt8"
Sep 15 13:53:14.270632 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:14.270604    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-707dcc5c-openshift-default-77c978f868-64lt8"
Sep 15 13:53:14.271701 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:14.271677    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-707dcc5c-openshift-default-77c978f868-64lt8"
Sep 15 13:53:15.925239 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:15.925210    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-a5a300cf-gw-openshift-default-d9695ff5b-cl4wp"
Sep 15 13:53:16.029709 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:16.029683    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85cee838-2c15-4d06-9c2c-835bcf29d1d8-istio-data\") pod \"85cee838-2c15-4d06-9c2c-835bcf29d1d8\" (UID: \"85cee838-2c15-4d06-9c2c-835bcf29d1d8\") "
Sep 15 13:53:16.029866 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:16.029720    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85cee838-2c15-4d06-9c2c-835bcf29d1d8-workload-certs\") pod \"85cee838-2c15-4d06-9c2c-835bcf29d1d8\" (UID: \"85cee838-2c15-4d06-9c2c-835bcf29d1d8\") "
Sep 15 13:53:16.029866 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:16.029758    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85cee838-2c15-4d06-9c2c-835bcf29d1d8-credential-socket\") pod \"85cee838-2c15-4d06-9c2c-835bcf29d1d8\" (UID: \"85cee838-2c15-4d06-9c2c-835bcf29d1d8\") "
Sep 15 13:53:16.029866 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:16.029820    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85cee838-2c15-4d06-9c2c-835bcf29d1d8-istiod-ca-cert\") pod \"85cee838-2c15-4d06-9c2c-835bcf29d1d8\" (UID: \"85cee838-2c15-4d06-9c2c-835bcf29d1d8\") "
Sep 15 13:53:16.029866 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:16.029858    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85cee838-2c15-4d06-9c2c-835bcf29d1d8-workload-socket\") pod \"85cee838-2c15-4d06-9c2c-835bcf29d1d8\" (UID: \"85cee838-2c15-4d06-9c2c-835bcf29d1d8\") "
Sep 15 13:53:16.030057 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:16.029889    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85cee838-2c15-4d06-9c2c-835bcf29d1d8-istio-podinfo\") pod \"85cee838-2c15-4d06-9c2c-835bcf29d1d8\" (UID: \"85cee838-2c15-4d06-9c2c-835bcf29d1d8\") "
Sep 15 13:53:16.030057 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:16.029922    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85cee838-2c15-4d06-9c2c-835bcf29d1d8-istio-envoy\") pod \"85cee838-2c15-4d06-9c2c-835bcf29d1d8\" (UID: \"85cee838-2c15-4d06-9c2c-835bcf29d1d8\") "
Sep 15 13:53:16.030057 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:16.029979    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85cee838-2c15-4d06-9c2c-835bcf29d1d8-istio-data" (OuterVolumeSpecName: "istio-data") pod "85cee838-2c15-4d06-9c2c-835bcf29d1d8" (UID: "85cee838-2c15-4d06-9c2c-835bcf29d1d8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:53:16.030057 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:16.029996    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85cee838-2c15-4d06-9c2c-835bcf29d1d8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "85cee838-2c15-4d06-9c2c-835bcf29d1d8" (UID: "85cee838-2c15-4d06-9c2c-835bcf29d1d8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:53:16.030057 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:16.030023    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nm2hx\" (UniqueName: \"kubernetes.io/projected/85cee838-2c15-4d06-9c2c-835bcf29d1d8-kube-api-access-nm2hx\") pod \"85cee838-2c15-4d06-9c2c-835bcf29d1d8\" (UID: \"85cee838-2c15-4d06-9c2c-835bcf29d1d8\") "
Sep 15 13:53:16.030363 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:16.030090    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85cee838-2c15-4d06-9c2c-835bcf29d1d8-istio-token\") pod \"85cee838-2c15-4d06-9c2c-835bcf29d1d8\" (UID: \"85cee838-2c15-4d06-9c2c-835bcf29d1d8\") "
Sep 15 13:53:16.030363 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:16.030111    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85cee838-2c15-4d06-9c2c-835bcf29d1d8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "85cee838-2c15-4d06-9c2c-835bcf29d1d8" (UID: "85cee838-2c15-4d06-9c2c-835bcf29d1d8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:53:16.030363 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:16.030235    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85cee838-2c15-4d06-9c2c-835bcf29d1d8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "85cee838-2c15-4d06-9c2c-835bcf29d1d8" (UID: "85cee838-2c15-4d06-9c2c-835bcf29d1d8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:53:16.030363 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:16.030298    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85cee838-2c15-4d06-9c2c-835bcf29d1d8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "85cee838-2c15-4d06-9c2c-835bcf29d1d8" (UID: "85cee838-2c15-4d06-9c2c-835bcf29d1d8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 13:53:16.030760 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:16.030738    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85cee838-2c15-4d06-9c2c-835bcf29d1d8-istio-data\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:53:16.030760 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:16.030761    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85cee838-2c15-4d06-9c2c-835bcf29d1d8-workload-certs\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:53:16.030918 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:16.030773    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85cee838-2c15-4d06-9c2c-835bcf29d1d8-credential-socket\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:53:16.030918 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:16.030785    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85cee838-2c15-4d06-9c2c-835bcf29d1d8-istiod-ca-cert\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:53:16.030918 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:16.030796    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85cee838-2c15-4d06-9c2c-835bcf29d1d8-workload-socket\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:53:16.032387 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:16.032366    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85cee838-2c15-4d06-9c2c-835bcf29d1d8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "85cee838-2c15-4d06-9c2c-835bcf29d1d8" (UID: "85cee838-2c15-4d06-9c2c-835bcf29d1d8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:53:16.032501 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:16.032381    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85cee838-2c15-4d06-9c2c-835bcf29d1d8-istio-token" (OuterVolumeSpecName: "istio-token") pod "85cee838-2c15-4d06-9c2c-835bcf29d1d8" (UID: "85cee838-2c15-4d06-9c2c-835bcf29d1d8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:53:16.032760 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:16.032742    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85cee838-2c15-4d06-9c2c-835bcf29d1d8-kube-api-access-nm2hx" (OuterVolumeSpecName: "kube-api-access-nm2hx") pod "85cee838-2c15-4d06-9c2c-835bcf29d1d8" (UID: "85cee838-2c15-4d06-9c2c-835bcf29d1d8"). InnerVolumeSpecName "kube-api-access-nm2hx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:53:16.032809 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:16.032758    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/85cee838-2c15-4d06-9c2c-835bcf29d1d8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "85cee838-2c15-4d06-9c2c-835bcf29d1d8" (UID: "85cee838-2c15-4d06-9c2c-835bcf29d1d8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 13:53:16.131968 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:16.131928    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85cee838-2c15-4d06-9c2c-835bcf29d1d8-istio-podinfo\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:53:16.131968 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:16.131959    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85cee838-2c15-4d06-9c2c-835bcf29d1d8-istio-envoy\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:53:16.131968 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:16.131971    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nm2hx\" (UniqueName: \"kubernetes.io/projected/85cee838-2c15-4d06-9c2c-835bcf29d1d8-kube-api-access-nm2hx\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:53:16.132250 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:16.131984    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85cee838-2c15-4d06-9c2c-835bcf29d1d8-istio-token\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:53:16.283833 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:16.283751    2578 generic.go:356] "Generic (PLEG): container finished" podID="85cee838-2c15-4d06-9c2c-835bcf29d1d8" containerID="e839006154fc5caa777561ef509cea1c028bfd615f24dd9dbd29de56b868f1e8" exitCode=0
Sep 15 13:53:16.283833 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:16.283809    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-a5a300cf-gw-openshift-default-d9695ff5b-cl4wp"
Sep 15 13:53:16.284017 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:16.283837    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-a5a300cf-gw-openshift-default-d9695ff5b-cl4wp" event={"ID":"85cee838-2c15-4d06-9c2c-835bcf29d1d8","Type":"ContainerDied","Data":"e839006154fc5caa777561ef509cea1c028bfd615f24dd9dbd29de56b868f1e8"}
Sep 15 13:53:16.284017 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:16.283892    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-a5a300cf-gw-openshift-default-d9695ff5b-cl4wp" event={"ID":"85cee838-2c15-4d06-9c2c-835bcf29d1d8","Type":"ContainerDied","Data":"0222f1a27f39b63c73417b37cebdbc22b4473bec46bbe003cc4132299fdf57b3"}
Sep 15 13:53:16.284017 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:16.283915    2578 scope.go:117] "RemoveContainer" containerID="e839006154fc5caa777561ef509cea1c028bfd615f24dd9dbd29de56b868f1e8"
Sep 15 13:53:16.298796 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:16.298771    2578 scope.go:117] "RemoveContainer" containerID="80029d6278becf43ebf60075363f9c6f61a3d681a9a92157a85018d9b4f5b2a7"
Sep 15 13:53:16.308066 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:16.308047    2578 scope.go:117] "RemoveContainer" containerID="e839006154fc5caa777561ef509cea1c028bfd615f24dd9dbd29de56b868f1e8"
Sep 15 13:53:16.308369 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:53:16.308347    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e839006154fc5caa777561ef509cea1c028bfd615f24dd9dbd29de56b868f1e8\": container with ID starting with e839006154fc5caa777561ef509cea1c028bfd615f24dd9dbd29de56b868f1e8 not found: ID does not exist" containerID="e839006154fc5caa777561ef509cea1c028bfd615f24dd9dbd29de56b868f1e8"
Sep 15 13:53:16.308425 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:16.308379    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e839006154fc5caa777561ef509cea1c028bfd615f24dd9dbd29de56b868f1e8"} err="failed to get container status \"e839006154fc5caa777561ef509cea1c028bfd615f24dd9dbd29de56b868f1e8\": rpc error: code = NotFound desc = could not find container \"e839006154fc5caa777561ef509cea1c028bfd615f24dd9dbd29de56b868f1e8\": container with ID starting with e839006154fc5caa777561ef509cea1c028bfd615f24dd9dbd29de56b868f1e8 not found: ID does not exist"
Sep 15 13:53:16.308425 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:16.308396    2578 scope.go:117] "RemoveContainer" containerID="80029d6278becf43ebf60075363f9c6f61a3d681a9a92157a85018d9b4f5b2a7"
Sep 15 13:53:16.308687 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:53:16.308668    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"80029d6278becf43ebf60075363f9c6f61a3d681a9a92157a85018d9b4f5b2a7\": container with ID starting with 80029d6278becf43ebf60075363f9c6f61a3d681a9a92157a85018d9b4f5b2a7 not found: ID does not exist" containerID="80029d6278becf43ebf60075363f9c6f61a3d681a9a92157a85018d9b4f5b2a7"
Sep 15 13:53:16.308746 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:16.308695    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80029d6278becf43ebf60075363f9c6f61a3d681a9a92157a85018d9b4f5b2a7"} err="failed to get container status \"80029d6278becf43ebf60075363f9c6f61a3d681a9a92157a85018d9b4f5b2a7\": rpc error: code = NotFound desc = could not find container \"80029d6278becf43ebf60075363f9c6f61a3d681a9a92157a85018d9b4f5b2a7\": container with ID starting with 80029d6278becf43ebf60075363f9c6f61a3d681a9a92157a85018d9b4f5b2a7 not found: ID does not exist"
Sep 15 13:53:16.310382 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:16.310362    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-a5a300cf-gw-openshift-default-d9695ff5b-cl4wp"]
Sep 15 13:53:16.315241 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:16.315221    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-a5a300cf-gw-openshift-default-d9695ff5b-cl4wp"]
Sep 15 13:53:16.538654 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:16.538579    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-707dcc5c-5564447578-72xsl"]
Sep 15 13:53:16.538988 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:16.538975    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85cee838-2c15-4d06-9c2c-835bcf29d1d8" containerName="istio-proxy"
Sep 15 13:53:16.539034 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:16.538990    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="85cee838-2c15-4d06-9c2c-835bcf29d1d8" containerName="istio-proxy"
Sep 15 13:53:16.539034 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:16.539005    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85cee838-2c15-4d06-9c2c-835bcf29d1d8" containerName="istio-proxy"
Sep 15 13:53:16.539034 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:16.539011    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="85cee838-2c15-4d06-9c2c-835bcf29d1d8" containerName="istio-proxy"
Sep 15 13:53:16.539159 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:16.539084    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="85cee838-2c15-4d06-9c2c-835bcf29d1d8" containerName="istio-proxy"
Sep 15 13:53:16.543856 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:16.543837    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-707dcc5c-5564447578-72xsl"
Sep 15 13:53:16.546332 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:16.546314    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-707dcc5c-dockercfg-2jlb7\""
Sep 15 13:53:16.546418 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:16.546341    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-707dcc5c\""
Sep 15 13:53:16.551433 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:16.551411    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-707dcc5c-5564447578-72xsl"]
Sep 15 13:53:16.563192 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:16.563167    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-707dcc5c-85989d4dd7-ws5qn"]
Sep 15 13:53:16.563605 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:16.563593    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="85cee838-2c15-4d06-9c2c-835bcf29d1d8" containerName="istio-proxy"
Sep 15 13:53:16.566354 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:16.566328    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-707dcc5c-85989d4dd7-ws5qn"
Sep 15 13:53:16.580383 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:16.580361    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-707dcc5c-85989d4dd7-ws5qn"]
Sep 15 13:53:16.639148 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:16.636440    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-442z5\" (UniqueName: \"kubernetes.io/projected/a41e46c2-5f0f-4a1e-ba17-5867801466e8-kube-api-access-442z5\") pod \"payload-processing-e2e-ait-707dcc5c-85989d4dd7-ws5qn\" (UID: \"a41e46c2-5f0f-4a1e-ba17-5867801466e8\") " pod="openshift-ingress/payload-processing-e2e-ait-707dcc5c-85989d4dd7-ws5qn"
Sep 15 13:53:16.639148 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:16.636497    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpd9p\" (UniqueName: \"kubernetes.io/projected/348918d6-ab67-48fb-8357-e1fd0e60152d-kube-api-access-jpd9p\") pod \"payload-pre-processing-e2e-ait-707dcc5c-5564447578-72xsl\" (UID: \"348918d6-ab67-48fb-8357-e1fd0e60152d\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-707dcc5c-5564447578-72xsl"
Sep 15 13:53:16.639148 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:16.636595    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a41e46c2-5f0f-4a1e-ba17-5867801466e8-plugins-config-volume\") pod \"payload-processing-e2e-ait-707dcc5c-85989d4dd7-ws5qn\" (UID: \"a41e46c2-5f0f-4a1e-ba17-5867801466e8\") " pod="openshift-ingress/payload-processing-e2e-ait-707dcc5c-85989d4dd7-ws5qn"
Sep 15 13:53:16.639148 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:16.636642    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/348918d6-ab67-48fb-8357-e1fd0e60152d-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-707dcc5c-5564447578-72xsl\" (UID: \"348918d6-ab67-48fb-8357-e1fd0e60152d\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-707dcc5c-5564447578-72xsl"
Sep 15 13:53:16.737799 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:16.737767    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a41e46c2-5f0f-4a1e-ba17-5867801466e8-plugins-config-volume\") pod \"payload-processing-e2e-ait-707dcc5c-85989d4dd7-ws5qn\" (UID: \"a41e46c2-5f0f-4a1e-ba17-5867801466e8\") " pod="openshift-ingress/payload-processing-e2e-ait-707dcc5c-85989d4dd7-ws5qn"
Sep 15 13:53:16.737992 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:16.737814    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/348918d6-ab67-48fb-8357-e1fd0e60152d-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-707dcc5c-5564447578-72xsl\" (UID: \"348918d6-ab67-48fb-8357-e1fd0e60152d\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-707dcc5c-5564447578-72xsl"
Sep 15 13:53:16.737992 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:16.737868    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-442z5\" (UniqueName: \"kubernetes.io/projected/a41e46c2-5f0f-4a1e-ba17-5867801466e8-kube-api-access-442z5\") pod \"payload-processing-e2e-ait-707dcc5c-85989d4dd7-ws5qn\" (UID: \"a41e46c2-5f0f-4a1e-ba17-5867801466e8\") " pod="openshift-ingress/payload-processing-e2e-ait-707dcc5c-85989d4dd7-ws5qn"
Sep 15 13:53:16.737992 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:16.737885    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jpd9p\" (UniqueName: \"kubernetes.io/projected/348918d6-ab67-48fb-8357-e1fd0e60152d-kube-api-access-jpd9p\") pod \"payload-pre-processing-e2e-ait-707dcc5c-5564447578-72xsl\" (UID: \"348918d6-ab67-48fb-8357-e1fd0e60152d\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-707dcc5c-5564447578-72xsl"
Sep 15 13:53:16.738525 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:16.738505    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a41e46c2-5f0f-4a1e-ba17-5867801466e8-plugins-config-volume\") pod \"payload-processing-e2e-ait-707dcc5c-85989d4dd7-ws5qn\" (UID: \"a41e46c2-5f0f-4a1e-ba17-5867801466e8\") " pod="openshift-ingress/payload-processing-e2e-ait-707dcc5c-85989d4dd7-ws5qn"
Sep 15 13:53:16.738602 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:16.738584    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/348918d6-ab67-48fb-8357-e1fd0e60152d-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-707dcc5c-5564447578-72xsl\" (UID: \"348918d6-ab67-48fb-8357-e1fd0e60152d\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-707dcc5c-5564447578-72xsl"
Sep 15 13:53:16.746600 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:16.746575    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-442z5\" (UniqueName: \"kubernetes.io/projected/a41e46c2-5f0f-4a1e-ba17-5867801466e8-kube-api-access-442z5\") pod \"payload-processing-e2e-ait-707dcc5c-85989d4dd7-ws5qn\" (UID: \"a41e46c2-5f0f-4a1e-ba17-5867801466e8\") " pod="openshift-ingress/payload-processing-e2e-ait-707dcc5c-85989d4dd7-ws5qn"
Sep 15 13:53:16.746706 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:16.746644    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpd9p\" (UniqueName: \"kubernetes.io/projected/348918d6-ab67-48fb-8357-e1fd0e60152d-kube-api-access-jpd9p\") pod \"payload-pre-processing-e2e-ait-707dcc5c-5564447578-72xsl\" (UID: \"348918d6-ab67-48fb-8357-e1fd0e60152d\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-707dcc5c-5564447578-72xsl"
Sep 15 13:53:16.855862 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:16.855781    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-707dcc5c-5564447578-72xsl"
Sep 15 13:53:16.877261 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:16.876511    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-707dcc5c-85989d4dd7-ws5qn"
Sep 15 13:53:17.136343 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:17.136313    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-707dcc5c-5564447578-72xsl"]
Sep 15 13:53:17.137550 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:53:17.137521    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod348918d6_ab67_48fb_8357_e1fd0e60152d.slice/crio-f692a4fc48c5301bda2067b67f8dd7cdf288a6f4057af11a42acb360c8846516 WatchSource:0}: Error finding container f692a4fc48c5301bda2067b67f8dd7cdf288a6f4057af11a42acb360c8846516: Status 404 returned error can't find the container with id f692a4fc48c5301bda2067b67f8dd7cdf288a6f4057af11a42acb360c8846516
Sep 15 13:53:17.164930 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:17.164907    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-707dcc5c-85989d4dd7-ws5qn"]
Sep 15 13:53:17.167317 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:53:17.167289    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda41e46c2_5f0f_4a1e_ba17_5867801466e8.slice/crio-f45256f70a16a8a021f5acaa3529fd658f79e311959f88722e7a399aa1529aa6 WatchSource:0}: Error finding container f45256f70a16a8a021f5acaa3529fd658f79e311959f88722e7a399aa1529aa6: Status 404 returned error can't find the container with id f45256f70a16a8a021f5acaa3529fd658f79e311959f88722e7a399aa1529aa6
Sep 15 13:53:17.292852 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:17.292816    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-707dcc5c-85989d4dd7-ws5qn" event={"ID":"a41e46c2-5f0f-4a1e-ba17-5867801466e8","Type":"ContainerStarted","Data":"778c6344c37da02e44ff52a5eff4ebb2c466f96b9ce82b2d719d5c3fbba4bdea"}
Sep 15 13:53:17.293057 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:17.293022    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-707dcc5c-85989d4dd7-ws5qn"
Sep 15 13:53:17.293216 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:17.293071    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-707dcc5c-85989d4dd7-ws5qn" event={"ID":"a41e46c2-5f0f-4a1e-ba17-5867801466e8","Type":"ContainerStarted","Data":"f45256f70a16a8a021f5acaa3529fd658f79e311959f88722e7a399aa1529aa6"}
Sep 15 13:53:17.295645 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:17.295613    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-707dcc5c-5564447578-72xsl" event={"ID":"348918d6-ab67-48fb-8357-e1fd0e60152d","Type":"ContainerStarted","Data":"e39bfe8dd920031a6396e4e56c39a8af7fe089e7f4741a86a78d64c5b248bbee"}
Sep 15 13:53:17.295735 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:17.295665    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-707dcc5c-5564447578-72xsl" event={"ID":"348918d6-ab67-48fb-8357-e1fd0e60152d","Type":"ContainerStarted","Data":"f692a4fc48c5301bda2067b67f8dd7cdf288a6f4057af11a42acb360c8846516"}
Sep 15 13:53:17.295735 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:17.295729    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-707dcc5c-5564447578-72xsl"
Sep 15 13:53:17.311344 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:17.311302    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-707dcc5c-85989d4dd7-ws5qn" podStartSLOduration=1.3112884519999999 podStartE2EDuration="1.311288452s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:53:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:53:17.308856693 +0000 UTC m=+884.067982981" watchObservedRunningTime="2026-09-15 13:53:17.311288452 +0000 UTC m=+884.070414804"
Sep 15 13:53:17.328370 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:17.328324    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-707dcc5c-5564447578-72xsl" podStartSLOduration=1.328311716 podStartE2EDuration="1.328311716s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:53:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:53:17.326910682 +0000 UTC m=+884.086036981" watchObservedRunningTime="2026-09-15 13:53:17.328311716 +0000 UTC m=+884.087438001"
Sep 15 13:53:17.759519 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:17.759491    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="85cee838-2c15-4d06-9c2c-835bcf29d1d8" path="/var/lib/kubelet/pods/85cee838-2c15-4d06-9c2c-835bcf29d1d8/volumes"
Sep 15 13:53:28.304611 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:28.304522    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-707dcc5c-85989d4dd7-ws5qn"
Sep 15 13:53:28.304994 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:28.304617    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-707dcc5c-5564447578-72xsl"
Sep 15 13:53:38.438117 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:38.438080    2578 generic.go:356] "Generic (PLEG): container finished" podID="616223cb-65a2-4eb8-bdc9-8fe948702e5b" containerID="34c73a8bf6672d292aee1275ed437e1560e60da966d89174d9c5e0a2e7521c13" exitCode=0
Sep 15 13:53:38.438568 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:38.438157    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-707dcc5c-openshift-default-77c978f868-64lt8" event={"ID":"616223cb-65a2-4eb8-bdc9-8fe948702e5b","Type":"ContainerDied","Data":"34c73a8bf6672d292aee1275ed437e1560e60da966d89174d9c5e0a2e7521c13"}
Sep 15 13:53:38.438628 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:38.438614    2578 scope.go:117] "RemoveContainer" containerID="34c73a8bf6672d292aee1275ed437e1560e60da966d89174d9c5e0a2e7521c13"
Sep 15 13:53:38.439848 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:38.439824    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 15 13:53:38.439913 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:38.439889    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 15 13:53:38.439949 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:38.439917    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 15 13:53:39.316610 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:39.316581    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-707dcc5c-h2c67"]
Sep 15 13:53:39.319431 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:39.319416    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-707dcc5c-h2c67"
Sep 15 13:53:39.321737 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:39.321717    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 15 13:53:39.322474 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:39.322460    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 13:53:39.322534 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:39.322476    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qzmkv\""
Sep 15 13:53:39.327331 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:39.327311    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-707dcc5c-h2c67"]
Sep 15 13:53:39.383922 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:39.383870    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f02d394e-65e0-454e-80cb-fa797a4a15ae-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-707dcc5c-h2c67\" (UID: \"f02d394e-65e0-454e-80cb-fa797a4a15ae\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-707dcc5c-h2c67"
Sep 15 13:53:39.384339 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:39.384314    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwd79\" (UniqueName: \"kubernetes.io/projected/f02d394e-65e0-454e-80cb-fa797a4a15ae-kube-api-access-fwd79\") pod \"maas-api-revoke-keys-e2e-ait-707dcc5c-h2c67\" (UID: \"f02d394e-65e0-454e-80cb-fa797a4a15ae\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-707dcc5c-h2c67"
Sep 15 13:53:39.446154 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:39.446097    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-707dcc5c-openshift-default-77c978f868-64lt8" event={"ID":"616223cb-65a2-4eb8-bdc9-8fe948702e5b","Type":"ContainerStarted","Data":"0b0fb2370ea8aa31c556aa918544f355d83fe501b1fe319f9c64d16d4e32ebfa"}
Sep 15 13:53:39.486110 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:39.486073    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f02d394e-65e0-454e-80cb-fa797a4a15ae-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-707dcc5c-h2c67\" (UID: \"f02d394e-65e0-454e-80cb-fa797a4a15ae\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-707dcc5c-h2c67"
Sep 15 13:53:39.486397 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:39.486375    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwd79\" (UniqueName: \"kubernetes.io/projected/f02d394e-65e0-454e-80cb-fa797a4a15ae-kube-api-access-fwd79\") pod \"maas-api-revoke-keys-e2e-ait-707dcc5c-h2c67\" (UID: \"f02d394e-65e0-454e-80cb-fa797a4a15ae\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-707dcc5c-h2c67"
Sep 15 13:53:39.487813 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:39.487789    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f02d394e-65e0-454e-80cb-fa797a4a15ae-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-707dcc5c-h2c67\" (UID: \"f02d394e-65e0-454e-80cb-fa797a4a15ae\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-707dcc5c-h2c67"
Sep 15 13:53:39.498212 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:39.498180    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwd79\" (UniqueName: \"kubernetes.io/projected/f02d394e-65e0-454e-80cb-fa797a4a15ae-kube-api-access-fwd79\") pod \"maas-api-revoke-keys-e2e-ait-707dcc5c-h2c67\" (UID: \"f02d394e-65e0-454e-80cb-fa797a4a15ae\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-707dcc5c-h2c67"
Sep 15 13:53:39.632199 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:39.632090    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-707dcc5c-h2c67"
Sep 15 13:53:39.735455 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:39.735367    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-707dcc5c-openshift-default-77c978f868-64lt8"
Sep 15 13:53:39.736374 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:39.736343    2578 patch_prober.go:28] interesting pod/e2e-ait-707dcc5c-openshift-default-77c978f868-64lt8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Sep 15 13:53:39.736506 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:39.736401    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-707dcc5c-openshift-default-77c978f868-64lt8" podUID="616223cb-65a2-4eb8-bdc9-8fe948702e5b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Sep 15 13:53:39.924638 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:39.924614    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-707dcc5c-h2c67"]
Sep 15 13:53:39.925694 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:53:39.925670    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf02d394e_65e0_454e_80cb_fa797a4a15ae.slice/crio-b561cf548474b5df13f8f20e94607b8ba64fa4b61ea4cf62fae62a70dcdf355c WatchSource:0}: Error finding container b561cf548474b5df13f8f20e94607b8ba64fa4b61ea4cf62fae62a70dcdf355c: Status 404 returned error can't find the container with id b561cf548474b5df13f8f20e94607b8ba64fa4b61ea4cf62fae62a70dcdf355c
Sep 15 13:53:40.454610 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:40.454567    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-707dcc5c-h2c67" event={"ID":"f02d394e-65e0-454e-80cb-fa797a4a15ae","Type":"ContainerStarted","Data":"0dd5283cb14c439c74887f1cae2e293a67649aefe408feddd487bdfc307b4175"}
Sep 15 13:53:40.455002 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:40.454631    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-707dcc5c-h2c67" event={"ID":"f02d394e-65e0-454e-80cb-fa797a4a15ae","Type":"ContainerStarted","Data":"b561cf548474b5df13f8f20e94607b8ba64fa4b61ea4cf62fae62a70dcdf355c"}
Sep 15 13:53:40.473149 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:40.470251    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-707dcc5c-h2c67" podStartSLOduration=1.470230012 podStartE2EDuration="1.470230012s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:53:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:53:40.468849308 +0000 UTC m=+907.227975596" watchObservedRunningTime="2026-09-15 13:53:40.470230012 +0000 UTC m=+907.229356300"
Sep 15 13:53:40.728613 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:40.728519    2578 patch_prober.go:28] interesting pod/e2e-ait-707dcc5c-openshift-default-77c978f868-64lt8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Sep 15 13:53:40.728613 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:40.728585    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-707dcc5c-openshift-default-77c978f868-64lt8" podUID="616223cb-65a2-4eb8-bdc9-8fe948702e5b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Sep 15 13:53:41.463847 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:41.463800    2578 generic.go:356] "Generic (PLEG): container finished" podID="f02d394e-65e0-454e-80cb-fa797a4a15ae" containerID="0dd5283cb14c439c74887f1cae2e293a67649aefe408feddd487bdfc307b4175" exitCode=0
Sep 15 13:53:41.464391 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:41.463984    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-707dcc5c-h2c67" event={"ID":"f02d394e-65e0-454e-80cb-fa797a4a15ae","Type":"ContainerDied","Data":"0dd5283cb14c439c74887f1cae2e293a67649aefe408feddd487bdfc307b4175"}
Sep 15 13:53:41.727997 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:41.727906    2578 patch_prober.go:28] interesting pod/e2e-ait-707dcc5c-openshift-default-77c978f868-64lt8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Sep 15 13:53:41.727997 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:41.727969    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-707dcc5c-openshift-default-77c978f868-64lt8" podUID="616223cb-65a2-4eb8-bdc9-8fe948702e5b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Sep 15 13:53:42.633947 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:42.633919    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-707dcc5c-h2c67"
Sep 15 13:53:42.720435 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:42.720400    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fwd79\" (UniqueName: \"kubernetes.io/projected/f02d394e-65e0-454e-80cb-fa797a4a15ae-kube-api-access-fwd79\") pod \"f02d394e-65e0-454e-80cb-fa797a4a15ae\" (UID: \"f02d394e-65e0-454e-80cb-fa797a4a15ae\") "
Sep 15 13:53:42.720605 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:42.720529    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f02d394e-65e0-454e-80cb-fa797a4a15ae-maas-api-service-ca\") pod \"f02d394e-65e0-454e-80cb-fa797a4a15ae\" (UID: \"f02d394e-65e0-454e-80cb-fa797a4a15ae\") "
Sep 15 13:53:42.720847 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:42.720820    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f02d394e-65e0-454e-80cb-fa797a4a15ae-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f02d394e-65e0-454e-80cb-fa797a4a15ae" (UID: "f02d394e-65e0-454e-80cb-fa797a4a15ae"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 13:53:42.722751 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:42.722729    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f02d394e-65e0-454e-80cb-fa797a4a15ae-kube-api-access-fwd79" (OuterVolumeSpecName: "kube-api-access-fwd79") pod "f02d394e-65e0-454e-80cb-fa797a4a15ae" (UID: "f02d394e-65e0-454e-80cb-fa797a4a15ae"). InnerVolumeSpecName "kube-api-access-fwd79". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:53:42.728704 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:42.728684    2578 patch_prober.go:28] interesting pod/e2e-ait-707dcc5c-openshift-default-77c978f868-64lt8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Sep 15 13:53:42.728789 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:42.728737    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-707dcc5c-openshift-default-77c978f868-64lt8" podUID="616223cb-65a2-4eb8-bdc9-8fe948702e5b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Sep 15 13:53:42.822035 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:42.821999    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fwd79\" (UniqueName: \"kubernetes.io/projected/f02d394e-65e0-454e-80cb-fa797a4a15ae-kube-api-access-fwd79\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:53:42.822035 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:42.822034    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f02d394e-65e0-454e-80cb-fa797a4a15ae-maas-api-service-ca\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:53:43.484508 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:43.484466    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-707dcc5c-h2c67" event={"ID":"f02d394e-65e0-454e-80cb-fa797a4a15ae","Type":"ContainerDied","Data":"b561cf548474b5df13f8f20e94607b8ba64fa4b61ea4cf62fae62a70dcdf355c"}
Sep 15 13:53:43.484768 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:43.484533    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b561cf548474b5df13f8f20e94607b8ba64fa4b61ea4cf62fae62a70dcdf355c"
Sep 15 13:53:43.484768 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:43.484601    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-707dcc5c-h2c67"
Sep 15 13:53:43.728619 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:43.728582    2578 patch_prober.go:28] interesting pod/e2e-ait-707dcc5c-openshift-default-77c978f868-64lt8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Sep 15 13:53:43.729070 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:43.728638    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-707dcc5c-openshift-default-77c978f868-64lt8" podUID="616223cb-65a2-4eb8-bdc9-8fe948702e5b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Sep 15 13:53:44.271202 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:44.271159    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-707dcc5c-openshift-default-77c978f868-64lt8"
Sep 15 13:53:44.728584 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:44.728541    2578 patch_prober.go:28] interesting pod/e2e-ait-707dcc5c-openshift-default-77c978f868-64lt8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Sep 15 13:53:44.728771 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:44.728607    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-707dcc5c-openshift-default-77c978f868-64lt8" podUID="616223cb-65a2-4eb8-bdc9-8fe948702e5b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Sep 15 13:53:45.391348 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:45.391313    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-707dcc5c-85989d4dd7-ws5qn"]
Sep 15 13:53:45.391587 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:45.391559    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-707dcc5c-85989d4dd7-ws5qn" podUID="a41e46c2-5f0f-4a1e-ba17-5867801466e8" containerName="payload-processing" containerID="cri-o://778c6344c37da02e44ff52a5eff4ebb2c466f96b9ce82b2d719d5c3fbba4bdea" gracePeriod=30
Sep 15 13:53:45.399657 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:45.399628    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-707dcc5c-5564447578-72xsl"]
Sep 15 13:53:45.399875 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:45.399856    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-707dcc5c-5564447578-72xsl" podUID="348918d6-ab67-48fb-8357-e1fd0e60152d" containerName="payload-pre-processing" containerID="cri-o://e39bfe8dd920031a6396e4e56c39a8af7fe089e7f4741a86a78d64c5b248bbee" gracePeriod=30
Sep 15 13:53:45.562457 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:45.562422    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-707dcc5c-h2c67"]
Sep 15 13:53:45.566052 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:45.566025    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-707dcc5c-h2c67"]
Sep 15 13:53:45.653308 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:45.653251    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-707dcc5c-85989d4dd7-ws5qn"
Sep 15 13:53:45.682093 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:45.682070    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-707dcc5c-5564447578-72xsl"
Sep 15 13:53:45.752024 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:45.751221    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a41e46c2-5f0f-4a1e-ba17-5867801466e8-plugins-config-volume\") pod \"a41e46c2-5f0f-4a1e-ba17-5867801466e8\" (UID: \"a41e46c2-5f0f-4a1e-ba17-5867801466e8\") "
Sep 15 13:53:45.752024 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:45.751355    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jpd9p\" (UniqueName: \"kubernetes.io/projected/348918d6-ab67-48fb-8357-e1fd0e60152d-kube-api-access-jpd9p\") pod \"348918d6-ab67-48fb-8357-e1fd0e60152d\" (UID: \"348918d6-ab67-48fb-8357-e1fd0e60152d\") "
Sep 15 13:53:45.752024 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:45.751396    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-442z5\" (UniqueName: \"kubernetes.io/projected/a41e46c2-5f0f-4a1e-ba17-5867801466e8-kube-api-access-442z5\") pod \"a41e46c2-5f0f-4a1e-ba17-5867801466e8\" (UID: \"a41e46c2-5f0f-4a1e-ba17-5867801466e8\") "
Sep 15 13:53:45.752024 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:45.751444    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/348918d6-ab67-48fb-8357-e1fd0e60152d-plugins-config-volume\") pod \"348918d6-ab67-48fb-8357-e1fd0e60152d\" (UID: \"348918d6-ab67-48fb-8357-e1fd0e60152d\") "
Sep 15 13:53:45.753082 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:45.752832    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/348918d6-ab67-48fb-8357-e1fd0e60152d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "348918d6-ab67-48fb-8357-e1fd0e60152d" (UID: "348918d6-ab67-48fb-8357-e1fd0e60152d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 13:53:45.756730 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:45.753866    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a41e46c2-5f0f-4a1e-ba17-5867801466e8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a41e46c2-5f0f-4a1e-ba17-5867801466e8" (UID: "a41e46c2-5f0f-4a1e-ba17-5867801466e8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 13:53:45.757022 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:45.756887    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/348918d6-ab67-48fb-8357-e1fd0e60152d-kube-api-access-jpd9p" (OuterVolumeSpecName: "kube-api-access-jpd9p") pod "348918d6-ab67-48fb-8357-e1fd0e60152d" (UID: "348918d6-ab67-48fb-8357-e1fd0e60152d"). InnerVolumeSpecName "kube-api-access-jpd9p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:53:45.761247 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:45.761220    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a41e46c2-5f0f-4a1e-ba17-5867801466e8-kube-api-access-442z5" (OuterVolumeSpecName: "kube-api-access-442z5") pod "a41e46c2-5f0f-4a1e-ba17-5867801466e8" (UID: "a41e46c2-5f0f-4a1e-ba17-5867801466e8"). InnerVolumeSpecName "kube-api-access-442z5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:53:45.765160 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:45.765104    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f02d394e-65e0-454e-80cb-fa797a4a15ae" path="/var/lib/kubelet/pods/f02d394e-65e0-454e-80cb-fa797a4a15ae/volumes"
Sep 15 13:53:45.853248 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:45.853216    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a41e46c2-5f0f-4a1e-ba17-5867801466e8-plugins-config-volume\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:53:45.853248 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:45.853249    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jpd9p\" (UniqueName: \"kubernetes.io/projected/348918d6-ab67-48fb-8357-e1fd0e60152d-kube-api-access-jpd9p\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:53:45.853524 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:45.853261    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-442z5\" (UniqueName: \"kubernetes.io/projected/a41e46c2-5f0f-4a1e-ba17-5867801466e8-kube-api-access-442z5\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:53:45.853524 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:45.853273    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/348918d6-ab67-48fb-8357-e1fd0e60152d-plugins-config-volume\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:53:45.895800 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:45.895768    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-707dcc5c-openshift-default-77c978f868-64lt8"
Sep 15 13:53:45.896846 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:45.896826    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-707dcc5c-openshift-default-77c978f868-64lt8"
Sep 15 13:53:46.503346 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:46.503310    2578 generic.go:356] "Generic (PLEG): container finished" podID="348918d6-ab67-48fb-8357-e1fd0e60152d" containerID="e39bfe8dd920031a6396e4e56c39a8af7fe089e7f4741a86a78d64c5b248bbee" exitCode=0
Sep 15 13:53:46.503346 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:46.503351    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-707dcc5c-5564447578-72xsl"
Sep 15 13:53:46.503597 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:46.503389    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-707dcc5c-5564447578-72xsl" event={"ID":"348918d6-ab67-48fb-8357-e1fd0e60152d","Type":"ContainerDied","Data":"e39bfe8dd920031a6396e4e56c39a8af7fe089e7f4741a86a78d64c5b248bbee"}
Sep 15 13:53:46.503597 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:46.503439    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-707dcc5c-5564447578-72xsl" event={"ID":"348918d6-ab67-48fb-8357-e1fd0e60152d","Type":"ContainerDied","Data":"f692a4fc48c5301bda2067b67f8dd7cdf288a6f4057af11a42acb360c8846516"}
Sep 15 13:53:46.503597 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:46.503462    2578 scope.go:117] "RemoveContainer" containerID="e39bfe8dd920031a6396e4e56c39a8af7fe089e7f4741a86a78d64c5b248bbee"
Sep 15 13:53:46.504852 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:46.504698    2578 generic.go:356] "Generic (PLEG): container finished" podID="a41e46c2-5f0f-4a1e-ba17-5867801466e8" containerID="778c6344c37da02e44ff52a5eff4ebb2c466f96b9ce82b2d719d5c3fbba4bdea" exitCode=0
Sep 15 13:53:46.504852 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:46.504730    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-707dcc5c-85989d4dd7-ws5qn" event={"ID":"a41e46c2-5f0f-4a1e-ba17-5867801466e8","Type":"ContainerDied","Data":"778c6344c37da02e44ff52a5eff4ebb2c466f96b9ce82b2d719d5c3fbba4bdea"}
Sep 15 13:53:46.504852 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:46.504787    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-707dcc5c-85989d4dd7-ws5qn" event={"ID":"a41e46c2-5f0f-4a1e-ba17-5867801466e8","Type":"ContainerDied","Data":"f45256f70a16a8a021f5acaa3529fd658f79e311959f88722e7a399aa1529aa6"}
Sep 15 13:53:46.504852 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:46.504743    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-707dcc5c-85989d4dd7-ws5qn"
Sep 15 13:53:46.512878 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:46.512862    2578 scope.go:117] "RemoveContainer" containerID="e39bfe8dd920031a6396e4e56c39a8af7fe089e7f4741a86a78d64c5b248bbee"
Sep 15 13:53:46.513152 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:53:46.513111    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e39bfe8dd920031a6396e4e56c39a8af7fe089e7f4741a86a78d64c5b248bbee\": container with ID starting with e39bfe8dd920031a6396e4e56c39a8af7fe089e7f4741a86a78d64c5b248bbee not found: ID does not exist" containerID="e39bfe8dd920031a6396e4e56c39a8af7fe089e7f4741a86a78d64c5b248bbee"
Sep 15 13:53:46.513209 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:46.513162    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e39bfe8dd920031a6396e4e56c39a8af7fe089e7f4741a86a78d64c5b248bbee"} err="failed to get container status \"e39bfe8dd920031a6396e4e56c39a8af7fe089e7f4741a86a78d64c5b248bbee\": rpc error: code = NotFound desc = could not find container \"e39bfe8dd920031a6396e4e56c39a8af7fe089e7f4741a86a78d64c5b248bbee\": container with ID starting with e39bfe8dd920031a6396e4e56c39a8af7fe089e7f4741a86a78d64c5b248bbee not found: ID does not exist"
Sep 15 13:53:46.513209 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:46.513179    2578 scope.go:117] "RemoveContainer" containerID="778c6344c37da02e44ff52a5eff4ebb2c466f96b9ce82b2d719d5c3fbba4bdea"
Sep 15 13:53:46.521216 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:46.521198    2578 scope.go:117] "RemoveContainer" containerID="778c6344c37da02e44ff52a5eff4ebb2c466f96b9ce82b2d719d5c3fbba4bdea"
Sep 15 13:53:46.521468 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:53:46.521439    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"778c6344c37da02e44ff52a5eff4ebb2c466f96b9ce82b2d719d5c3fbba4bdea\": container with ID starting with 778c6344c37da02e44ff52a5eff4ebb2c466f96b9ce82b2d719d5c3fbba4bdea not found: ID does not exist" containerID="778c6344c37da02e44ff52a5eff4ebb2c466f96b9ce82b2d719d5c3fbba4bdea"
Sep 15 13:53:46.521535 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:46.521477    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"778c6344c37da02e44ff52a5eff4ebb2c466f96b9ce82b2d719d5c3fbba4bdea"} err="failed to get container status \"778c6344c37da02e44ff52a5eff4ebb2c466f96b9ce82b2d719d5c3fbba4bdea\": rpc error: code = NotFound desc = could not find container \"778c6344c37da02e44ff52a5eff4ebb2c466f96b9ce82b2d719d5c3fbba4bdea\": container with ID starting with 778c6344c37da02e44ff52a5eff4ebb2c466f96b9ce82b2d719d5c3fbba4bdea not found: ID does not exist"
Sep 15 13:53:46.522152 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:46.522109    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-707dcc5c-85989d4dd7-ws5qn"]
Sep 15 13:53:46.525661 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:46.525640    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-707dcc5c-85989d4dd7-ws5qn"]
Sep 15 13:53:46.535136 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:46.535105    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-707dcc5c-5564447578-72xsl"]
Sep 15 13:53:46.537507 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:46.537482    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-707dcc5c-5564447578-72xsl"]
Sep 15 13:53:46.670477 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:46.670401    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-707dcc5c-openshift-default-77c978f868-64lt8"]
Sep 15 13:53:47.394236 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:47.394203    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-974680ec-openshift-default-5477f5c74d-xf4w8"]
Sep 15 13:53:47.394734 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:47.394620    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a41e46c2-5f0f-4a1e-ba17-5867801466e8" containerName="payload-processing"
Sep 15 13:53:47.394734 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:47.394632    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a41e46c2-5f0f-4a1e-ba17-5867801466e8" containerName="payload-processing"
Sep 15 13:53:47.394734 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:47.394651    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="348918d6-ab67-48fb-8357-e1fd0e60152d" containerName="payload-pre-processing"
Sep 15 13:53:47.394734 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:47.394657    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="348918d6-ab67-48fb-8357-e1fd0e60152d" containerName="payload-pre-processing"
Sep 15 13:53:47.394734 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:47.394663    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f02d394e-65e0-454e-80cb-fa797a4a15ae" containerName="revoke-keys"
Sep 15 13:53:47.394734 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:47.394668    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f02d394e-65e0-454e-80cb-fa797a4a15ae" containerName="revoke-keys"
Sep 15 13:53:47.394734 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:47.394727    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f02d394e-65e0-454e-80cb-fa797a4a15ae" containerName="revoke-keys"
Sep 15 13:53:47.394734 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:47.394735    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="348918d6-ab67-48fb-8357-e1fd0e60152d" containerName="payload-pre-processing"
Sep 15 13:53:47.394734 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:47.394742    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a41e46c2-5f0f-4a1e-ba17-5867801466e8" containerName="payload-processing"
Sep 15 13:53:47.397701 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:47.397679    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-974680ec-openshift-default-5477f5c74d-xf4w8"
Sep 15 13:53:47.400196 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:47.400178    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-974680ec-openshift-default-dockercfg-mrf2c\""
Sep 15 13:53:47.415070 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:47.415042    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-974680ec-openshift-default-5477f5c74d-xf4w8"]
Sep 15 13:53:47.468599 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:47.468560    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85c78690-b012-48bd-9379-1ab052f51da3-istio-envoy\") pod \"e2e-derive-974680ec-openshift-default-5477f5c74d-xf4w8\" (UID: \"85c78690-b012-48bd-9379-1ab052f51da3\") " pod="openshift-ingress/e2e-derive-974680ec-openshift-default-5477f5c74d-xf4w8"
Sep 15 13:53:47.468800 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:47.468641    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85c78690-b012-48bd-9379-1ab052f51da3-workload-certs\") pod \"e2e-derive-974680ec-openshift-default-5477f5c74d-xf4w8\" (UID: \"85c78690-b012-48bd-9379-1ab052f51da3\") " pod="openshift-ingress/e2e-derive-974680ec-openshift-default-5477f5c74d-xf4w8"
Sep 15 13:53:47.468800 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:47.468682    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85c78690-b012-48bd-9379-1ab052f51da3-istiod-ca-cert\") pod \"e2e-derive-974680ec-openshift-default-5477f5c74d-xf4w8\" (UID: \"85c78690-b012-48bd-9379-1ab052f51da3\") " pod="openshift-ingress/e2e-derive-974680ec-openshift-default-5477f5c74d-xf4w8"
Sep 15 13:53:47.468800 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:47.468759    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85c78690-b012-48bd-9379-1ab052f51da3-credential-socket\") pod \"e2e-derive-974680ec-openshift-default-5477f5c74d-xf4w8\" (UID: \"85c78690-b012-48bd-9379-1ab052f51da3\") " pod="openshift-ingress/e2e-derive-974680ec-openshift-default-5477f5c74d-xf4w8"
Sep 15 13:53:47.468800 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:47.468788    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85c78690-b012-48bd-9379-1ab052f51da3-istio-token\") pod \"e2e-derive-974680ec-openshift-default-5477f5c74d-xf4w8\" (UID: \"85c78690-b012-48bd-9379-1ab052f51da3\") " pod="openshift-ingress/e2e-derive-974680ec-openshift-default-5477f5c74d-xf4w8"
Sep 15 13:53:47.469008 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:47.468840    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhw42\" (UniqueName: \"kubernetes.io/projected/85c78690-b012-48bd-9379-1ab052f51da3-kube-api-access-hhw42\") pod \"e2e-derive-974680ec-openshift-default-5477f5c74d-xf4w8\" (UID: \"85c78690-b012-48bd-9379-1ab052f51da3\") " pod="openshift-ingress/e2e-derive-974680ec-openshift-default-5477f5c74d-xf4w8"
Sep 15 13:53:47.469008 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:47.468875    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85c78690-b012-48bd-9379-1ab052f51da3-istio-podinfo\") pod \"e2e-derive-974680ec-openshift-default-5477f5c74d-xf4w8\" (UID: \"85c78690-b012-48bd-9379-1ab052f51da3\") " pod="openshift-ingress/e2e-derive-974680ec-openshift-default-5477f5c74d-xf4w8"
Sep 15 13:53:47.469008 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:47.468891    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85c78690-b012-48bd-9379-1ab052f51da3-workload-socket\") pod \"e2e-derive-974680ec-openshift-default-5477f5c74d-xf4w8\" (UID: \"85c78690-b012-48bd-9379-1ab052f51da3\") " pod="openshift-ingress/e2e-derive-974680ec-openshift-default-5477f5c74d-xf4w8"
Sep 15 13:53:47.469008 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:47.468938    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85c78690-b012-48bd-9379-1ab052f51da3-istio-data\") pod \"e2e-derive-974680ec-openshift-default-5477f5c74d-xf4w8\" (UID: \"85c78690-b012-48bd-9379-1ab052f51da3\") " pod="openshift-ingress/e2e-derive-974680ec-openshift-default-5477f5c74d-xf4w8"
Sep 15 13:53:47.517002 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:47.516948    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-707dcc5c-openshift-default-77c978f868-64lt8" podUID="616223cb-65a2-4eb8-bdc9-8fe948702e5b" containerName="istio-proxy" containerID="cri-o://0b0fb2370ea8aa31c556aa918544f355d83fe501b1fe319f9c64d16d4e32ebfa" gracePeriod=30
Sep 15 13:53:47.569912 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:47.569876    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85c78690-b012-48bd-9379-1ab052f51da3-workload-socket\") pod \"e2e-derive-974680ec-openshift-default-5477f5c74d-xf4w8\" (UID: \"85c78690-b012-48bd-9379-1ab052f51da3\") " pod="openshift-ingress/e2e-derive-974680ec-openshift-default-5477f5c74d-xf4w8"
Sep 15 13:53:47.570064 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:47.569921    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85c78690-b012-48bd-9379-1ab052f51da3-istio-data\") pod \"e2e-derive-974680ec-openshift-default-5477f5c74d-xf4w8\" (UID: \"85c78690-b012-48bd-9379-1ab052f51da3\") " pod="openshift-ingress/e2e-derive-974680ec-openshift-default-5477f5c74d-xf4w8"
Sep 15 13:53:47.570064 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:47.569952    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85c78690-b012-48bd-9379-1ab052f51da3-istio-envoy\") pod \"e2e-derive-974680ec-openshift-default-5477f5c74d-xf4w8\" (UID: \"85c78690-b012-48bd-9379-1ab052f51da3\") " pod="openshift-ingress/e2e-derive-974680ec-openshift-default-5477f5c74d-xf4w8"
Sep 15 13:53:47.570064 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:47.569988    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85c78690-b012-48bd-9379-1ab052f51da3-workload-certs\") pod \"e2e-derive-974680ec-openshift-default-5477f5c74d-xf4w8\" (UID: \"85c78690-b012-48bd-9379-1ab052f51da3\") " pod="openshift-ingress/e2e-derive-974680ec-openshift-default-5477f5c74d-xf4w8"
Sep 15 13:53:47.570064 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:47.570008    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85c78690-b012-48bd-9379-1ab052f51da3-istiod-ca-cert\") pod \"e2e-derive-974680ec-openshift-default-5477f5c74d-xf4w8\" (UID: \"85c78690-b012-48bd-9379-1ab052f51da3\") " pod="openshift-ingress/e2e-derive-974680ec-openshift-default-5477f5c74d-xf4w8"
Sep 15 13:53:47.570347 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:47.570098    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85c78690-b012-48bd-9379-1ab052f51da3-credential-socket\") pod \"e2e-derive-974680ec-openshift-default-5477f5c74d-xf4w8\" (UID: \"85c78690-b012-48bd-9379-1ab052f51da3\") " pod="openshift-ingress/e2e-derive-974680ec-openshift-default-5477f5c74d-xf4w8"
Sep 15 13:53:47.570347 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:47.570165    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85c78690-b012-48bd-9379-1ab052f51da3-istio-token\") pod \"e2e-derive-974680ec-openshift-default-5477f5c74d-xf4w8\" (UID: \"85c78690-b012-48bd-9379-1ab052f51da3\") " pod="openshift-ingress/e2e-derive-974680ec-openshift-default-5477f5c74d-xf4w8"
Sep 15 13:53:47.570347 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:47.570221    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhw42\" (UniqueName: \"kubernetes.io/projected/85c78690-b012-48bd-9379-1ab052f51da3-kube-api-access-hhw42\") pod \"e2e-derive-974680ec-openshift-default-5477f5c74d-xf4w8\" (UID: \"85c78690-b012-48bd-9379-1ab052f51da3\") " pod="openshift-ingress/e2e-derive-974680ec-openshift-default-5477f5c74d-xf4w8"
Sep 15 13:53:47.570347 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:47.570285    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85c78690-b012-48bd-9379-1ab052f51da3-istio-podinfo\") pod \"e2e-derive-974680ec-openshift-default-5477f5c74d-xf4w8\" (UID: \"85c78690-b012-48bd-9379-1ab052f51da3\") " pod="openshift-ingress/e2e-derive-974680ec-openshift-default-5477f5c74d-xf4w8"
Sep 15 13:53:47.570347 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:47.570331    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85c78690-b012-48bd-9379-1ab052f51da3-workload-socket\") pod \"e2e-derive-974680ec-openshift-default-5477f5c74d-xf4w8\" (UID: \"85c78690-b012-48bd-9379-1ab052f51da3\") " pod="openshift-ingress/e2e-derive-974680ec-openshift-default-5477f5c74d-xf4w8"
Sep 15 13:53:47.570630 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:47.570601    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85c78690-b012-48bd-9379-1ab052f51da3-workload-certs\") pod \"e2e-derive-974680ec-openshift-default-5477f5c74d-xf4w8\" (UID: \"85c78690-b012-48bd-9379-1ab052f51da3\") " pod="openshift-ingress/e2e-derive-974680ec-openshift-default-5477f5c74d-xf4w8"
Sep 15 13:53:47.570701 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:47.570623    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85c78690-b012-48bd-9379-1ab052f51da3-credential-socket\") pod \"e2e-derive-974680ec-openshift-default-5477f5c74d-xf4w8\" (UID: \"85c78690-b012-48bd-9379-1ab052f51da3\") " pod="openshift-ingress/e2e-derive-974680ec-openshift-default-5477f5c74d-xf4w8"
Sep 15 13:53:47.570701 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:47.570668    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85c78690-b012-48bd-9379-1ab052f51da3-istio-data\") pod \"e2e-derive-974680ec-openshift-default-5477f5c74d-xf4w8\" (UID: \"85c78690-b012-48bd-9379-1ab052f51da3\") " pod="openshift-ingress/e2e-derive-974680ec-openshift-default-5477f5c74d-xf4w8"
Sep 15 13:53:47.570701 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:47.570690    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85c78690-b012-48bd-9379-1ab052f51da3-istiod-ca-cert\") pod \"e2e-derive-974680ec-openshift-default-5477f5c74d-xf4w8\" (UID: \"85c78690-b012-48bd-9379-1ab052f51da3\") " pod="openshift-ingress/e2e-derive-974680ec-openshift-default-5477f5c74d-xf4w8"
Sep 15 13:53:47.572372 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:47.572339    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85c78690-b012-48bd-9379-1ab052f51da3-istio-envoy\") pod \"e2e-derive-974680ec-openshift-default-5477f5c74d-xf4w8\" (UID: \"85c78690-b012-48bd-9379-1ab052f51da3\") " pod="openshift-ingress/e2e-derive-974680ec-openshift-default-5477f5c74d-xf4w8"
Sep 15 13:53:47.572744 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:47.572727    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85c78690-b012-48bd-9379-1ab052f51da3-istio-podinfo\") pod \"e2e-derive-974680ec-openshift-default-5477f5c74d-xf4w8\" (UID: \"85c78690-b012-48bd-9379-1ab052f51da3\") " pod="openshift-ingress/e2e-derive-974680ec-openshift-default-5477f5c74d-xf4w8"
Sep 15 13:53:47.577951 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:47.577930    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85c78690-b012-48bd-9379-1ab052f51da3-istio-token\") pod \"e2e-derive-974680ec-openshift-default-5477f5c74d-xf4w8\" (UID: \"85c78690-b012-48bd-9379-1ab052f51da3\") " pod="openshift-ingress/e2e-derive-974680ec-openshift-default-5477f5c74d-xf4w8"
Sep 15 13:53:47.578473 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:47.578457    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhw42\" (UniqueName: \"kubernetes.io/projected/85c78690-b012-48bd-9379-1ab052f51da3-kube-api-access-hhw42\") pod \"e2e-derive-974680ec-openshift-default-5477f5c74d-xf4w8\" (UID: \"85c78690-b012-48bd-9379-1ab052f51da3\") " pod="openshift-ingress/e2e-derive-974680ec-openshift-default-5477f5c74d-xf4w8"
Sep 15 13:53:47.707816 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:47.707723    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-974680ec-openshift-default-5477f5c74d-xf4w8"
Sep 15 13:53:47.760426 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:47.760396    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="348918d6-ab67-48fb-8357-e1fd0e60152d" path="/var/lib/kubelet/pods/348918d6-ab67-48fb-8357-e1fd0e60152d/volumes"
Sep 15 13:53:47.760953 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:47.760933    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a41e46c2-5f0f-4a1e-ba17-5867801466e8" path="/var/lib/kubelet/pods/a41e46c2-5f0f-4a1e-ba17-5867801466e8/volumes"
Sep 15 13:53:47.985901 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:47.985874    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-974680ec-openshift-default-5477f5c74d-xf4w8"]
Sep 15 13:53:47.986985 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:53:47.986962    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85c78690_b012_48bd_9379_1ab052f51da3.slice/crio-9f6d7d4e98b2923d25cf54e19746375141b7598b3678e23deb27fc0fbc5e97d1 WatchSource:0}: Error finding container 9f6d7d4e98b2923d25cf54e19746375141b7598b3678e23deb27fc0fbc5e97d1: Status 404 returned error can't find the container with id 9f6d7d4e98b2923d25cf54e19746375141b7598b3678e23deb27fc0fbc5e97d1
Sep 15 13:53:47.989336 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:47.989307    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 15 13:53:47.989417 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:47.989367    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 15 13:53:47.989417 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:47.989393    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 15 13:53:48.525374 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:48.525336    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-974680ec-openshift-default-5477f5c74d-xf4w8" event={"ID":"85c78690-b012-48bd-9379-1ab052f51da3","Type":"ContainerStarted","Data":"481ccb22b30dc2b45bafae535f5c7bac14b65b5e11ce17b70d894f89f0418519"}
Sep 15 13:53:48.525770 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:48.525402    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-974680ec-openshift-default-5477f5c74d-xf4w8" event={"ID":"85c78690-b012-48bd-9379-1ab052f51da3","Type":"ContainerStarted","Data":"9f6d7d4e98b2923d25cf54e19746375141b7598b3678e23deb27fc0fbc5e97d1"}
Sep 15 13:53:48.548443 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:48.548393    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-974680ec-openshift-default-5477f5c74d-xf4w8" podStartSLOduration=1.548377242 podStartE2EDuration="1.548377242s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:53:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:53:48.54594739 +0000 UTC m=+915.305073689" watchObservedRunningTime="2026-09-15 13:53:48.548377242 +0000 UTC m=+915.307503528"
Sep 15 13:53:48.708513 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:48.708486    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-974680ec-openshift-default-5477f5c74d-xf4w8"
Sep 15 13:53:49.713640 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:49.713607    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-974680ec-openshift-default-5477f5c74d-xf4w8"
Sep 15 13:53:50.542436 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:50.542401    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-974680ec-openshift-default-5477f5c74d-xf4w8"
Sep 15 13:53:50.543441 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:50.543423    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-974680ec-openshift-default-5477f5c74d-xf4w8"
Sep 15 13:53:51.851679 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:51.851646    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-974680ec-7dc964686b-zrxms"]
Sep 15 13:53:51.854148 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:51.854110    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-974680ec-7dc964686b-zrxms"
Sep 15 13:53:51.857784 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:51.857756    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-974680ec\""
Sep 15 13:53:51.857897 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:51.857807    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-974680ec-dockercfg-45ngf\""
Sep 15 13:53:51.872923 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:51.872903    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-974680ec-7dc964686b-zrxms"]
Sep 15 13:53:51.887425 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:51.887389    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-974680ec-c86c579bf-mq5j9"]
Sep 15 13:53:51.890076 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:51.890057    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-974680ec-c86c579bf-mq5j9"
Sep 15 13:53:51.900237 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:51.900213    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-974680ec-c86c579bf-mq5j9"]
Sep 15 13:53:52.016250 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:52.016222    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/02a6aea8-f97a-4e59-92cf-155fc5198cc1-plugins-config-volume\") pod \"payload-processing-e2e-derive-974680ec-c86c579bf-mq5j9\" (UID: \"02a6aea8-f97a-4e59-92cf-155fc5198cc1\") " pod="openshift-ingress/payload-processing-e2e-derive-974680ec-c86c579bf-mq5j9"
Sep 15 13:53:52.016411 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:52.016265    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ngw8m\" (UniqueName: \"kubernetes.io/projected/aac97f6f-7c1a-48ac-88b5-3d54cc4e30a0-kube-api-access-ngw8m\") pod \"payload-pre-processing-e2e-derive-974680ec-7dc964686b-zrxms\" (UID: \"aac97f6f-7c1a-48ac-88b5-3d54cc4e30a0\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-974680ec-7dc964686b-zrxms"
Sep 15 13:53:52.016411 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:52.016295    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aac97f6f-7c1a-48ac-88b5-3d54cc4e30a0-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-974680ec-7dc964686b-zrxms\" (UID: \"aac97f6f-7c1a-48ac-88b5-3d54cc4e30a0\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-974680ec-7dc964686b-zrxms"
Sep 15 13:53:52.016411 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:52.016400    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcbmq\" (UniqueName: \"kubernetes.io/projected/02a6aea8-f97a-4e59-92cf-155fc5198cc1-kube-api-access-zcbmq\") pod \"payload-processing-e2e-derive-974680ec-c86c579bf-mq5j9\" (UID: \"02a6aea8-f97a-4e59-92cf-155fc5198cc1\") " pod="openshift-ingress/payload-processing-e2e-derive-974680ec-c86c579bf-mq5j9"
Sep 15 13:53:52.116940 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:52.116855    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcbmq\" (UniqueName: \"kubernetes.io/projected/02a6aea8-f97a-4e59-92cf-155fc5198cc1-kube-api-access-zcbmq\") pod \"payload-processing-e2e-derive-974680ec-c86c579bf-mq5j9\" (UID: \"02a6aea8-f97a-4e59-92cf-155fc5198cc1\") " pod="openshift-ingress/payload-processing-e2e-derive-974680ec-c86c579bf-mq5j9"
Sep 15 13:53:52.116940 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:52.116910    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/02a6aea8-f97a-4e59-92cf-155fc5198cc1-plugins-config-volume\") pod \"payload-processing-e2e-derive-974680ec-c86c579bf-mq5j9\" (UID: \"02a6aea8-f97a-4e59-92cf-155fc5198cc1\") " pod="openshift-ingress/payload-processing-e2e-derive-974680ec-c86c579bf-mq5j9"
Sep 15 13:53:52.116940 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:52.116939    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ngw8m\" (UniqueName: \"kubernetes.io/projected/aac97f6f-7c1a-48ac-88b5-3d54cc4e30a0-kube-api-access-ngw8m\") pod \"payload-pre-processing-e2e-derive-974680ec-7dc964686b-zrxms\" (UID: \"aac97f6f-7c1a-48ac-88b5-3d54cc4e30a0\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-974680ec-7dc964686b-zrxms"
Sep 15 13:53:52.117254 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:52.116966    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aac97f6f-7c1a-48ac-88b5-3d54cc4e30a0-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-974680ec-7dc964686b-zrxms\" (UID: \"aac97f6f-7c1a-48ac-88b5-3d54cc4e30a0\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-974680ec-7dc964686b-zrxms"
Sep 15 13:53:52.117678 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:52.117659    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aac97f6f-7c1a-48ac-88b5-3d54cc4e30a0-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-974680ec-7dc964686b-zrxms\" (UID: \"aac97f6f-7c1a-48ac-88b5-3d54cc4e30a0\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-974680ec-7dc964686b-zrxms"
Sep 15 13:53:52.117728 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:52.117712    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/02a6aea8-f97a-4e59-92cf-155fc5198cc1-plugins-config-volume\") pod \"payload-processing-e2e-derive-974680ec-c86c579bf-mq5j9\" (UID: \"02a6aea8-f97a-4e59-92cf-155fc5198cc1\") " pod="openshift-ingress/payload-processing-e2e-derive-974680ec-c86c579bf-mq5j9"
Sep 15 13:53:52.125594 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:52.125569    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ngw8m\" (UniqueName: \"kubernetes.io/projected/aac97f6f-7c1a-48ac-88b5-3d54cc4e30a0-kube-api-access-ngw8m\") pod \"payload-pre-processing-e2e-derive-974680ec-7dc964686b-zrxms\" (UID: \"aac97f6f-7c1a-48ac-88b5-3d54cc4e30a0\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-974680ec-7dc964686b-zrxms"
Sep 15 13:53:52.125707 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:52.125696    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcbmq\" (UniqueName: \"kubernetes.io/projected/02a6aea8-f97a-4e59-92cf-155fc5198cc1-kube-api-access-zcbmq\") pod \"payload-processing-e2e-derive-974680ec-c86c579bf-mq5j9\" (UID: \"02a6aea8-f97a-4e59-92cf-155fc5198cc1\") " pod="openshift-ingress/payload-processing-e2e-derive-974680ec-c86c579bf-mq5j9"
Sep 15 13:53:52.165206 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:52.165173    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-974680ec-7dc964686b-zrxms"
Sep 15 13:53:52.201504 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:52.201460    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-974680ec-c86c579bf-mq5j9"
Sep 15 13:53:52.438514 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:52.438490    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-974680ec-7dc964686b-zrxms"]
Sep 15 13:53:52.440870 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:53:52.440841    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaac97f6f_7c1a_48ac_88b5_3d54cc4e30a0.slice/crio-495f135538e1f331d4fe8c7b7dcefecdafcd821fd335ace4723dfbcd538cb941 WatchSource:0}: Error finding container 495f135538e1f331d4fe8c7b7dcefecdafcd821fd335ace4723dfbcd538cb941: Status 404 returned error can't find the container with id 495f135538e1f331d4fe8c7b7dcefecdafcd821fd335ace4723dfbcd538cb941
Sep 15 13:53:52.481937 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:52.481915    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-974680ec-c86c579bf-mq5j9"]
Sep 15 13:53:52.488153 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:53:52.488114    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02a6aea8_f97a_4e59_92cf_155fc5198cc1.slice/crio-fbe145f7001f81b2953ac2c1b3ced48cdee5b7bb73fcd82b4a237e3b1c9c7c45 WatchSource:0}: Error finding container fbe145f7001f81b2953ac2c1b3ced48cdee5b7bb73fcd82b4a237e3b1c9c7c45: Status 404 returned error can't find the container with id fbe145f7001f81b2953ac2c1b3ced48cdee5b7bb73fcd82b4a237e3b1c9c7c45
Sep 15 13:53:52.555057 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:52.555028    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-974680ec-c86c579bf-mq5j9" event={"ID":"02a6aea8-f97a-4e59-92cf-155fc5198cc1","Type":"ContainerStarted","Data":"fbe145f7001f81b2953ac2c1b3ced48cdee5b7bb73fcd82b4a237e3b1c9c7c45"}
Sep 15 13:53:52.556598 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:52.556573    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-974680ec-7dc964686b-zrxms" event={"ID":"aac97f6f-7c1a-48ac-88b5-3d54cc4e30a0","Type":"ContainerStarted","Data":"8b666f3cb785e5a0e8a237928320513b65de60547a167156e4a1ba371081ed36"}
Sep 15 13:53:52.556702 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:52.556620    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-974680ec-7dc964686b-zrxms" event={"ID":"aac97f6f-7c1a-48ac-88b5-3d54cc4e30a0","Type":"ContainerStarted","Data":"495f135538e1f331d4fe8c7b7dcefecdafcd821fd335ace4723dfbcd538cb941"}
Sep 15 13:53:52.556702 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:52.556661    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-974680ec-7dc964686b-zrxms"
Sep 15 13:53:52.574351 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:52.574313    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-974680ec-7dc964686b-zrxms" podStartSLOduration=1.574296746 podStartE2EDuration="1.574296746s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:53:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:53:52.572032208 +0000 UTC m=+919.331158496" watchObservedRunningTime="2026-09-15 13:53:52.574296746 +0000 UTC m=+919.333423031"
Sep 15 13:53:52.761466 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:52.761411    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-707dcc5c-openshift-default-77c978f868-64lt8"
Sep 15 13:53:52.924910 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:52.924879    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kw5pf\" (UniqueName: \"kubernetes.io/projected/616223cb-65a2-4eb8-bdc9-8fe948702e5b-kube-api-access-kw5pf\") pod \"616223cb-65a2-4eb8-bdc9-8fe948702e5b\" (UID: \"616223cb-65a2-4eb8-bdc9-8fe948702e5b\") "
Sep 15 13:53:52.925390 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:52.924931    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/616223cb-65a2-4eb8-bdc9-8fe948702e5b-istio-data\") pod \"616223cb-65a2-4eb8-bdc9-8fe948702e5b\" (UID: \"616223cb-65a2-4eb8-bdc9-8fe948702e5b\") "
Sep 15 13:53:52.925390 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:52.924952    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/616223cb-65a2-4eb8-bdc9-8fe948702e5b-istio-podinfo\") pod \"616223cb-65a2-4eb8-bdc9-8fe948702e5b\" (UID: \"616223cb-65a2-4eb8-bdc9-8fe948702e5b\") "
Sep 15 13:53:52.925390 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:52.924974    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/616223cb-65a2-4eb8-bdc9-8fe948702e5b-istiod-ca-cert\") pod \"616223cb-65a2-4eb8-bdc9-8fe948702e5b\" (UID: \"616223cb-65a2-4eb8-bdc9-8fe948702e5b\") "
Sep 15 13:53:52.925390 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:52.925094    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/616223cb-65a2-4eb8-bdc9-8fe948702e5b-workload-socket\") pod \"616223cb-65a2-4eb8-bdc9-8fe948702e5b\" (UID: \"616223cb-65a2-4eb8-bdc9-8fe948702e5b\") "
Sep 15 13:53:52.925390 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:52.925167    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/616223cb-65a2-4eb8-bdc9-8fe948702e5b-credential-socket\") pod \"616223cb-65a2-4eb8-bdc9-8fe948702e5b\" (UID: \"616223cb-65a2-4eb8-bdc9-8fe948702e5b\") "
Sep 15 13:53:52.925390 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:52.925266    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/616223cb-65a2-4eb8-bdc9-8fe948702e5b-istio-envoy\") pod \"616223cb-65a2-4eb8-bdc9-8fe948702e5b\" (UID: \"616223cb-65a2-4eb8-bdc9-8fe948702e5b\") "
Sep 15 13:53:52.925390 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:52.925301    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/616223cb-65a2-4eb8-bdc9-8fe948702e5b-workload-certs\") pod \"616223cb-65a2-4eb8-bdc9-8fe948702e5b\" (UID: \"616223cb-65a2-4eb8-bdc9-8fe948702e5b\") "
Sep 15 13:53:52.925390 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:52.925365    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/616223cb-65a2-4eb8-bdc9-8fe948702e5b-istio-token\") pod \"616223cb-65a2-4eb8-bdc9-8fe948702e5b\" (UID: \"616223cb-65a2-4eb8-bdc9-8fe948702e5b\") "
Sep 15 13:53:52.925390 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:52.925231    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/616223cb-65a2-4eb8-bdc9-8fe948702e5b-istio-data" (OuterVolumeSpecName: "istio-data") pod "616223cb-65a2-4eb8-bdc9-8fe948702e5b" (UID: "616223cb-65a2-4eb8-bdc9-8fe948702e5b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:53:52.926048 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:52.925315    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/616223cb-65a2-4eb8-bdc9-8fe948702e5b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "616223cb-65a2-4eb8-bdc9-8fe948702e5b" (UID: "616223cb-65a2-4eb8-bdc9-8fe948702e5b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:53:52.926048 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:52.925421    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/616223cb-65a2-4eb8-bdc9-8fe948702e5b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "616223cb-65a2-4eb8-bdc9-8fe948702e5b" (UID: "616223cb-65a2-4eb8-bdc9-8fe948702e5b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:53:52.926048 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:52.925468    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/616223cb-65a2-4eb8-bdc9-8fe948702e5b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "616223cb-65a2-4eb8-bdc9-8fe948702e5b" (UID: "616223cb-65a2-4eb8-bdc9-8fe948702e5b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:53:52.926048 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:52.925682    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/616223cb-65a2-4eb8-bdc9-8fe948702e5b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "616223cb-65a2-4eb8-bdc9-8fe948702e5b" (UID: "616223cb-65a2-4eb8-bdc9-8fe948702e5b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 13:53:52.926048 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:52.925743    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/616223cb-65a2-4eb8-bdc9-8fe948702e5b-istio-data\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:53:52.926048 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:52.925759    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/616223cb-65a2-4eb8-bdc9-8fe948702e5b-workload-socket\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:53:52.926048 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:52.925769    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/616223cb-65a2-4eb8-bdc9-8fe948702e5b-credential-socket\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:53:52.926048 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:52.925778    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/616223cb-65a2-4eb8-bdc9-8fe948702e5b-workload-certs\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:53:52.927446 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:52.927419    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/616223cb-65a2-4eb8-bdc9-8fe948702e5b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "616223cb-65a2-4eb8-bdc9-8fe948702e5b" (UID: "616223cb-65a2-4eb8-bdc9-8fe948702e5b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 13:53:52.927446 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:52.927425    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/616223cb-65a2-4eb8-bdc9-8fe948702e5b-kube-api-access-kw5pf" (OuterVolumeSpecName: "kube-api-access-kw5pf") pod "616223cb-65a2-4eb8-bdc9-8fe948702e5b" (UID: "616223cb-65a2-4eb8-bdc9-8fe948702e5b"). InnerVolumeSpecName "kube-api-access-kw5pf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:53:52.927748 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:52.927731    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/616223cb-65a2-4eb8-bdc9-8fe948702e5b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "616223cb-65a2-4eb8-bdc9-8fe948702e5b" (UID: "616223cb-65a2-4eb8-bdc9-8fe948702e5b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:53:52.927827 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:52.927810    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/616223cb-65a2-4eb8-bdc9-8fe948702e5b-istio-token" (OuterVolumeSpecName: "istio-token") pod "616223cb-65a2-4eb8-bdc9-8fe948702e5b" (UID: "616223cb-65a2-4eb8-bdc9-8fe948702e5b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:53:53.026697 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:53.026674    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/616223cb-65a2-4eb8-bdc9-8fe948702e5b-istio-envoy\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:53:53.026856 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:53.026701    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/616223cb-65a2-4eb8-bdc9-8fe948702e5b-istio-token\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:53:53.026856 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:53.026715    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kw5pf\" (UniqueName: \"kubernetes.io/projected/616223cb-65a2-4eb8-bdc9-8fe948702e5b-kube-api-access-kw5pf\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:53:53.026856 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:53.026724    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/616223cb-65a2-4eb8-bdc9-8fe948702e5b-istio-podinfo\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:53:53.026856 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:53.026733    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/616223cb-65a2-4eb8-bdc9-8fe948702e5b-istiod-ca-cert\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:53:53.564008 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:53.563974    2578 generic.go:356] "Generic (PLEG): container finished" podID="616223cb-65a2-4eb8-bdc9-8fe948702e5b" containerID="0b0fb2370ea8aa31c556aa918544f355d83fe501b1fe319f9c64d16d4e32ebfa" exitCode=0
Sep 15 13:53:53.564216 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:53.564022    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-707dcc5c-openshift-default-77c978f868-64lt8"
Sep 15 13:53:53.564216 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:53.564058    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-707dcc5c-openshift-default-77c978f868-64lt8" event={"ID":"616223cb-65a2-4eb8-bdc9-8fe948702e5b","Type":"ContainerDied","Data":"0b0fb2370ea8aa31c556aa918544f355d83fe501b1fe319f9c64d16d4e32ebfa"}
Sep 15 13:53:53.564216 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:53.564106    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-707dcc5c-openshift-default-77c978f868-64lt8" event={"ID":"616223cb-65a2-4eb8-bdc9-8fe948702e5b","Type":"ContainerDied","Data":"63bf26e6d44e56a8cb6c2083000c2342e5f0574c2eda942b1607a84572ce5e9c"}
Sep 15 13:53:53.564216 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:53.564151    2578 scope.go:117] "RemoveContainer" containerID="0b0fb2370ea8aa31c556aa918544f355d83fe501b1fe319f9c64d16d4e32ebfa"
Sep 15 13:53:53.565885 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:53.565852    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-974680ec-c86c579bf-mq5j9" event={"ID":"02a6aea8-f97a-4e59-92cf-155fc5198cc1","Type":"ContainerStarted","Data":"9be5303a0f3a719d17d1fada5762c4949b4b1f46e1b8b126e2d24f5ee87f7499"}
Sep 15 13:53:53.566077 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:53.566061    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-974680ec-c86c579bf-mq5j9"
Sep 15 13:53:53.577101 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:53.577081    2578 scope.go:117] "RemoveContainer" containerID="34c73a8bf6672d292aee1275ed437e1560e60da966d89174d9c5e0a2e7521c13"
Sep 15 13:53:53.585729 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:53.585688    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-974680ec-c86c579bf-mq5j9" podStartSLOduration=2.5856757249999998 podStartE2EDuration="2.585675725s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:53:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:53:53.58453641 +0000 UTC m=+920.343662696" watchObservedRunningTime="2026-09-15 13:53:53.585675725 +0000 UTC m=+920.344802043"
Sep 15 13:53:53.586271 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:53.586254    2578 scope.go:117] "RemoveContainer" containerID="0b0fb2370ea8aa31c556aa918544f355d83fe501b1fe319f9c64d16d4e32ebfa"
Sep 15 13:53:53.586543 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:53:53.586522    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b0fb2370ea8aa31c556aa918544f355d83fe501b1fe319f9c64d16d4e32ebfa\": container with ID starting with 0b0fb2370ea8aa31c556aa918544f355d83fe501b1fe319f9c64d16d4e32ebfa not found: ID does not exist" containerID="0b0fb2370ea8aa31c556aa918544f355d83fe501b1fe319f9c64d16d4e32ebfa"
Sep 15 13:53:53.586610 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:53.586551    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b0fb2370ea8aa31c556aa918544f355d83fe501b1fe319f9c64d16d4e32ebfa"} err="failed to get container status \"0b0fb2370ea8aa31c556aa918544f355d83fe501b1fe319f9c64d16d4e32ebfa\": rpc error: code = NotFound desc = could not find container \"0b0fb2370ea8aa31c556aa918544f355d83fe501b1fe319f9c64d16d4e32ebfa\": container with ID starting with 0b0fb2370ea8aa31c556aa918544f355d83fe501b1fe319f9c64d16d4e32ebfa not found: ID does not exist"
Sep 15 13:53:53.586610 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:53.586570    2578 scope.go:117] "RemoveContainer" containerID="34c73a8bf6672d292aee1275ed437e1560e60da966d89174d9c5e0a2e7521c13"
Sep 15 13:53:53.586837 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:53:53.586821    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"34c73a8bf6672d292aee1275ed437e1560e60da966d89174d9c5e0a2e7521c13\": container with ID starting with 34c73a8bf6672d292aee1275ed437e1560e60da966d89174d9c5e0a2e7521c13 not found: ID does not exist" containerID="34c73a8bf6672d292aee1275ed437e1560e60da966d89174d9c5e0a2e7521c13"
Sep 15 13:53:53.586893 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:53.586841    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34c73a8bf6672d292aee1275ed437e1560e60da966d89174d9c5e0a2e7521c13"} err="failed to get container status \"34c73a8bf6672d292aee1275ed437e1560e60da966d89174d9c5e0a2e7521c13\": rpc error: code = NotFound desc = could not find container \"34c73a8bf6672d292aee1275ed437e1560e60da966d89174d9c5e0a2e7521c13\": container with ID starting with 34c73a8bf6672d292aee1275ed437e1560e60da966d89174d9c5e0a2e7521c13 not found: ID does not exist"
Sep 15 13:53:53.598973 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:53.598949    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-707dcc5c-openshift-default-77c978f868-64lt8"]
Sep 15 13:53:53.604490 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:53.604468    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-707dcc5c-openshift-default-77c978f868-64lt8"]
Sep 15 13:53:53.758178 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:53:53.758141    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="616223cb-65a2-4eb8-bdc9-8fe948702e5b" path="/var/lib/kubelet/pods/616223cb-65a2-4eb8-bdc9-8fe948702e5b/volumes"
Sep 15 13:54:03.567806 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:03.567775    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-974680ec-7dc964686b-zrxms"
Sep 15 13:54:04.574578 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:04.574550    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-974680ec-c86c579bf-mq5j9"
Sep 15 13:54:13.695054 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:13.695020    2578 generic.go:356] "Generic (PLEG): container finished" podID="85c78690-b012-48bd-9379-1ab052f51da3" containerID="481ccb22b30dc2b45bafae535f5c7bac14b65b5e11ce17b70d894f89f0418519" exitCode=0
Sep 15 13:54:13.695479 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:13.695087    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-974680ec-openshift-default-5477f5c74d-xf4w8" event={"ID":"85c78690-b012-48bd-9379-1ab052f51da3","Type":"ContainerDied","Data":"481ccb22b30dc2b45bafae535f5c7bac14b65b5e11ce17b70d894f89f0418519"}
Sep 15 13:54:13.695526 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:13.695501    2578 scope.go:117] "RemoveContainer" containerID="481ccb22b30dc2b45bafae535f5c7bac14b65b5e11ce17b70d894f89f0418519"
Sep 15 13:54:13.696651 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:13.696627    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 15 13:54:13.696715 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:13.696691    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 15 13:54:13.696750 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:13.696722    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 15 13:54:14.704057 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:14.704013    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-974680ec-openshift-default-5477f5c74d-xf4w8" event={"ID":"85c78690-b012-48bd-9379-1ab052f51da3","Type":"ContainerStarted","Data":"00cf031401819913148bb3f62b022cadb1d3ac1ab0b06535a3c60c110e57442f"}
Sep 15 13:54:14.707978 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:14.707956    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-974680ec-openshift-default-5477f5c74d-xf4w8"
Sep 15 13:54:14.708226 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:14.708116    2578 patch_prober.go:28] interesting pod/e2e-derive-974680ec-openshift-default-5477f5c74d-xf4w8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Sep 15 13:54:14.708226 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:14.708204    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-974680ec-openshift-default-5477f5c74d-xf4w8" podUID="85c78690-b012-48bd-9379-1ab052f51da3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Sep 15 13:54:14.717281 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:14.717255    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-974680ec-rrw8n"]
Sep 15 13:54:14.717654 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:14.717641    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="616223cb-65a2-4eb8-bdc9-8fe948702e5b" containerName="istio-proxy"
Sep 15 13:54:14.717704 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:14.717656    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="616223cb-65a2-4eb8-bdc9-8fe948702e5b" containerName="istio-proxy"
Sep 15 13:54:14.717704 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:14.717668    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="616223cb-65a2-4eb8-bdc9-8fe948702e5b" containerName="istio-proxy"
Sep 15 13:54:14.717704 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:14.717673    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="616223cb-65a2-4eb8-bdc9-8fe948702e5b" containerName="istio-proxy"
Sep 15 13:54:14.717797 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:14.717732    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="616223cb-65a2-4eb8-bdc9-8fe948702e5b" containerName="istio-proxy"
Sep 15 13:54:14.717797 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:14.717741    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="616223cb-65a2-4eb8-bdc9-8fe948702e5b" containerName="istio-proxy"
Sep 15 13:54:14.719691 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:14.719676    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-974680ec-rrw8n"
Sep 15 13:54:14.722460 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:14.722430    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qzmkv\""
Sep 15 13:54:14.722460 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:14.722450    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 15 13:54:14.722635 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:14.722438    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 13:54:14.732589 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:14.732564    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-974680ec-rrw8n"]
Sep 15 13:54:14.863228 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:14.863191    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/64474064-1fe2-47a9-bd22-ff389c15f46f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-974680ec-rrw8n\" (UID: \"64474064-1fe2-47a9-bd22-ff389c15f46f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-974680ec-rrw8n"
Sep 15 13:54:14.863408 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:14.863244    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nblp4\" (UniqueName: \"kubernetes.io/projected/64474064-1fe2-47a9-bd22-ff389c15f46f-kube-api-access-nblp4\") pod \"maas-api-revoke-keys-e2e-derive-974680ec-rrw8n\" (UID: \"64474064-1fe2-47a9-bd22-ff389c15f46f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-974680ec-rrw8n"
Sep 15 13:54:14.964601 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:14.964514    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/64474064-1fe2-47a9-bd22-ff389c15f46f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-974680ec-rrw8n\" (UID: \"64474064-1fe2-47a9-bd22-ff389c15f46f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-974680ec-rrw8n"
Sep 15 13:54:14.964601 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:14.964567    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nblp4\" (UniqueName: \"kubernetes.io/projected/64474064-1fe2-47a9-bd22-ff389c15f46f-kube-api-access-nblp4\") pod \"maas-api-revoke-keys-e2e-derive-974680ec-rrw8n\" (UID: \"64474064-1fe2-47a9-bd22-ff389c15f46f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-974680ec-rrw8n"
Sep 15 13:54:14.965154 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:14.965109    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/64474064-1fe2-47a9-bd22-ff389c15f46f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-974680ec-rrw8n\" (UID: \"64474064-1fe2-47a9-bd22-ff389c15f46f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-974680ec-rrw8n"
Sep 15 13:54:14.973301 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:14.973281    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nblp4\" (UniqueName: \"kubernetes.io/projected/64474064-1fe2-47a9-bd22-ff389c15f46f-kube-api-access-nblp4\") pod \"maas-api-revoke-keys-e2e-derive-974680ec-rrw8n\" (UID: \"64474064-1fe2-47a9-bd22-ff389c15f46f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-974680ec-rrw8n"
Sep 15 13:54:15.031284 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:15.031250    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-974680ec-rrw8n"
Sep 15 13:54:15.306098 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:15.306071    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-974680ec-rrw8n"]
Sep 15 13:54:15.307652 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:54:15.307624    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64474064_1fe2_47a9_bd22_ff389c15f46f.slice/crio-f5f053e4aceb569bc9c40e95903e10be9c998b2814ee6e23ce4bc4555a6b438b WatchSource:0}: Error finding container f5f053e4aceb569bc9c40e95903e10be9c998b2814ee6e23ce4bc4555a6b438b: Status 404 returned error can't find the container with id f5f053e4aceb569bc9c40e95903e10be9c998b2814ee6e23ce4bc4555a6b438b
Sep 15 13:54:15.708597 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:15.708567    2578 patch_prober.go:28] interesting pod/e2e-derive-974680ec-openshift-default-5477f5c74d-xf4w8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Sep 15 13:54:15.708979 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:15.708620    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-974680ec-openshift-default-5477f5c74d-xf4w8" podUID="85c78690-b012-48bd-9379-1ab052f51da3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Sep 15 13:54:15.711502 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:15.711471    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-974680ec-rrw8n" event={"ID":"64474064-1fe2-47a9-bd22-ff389c15f46f","Type":"ContainerStarted","Data":"a803aa68c222e88ce257f1630007367560e60ba76a2abcc573dc345cc2cfb5a6"}
Sep 15 13:54:15.711649 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:15.711525    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-974680ec-rrw8n" event={"ID":"64474064-1fe2-47a9-bd22-ff389c15f46f","Type":"ContainerStarted","Data":"f5f053e4aceb569bc9c40e95903e10be9c998b2814ee6e23ce4bc4555a6b438b"}
Sep 15 13:54:15.728643 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:15.728594    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-974680ec-rrw8n" podStartSLOduration=1.728580859 podStartE2EDuration="1.728580859s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:54:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:54:15.725683042 +0000 UTC m=+942.484809328" watchObservedRunningTime="2026-09-15 13:54:15.728580859 +0000 UTC m=+942.487707198"
Sep 15 13:54:16.708417 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:16.708328    2578 patch_prober.go:28] interesting pod/e2e-derive-974680ec-openshift-default-5477f5c74d-xf4w8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Sep 15 13:54:16.708417 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:16.708382    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-974680ec-openshift-default-5477f5c74d-xf4w8" podUID="85c78690-b012-48bd-9379-1ab052f51da3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Sep 15 13:54:16.725274 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:16.725238    2578 generic.go:356] "Generic (PLEG): container finished" podID="64474064-1fe2-47a9-bd22-ff389c15f46f" containerID="a803aa68c222e88ce257f1630007367560e60ba76a2abcc573dc345cc2cfb5a6" exitCode=0
Sep 15 13:54:16.725655 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:16.725326    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-974680ec-rrw8n" event={"ID":"64474064-1fe2-47a9-bd22-ff389c15f46f","Type":"ContainerDied","Data":"a803aa68c222e88ce257f1630007367560e60ba76a2abcc573dc345cc2cfb5a6"}
Sep 15 13:54:17.708758 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:17.708719    2578 patch_prober.go:28] interesting pod/e2e-derive-974680ec-openshift-default-5477f5c74d-xf4w8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Sep 15 13:54:17.708944 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:17.708777    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-974680ec-openshift-default-5477f5c74d-xf4w8" podUID="85c78690-b012-48bd-9379-1ab052f51da3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Sep 15 13:54:17.909728 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:17.909706    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-974680ec-rrw8n"
Sep 15 13:54:18.002662 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:18.002569    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/64474064-1fe2-47a9-bd22-ff389c15f46f-maas-api-service-ca\") pod \"64474064-1fe2-47a9-bd22-ff389c15f46f\" (UID: \"64474064-1fe2-47a9-bd22-ff389c15f46f\") "
Sep 15 13:54:18.002819 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:18.002678    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nblp4\" (UniqueName: \"kubernetes.io/projected/64474064-1fe2-47a9-bd22-ff389c15f46f-kube-api-access-nblp4\") pod \"64474064-1fe2-47a9-bd22-ff389c15f46f\" (UID: \"64474064-1fe2-47a9-bd22-ff389c15f46f\") "
Sep 15 13:54:18.002899 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:18.002876    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/64474064-1fe2-47a9-bd22-ff389c15f46f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "64474064-1fe2-47a9-bd22-ff389c15f46f" (UID: "64474064-1fe2-47a9-bd22-ff389c15f46f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 13:54:18.004817 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:18.004787    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64474064-1fe2-47a9-bd22-ff389c15f46f-kube-api-access-nblp4" (OuterVolumeSpecName: "kube-api-access-nblp4") pod "64474064-1fe2-47a9-bd22-ff389c15f46f" (UID: "64474064-1fe2-47a9-bd22-ff389c15f46f"). InnerVolumeSpecName "kube-api-access-nblp4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:54:18.103768 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:18.103722    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/64474064-1fe2-47a9-bd22-ff389c15f46f-maas-api-service-ca\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:54:18.103768 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:18.103763    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nblp4\" (UniqueName: \"kubernetes.io/projected/64474064-1fe2-47a9-bd22-ff389c15f46f-kube-api-access-nblp4\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:54:18.708516 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:18.708479    2578 patch_prober.go:28] interesting pod/e2e-derive-974680ec-openshift-default-5477f5c74d-xf4w8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Sep 15 13:54:18.708695 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:18.708545    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-974680ec-openshift-default-5477f5c74d-xf4w8" podUID="85c78690-b012-48bd-9379-1ab052f51da3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Sep 15 13:54:18.737208 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:18.737181    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-974680ec-rrw8n"
Sep 15 13:54:18.737347 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:18.737218    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-974680ec-rrw8n" event={"ID":"64474064-1fe2-47a9-bd22-ff389c15f46f","Type":"ContainerDied","Data":"f5f053e4aceb569bc9c40e95903e10be9c998b2814ee6e23ce4bc4555a6b438b"}
Sep 15 13:54:18.737347 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:18.737269    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f5f053e4aceb569bc9c40e95903e10be9c998b2814ee6e23ce4bc4555a6b438b"
Sep 15 13:54:19.708199 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:19.708163    2578 patch_prober.go:28] interesting pod/e2e-derive-974680ec-openshift-default-5477f5c74d-xf4w8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Sep 15 13:54:19.708589 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:19.708244    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-974680ec-openshift-default-5477f5c74d-xf4w8" podUID="85c78690-b012-48bd-9379-1ab052f51da3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Sep 15 13:54:20.543354 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:20.543316    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-974680ec-openshift-default-5477f5c74d-xf4w8"
Sep 15 13:54:20.708420 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:20.708380    2578 patch_prober.go:28] interesting pod/e2e-derive-974680ec-openshift-default-5477f5c74d-xf4w8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Sep 15 13:54:20.708901 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:20.708444    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-974680ec-openshift-default-5477f5c74d-xf4w8" podUID="85c78690-b012-48bd-9379-1ab052f51da3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Sep 15 13:54:21.712346 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:21.712313    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-974680ec-openshift-default-5477f5c74d-xf4w8"
Sep 15 13:54:21.713506 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:21.713484    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-974680ec-openshift-default-5477f5c74d-xf4w8"
Sep 15 13:54:21.950445 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:21.950410    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-974680ec-c86c579bf-mq5j9"]
Sep 15 13:54:21.951806 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:21.951770    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-974680ec-c86c579bf-mq5j9" podUID="02a6aea8-f97a-4e59-92cf-155fc5198cc1" containerName="payload-processing" containerID="cri-o://9be5303a0f3a719d17d1fada5762c4949b4b1f46e1b8b126e2d24f5ee87f7499" gracePeriod=30
Sep 15 13:54:21.956736 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:21.956705    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-974680ec-7dc964686b-zrxms"]
Sep 15 13:54:21.956994 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:21.956951    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-974680ec-7dc964686b-zrxms" podUID="aac97f6f-7c1a-48ac-88b5-3d54cc4e30a0" containerName="payload-pre-processing" containerID="cri-o://8b666f3cb785e5a0e8a237928320513b65de60547a167156e4a1ba371081ed36" gracePeriod=30
Sep 15 13:54:22.130757 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:22.130695    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-974680ec-rrw8n"]
Sep 15 13:54:22.135774 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:22.135745    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-974680ec-rrw8n"]
Sep 15 13:54:22.234638 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:22.234551    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-974680ec-c86c579bf-mq5j9"
Sep 15 13:54:22.238679 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:22.238653    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-974680ec-7dc964686b-zrxms"
Sep 15 13:54:22.252572 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:22.252543    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-974680ec-openshift-default-5477f5c74d-xf4w8"]
Sep 15 13:54:22.345737 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:22.345699    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/02a6aea8-f97a-4e59-92cf-155fc5198cc1-plugins-config-volume\") pod \"02a6aea8-f97a-4e59-92cf-155fc5198cc1\" (UID: \"02a6aea8-f97a-4e59-92cf-155fc5198cc1\") "
Sep 15 13:54:22.345737 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:22.345740    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aac97f6f-7c1a-48ac-88b5-3d54cc4e30a0-plugins-config-volume\") pod \"aac97f6f-7c1a-48ac-88b5-3d54cc4e30a0\" (UID: \"aac97f6f-7c1a-48ac-88b5-3d54cc4e30a0\") "
Sep 15 13:54:22.346054 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:22.345779    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ngw8m\" (UniqueName: \"kubernetes.io/projected/aac97f6f-7c1a-48ac-88b5-3d54cc4e30a0-kube-api-access-ngw8m\") pod \"aac97f6f-7c1a-48ac-88b5-3d54cc4e30a0\" (UID: \"aac97f6f-7c1a-48ac-88b5-3d54cc4e30a0\") "
Sep 15 13:54:22.346054 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:22.345820    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zcbmq\" (UniqueName: \"kubernetes.io/projected/02a6aea8-f97a-4e59-92cf-155fc5198cc1-kube-api-access-zcbmq\") pod \"02a6aea8-f97a-4e59-92cf-155fc5198cc1\" (UID: \"02a6aea8-f97a-4e59-92cf-155fc5198cc1\") "
Sep 15 13:54:22.346808 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:22.346409    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02a6aea8-f97a-4e59-92cf-155fc5198cc1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "02a6aea8-f97a-4e59-92cf-155fc5198cc1" (UID: "02a6aea8-f97a-4e59-92cf-155fc5198cc1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 13:54:22.346808 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:22.346649    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/02a6aea8-f97a-4e59-92cf-155fc5198cc1-plugins-config-volume\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:54:22.347096 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:22.347067    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aac97f6f-7c1a-48ac-88b5-3d54cc4e30a0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "aac97f6f-7c1a-48ac-88b5-3d54cc4e30a0" (UID: "aac97f6f-7c1a-48ac-88b5-3d54cc4e30a0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 13:54:22.350422 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:22.350391    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02a6aea8-f97a-4e59-92cf-155fc5198cc1-kube-api-access-zcbmq" (OuterVolumeSpecName: "kube-api-access-zcbmq") pod "02a6aea8-f97a-4e59-92cf-155fc5198cc1" (UID: "02a6aea8-f97a-4e59-92cf-155fc5198cc1"). InnerVolumeSpecName "kube-api-access-zcbmq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:54:22.355275 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:22.355241    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aac97f6f-7c1a-48ac-88b5-3d54cc4e30a0-kube-api-access-ngw8m" (OuterVolumeSpecName: "kube-api-access-ngw8m") pod "aac97f6f-7c1a-48ac-88b5-3d54cc4e30a0" (UID: "aac97f6f-7c1a-48ac-88b5-3d54cc4e30a0"). InnerVolumeSpecName "kube-api-access-ngw8m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:54:22.447728 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:22.447697    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aac97f6f-7c1a-48ac-88b5-3d54cc4e30a0-plugins-config-volume\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:54:22.447728 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:22.447724    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ngw8m\" (UniqueName: \"kubernetes.io/projected/aac97f6f-7c1a-48ac-88b5-3d54cc4e30a0-kube-api-access-ngw8m\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:54:22.447728 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:22.447735    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zcbmq\" (UniqueName: \"kubernetes.io/projected/02a6aea8-f97a-4e59-92cf-155fc5198cc1-kube-api-access-zcbmq\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:54:22.763525 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:22.763492    2578 generic.go:356] "Generic (PLEG): container finished" podID="02a6aea8-f97a-4e59-92cf-155fc5198cc1" containerID="9be5303a0f3a719d17d1fada5762c4949b4b1f46e1b8b126e2d24f5ee87f7499" exitCode=0
Sep 15 13:54:22.764007 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:22.763539    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-974680ec-c86c579bf-mq5j9"
Sep 15 13:54:22.764007 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:22.763578    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-974680ec-c86c579bf-mq5j9" event={"ID":"02a6aea8-f97a-4e59-92cf-155fc5198cc1","Type":"ContainerDied","Data":"9be5303a0f3a719d17d1fada5762c4949b4b1f46e1b8b126e2d24f5ee87f7499"}
Sep 15 13:54:22.764007 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:22.763629    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-974680ec-c86c579bf-mq5j9" event={"ID":"02a6aea8-f97a-4e59-92cf-155fc5198cc1","Type":"ContainerDied","Data":"fbe145f7001f81b2953ac2c1b3ced48cdee5b7bb73fcd82b4a237e3b1c9c7c45"}
Sep 15 13:54:22.764007 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:22.763659    2578 scope.go:117] "RemoveContainer" containerID="9be5303a0f3a719d17d1fada5762c4949b4b1f46e1b8b126e2d24f5ee87f7499"
Sep 15 13:54:22.765013 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:22.764994    2578 generic.go:356] "Generic (PLEG): container finished" podID="aac97f6f-7c1a-48ac-88b5-3d54cc4e30a0" containerID="8b666f3cb785e5a0e8a237928320513b65de60547a167156e4a1ba371081ed36" exitCode=0
Sep 15 13:54:22.765145 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:22.765021    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-974680ec-7dc964686b-zrxms"
Sep 15 13:54:22.765145 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:22.765053    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-974680ec-7dc964686b-zrxms" event={"ID":"aac97f6f-7c1a-48ac-88b5-3d54cc4e30a0","Type":"ContainerDied","Data":"8b666f3cb785e5a0e8a237928320513b65de60547a167156e4a1ba371081ed36"}
Sep 15 13:54:22.765145 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:22.765095    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-974680ec-7dc964686b-zrxms" event={"ID":"aac97f6f-7c1a-48ac-88b5-3d54cc4e30a0","Type":"ContainerDied","Data":"495f135538e1f331d4fe8c7b7dcefecdafcd821fd335ace4723dfbcd538cb941"}
Sep 15 13:54:22.765334 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:22.765316    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-974680ec-openshift-default-5477f5c74d-xf4w8" podUID="85c78690-b012-48bd-9379-1ab052f51da3" containerName="istio-proxy" containerID="cri-o://00cf031401819913148bb3f62b022cadb1d3ac1ab0b06535a3c60c110e57442f" gracePeriod=30
Sep 15 13:54:22.774149 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:22.774096    2578 scope.go:117] "RemoveContainer" containerID="9be5303a0f3a719d17d1fada5762c4949b4b1f46e1b8b126e2d24f5ee87f7499"
Sep 15 13:54:22.774471 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:54:22.774450    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9be5303a0f3a719d17d1fada5762c4949b4b1f46e1b8b126e2d24f5ee87f7499\": container with ID starting with 9be5303a0f3a719d17d1fada5762c4949b4b1f46e1b8b126e2d24f5ee87f7499 not found: ID does not exist" containerID="9be5303a0f3a719d17d1fada5762c4949b4b1f46e1b8b126e2d24f5ee87f7499"
Sep 15 13:54:22.774557 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:22.774480    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9be5303a0f3a719d17d1fada5762c4949b4b1f46e1b8b126e2d24f5ee87f7499"} err="failed to get container status \"9be5303a0f3a719d17d1fada5762c4949b4b1f46e1b8b126e2d24f5ee87f7499\": rpc error: code = NotFound desc = could not find container \"9be5303a0f3a719d17d1fada5762c4949b4b1f46e1b8b126e2d24f5ee87f7499\": container with ID starting with 9be5303a0f3a719d17d1fada5762c4949b4b1f46e1b8b126e2d24f5ee87f7499 not found: ID does not exist"
Sep 15 13:54:22.774557 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:22.774496    2578 scope.go:117] "RemoveContainer" containerID="8b666f3cb785e5a0e8a237928320513b65de60547a167156e4a1ba371081ed36"
Sep 15 13:54:22.783168 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:22.783149    2578 scope.go:117] "RemoveContainer" containerID="8b666f3cb785e5a0e8a237928320513b65de60547a167156e4a1ba371081ed36"
Sep 15 13:54:22.783439 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:54:22.783421    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b666f3cb785e5a0e8a237928320513b65de60547a167156e4a1ba371081ed36\": container with ID starting with 8b666f3cb785e5a0e8a237928320513b65de60547a167156e4a1ba371081ed36 not found: ID does not exist" containerID="8b666f3cb785e5a0e8a237928320513b65de60547a167156e4a1ba371081ed36"
Sep 15 13:54:22.783503 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:22.783445    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b666f3cb785e5a0e8a237928320513b65de60547a167156e4a1ba371081ed36"} err="failed to get container status \"8b666f3cb785e5a0e8a237928320513b65de60547a167156e4a1ba371081ed36\": rpc error: code = NotFound desc = could not find container \"8b666f3cb785e5a0e8a237928320513b65de60547a167156e4a1ba371081ed36\": container with ID starting with 8b666f3cb785e5a0e8a237928320513b65de60547a167156e4a1ba371081ed36 not found: ID does not exist"
Sep 15 13:54:22.806439 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:22.806414    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-974680ec-c86c579bf-mq5j9"]
Sep 15 13:54:22.810536 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:22.810514    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-974680ec-c86c579bf-mq5j9"]
Sep 15 13:54:22.821735 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:22.821714    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-974680ec-7dc964686b-zrxms"]
Sep 15 13:54:22.827569 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:22.827548    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-974680ec-7dc964686b-zrxms"]
Sep 15 13:54:23.758478 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:23.758447    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="02a6aea8-f97a-4e59-92cf-155fc5198cc1" path="/var/lib/kubelet/pods/02a6aea8-f97a-4e59-92cf-155fc5198cc1/volumes"
Sep 15 13:54:23.758850 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:23.758838    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="64474064-1fe2-47a9-bd22-ff389c15f46f" path="/var/lib/kubelet/pods/64474064-1fe2-47a9-bd22-ff389c15f46f/volumes"
Sep 15 13:54:23.759179 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:23.759167    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aac97f6f-7c1a-48ac-88b5-3d54cc4e30a0" path="/var/lib/kubelet/pods/aac97f6f-7c1a-48ac-88b5-3d54cc4e30a0/volumes"
Sep 15 13:54:28.012224 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:28.012198    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-974680ec-openshift-default-5477f5c74d-xf4w8"
Sep 15 13:54:28.203370 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:28.203284    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85c78690-b012-48bd-9379-1ab052f51da3-credential-socket\") pod \"85c78690-b012-48bd-9379-1ab052f51da3\" (UID: \"85c78690-b012-48bd-9379-1ab052f51da3\") "
Sep 15 13:54:28.203370 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:28.203329    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85c78690-b012-48bd-9379-1ab052f51da3-istio-token\") pod \"85c78690-b012-48bd-9379-1ab052f51da3\" (UID: \"85c78690-b012-48bd-9379-1ab052f51da3\") "
Sep 15 13:54:28.203370 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:28.203364    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85c78690-b012-48bd-9379-1ab052f51da3-workload-certs\") pod \"85c78690-b012-48bd-9379-1ab052f51da3\" (UID: \"85c78690-b012-48bd-9379-1ab052f51da3\") "
Sep 15 13:54:28.203646 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:28.203407    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85c78690-b012-48bd-9379-1ab052f51da3-istiod-ca-cert\") pod \"85c78690-b012-48bd-9379-1ab052f51da3\" (UID: \"85c78690-b012-48bd-9379-1ab052f51da3\") "
Sep 15 13:54:28.203646 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:28.203428    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85c78690-b012-48bd-9379-1ab052f51da3-istio-data\") pod \"85c78690-b012-48bd-9379-1ab052f51da3\" (UID: \"85c78690-b012-48bd-9379-1ab052f51da3\") "
Sep 15 13:54:28.203646 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:28.203476    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hhw42\" (UniqueName: \"kubernetes.io/projected/85c78690-b012-48bd-9379-1ab052f51da3-kube-api-access-hhw42\") pod \"85c78690-b012-48bd-9379-1ab052f51da3\" (UID: \"85c78690-b012-48bd-9379-1ab052f51da3\") "
Sep 15 13:54:28.203646 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:28.203499    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85c78690-b012-48bd-9379-1ab052f51da3-istio-podinfo\") pod \"85c78690-b012-48bd-9379-1ab052f51da3\" (UID: \"85c78690-b012-48bd-9379-1ab052f51da3\") "
Sep 15 13:54:28.203646 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:28.203526    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85c78690-b012-48bd-9379-1ab052f51da3-workload-socket\") pod \"85c78690-b012-48bd-9379-1ab052f51da3\" (UID: \"85c78690-b012-48bd-9379-1ab052f51da3\") "
Sep 15 13:54:28.203646 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:28.203581    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85c78690-b012-48bd-9379-1ab052f51da3-istio-envoy\") pod \"85c78690-b012-48bd-9379-1ab052f51da3\" (UID: \"85c78690-b012-48bd-9379-1ab052f51da3\") "
Sep 15 13:54:28.203646 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:28.203610    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85c78690-b012-48bd-9379-1ab052f51da3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "85c78690-b012-48bd-9379-1ab052f51da3" (UID: "85c78690-b012-48bd-9379-1ab052f51da3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:54:28.204021 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:28.203748    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85c78690-b012-48bd-9379-1ab052f51da3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "85c78690-b012-48bd-9379-1ab052f51da3" (UID: "85c78690-b012-48bd-9379-1ab052f51da3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:54:28.204021 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:28.203868    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85c78690-b012-48bd-9379-1ab052f51da3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "85c78690-b012-48bd-9379-1ab052f51da3" (UID: "85c78690-b012-48bd-9379-1ab052f51da3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 13:54:28.204021 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:28.203896    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85c78690-b012-48bd-9379-1ab052f51da3-istio-data" (OuterVolumeSpecName: "istio-data") pod "85c78690-b012-48bd-9379-1ab052f51da3" (UID: "85c78690-b012-48bd-9379-1ab052f51da3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:54:28.204021 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:28.203969    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85c78690-b012-48bd-9379-1ab052f51da3-credential-socket\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:54:28.204021 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:28.203990    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85c78690-b012-48bd-9379-1ab052f51da3-workload-certs\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:54:28.204021 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:28.204003    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85c78690-b012-48bd-9379-1ab052f51da3-istiod-ca-cert\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:54:28.204533 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:28.204114    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85c78690-b012-48bd-9379-1ab052f51da3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "85c78690-b012-48bd-9379-1ab052f51da3" (UID: "85c78690-b012-48bd-9379-1ab052f51da3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:54:28.205783 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:28.205759    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85c78690-b012-48bd-9379-1ab052f51da3-istio-token" (OuterVolumeSpecName: "istio-token") pod "85c78690-b012-48bd-9379-1ab052f51da3" (UID: "85c78690-b012-48bd-9379-1ab052f51da3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:54:28.205889 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:28.205823    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/85c78690-b012-48bd-9379-1ab052f51da3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "85c78690-b012-48bd-9379-1ab052f51da3" (UID: "85c78690-b012-48bd-9379-1ab052f51da3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 13:54:28.206357 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:28.206338    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85c78690-b012-48bd-9379-1ab052f51da3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "85c78690-b012-48bd-9379-1ab052f51da3" (UID: "85c78690-b012-48bd-9379-1ab052f51da3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:54:28.206429 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:28.206406    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85c78690-b012-48bd-9379-1ab052f51da3-kube-api-access-hhw42" (OuterVolumeSpecName: "kube-api-access-hhw42") pod "85c78690-b012-48bd-9379-1ab052f51da3" (UID: "85c78690-b012-48bd-9379-1ab052f51da3"). InnerVolumeSpecName "kube-api-access-hhw42". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:54:28.304721 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:28.304686    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85c78690-b012-48bd-9379-1ab052f51da3-istio-envoy\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:54:28.304721 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:28.304714    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85c78690-b012-48bd-9379-1ab052f51da3-istio-token\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:54:28.304721 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:28.304722    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85c78690-b012-48bd-9379-1ab052f51da3-istio-data\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:54:28.304948 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:28.304731    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hhw42\" (UniqueName: \"kubernetes.io/projected/85c78690-b012-48bd-9379-1ab052f51da3-kube-api-access-hhw42\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:54:28.304948 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:28.304741    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85c78690-b012-48bd-9379-1ab052f51da3-istio-podinfo\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:54:28.304948 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:28.304749    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85c78690-b012-48bd-9379-1ab052f51da3-workload-socket\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:54:28.806882 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:28.806848    2578 generic.go:356] "Generic (PLEG): container finished" podID="85c78690-b012-48bd-9379-1ab052f51da3" containerID="00cf031401819913148bb3f62b022cadb1d3ac1ab0b06535a3c60c110e57442f" exitCode=0
Sep 15 13:54:28.807047 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:28.806898    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-974680ec-openshift-default-5477f5c74d-xf4w8"
Sep 15 13:54:28.807047 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:28.806938    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-974680ec-openshift-default-5477f5c74d-xf4w8" event={"ID":"85c78690-b012-48bd-9379-1ab052f51da3","Type":"ContainerDied","Data":"00cf031401819913148bb3f62b022cadb1d3ac1ab0b06535a3c60c110e57442f"}
Sep 15 13:54:28.807047 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:28.806994    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-974680ec-openshift-default-5477f5c74d-xf4w8" event={"ID":"85c78690-b012-48bd-9379-1ab052f51da3","Type":"ContainerDied","Data":"9f6d7d4e98b2923d25cf54e19746375141b7598b3678e23deb27fc0fbc5e97d1"}
Sep 15 13:54:28.807047 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:28.807016    2578 scope.go:117] "RemoveContainer" containerID="00cf031401819913148bb3f62b022cadb1d3ac1ab0b06535a3c60c110e57442f"
Sep 15 13:54:28.817400 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:28.817379    2578 scope.go:117] "RemoveContainer" containerID="481ccb22b30dc2b45bafae535f5c7bac14b65b5e11ce17b70d894f89f0418519"
Sep 15 13:54:28.826506 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:28.826490    2578 scope.go:117] "RemoveContainer" containerID="00cf031401819913148bb3f62b022cadb1d3ac1ab0b06535a3c60c110e57442f"
Sep 15 13:54:28.826769 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:54:28.826750    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00cf031401819913148bb3f62b022cadb1d3ac1ab0b06535a3c60c110e57442f\": container with ID starting with 00cf031401819913148bb3f62b022cadb1d3ac1ab0b06535a3c60c110e57442f not found: ID does not exist" containerID="00cf031401819913148bb3f62b022cadb1d3ac1ab0b06535a3c60c110e57442f"
Sep 15 13:54:28.826820 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:28.826777    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00cf031401819913148bb3f62b022cadb1d3ac1ab0b06535a3c60c110e57442f"} err="failed to get container status \"00cf031401819913148bb3f62b022cadb1d3ac1ab0b06535a3c60c110e57442f\": rpc error: code = NotFound desc = could not find container \"00cf031401819913148bb3f62b022cadb1d3ac1ab0b06535a3c60c110e57442f\": container with ID starting with 00cf031401819913148bb3f62b022cadb1d3ac1ab0b06535a3c60c110e57442f not found: ID does not exist"
Sep 15 13:54:28.826820 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:28.826792    2578 scope.go:117] "RemoveContainer" containerID="481ccb22b30dc2b45bafae535f5c7bac14b65b5e11ce17b70d894f89f0418519"
Sep 15 13:54:28.827024 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:54:28.827010    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"481ccb22b30dc2b45bafae535f5c7bac14b65b5e11ce17b70d894f89f0418519\": container with ID starting with 481ccb22b30dc2b45bafae535f5c7bac14b65b5e11ce17b70d894f89f0418519 not found: ID does not exist" containerID="481ccb22b30dc2b45bafae535f5c7bac14b65b5e11ce17b70d894f89f0418519"
Sep 15 13:54:28.827065 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:28.827028    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"481ccb22b30dc2b45bafae535f5c7bac14b65b5e11ce17b70d894f89f0418519"} err="failed to get container status \"481ccb22b30dc2b45bafae535f5c7bac14b65b5e11ce17b70d894f89f0418519\": rpc error: code = NotFound desc = could not find container \"481ccb22b30dc2b45bafae535f5c7bac14b65b5e11ce17b70d894f89f0418519\": container with ID starting with 481ccb22b30dc2b45bafae535f5c7bac14b65b5e11ce17b70d894f89f0418519 not found: ID does not exist"
Sep 15 13:54:28.828018 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:28.828001    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-974680ec-openshift-default-5477f5c74d-xf4w8"]
Sep 15 13:54:28.834000 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:28.833981    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-974680ec-openshift-default-5477f5c74d-xf4w8"]
Sep 15 13:54:29.758081 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:29.758049    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="85c78690-b012-48bd-9379-1ab052f51da3" path="/var/lib/kubelet/pods/85c78690-b012-48bd-9379-1ab052f51da3/volumes"
Sep 15 13:54:30.422698 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:30.422661    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-4441a1/test-model-4441a1-kserve-57b7d97547-d65cq"]
Sep 15 13:54:30.423107 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:30.423090    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85c78690-b012-48bd-9379-1ab052f51da3" containerName="istio-proxy"
Sep 15 13:54:30.423229 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:30.423110    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="85c78690-b012-48bd-9379-1ab052f51da3" containerName="istio-proxy"
Sep 15 13:54:30.423229 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:30.423144    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aac97f6f-7c1a-48ac-88b5-3d54cc4e30a0" containerName="payload-pre-processing"
Sep 15 13:54:30.423229 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:30.423153    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="aac97f6f-7c1a-48ac-88b5-3d54cc4e30a0" containerName="payload-pre-processing"
Sep 15 13:54:30.423229 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:30.423171    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64474064-1fe2-47a9-bd22-ff389c15f46f" containerName="revoke-keys"
Sep 15 13:54:30.423229 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:30.423181    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="64474064-1fe2-47a9-bd22-ff389c15f46f" containerName="revoke-keys"
Sep 15 13:54:30.423229 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:30.423193    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85c78690-b012-48bd-9379-1ab052f51da3" containerName="istio-proxy"
Sep 15 13:54:30.423229 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:30.423202    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="85c78690-b012-48bd-9379-1ab052f51da3" containerName="istio-proxy"
Sep 15 13:54:30.423229 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:30.423216    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02a6aea8-f97a-4e59-92cf-155fc5198cc1" containerName="payload-processing"
Sep 15 13:54:30.423229 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:30.423224    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="02a6aea8-f97a-4e59-92cf-155fc5198cc1" containerName="payload-processing"
Sep 15 13:54:30.423662 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:30.423339    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="aac97f6f-7c1a-48ac-88b5-3d54cc4e30a0" containerName="payload-pre-processing"
Sep 15 13:54:30.423662 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:30.423352    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="64474064-1fe2-47a9-bd22-ff389c15f46f" containerName="revoke-keys"
Sep 15 13:54:30.423662 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:30.423365    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="85c78690-b012-48bd-9379-1ab052f51da3" containerName="istio-proxy"
Sep 15 13:54:30.423662 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:30.423376    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="02a6aea8-f97a-4e59-92cf-155fc5198cc1" containerName="payload-processing"
Sep 15 13:54:30.426551 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:30.426530    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-4441a1/test-model-4441a1-kserve-57b7d97547-d65cq"
Sep 15 13:54:30.429543 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:30.429521    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-4441a1\"/\"test-model-4441a1-kserve-self-signed-certs\""
Sep 15 13:54:30.429618 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:30.429545    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-4441a1\"/\"kube-root-ca.crt\""
Sep 15 13:54:30.429718 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:30.429698    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-4441a1\"/\"default-dockercfg-lpjl5\""
Sep 15 13:54:30.429760 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:30.429709    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-4441a1\"/\"openshift-service-ca.crt\""
Sep 15 13:54:30.435887 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:30.435865    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-4441a1/test-model-4441a1-kserve-57b7d97547-d65cq"]
Sep 15 13:54:30.526233 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:30.526206    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c3318f2d-abc0-4000-a96d-05599233d4ae-home\") pod \"test-model-4441a1-kserve-57b7d97547-d65cq\" (UID: \"c3318f2d-abc0-4000-a96d-05599233d4ae\") " pod="ai-tenant-e2e-inf-a-4441a1/test-model-4441a1-kserve-57b7d97547-d65cq"
Sep 15 13:54:30.526394 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:30.526238    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c3318f2d-abc0-4000-a96d-05599233d4ae-tmp-dir\") pod \"test-model-4441a1-kserve-57b7d97547-d65cq\" (UID: \"c3318f2d-abc0-4000-a96d-05599233d4ae\") " pod="ai-tenant-e2e-inf-a-4441a1/test-model-4441a1-kserve-57b7d97547-d65cq"
Sep 15 13:54:30.526394 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:30.526295    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzpkk\" (UniqueName: \"kubernetes.io/projected/c3318f2d-abc0-4000-a96d-05599233d4ae-kube-api-access-dzpkk\") pod \"test-model-4441a1-kserve-57b7d97547-d65cq\" (UID: \"c3318f2d-abc0-4000-a96d-05599233d4ae\") " pod="ai-tenant-e2e-inf-a-4441a1/test-model-4441a1-kserve-57b7d97547-d65cq"
Sep 15 13:54:30.526394 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:30.526338    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c3318f2d-abc0-4000-a96d-05599233d4ae-tls-certs\") pod \"test-model-4441a1-kserve-57b7d97547-d65cq\" (UID: \"c3318f2d-abc0-4000-a96d-05599233d4ae\") " pod="ai-tenant-e2e-inf-a-4441a1/test-model-4441a1-kserve-57b7d97547-d65cq"
Sep 15 13:54:30.526506 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:30.526403    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c3318f2d-abc0-4000-a96d-05599233d4ae-model-cache\") pod \"test-model-4441a1-kserve-57b7d97547-d65cq\" (UID: \"c3318f2d-abc0-4000-a96d-05599233d4ae\") " pod="ai-tenant-e2e-inf-a-4441a1/test-model-4441a1-kserve-57b7d97547-d65cq"
Sep 15 13:54:30.526506 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:30.526445    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c3318f2d-abc0-4000-a96d-05599233d4ae-dshm\") pod \"test-model-4441a1-kserve-57b7d97547-d65cq\" (UID: \"c3318f2d-abc0-4000-a96d-05599233d4ae\") " pod="ai-tenant-e2e-inf-a-4441a1/test-model-4441a1-kserve-57b7d97547-d65cq"
Sep 15 13:54:30.627216 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:30.627178    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c3318f2d-abc0-4000-a96d-05599233d4ae-home\") pod \"test-model-4441a1-kserve-57b7d97547-d65cq\" (UID: \"c3318f2d-abc0-4000-a96d-05599233d4ae\") " pod="ai-tenant-e2e-inf-a-4441a1/test-model-4441a1-kserve-57b7d97547-d65cq"
Sep 15 13:54:30.627388 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:30.627228    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c3318f2d-abc0-4000-a96d-05599233d4ae-tmp-dir\") pod \"test-model-4441a1-kserve-57b7d97547-d65cq\" (UID: \"c3318f2d-abc0-4000-a96d-05599233d4ae\") " pod="ai-tenant-e2e-inf-a-4441a1/test-model-4441a1-kserve-57b7d97547-d65cq"
Sep 15 13:54:30.627388 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:30.627273    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzpkk\" (UniqueName: \"kubernetes.io/projected/c3318f2d-abc0-4000-a96d-05599233d4ae-kube-api-access-dzpkk\") pod \"test-model-4441a1-kserve-57b7d97547-d65cq\" (UID: \"c3318f2d-abc0-4000-a96d-05599233d4ae\") " pod="ai-tenant-e2e-inf-a-4441a1/test-model-4441a1-kserve-57b7d97547-d65cq"
Sep 15 13:54:30.627388 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:30.627335    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c3318f2d-abc0-4000-a96d-05599233d4ae-tls-certs\") pod \"test-model-4441a1-kserve-57b7d97547-d65cq\" (UID: \"c3318f2d-abc0-4000-a96d-05599233d4ae\") " pod="ai-tenant-e2e-inf-a-4441a1/test-model-4441a1-kserve-57b7d97547-d65cq"
Sep 15 13:54:30.627388 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:30.627375    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c3318f2d-abc0-4000-a96d-05599233d4ae-model-cache\") pod \"test-model-4441a1-kserve-57b7d97547-d65cq\" (UID: \"c3318f2d-abc0-4000-a96d-05599233d4ae\") " pod="ai-tenant-e2e-inf-a-4441a1/test-model-4441a1-kserve-57b7d97547-d65cq"
Sep 15 13:54:30.627594 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:30.627423    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c3318f2d-abc0-4000-a96d-05599233d4ae-dshm\") pod \"test-model-4441a1-kserve-57b7d97547-d65cq\" (UID: \"c3318f2d-abc0-4000-a96d-05599233d4ae\") " pod="ai-tenant-e2e-inf-a-4441a1/test-model-4441a1-kserve-57b7d97547-d65cq"
Sep 15 13:54:30.627594 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:30.627577    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c3318f2d-abc0-4000-a96d-05599233d4ae-home\") pod \"test-model-4441a1-kserve-57b7d97547-d65cq\" (UID: \"c3318f2d-abc0-4000-a96d-05599233d4ae\") " pod="ai-tenant-e2e-inf-a-4441a1/test-model-4441a1-kserve-57b7d97547-d65cq"
Sep 15 13:54:30.627705 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:30.627605    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c3318f2d-abc0-4000-a96d-05599233d4ae-tmp-dir\") pod \"test-model-4441a1-kserve-57b7d97547-d65cq\" (UID: \"c3318f2d-abc0-4000-a96d-05599233d4ae\") " pod="ai-tenant-e2e-inf-a-4441a1/test-model-4441a1-kserve-57b7d97547-d65cq"
Sep 15 13:54:30.627705 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:30.627664    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c3318f2d-abc0-4000-a96d-05599233d4ae-model-cache\") pod \"test-model-4441a1-kserve-57b7d97547-d65cq\" (UID: \"c3318f2d-abc0-4000-a96d-05599233d4ae\") " pod="ai-tenant-e2e-inf-a-4441a1/test-model-4441a1-kserve-57b7d97547-d65cq"
Sep 15 13:54:30.629001 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:30.628978    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-80a7cc-p97ql"]
Sep 15 13:54:30.629723 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:30.629702    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="85c78690-b012-48bd-9379-1ab052f51da3" containerName="istio-proxy"
Sep 15 13:54:30.629963 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:30.629947    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c3318f2d-abc0-4000-a96d-05599233d4ae-dshm\") pod \"test-model-4441a1-kserve-57b7d97547-d65cq\" (UID: \"c3318f2d-abc0-4000-a96d-05599233d4ae\") " pod="ai-tenant-e2e-inf-a-4441a1/test-model-4441a1-kserve-57b7d97547-d65cq"
Sep 15 13:54:30.630089 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:30.630071    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c3318f2d-abc0-4000-a96d-05599233d4ae-tls-certs\") pod \"test-model-4441a1-kserve-57b7d97547-d65cq\" (UID: \"c3318f2d-abc0-4000-a96d-05599233d4ae\") " pod="ai-tenant-e2e-inf-a-4441a1/test-model-4441a1-kserve-57b7d97547-d65cq"
Sep 15 13:54:30.632934 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:30.632920    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-80a7cc-p97ql"
Sep 15 13:54:30.635604 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:30.635552    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 13:54:30.635705 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:30.635692    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qzmkv\""
Sep 15 13:54:30.636066 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:30.635835    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 15 13:54:30.636860 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:30.636833    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzpkk\" (UniqueName: \"kubernetes.io/projected/c3318f2d-abc0-4000-a96d-05599233d4ae-kube-api-access-dzpkk\") pod \"test-model-4441a1-kserve-57b7d97547-d65cq\" (UID: \"c3318f2d-abc0-4000-a96d-05599233d4ae\") " pod="ai-tenant-e2e-inf-a-4441a1/test-model-4441a1-kserve-57b7d97547-d65cq"
Sep 15 13:54:30.639913 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:30.639892    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-80a7cc-p97ql"]
Sep 15 13:54:30.728489 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:30.728398    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0624f68-913d-473a-a1a2-bac510c14483-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-80a7cc-p97ql\" (UID: \"f0624f68-913d-473a-a1a2-bac510c14483\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-80a7cc-p97ql"
Sep 15 13:54:30.728489 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:30.728444    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f57cg\" (UniqueName: \"kubernetes.io/projected/f0624f68-913d-473a-a1a2-bac510c14483-kube-api-access-f57cg\") pod \"maas-api-revoke-keys-e2e-autores-80a7cc-p97ql\" (UID: \"f0624f68-913d-473a-a1a2-bac510c14483\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-80a7cc-p97ql"
Sep 15 13:54:30.737269 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:30.737241    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-4441a1/test-model-4441a1-kserve-57b7d97547-d65cq"
Sep 15 13:54:30.829083 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:30.829033    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0624f68-913d-473a-a1a2-bac510c14483-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-80a7cc-p97ql\" (UID: \"f0624f68-913d-473a-a1a2-bac510c14483\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-80a7cc-p97ql"
Sep 15 13:54:30.829557 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:30.829105    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f57cg\" (UniqueName: \"kubernetes.io/projected/f0624f68-913d-473a-a1a2-bac510c14483-kube-api-access-f57cg\") pod \"maas-api-revoke-keys-e2e-autores-80a7cc-p97ql\" (UID: \"f0624f68-913d-473a-a1a2-bac510c14483\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-80a7cc-p97ql"
Sep 15 13:54:30.829734 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:30.829714    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0624f68-913d-473a-a1a2-bac510c14483-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-80a7cc-p97ql\" (UID: \"f0624f68-913d-473a-a1a2-bac510c14483\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-80a7cc-p97ql"
Sep 15 13:54:30.837847 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:30.837819    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f57cg\" (UniqueName: \"kubernetes.io/projected/f0624f68-913d-473a-a1a2-bac510c14483-kube-api-access-f57cg\") pod \"maas-api-revoke-keys-e2e-autores-80a7cc-p97ql\" (UID: \"f0624f68-913d-473a-a1a2-bac510c14483\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-80a7cc-p97ql"
Sep 15 13:54:30.958002 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:30.957852    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-80a7cc-p97ql"
Sep 15 13:54:31.009541 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:31.009512    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-4441a1/test-model-4441a1-kserve-57b7d97547-d65cq"]
Sep 15 13:54:31.011025 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:54:31.010998    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc3318f2d_abc0_4000_a96d_05599233d4ae.slice/crio-dcb60d9326bc362e0732371e500855d74a59ba4b3e597829b2749402c439e662 WatchSource:0}: Error finding container dcb60d9326bc362e0732371e500855d74a59ba4b3e597829b2749402c439e662: Status 404 returned error can't find the container with id dcb60d9326bc362e0732371e500855d74a59ba4b3e597829b2749402c439e662
Sep 15 13:54:31.248767 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:31.248746    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-80a7cc-p97ql"]
Sep 15 13:54:31.250715 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:54:31.250688    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0624f68_913d_473a_a1a2_bac510c14483.slice/crio-ece503a21a4b78c748aa6dff5045cd2a7a6d85958b1dd066e5f4543ae0c84a93 WatchSource:0}: Error finding container ece503a21a4b78c748aa6dff5045cd2a7a6d85958b1dd066e5f4543ae0c84a93: Status 404 returned error can't find the container with id ece503a21a4b78c748aa6dff5045cd2a7a6d85958b1dd066e5f4543ae0c84a93
Sep 15 13:54:31.826830 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:31.826729    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-4441a1/test-model-4441a1-kserve-57b7d97547-d65cq" event={"ID":"c3318f2d-abc0-4000-a96d-05599233d4ae","Type":"ContainerStarted","Data":"5a258a6158ff5fa5bdeba9bc9daca959da18b340efa6050a0d4eb7e2a272fc62"}
Sep 15 13:54:31.826830 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:31.826777    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-4441a1/test-model-4441a1-kserve-57b7d97547-d65cq" event={"ID":"c3318f2d-abc0-4000-a96d-05599233d4ae","Type":"ContainerStarted","Data":"dcb60d9326bc362e0732371e500855d74a59ba4b3e597829b2749402c439e662"}
Sep 15 13:54:31.828297 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:31.828270    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-80a7cc-p97ql" event={"ID":"f0624f68-913d-473a-a1a2-bac510c14483","Type":"ContainerStarted","Data":"7987fa5366b2c0dc62e45a6d45514767eba25985cf38d25a9cba6db231364e0b"}
Sep 15 13:54:31.828421 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:31.828309    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-80a7cc-p97ql" event={"ID":"f0624f68-913d-473a-a1a2-bac510c14483","Type":"ContainerStarted","Data":"ece503a21a4b78c748aa6dff5045cd2a7a6d85958b1dd066e5f4543ae0c84a93"}
Sep 15 13:54:31.844604 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:31.844560    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-4441a1/test-model-4441a1-kserve-57b7d97547-d65cq" podStartSLOduration=1.844535561 podStartE2EDuration="1.844535561s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:54:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:54:31.841916999 +0000 UTC m=+958.601043282" watchObservedRunningTime="2026-09-15 13:54:31.844535561 +0000 UTC m=+958.603661847"
Sep 15 13:54:31.857207 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:31.857164    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-80a7cc-p97ql" podStartSLOduration=1.8571497300000002 podStartE2EDuration="1.85714973s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:54:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:54:31.855549467 +0000 UTC m=+958.614675754" watchObservedRunningTime="2026-09-15 13:54:31.85714973 +0000 UTC m=+958.616276014"
Sep 15 13:54:32.835705 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:32.835668    2578 generic.go:356] "Generic (PLEG): container finished" podID="f0624f68-913d-473a-a1a2-bac510c14483" containerID="7987fa5366b2c0dc62e45a6d45514767eba25985cf38d25a9cba6db231364e0b" exitCode=0
Sep 15 13:54:32.835851 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:32.835745    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-80a7cc-p97ql" event={"ID":"f0624f68-913d-473a-a1a2-bac510c14483","Type":"ContainerDied","Data":"7987fa5366b2c0dc62e45a6d45514767eba25985cf38d25a9cba6db231364e0b"}
Sep 15 13:54:33.984821 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:33.984798    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-80a7cc-p97ql"
Sep 15 13:54:34.058453 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:34.058420    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0624f68-913d-473a-a1a2-bac510c14483-maas-api-service-ca\") pod \"f0624f68-913d-473a-a1a2-bac510c14483\" (UID: \"f0624f68-913d-473a-a1a2-bac510c14483\") "
Sep 15 13:54:34.058599 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:34.058535    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f57cg\" (UniqueName: \"kubernetes.io/projected/f0624f68-913d-473a-a1a2-bac510c14483-kube-api-access-f57cg\") pod \"f0624f68-913d-473a-a1a2-bac510c14483\" (UID: \"f0624f68-913d-473a-a1a2-bac510c14483\") "
Sep 15 13:54:34.058776 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:34.058754    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f0624f68-913d-473a-a1a2-bac510c14483-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f0624f68-913d-473a-a1a2-bac510c14483" (UID: "f0624f68-913d-473a-a1a2-bac510c14483"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 13:54:34.060711 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:34.060676    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0624f68-913d-473a-a1a2-bac510c14483-kube-api-access-f57cg" (OuterVolumeSpecName: "kube-api-access-f57cg") pod "f0624f68-913d-473a-a1a2-bac510c14483" (UID: "f0624f68-913d-473a-a1a2-bac510c14483"). InnerVolumeSpecName "kube-api-access-f57cg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:54:34.160276 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:34.160194    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f57cg\" (UniqueName: \"kubernetes.io/projected/f0624f68-913d-473a-a1a2-bac510c14483-kube-api-access-f57cg\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:54:34.160276 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:34.160221    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0624f68-913d-473a-a1a2-bac510c14483-maas-api-service-ca\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:54:34.850348 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:34.850319    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-80a7cc-p97ql"
Sep 15 13:54:34.850531 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:34.850350    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-80a7cc-p97ql" event={"ID":"f0624f68-913d-473a-a1a2-bac510c14483","Type":"ContainerDied","Data":"ece503a21a4b78c748aa6dff5045cd2a7a6d85958b1dd066e5f4543ae0c84a93"}
Sep 15 13:54:34.850531 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:34.850392    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ece503a21a4b78c748aa6dff5045cd2a7a6d85958b1dd066e5f4543ae0c84a93"
Sep 15 13:54:40.737913 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:40.737877    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-4441a1/test-model-4441a1-kserve-57b7d97547-d65cq"
Sep 15 13:54:40.738364 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:40.738177    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-4441a1/test-model-4441a1-kserve-57b7d97547-d65cq"
Sep 15 13:54:40.750698 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:40.750678    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-4441a1/test-model-4441a1-kserve-57b7d97547-d65cq"
Sep 15 13:54:40.896637 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:40.896607    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-4441a1/test-model-4441a1-kserve-57b7d97547-d65cq"
Sep 15 13:54:41.696083 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:41.696045    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-80a7cc-p97ql"]
Sep 15 13:54:41.698414 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:41.698394    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-80a7cc-p97ql"]
Sep 15 13:54:41.762941 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:54:41.762909    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0624f68-913d-473a-a1a2-bac510c14483" path="/var/lib/kubelet/pods/f0624f68-913d-473a-a1a2-bac510c14483/volumes"
Sep 15 13:55:24.121477 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:24.121436    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-80a7cc-openshift-default-5f789585f4-bpw9x"]
Sep 15 13:55:24.122056 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:24.121711    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-autores-80a7cc-openshift-default-5f789585f4-bpw9x" podUID="300413ac-ddff-4342-a863-82e20c29deeb" containerName="istio-proxy" containerID="cri-o://643c6d7c797b367a69cda737781891490cfa709325443f6c2a9a2c85a1d43a9c" gracePeriod=30
Sep 15 13:55:24.891321 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:24.891274    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-explicit-f9e4ef-openshift-default-7884cdcffb-7vhp6"]
Sep 15 13:55:24.891860 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:24.891838    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0624f68-913d-473a-a1a2-bac510c14483" containerName="revoke-keys"
Sep 15 13:55:24.891943 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:24.891862    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0624f68-913d-473a-a1a2-bac510c14483" containerName="revoke-keys"
Sep 15 13:55:24.892003 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:24.891948    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0624f68-913d-473a-a1a2-bac510c14483" containerName="revoke-keys"
Sep 15 13:55:24.895453 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:24.895431    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-f9e4ef-openshift-default-7884cdcffb-7vhp6"
Sep 15 13:55:24.899878 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:24.899852    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-explicit-f9e4ef-openshift-default-dockercfg-lch8r\""
Sep 15 13:55:24.903382 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:24.903358    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-f9e4ef-openshift-default-7884cdcffb-7vhp6"]
Sep 15 13:55:24.951175 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:24.951100    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a350d01b-8811-40dd-96d5-8a3bece1d1f3-istio-podinfo\") pod \"e2e-explicit-f9e4ef-openshift-default-7884cdcffb-7vhp6\" (UID: \"a350d01b-8811-40dd-96d5-8a3bece1d1f3\") " pod="openshift-ingress/e2e-explicit-f9e4ef-openshift-default-7884cdcffb-7vhp6"
Sep 15 13:55:24.951357 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:24.951188    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a350d01b-8811-40dd-96d5-8a3bece1d1f3-credential-socket\") pod \"e2e-explicit-f9e4ef-openshift-default-7884cdcffb-7vhp6\" (UID: \"a350d01b-8811-40dd-96d5-8a3bece1d1f3\") " pod="openshift-ingress/e2e-explicit-f9e4ef-openshift-default-7884cdcffb-7vhp6"
Sep 15 13:55:24.951357 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:24.951269    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a350d01b-8811-40dd-96d5-8a3bece1d1f3-istio-envoy\") pod \"e2e-explicit-f9e4ef-openshift-default-7884cdcffb-7vhp6\" (UID: \"a350d01b-8811-40dd-96d5-8a3bece1d1f3\") " pod="openshift-ingress/e2e-explicit-f9e4ef-openshift-default-7884cdcffb-7vhp6"
Sep 15 13:55:24.951357 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:24.951299    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a350d01b-8811-40dd-96d5-8a3bece1d1f3-istio-token\") pod \"e2e-explicit-f9e4ef-openshift-default-7884cdcffb-7vhp6\" (UID: \"a350d01b-8811-40dd-96d5-8a3bece1d1f3\") " pod="openshift-ingress/e2e-explicit-f9e4ef-openshift-default-7884cdcffb-7vhp6"
Sep 15 13:55:24.951464 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:24.951371    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a350d01b-8811-40dd-96d5-8a3bece1d1f3-workload-certs\") pod \"e2e-explicit-f9e4ef-openshift-default-7884cdcffb-7vhp6\" (UID: \"a350d01b-8811-40dd-96d5-8a3bece1d1f3\") " pod="openshift-ingress/e2e-explicit-f9e4ef-openshift-default-7884cdcffb-7vhp6"
Sep 15 13:55:24.951464 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:24.951447    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a350d01b-8811-40dd-96d5-8a3bece1d1f3-istio-data\") pod \"e2e-explicit-f9e4ef-openshift-default-7884cdcffb-7vhp6\" (UID: \"a350d01b-8811-40dd-96d5-8a3bece1d1f3\") " pod="openshift-ingress/e2e-explicit-f9e4ef-openshift-default-7884cdcffb-7vhp6"
Sep 15 13:55:24.951538 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:24.951476    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a350d01b-8811-40dd-96d5-8a3bece1d1f3-istiod-ca-cert\") pod \"e2e-explicit-f9e4ef-openshift-default-7884cdcffb-7vhp6\" (UID: \"a350d01b-8811-40dd-96d5-8a3bece1d1f3\") " pod="openshift-ingress/e2e-explicit-f9e4ef-openshift-default-7884cdcffb-7vhp6"
Sep 15 13:55:24.951538 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:24.951520    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gdzs\" (UniqueName: \"kubernetes.io/projected/a350d01b-8811-40dd-96d5-8a3bece1d1f3-kube-api-access-9gdzs\") pod \"e2e-explicit-f9e4ef-openshift-default-7884cdcffb-7vhp6\" (UID: \"a350d01b-8811-40dd-96d5-8a3bece1d1f3\") " pod="openshift-ingress/e2e-explicit-f9e4ef-openshift-default-7884cdcffb-7vhp6"
Sep 15 13:55:24.951618 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:24.951538    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a350d01b-8811-40dd-96d5-8a3bece1d1f3-workload-socket\") pod \"e2e-explicit-f9e4ef-openshift-default-7884cdcffb-7vhp6\" (UID: \"a350d01b-8811-40dd-96d5-8a3bece1d1f3\") " pod="openshift-ingress/e2e-explicit-f9e4ef-openshift-default-7884cdcffb-7vhp6"
Sep 15 13:55:25.052031 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:25.051997    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a350d01b-8811-40dd-96d5-8a3bece1d1f3-istio-envoy\") pod \"e2e-explicit-f9e4ef-openshift-default-7884cdcffb-7vhp6\" (UID: \"a350d01b-8811-40dd-96d5-8a3bece1d1f3\") " pod="openshift-ingress/e2e-explicit-f9e4ef-openshift-default-7884cdcffb-7vhp6"
Sep 15 13:55:25.052031 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:25.052033    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a350d01b-8811-40dd-96d5-8a3bece1d1f3-istio-token\") pod \"e2e-explicit-f9e4ef-openshift-default-7884cdcffb-7vhp6\" (UID: \"a350d01b-8811-40dd-96d5-8a3bece1d1f3\") " pod="openshift-ingress/e2e-explicit-f9e4ef-openshift-default-7884cdcffb-7vhp6"
Sep 15 13:55:25.052316 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:25.052069    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a350d01b-8811-40dd-96d5-8a3bece1d1f3-workload-certs\") pod \"e2e-explicit-f9e4ef-openshift-default-7884cdcffb-7vhp6\" (UID: \"a350d01b-8811-40dd-96d5-8a3bece1d1f3\") " pod="openshift-ingress/e2e-explicit-f9e4ef-openshift-default-7884cdcffb-7vhp6"
Sep 15 13:55:25.052316 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:25.052102    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a350d01b-8811-40dd-96d5-8a3bece1d1f3-istio-data\") pod \"e2e-explicit-f9e4ef-openshift-default-7884cdcffb-7vhp6\" (UID: \"a350d01b-8811-40dd-96d5-8a3bece1d1f3\") " pod="openshift-ingress/e2e-explicit-f9e4ef-openshift-default-7884cdcffb-7vhp6"
Sep 15 13:55:25.052316 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:25.052118    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a350d01b-8811-40dd-96d5-8a3bece1d1f3-istiod-ca-cert\") pod \"e2e-explicit-f9e4ef-openshift-default-7884cdcffb-7vhp6\" (UID: \"a350d01b-8811-40dd-96d5-8a3bece1d1f3\") " pod="openshift-ingress/e2e-explicit-f9e4ef-openshift-default-7884cdcffb-7vhp6"
Sep 15 13:55:25.052316 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:25.052192    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gdzs\" (UniqueName: \"kubernetes.io/projected/a350d01b-8811-40dd-96d5-8a3bece1d1f3-kube-api-access-9gdzs\") pod \"e2e-explicit-f9e4ef-openshift-default-7884cdcffb-7vhp6\" (UID: \"a350d01b-8811-40dd-96d5-8a3bece1d1f3\") " pod="openshift-ingress/e2e-explicit-f9e4ef-openshift-default-7884cdcffb-7vhp6"
Sep 15 13:55:25.052316 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:25.052208    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a350d01b-8811-40dd-96d5-8a3bece1d1f3-workload-socket\") pod \"e2e-explicit-f9e4ef-openshift-default-7884cdcffb-7vhp6\" (UID: \"a350d01b-8811-40dd-96d5-8a3bece1d1f3\") " pod="openshift-ingress/e2e-explicit-f9e4ef-openshift-default-7884cdcffb-7vhp6"
Sep 15 13:55:25.052316 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:25.052245    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a350d01b-8811-40dd-96d5-8a3bece1d1f3-istio-podinfo\") pod \"e2e-explicit-f9e4ef-openshift-default-7884cdcffb-7vhp6\" (UID: \"a350d01b-8811-40dd-96d5-8a3bece1d1f3\") " pod="openshift-ingress/e2e-explicit-f9e4ef-openshift-default-7884cdcffb-7vhp6"
Sep 15 13:55:25.052316 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:25.052285    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a350d01b-8811-40dd-96d5-8a3bece1d1f3-credential-socket\") pod \"e2e-explicit-f9e4ef-openshift-default-7884cdcffb-7vhp6\" (UID: \"a350d01b-8811-40dd-96d5-8a3bece1d1f3\") " pod="openshift-ingress/e2e-explicit-f9e4ef-openshift-default-7884cdcffb-7vhp6"
Sep 15 13:55:25.052731 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:25.052541    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a350d01b-8811-40dd-96d5-8a3bece1d1f3-istio-data\") pod \"e2e-explicit-f9e4ef-openshift-default-7884cdcffb-7vhp6\" (UID: \"a350d01b-8811-40dd-96d5-8a3bece1d1f3\") " pod="openshift-ingress/e2e-explicit-f9e4ef-openshift-default-7884cdcffb-7vhp6"
Sep 15 13:55:25.052731 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:25.052567    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a350d01b-8811-40dd-96d5-8a3bece1d1f3-workload-certs\") pod \"e2e-explicit-f9e4ef-openshift-default-7884cdcffb-7vhp6\" (UID: \"a350d01b-8811-40dd-96d5-8a3bece1d1f3\") " pod="openshift-ingress/e2e-explicit-f9e4ef-openshift-default-7884cdcffb-7vhp6"
Sep 15 13:55:25.052731 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:25.052622    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a350d01b-8811-40dd-96d5-8a3bece1d1f3-workload-socket\") pod \"e2e-explicit-f9e4ef-openshift-default-7884cdcffb-7vhp6\" (UID: \"a350d01b-8811-40dd-96d5-8a3bece1d1f3\") " pod="openshift-ingress/e2e-explicit-f9e4ef-openshift-default-7884cdcffb-7vhp6"
Sep 15 13:55:25.052731 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:25.052674    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a350d01b-8811-40dd-96d5-8a3bece1d1f3-credential-socket\") pod \"e2e-explicit-f9e4ef-openshift-default-7884cdcffb-7vhp6\" (UID: \"a350d01b-8811-40dd-96d5-8a3bece1d1f3\") " pod="openshift-ingress/e2e-explicit-f9e4ef-openshift-default-7884cdcffb-7vhp6"
Sep 15 13:55:25.053069 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:25.053042    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a350d01b-8811-40dd-96d5-8a3bece1d1f3-istiod-ca-cert\") pod \"e2e-explicit-f9e4ef-openshift-default-7884cdcffb-7vhp6\" (UID: \"a350d01b-8811-40dd-96d5-8a3bece1d1f3\") " pod="openshift-ingress/e2e-explicit-f9e4ef-openshift-default-7884cdcffb-7vhp6"
Sep 15 13:55:25.054490 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:25.054468    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a350d01b-8811-40dd-96d5-8a3bece1d1f3-istio-envoy\") pod \"e2e-explicit-f9e4ef-openshift-default-7884cdcffb-7vhp6\" (UID: \"a350d01b-8811-40dd-96d5-8a3bece1d1f3\") " pod="openshift-ingress/e2e-explicit-f9e4ef-openshift-default-7884cdcffb-7vhp6"
Sep 15 13:55:25.054901 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:25.054880    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a350d01b-8811-40dd-96d5-8a3bece1d1f3-istio-podinfo\") pod \"e2e-explicit-f9e4ef-openshift-default-7884cdcffb-7vhp6\" (UID: \"a350d01b-8811-40dd-96d5-8a3bece1d1f3\") " pod="openshift-ingress/e2e-explicit-f9e4ef-openshift-default-7884cdcffb-7vhp6"
Sep 15 13:55:25.060163 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:25.060116    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a350d01b-8811-40dd-96d5-8a3bece1d1f3-istio-token\") pod \"e2e-explicit-f9e4ef-openshift-default-7884cdcffb-7vhp6\" (UID: \"a350d01b-8811-40dd-96d5-8a3bece1d1f3\") " pod="openshift-ingress/e2e-explicit-f9e4ef-openshift-default-7884cdcffb-7vhp6"
Sep 15 13:55:25.060444 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:25.060425    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gdzs\" (UniqueName: \"kubernetes.io/projected/a350d01b-8811-40dd-96d5-8a3bece1d1f3-kube-api-access-9gdzs\") pod \"e2e-explicit-f9e4ef-openshift-default-7884cdcffb-7vhp6\" (UID: \"a350d01b-8811-40dd-96d5-8a3bece1d1f3\") " pod="openshift-ingress/e2e-explicit-f9e4ef-openshift-default-7884cdcffb-7vhp6"
Sep 15 13:55:25.208453 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:25.208359    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-f9e4ef-openshift-default-7884cdcffb-7vhp6"
Sep 15 13:55:25.489165 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:25.489134    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-f9e4ef-openshift-default-7884cdcffb-7vhp6"]
Sep 15 13:55:25.491326 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:55:25.491290    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda350d01b_8811_40dd_96d5_8a3bece1d1f3.slice/crio-4d43077e8cf775091e1ca130885e32c0e26abb638d4aa4a60abfa39fa2358b1d WatchSource:0}: Error finding container 4d43077e8cf775091e1ca130885e32c0e26abb638d4aa4a60abfa39fa2358b1d: Status 404 returned error can't find the container with id 4d43077e8cf775091e1ca130885e32c0e26abb638d4aa4a60abfa39fa2358b1d
Sep 15 13:55:25.494005 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:25.493973    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 15 13:55:25.494090 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:25.494042    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 15 13:55:25.494090 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:25.494070    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 15 13:55:26.152451 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:26.152411    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-f9e4ef-openshift-default-7884cdcffb-7vhp6" event={"ID":"a350d01b-8811-40dd-96d5-8a3bece1d1f3","Type":"ContainerStarted","Data":"eed12d0fde4dacb6e5f62fa4342b724c5a06451aa745ea8bbbe501b738f40bf2"}
Sep 15 13:55:26.152666 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:26.152477    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-f9e4ef-openshift-default-7884cdcffb-7vhp6" event={"ID":"a350d01b-8811-40dd-96d5-8a3bece1d1f3","Type":"ContainerStarted","Data":"4d43077e8cf775091e1ca130885e32c0e26abb638d4aa4a60abfa39fa2358b1d"}
Sep 15 13:55:26.174352 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:26.174300    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-explicit-f9e4ef-openshift-default-7884cdcffb-7vhp6" podStartSLOduration=2.174285229 podStartE2EDuration="2.174285229s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:55:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:55:26.171275972 +0000 UTC m=+1012.930402270" watchObservedRunningTime="2026-09-15 13:55:26.174285229 +0000 UTC m=+1012.933411515"
Sep 15 13:55:26.208838 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:26.208809    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-f9e4ef-openshift-default-7884cdcffb-7vhp6"
Sep 15 13:55:26.213618 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:26.213594    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-f9e4ef-openshift-default-7884cdcffb-7vhp6"
Sep 15 13:55:27.158730 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:27.158694    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-f9e4ef-openshift-default-7884cdcffb-7vhp6"
Sep 15 13:55:27.159643 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:27.159621    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-f9e4ef-openshift-default-7884cdcffb-7vhp6"
Sep 15 13:55:29.373961 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:29.373938    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-80a7cc-openshift-default-5f789585f4-bpw9x"
Sep 15 13:55:29.497108 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:29.497006    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k8bll\" (UniqueName: \"kubernetes.io/projected/300413ac-ddff-4342-a863-82e20c29deeb-kube-api-access-k8bll\") pod \"300413ac-ddff-4342-a863-82e20c29deeb\" (UID: \"300413ac-ddff-4342-a863-82e20c29deeb\") "
Sep 15 13:55:29.497108 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:29.497070    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/300413ac-ddff-4342-a863-82e20c29deeb-credential-socket\") pod \"300413ac-ddff-4342-a863-82e20c29deeb\" (UID: \"300413ac-ddff-4342-a863-82e20c29deeb\") "
Sep 15 13:55:29.497108 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:29.497101    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/300413ac-ddff-4342-a863-82e20c29deeb-istio-token\") pod \"300413ac-ddff-4342-a863-82e20c29deeb\" (UID: \"300413ac-ddff-4342-a863-82e20c29deeb\") "
Sep 15 13:55:29.497441 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:29.497181    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/300413ac-ddff-4342-a863-82e20c29deeb-istiod-ca-cert\") pod \"300413ac-ddff-4342-a863-82e20c29deeb\" (UID: \"300413ac-ddff-4342-a863-82e20c29deeb\") "
Sep 15 13:55:29.497441 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:29.497238    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/300413ac-ddff-4342-a863-82e20c29deeb-istio-envoy\") pod \"300413ac-ddff-4342-a863-82e20c29deeb\" (UID: \"300413ac-ddff-4342-a863-82e20c29deeb\") "
Sep 15 13:55:29.497441 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:29.497267    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/300413ac-ddff-4342-a863-82e20c29deeb-istio-podinfo\") pod \"300413ac-ddff-4342-a863-82e20c29deeb\" (UID: \"300413ac-ddff-4342-a863-82e20c29deeb\") "
Sep 15 13:55:29.497441 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:29.497288    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/300413ac-ddff-4342-a863-82e20c29deeb-workload-socket\") pod \"300413ac-ddff-4342-a863-82e20c29deeb\" (UID: \"300413ac-ddff-4342-a863-82e20c29deeb\") "
Sep 15 13:55:29.497441 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:29.497332    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/300413ac-ddff-4342-a863-82e20c29deeb-workload-certs\") pod \"300413ac-ddff-4342-a863-82e20c29deeb\" (UID: \"300413ac-ddff-4342-a863-82e20c29deeb\") "
Sep 15 13:55:29.497441 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:29.497379    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/300413ac-ddff-4342-a863-82e20c29deeb-istio-data\") pod \"300413ac-ddff-4342-a863-82e20c29deeb\" (UID: \"300413ac-ddff-4342-a863-82e20c29deeb\") "
Sep 15 13:55:29.497441 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:29.497417    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/300413ac-ddff-4342-a863-82e20c29deeb-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "300413ac-ddff-4342-a863-82e20c29deeb" (UID: "300413ac-ddff-4342-a863-82e20c29deeb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:55:29.497808 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:29.497598    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/300413ac-ddff-4342-a863-82e20c29deeb-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "300413ac-ddff-4342-a863-82e20c29deeb" (UID: "300413ac-ddff-4342-a863-82e20c29deeb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 13:55:29.497808 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:29.497632    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/300413ac-ddff-4342-a863-82e20c29deeb-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "300413ac-ddff-4342-a863-82e20c29deeb" (UID: "300413ac-ddff-4342-a863-82e20c29deeb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:55:29.497808 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:29.497797    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/300413ac-ddff-4342-a863-82e20c29deeb-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "300413ac-ddff-4342-a863-82e20c29deeb" (UID: "300413ac-ddff-4342-a863-82e20c29deeb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:55:29.497944 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:29.497815    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/300413ac-ddff-4342-a863-82e20c29deeb-istio-data" (OuterVolumeSpecName: "istio-data") pod "300413ac-ddff-4342-a863-82e20c29deeb" (UID: "300413ac-ddff-4342-a863-82e20c29deeb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:55:29.498029 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:29.498008    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/300413ac-ddff-4342-a863-82e20c29deeb-credential-socket\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:55:29.498114 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:29.498065    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/300413ac-ddff-4342-a863-82e20c29deeb-istiod-ca-cert\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:55:29.498253 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:29.498143    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/300413ac-ddff-4342-a863-82e20c29deeb-workload-socket\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:55:29.498296 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:29.498259    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/300413ac-ddff-4342-a863-82e20c29deeb-workload-certs\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:55:29.498296 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:29.498273    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/300413ac-ddff-4342-a863-82e20c29deeb-istio-data\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:55:29.499472 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:29.499445    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/300413ac-ddff-4342-a863-82e20c29deeb-kube-api-access-k8bll" (OuterVolumeSpecName: "kube-api-access-k8bll") pod "300413ac-ddff-4342-a863-82e20c29deeb" (UID: "300413ac-ddff-4342-a863-82e20c29deeb"). InnerVolumeSpecName "kube-api-access-k8bll". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:55:29.499646 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:29.499624    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/300413ac-ddff-4342-a863-82e20c29deeb-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "300413ac-ddff-4342-a863-82e20c29deeb" (UID: "300413ac-ddff-4342-a863-82e20c29deeb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 13:55:29.499921 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:29.499896    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/300413ac-ddff-4342-a863-82e20c29deeb-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "300413ac-ddff-4342-a863-82e20c29deeb" (UID: "300413ac-ddff-4342-a863-82e20c29deeb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:55:29.499921 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:29.499906    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/300413ac-ddff-4342-a863-82e20c29deeb-istio-token" (OuterVolumeSpecName: "istio-token") pod "300413ac-ddff-4342-a863-82e20c29deeb" (UID: "300413ac-ddff-4342-a863-82e20c29deeb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:55:29.599118 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:29.599083    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/300413ac-ddff-4342-a863-82e20c29deeb-istio-envoy\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:55:29.599118 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:29.599109    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/300413ac-ddff-4342-a863-82e20c29deeb-istio-podinfo\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:55:29.599118 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:29.599118    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k8bll\" (UniqueName: \"kubernetes.io/projected/300413ac-ddff-4342-a863-82e20c29deeb-kube-api-access-k8bll\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:55:29.599384 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:29.599158    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/300413ac-ddff-4342-a863-82e20c29deeb-istio-token\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:55:30.177637 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:30.177605    2578 generic.go:356] "Generic (PLEG): container finished" podID="300413ac-ddff-4342-a863-82e20c29deeb" containerID="643c6d7c797b367a69cda737781891490cfa709325443f6c2a9a2c85a1d43a9c" exitCode=0
Sep 15 13:55:30.177805 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:30.177668    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-80a7cc-openshift-default-5f789585f4-bpw9x"
Sep 15 13:55:30.177805 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:30.177687    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-80a7cc-openshift-default-5f789585f4-bpw9x" event={"ID":"300413ac-ddff-4342-a863-82e20c29deeb","Type":"ContainerDied","Data":"643c6d7c797b367a69cda737781891490cfa709325443f6c2a9a2c85a1d43a9c"}
Sep 15 13:55:30.177805 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:30.177741    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-80a7cc-openshift-default-5f789585f4-bpw9x" event={"ID":"300413ac-ddff-4342-a863-82e20c29deeb","Type":"ContainerDied","Data":"0f1879e30500bb2c1d20275b35e150c72f075c989c55ca015f84de16adb980a5"}
Sep 15 13:55:30.177805 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:30.177764    2578 scope.go:117] "RemoveContainer" containerID="643c6d7c797b367a69cda737781891490cfa709325443f6c2a9a2c85a1d43a9c"
Sep 15 13:55:30.186882 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:30.186864    2578 scope.go:117] "RemoveContainer" containerID="596cc9674199435774c79ab0bafd76077bc0cdc3b94a93c94c5ea57116c478b1"
Sep 15 13:55:30.195470 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:30.195449    2578 scope.go:117] "RemoveContainer" containerID="643c6d7c797b367a69cda737781891490cfa709325443f6c2a9a2c85a1d43a9c"
Sep 15 13:55:30.195757 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:55:30.195738    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"643c6d7c797b367a69cda737781891490cfa709325443f6c2a9a2c85a1d43a9c\": container with ID starting with 643c6d7c797b367a69cda737781891490cfa709325443f6c2a9a2c85a1d43a9c not found: ID does not exist" containerID="643c6d7c797b367a69cda737781891490cfa709325443f6c2a9a2c85a1d43a9c"
Sep 15 13:55:30.195826 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:30.195765    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"643c6d7c797b367a69cda737781891490cfa709325443f6c2a9a2c85a1d43a9c"} err="failed to get container status \"643c6d7c797b367a69cda737781891490cfa709325443f6c2a9a2c85a1d43a9c\": rpc error: code = NotFound desc = could not find container \"643c6d7c797b367a69cda737781891490cfa709325443f6c2a9a2c85a1d43a9c\": container with ID starting with 643c6d7c797b367a69cda737781891490cfa709325443f6c2a9a2c85a1d43a9c not found: ID does not exist"
Sep 15 13:55:30.195826 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:30.195781    2578 scope.go:117] "RemoveContainer" containerID="596cc9674199435774c79ab0bafd76077bc0cdc3b94a93c94c5ea57116c478b1"
Sep 15 13:55:30.196026 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:55:30.196010    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"596cc9674199435774c79ab0bafd76077bc0cdc3b94a93c94c5ea57116c478b1\": container with ID starting with 596cc9674199435774c79ab0bafd76077bc0cdc3b94a93c94c5ea57116c478b1 not found: ID does not exist" containerID="596cc9674199435774c79ab0bafd76077bc0cdc3b94a93c94c5ea57116c478b1"
Sep 15 13:55:30.196069 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:30.196031    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"596cc9674199435774c79ab0bafd76077bc0cdc3b94a93c94c5ea57116c478b1"} err="failed to get container status \"596cc9674199435774c79ab0bafd76077bc0cdc3b94a93c94c5ea57116c478b1\": rpc error: code = NotFound desc = could not find container \"596cc9674199435774c79ab0bafd76077bc0cdc3b94a93c94c5ea57116c478b1\": container with ID starting with 596cc9674199435774c79ab0bafd76077bc0cdc3b94a93c94c5ea57116c478b1 not found: ID does not exist"
Sep 15 13:55:30.208422 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:30.208397    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-80a7cc-openshift-default-5f789585f4-bpw9x"]
Sep 15 13:55:30.211752 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:30.211732    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-autores-80a7cc-openshift-default-5f789585f4-bpw9x"]
Sep 15 13:55:31.759674 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:31.759643    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="300413ac-ddff-4342-a863-82e20c29deeb" path="/var/lib/kubelet/pods/300413ac-ddff-4342-a863-82e20c29deeb/volumes"
Sep 15 13:55:32.088959 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:32.088929    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-f9e4ef-544469d9db-s4rrh"]
Sep 15 13:55:32.089351 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:32.089337    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="300413ac-ddff-4342-a863-82e20c29deeb" containerName="istio-proxy"
Sep 15 13:55:32.089400 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:32.089353    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="300413ac-ddff-4342-a863-82e20c29deeb" containerName="istio-proxy"
Sep 15 13:55:32.089442 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:32.089433    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="300413ac-ddff-4342-a863-82e20c29deeb" containerName="istio-proxy"
Sep 15 13:55:32.094204 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:32.094183    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-f9e4ef-544469d9db-s4rrh"
Sep 15 13:55:32.096717 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:32.096700    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-explicit-f9e4ef\""
Sep 15 13:55:32.108203 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:32.108183    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-f9e4ef-544469d9db-s4rrh"]
Sep 15 13:55:32.120135 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:32.120107    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-f9e4ef-8586584477-5ljzm"]
Sep 15 13:55:32.120694 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:32.120674    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="300413ac-ddff-4342-a863-82e20c29deeb" containerName="istio-proxy"
Sep 15 13:55:32.120741 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:32.120699    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="300413ac-ddff-4342-a863-82e20c29deeb" containerName="istio-proxy"
Sep 15 13:55:32.120837 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:32.120826    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="300413ac-ddff-4342-a863-82e20c29deeb" containerName="istio-proxy"
Sep 15 13:55:32.124302 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:32.124285    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-f9e4ef-8586584477-5ljzm"
Sep 15 13:55:32.127184 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:32.127165    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-explicit-f9e4ef-dockercfg-xkpf6\""
Sep 15 13:55:32.135701 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:32.135677    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-f9e4ef-8586584477-5ljzm"]
Sep 15 13:55:32.226216 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:32.226176    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/49ead8a2-c5ef-4dde-a0ab-b971df8191f0-plugins-config-volume\") pod \"payload-processing-e2e-explicit-f9e4ef-8586584477-5ljzm\" (UID: \"49ead8a2-c5ef-4dde-a0ab-b971df8191f0\") " pod="openshift-ingress/payload-processing-e2e-explicit-f9e4ef-8586584477-5ljzm"
Sep 15 13:55:32.226408 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:32.226235    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/af68b14d-c929-43e4-b802-09f91fa50848-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-f9e4ef-544469d9db-s4rrh\" (UID: \"af68b14d-c929-43e4-b802-09f91fa50848\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-f9e4ef-544469d9db-s4rrh"
Sep 15 13:55:32.226408 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:32.226263    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-th82c\" (UniqueName: \"kubernetes.io/projected/49ead8a2-c5ef-4dde-a0ab-b971df8191f0-kube-api-access-th82c\") pod \"payload-processing-e2e-explicit-f9e4ef-8586584477-5ljzm\" (UID: \"49ead8a2-c5ef-4dde-a0ab-b971df8191f0\") " pod="openshift-ingress/payload-processing-e2e-explicit-f9e4ef-8586584477-5ljzm"
Sep 15 13:55:32.226408 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:32.226324    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxgnm\" (UniqueName: \"kubernetes.io/projected/af68b14d-c929-43e4-b802-09f91fa50848-kube-api-access-vxgnm\") pod \"payload-pre-processing-e2e-explicit-f9e4ef-544469d9db-s4rrh\" (UID: \"af68b14d-c929-43e4-b802-09f91fa50848\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-f9e4ef-544469d9db-s4rrh"
Sep 15 13:55:32.327865 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:32.327827    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/49ead8a2-c5ef-4dde-a0ab-b971df8191f0-plugins-config-volume\") pod \"payload-processing-e2e-explicit-f9e4ef-8586584477-5ljzm\" (UID: \"49ead8a2-c5ef-4dde-a0ab-b971df8191f0\") " pod="openshift-ingress/payload-processing-e2e-explicit-f9e4ef-8586584477-5ljzm"
Sep 15 13:55:32.328065 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:32.327876    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/af68b14d-c929-43e4-b802-09f91fa50848-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-f9e4ef-544469d9db-s4rrh\" (UID: \"af68b14d-c929-43e4-b802-09f91fa50848\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-f9e4ef-544469d9db-s4rrh"
Sep 15 13:55:32.328065 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:32.327903    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-th82c\" (UniqueName: \"kubernetes.io/projected/49ead8a2-c5ef-4dde-a0ab-b971df8191f0-kube-api-access-th82c\") pod \"payload-processing-e2e-explicit-f9e4ef-8586584477-5ljzm\" (UID: \"49ead8a2-c5ef-4dde-a0ab-b971df8191f0\") " pod="openshift-ingress/payload-processing-e2e-explicit-f9e4ef-8586584477-5ljzm"
Sep 15 13:55:32.328065 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:32.327962    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxgnm\" (UniqueName: \"kubernetes.io/projected/af68b14d-c929-43e4-b802-09f91fa50848-kube-api-access-vxgnm\") pod \"payload-pre-processing-e2e-explicit-f9e4ef-544469d9db-s4rrh\" (UID: \"af68b14d-c929-43e4-b802-09f91fa50848\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-f9e4ef-544469d9db-s4rrh"
Sep 15 13:55:32.328646 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:32.328625    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/49ead8a2-c5ef-4dde-a0ab-b971df8191f0-plugins-config-volume\") pod \"payload-processing-e2e-explicit-f9e4ef-8586584477-5ljzm\" (UID: \"49ead8a2-c5ef-4dde-a0ab-b971df8191f0\") " pod="openshift-ingress/payload-processing-e2e-explicit-f9e4ef-8586584477-5ljzm"
Sep 15 13:55:32.328698 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:32.328631    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/af68b14d-c929-43e4-b802-09f91fa50848-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-f9e4ef-544469d9db-s4rrh\" (UID: \"af68b14d-c929-43e4-b802-09f91fa50848\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-f9e4ef-544469d9db-s4rrh"
Sep 15 13:55:32.335777 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:32.335748    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-th82c\" (UniqueName: \"kubernetes.io/projected/49ead8a2-c5ef-4dde-a0ab-b971df8191f0-kube-api-access-th82c\") pod \"payload-processing-e2e-explicit-f9e4ef-8586584477-5ljzm\" (UID: \"49ead8a2-c5ef-4dde-a0ab-b971df8191f0\") " pod="openshift-ingress/payload-processing-e2e-explicit-f9e4ef-8586584477-5ljzm"
Sep 15 13:55:32.335954 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:32.335934    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxgnm\" (UniqueName: \"kubernetes.io/projected/af68b14d-c929-43e4-b802-09f91fa50848-kube-api-access-vxgnm\") pod \"payload-pre-processing-e2e-explicit-f9e4ef-544469d9db-s4rrh\" (UID: \"af68b14d-c929-43e4-b802-09f91fa50848\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-f9e4ef-544469d9db-s4rrh"
Sep 15 13:55:32.403914 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:32.403828    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-f9e4ef-544469d9db-s4rrh"
Sep 15 13:55:32.435098 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:32.435069    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-f9e4ef-8586584477-5ljzm"
Sep 15 13:55:32.680157 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:32.680111    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-f9e4ef-544469d9db-s4rrh"]
Sep 15 13:55:32.681507 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:55:32.681481    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf68b14d_c929_43e4_b802_09f91fa50848.slice/crio-b3adf269263b17389a2c1e0abe3f69cb47ec0e547573a3f5cd8b5cdfa1a2845b WatchSource:0}: Error finding container b3adf269263b17389a2c1e0abe3f69cb47ec0e547573a3f5cd8b5cdfa1a2845b: Status 404 returned error can't find the container with id b3adf269263b17389a2c1e0abe3f69cb47ec0e547573a3f5cd8b5cdfa1a2845b
Sep 15 13:55:32.716442 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:32.716401    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-f9e4ef-8586584477-5ljzm"]
Sep 15 13:55:32.718291 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:55:32.718268    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49ead8a2_c5ef_4dde_a0ab_b971df8191f0.slice/crio-cb694ed987c63d306922fd87121be124658405a4ca405cb70a5cf54ba93bea69 WatchSource:0}: Error finding container cb694ed987c63d306922fd87121be124658405a4ca405cb70a5cf54ba93bea69: Status 404 returned error can't find the container with id cb694ed987c63d306922fd87121be124658405a4ca405cb70a5cf54ba93bea69
Sep 15 13:55:33.197610 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:33.197571    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-f9e4ef-544469d9db-s4rrh" event={"ID":"af68b14d-c929-43e4-b802-09f91fa50848","Type":"ContainerStarted","Data":"727255874dabb4e4627fd7209a1b0694b7b2d673815439d41dbf3d92035bd27b"}
Sep 15 13:55:33.198094 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:33.197633    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-f9e4ef-544469d9db-s4rrh" event={"ID":"af68b14d-c929-43e4-b802-09f91fa50848","Type":"ContainerStarted","Data":"b3adf269263b17389a2c1e0abe3f69cb47ec0e547573a3f5cd8b5cdfa1a2845b"}
Sep 15 13:55:33.198094 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:33.197730    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-f9e4ef-544469d9db-s4rrh"
Sep 15 13:55:33.199393 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:33.199362    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-f9e4ef-8586584477-5ljzm" event={"ID":"49ead8a2-c5ef-4dde-a0ab-b971df8191f0","Type":"ContainerStarted","Data":"a8394ece5c73877f5504e822649bf7f04f2db8d8a4d38768a3d2532228f300f0"}
Sep 15 13:55:33.199528 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:33.199416    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-f9e4ef-8586584477-5ljzm" event={"ID":"49ead8a2-c5ef-4dde-a0ab-b971df8191f0","Type":"ContainerStarted","Data":"cb694ed987c63d306922fd87121be124658405a4ca405cb70a5cf54ba93bea69"}
Sep 15 13:55:33.199528 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:33.199446    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-explicit-f9e4ef-8586584477-5ljzm"
Sep 15 13:55:33.215388 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:33.215346    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-explicit-f9e4ef-544469d9db-s4rrh" podStartSLOduration=1.215333794 podStartE2EDuration="1.215333794s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:55:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:55:33.212999203 +0000 UTC m=+1019.972125491" watchObservedRunningTime="2026-09-15 13:55:33.215333794 +0000 UTC m=+1019.974460080"
Sep 15 13:55:33.231778 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:33.231741    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-explicit-f9e4ef-8586584477-5ljzm" podStartSLOduration=1.231729002 podStartE2EDuration="1.231729002s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:55:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:55:33.231304148 +0000 UTC m=+1019.990430438" watchObservedRunningTime="2026-09-15 13:55:33.231729002 +0000 UTC m=+1019.990855288"
Sep 15 13:55:44.207683 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:44.207653    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-explicit-f9e4ef-8586584477-5ljzm"
Sep 15 13:55:44.208085 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:44.207721    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-f9e4ef-544469d9db-s4rrh"
Sep 15 13:55:51.321461 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:51.321420    2578 generic.go:356] "Generic (PLEG): container finished" podID="a350d01b-8811-40dd-96d5-8a3bece1d1f3" containerID="eed12d0fde4dacb6e5f62fa4342b724c5a06451aa745ea8bbbe501b738f40bf2" exitCode=0
Sep 15 13:55:51.321881 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:51.321494    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-f9e4ef-openshift-default-7884cdcffb-7vhp6" event={"ID":"a350d01b-8811-40dd-96d5-8a3bece1d1f3","Type":"ContainerDied","Data":"eed12d0fde4dacb6e5f62fa4342b724c5a06451aa745ea8bbbe501b738f40bf2"}
Sep 15 13:55:51.322063 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:51.322050    2578 scope.go:117] "RemoveContainer" containerID="eed12d0fde4dacb6e5f62fa4342b724c5a06451aa745ea8bbbe501b738f40bf2"
Sep 15 13:55:51.323105 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:51.323077    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 15 13:55:51.323179 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:51.323163    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 15 13:55:51.323216 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:51.323198    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 15 13:55:52.332363 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:52.332331    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-f9e4ef-openshift-default-7884cdcffb-7vhp6" event={"ID":"a350d01b-8811-40dd-96d5-8a3bece1d1f3","Type":"ContainerStarted","Data":"317a2293d0147fb8b7bb8af02b7eefd1bd1707dfe01ba6aea0e8934ea45cf4e2"}
Sep 15 13:55:53.209289 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:53.209261    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-f9e4ef-openshift-default-7884cdcffb-7vhp6"
Sep 15 13:55:53.210515 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:53.210491    2578 patch_prober.go:28] interesting pod/e2e-explicit-f9e4ef-openshift-default-7884cdcffb-7vhp6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Sep 15 13:55:53.210693 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:53.210542    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-f9e4ef-openshift-default-7884cdcffb-7vhp6" podUID="a350d01b-8811-40dd-96d5-8a3bece1d1f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Sep 15 13:55:54.209596 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:54.209557    2578 patch_prober.go:28] interesting pod/e2e-explicit-f9e4ef-openshift-default-7884cdcffb-7vhp6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Sep 15 13:55:54.210068 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:54.209619    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-f9e4ef-openshift-default-7884cdcffb-7vhp6" podUID="a350d01b-8811-40dd-96d5-8a3bece1d1f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Sep 15 13:55:55.209384 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:55.209349    2578 patch_prober.go:28] interesting pod/e2e-explicit-f9e4ef-openshift-default-7884cdcffb-7vhp6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Sep 15 13:55:55.209648 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:55.209417    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-f9e4ef-openshift-default-7884cdcffb-7vhp6" podUID="a350d01b-8811-40dd-96d5-8a3bece1d1f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Sep 15 13:55:56.208719 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:56.208679    2578 patch_prober.go:28] interesting pod/e2e-explicit-f9e4ef-openshift-default-7884cdcffb-7vhp6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Sep 15 13:55:56.208914 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:56.208738    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-f9e4ef-openshift-default-7884cdcffb-7vhp6" podUID="a350d01b-8811-40dd-96d5-8a3bece1d1f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Sep 15 13:55:57.158983 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:57.158947    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-f9e4ef-openshift-default-7884cdcffb-7vhp6"
Sep 15 13:55:57.208897 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:57.208852    2578 patch_prober.go:28] interesting pod/e2e-explicit-f9e4ef-openshift-default-7884cdcffb-7vhp6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Sep 15 13:55:57.209096 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:57.208915    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-f9e4ef-openshift-default-7884cdcffb-7vhp6" podUID="a350d01b-8811-40dd-96d5-8a3bece1d1f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Sep 15 13:55:58.213191 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:58.213162    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-f9e4ef-openshift-default-7884cdcffb-7vhp6"
Sep 15 13:55:58.214212 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:55:58.214193    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-f9e4ef-openshift-default-7884cdcffb-7vhp6"
Sep 15 13:57:07.427203 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:07.427161    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-66261e/e2e-conflict-a-51bbeba1-kserve-79555777f6-cjl99"]
Sep 15 13:57:07.430697 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:07.430679    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-66261e/e2e-conflict-a-51bbeba1-kserve-79555777f6-cjl99"
Sep 15 13:57:07.434099 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:07.434074    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-66261e\"/\"kube-root-ca.crt\""
Sep 15 13:57:07.434099 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:07.434086    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-66261e\"/\"openshift-service-ca.crt\""
Sep 15 13:57:07.434325 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:07.434086    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-66261e\"/\"default-dockercfg-tjnkz\""
Sep 15 13:57:07.434325 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:07.434075    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-66261e\"/\"e2e-conflict-a-51bbeba1-kserve-self-signed-certs\""
Sep 15 13:57:07.440793 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:07.440771    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-66261e/e2e-conflict-a-51bbeba1-kserve-79555777f6-cjl99"]
Sep 15 13:57:07.479865 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:07.479833    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5c5a959a-c352-43cf-bb54-cd19e59e0f09-dshm\") pod \"e2e-conflict-a-51bbeba1-kserve-79555777f6-cjl99\" (UID: \"5c5a959a-c352-43cf-bb54-cd19e59e0f09\") " pod="e2e-models-e2e-worker-w4-66261e/e2e-conflict-a-51bbeba1-kserve-79555777f6-cjl99"
Sep 15 13:57:07.479865 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:07.479866    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5c5a959a-c352-43cf-bb54-cd19e59e0f09-model-cache\") pod \"e2e-conflict-a-51bbeba1-kserve-79555777f6-cjl99\" (UID: \"5c5a959a-c352-43cf-bb54-cd19e59e0f09\") " pod="e2e-models-e2e-worker-w4-66261e/e2e-conflict-a-51bbeba1-kserve-79555777f6-cjl99"
Sep 15 13:57:07.480079 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:07.479948    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c5a959a-c352-43cf-bb54-cd19e59e0f09-tmp-dir\") pod \"e2e-conflict-a-51bbeba1-kserve-79555777f6-cjl99\" (UID: \"5c5a959a-c352-43cf-bb54-cd19e59e0f09\") " pod="e2e-models-e2e-worker-w4-66261e/e2e-conflict-a-51bbeba1-kserve-79555777f6-cjl99"
Sep 15 13:57:07.480079 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:07.480014    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c5a959a-c352-43cf-bb54-cd19e59e0f09-tls-certs\") pod \"e2e-conflict-a-51bbeba1-kserve-79555777f6-cjl99\" (UID: \"5c5a959a-c352-43cf-bb54-cd19e59e0f09\") " pod="e2e-models-e2e-worker-w4-66261e/e2e-conflict-a-51bbeba1-kserve-79555777f6-cjl99"
Sep 15 13:57:07.480205 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:07.480091    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6k8r\" (UniqueName: \"kubernetes.io/projected/5c5a959a-c352-43cf-bb54-cd19e59e0f09-kube-api-access-l6k8r\") pod \"e2e-conflict-a-51bbeba1-kserve-79555777f6-cjl99\" (UID: \"5c5a959a-c352-43cf-bb54-cd19e59e0f09\") " pod="e2e-models-e2e-worker-w4-66261e/e2e-conflict-a-51bbeba1-kserve-79555777f6-cjl99"
Sep 15 13:57:07.480205 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:07.480117    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5c5a959a-c352-43cf-bb54-cd19e59e0f09-home\") pod \"e2e-conflict-a-51bbeba1-kserve-79555777f6-cjl99\" (UID: \"5c5a959a-c352-43cf-bb54-cd19e59e0f09\") " pod="e2e-models-e2e-worker-w4-66261e/e2e-conflict-a-51bbeba1-kserve-79555777f6-cjl99"
Sep 15 13:57:07.580892 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:07.580861    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5c5a959a-c352-43cf-bb54-cd19e59e0f09-dshm\") pod \"e2e-conflict-a-51bbeba1-kserve-79555777f6-cjl99\" (UID: \"5c5a959a-c352-43cf-bb54-cd19e59e0f09\") " pod="e2e-models-e2e-worker-w4-66261e/e2e-conflict-a-51bbeba1-kserve-79555777f6-cjl99"
Sep 15 13:57:07.580892 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:07.580895    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5c5a959a-c352-43cf-bb54-cd19e59e0f09-model-cache\") pod \"e2e-conflict-a-51bbeba1-kserve-79555777f6-cjl99\" (UID: \"5c5a959a-c352-43cf-bb54-cd19e59e0f09\") " pod="e2e-models-e2e-worker-w4-66261e/e2e-conflict-a-51bbeba1-kserve-79555777f6-cjl99"
Sep 15 13:57:07.581187 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:07.580947    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c5a959a-c352-43cf-bb54-cd19e59e0f09-tmp-dir\") pod \"e2e-conflict-a-51bbeba1-kserve-79555777f6-cjl99\" (UID: \"5c5a959a-c352-43cf-bb54-cd19e59e0f09\") " pod="e2e-models-e2e-worker-w4-66261e/e2e-conflict-a-51bbeba1-kserve-79555777f6-cjl99"
Sep 15 13:57:07.581187 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:07.580963    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c5a959a-c352-43cf-bb54-cd19e59e0f09-tls-certs\") pod \"e2e-conflict-a-51bbeba1-kserve-79555777f6-cjl99\" (UID: \"5c5a959a-c352-43cf-bb54-cd19e59e0f09\") " pod="e2e-models-e2e-worker-w4-66261e/e2e-conflict-a-51bbeba1-kserve-79555777f6-cjl99"
Sep 15 13:57:07.581187 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:07.580999    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6k8r\" (UniqueName: \"kubernetes.io/projected/5c5a959a-c352-43cf-bb54-cd19e59e0f09-kube-api-access-l6k8r\") pod \"e2e-conflict-a-51bbeba1-kserve-79555777f6-cjl99\" (UID: \"5c5a959a-c352-43cf-bb54-cd19e59e0f09\") " pod="e2e-models-e2e-worker-w4-66261e/e2e-conflict-a-51bbeba1-kserve-79555777f6-cjl99"
Sep 15 13:57:07.581187 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:07.581022    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5c5a959a-c352-43cf-bb54-cd19e59e0f09-home\") pod \"e2e-conflict-a-51bbeba1-kserve-79555777f6-cjl99\" (UID: \"5c5a959a-c352-43cf-bb54-cd19e59e0f09\") " pod="e2e-models-e2e-worker-w4-66261e/e2e-conflict-a-51bbeba1-kserve-79555777f6-cjl99"
Sep 15 13:57:07.581422 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:07.581399    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c5a959a-c352-43cf-bb54-cd19e59e0f09-tmp-dir\") pod \"e2e-conflict-a-51bbeba1-kserve-79555777f6-cjl99\" (UID: \"5c5a959a-c352-43cf-bb54-cd19e59e0f09\") " pod="e2e-models-e2e-worker-w4-66261e/e2e-conflict-a-51bbeba1-kserve-79555777f6-cjl99"
Sep 15 13:57:07.581478 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:07.581462    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5c5a959a-c352-43cf-bb54-cd19e59e0f09-model-cache\") pod \"e2e-conflict-a-51bbeba1-kserve-79555777f6-cjl99\" (UID: \"5c5a959a-c352-43cf-bb54-cd19e59e0f09\") " pod="e2e-models-e2e-worker-w4-66261e/e2e-conflict-a-51bbeba1-kserve-79555777f6-cjl99"
Sep 15 13:57:07.581513 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:07.581500    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5c5a959a-c352-43cf-bb54-cd19e59e0f09-home\") pod \"e2e-conflict-a-51bbeba1-kserve-79555777f6-cjl99\" (UID: \"5c5a959a-c352-43cf-bb54-cd19e59e0f09\") " pod="e2e-models-e2e-worker-w4-66261e/e2e-conflict-a-51bbeba1-kserve-79555777f6-cjl99"
Sep 15 13:57:07.583488 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:07.583461    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5c5a959a-c352-43cf-bb54-cd19e59e0f09-dshm\") pod \"e2e-conflict-a-51bbeba1-kserve-79555777f6-cjl99\" (UID: \"5c5a959a-c352-43cf-bb54-cd19e59e0f09\") " pod="e2e-models-e2e-worker-w4-66261e/e2e-conflict-a-51bbeba1-kserve-79555777f6-cjl99"
Sep 15 13:57:07.583628 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:07.583612    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c5a959a-c352-43cf-bb54-cd19e59e0f09-tls-certs\") pod \"e2e-conflict-a-51bbeba1-kserve-79555777f6-cjl99\" (UID: \"5c5a959a-c352-43cf-bb54-cd19e59e0f09\") " pod="e2e-models-e2e-worker-w4-66261e/e2e-conflict-a-51bbeba1-kserve-79555777f6-cjl99"
Sep 15 13:57:07.588520 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:07.588491    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6k8r\" (UniqueName: \"kubernetes.io/projected/5c5a959a-c352-43cf-bb54-cd19e59e0f09-kube-api-access-l6k8r\") pod \"e2e-conflict-a-51bbeba1-kserve-79555777f6-cjl99\" (UID: \"5c5a959a-c352-43cf-bb54-cd19e59e0f09\") " pod="e2e-models-e2e-worker-w4-66261e/e2e-conflict-a-51bbeba1-kserve-79555777f6-cjl99"
Sep 15 13:57:07.740649 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:07.740561    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-66261e/e2e-conflict-a-51bbeba1-kserve-79555777f6-cjl99"
Sep 15 13:57:08.020252 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:08.020225    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-66261e/e2e-conflict-a-51bbeba1-kserve-79555777f6-cjl99"]
Sep 15 13:57:08.021555 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:57:08.021529    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5c5a959a_c352_43cf_bb54_cd19e59e0f09.slice/crio-c090602abb2a764585ac878e0a5e871380e8dc8f219fd53517a1fd47078655f2 WatchSource:0}: Error finding container c090602abb2a764585ac878e0a5e871380e8dc8f219fd53517a1fd47078655f2: Status 404 returned error can't find the container with id c090602abb2a764585ac878e0a5e871380e8dc8f219fd53517a1fd47078655f2
Sep 15 13:57:08.788540 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:08.788505    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-66261e/e2e-conflict-a-51bbeba1-kserve-79555777f6-cjl99" event={"ID":"5c5a959a-c352-43cf-bb54-cd19e59e0f09","Type":"ContainerStarted","Data":"413153b8de09133819738cf83d3a090e7441f5faa1b24d6480da47ba353d64d5"}
Sep 15 13:57:08.788952 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:08.788548    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-66261e/e2e-conflict-a-51bbeba1-kserve-79555777f6-cjl99" event={"ID":"5c5a959a-c352-43cf-bb54-cd19e59e0f09","Type":"ContainerStarted","Data":"c090602abb2a764585ac878e0a5e871380e8dc8f219fd53517a1fd47078655f2"}
Sep 15 13:57:08.806740 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:08.806686    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-66261e/e2e-conflict-a-51bbeba1-kserve-79555777f6-cjl99" podStartSLOduration=1.806669869 podStartE2EDuration="1.806669869s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:57:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:57:08.805104183 +0000 UTC m=+1115.564230469" watchObservedRunningTime="2026-09-15 13:57:08.806669869 +0000 UTC m=+1115.565796155"
Sep 15 13:57:10.679811 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:10.679782    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-f9e4ef-kttpj"]
Sep 15 13:57:10.683241 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:10.683224    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-f9e4ef-kttpj"
Sep 15 13:57:10.685530 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:10.685507    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qzmkv\""
Sep 15 13:57:10.685653 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:10.685538    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 15 13:57:10.686101 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:10.686087    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 13:57:10.691580 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:10.691027    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-f9e4ef-kttpj"]
Sep 15 13:57:10.813384 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:10.813355    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wc4w\" (UniqueName: \"kubernetes.io/projected/5572b30b-ab23-483f-8ad4-51b11cd4a9b2-kube-api-access-9wc4w\") pod \"maas-api-revoke-keys-e2e-explicit-f9e4ef-kttpj\" (UID: \"5572b30b-ab23-483f-8ad4-51b11cd4a9b2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-f9e4ef-kttpj"
Sep 15 13:57:10.813563 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:10.813491    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5572b30b-ab23-483f-8ad4-51b11cd4a9b2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-f9e4ef-kttpj\" (UID: \"5572b30b-ab23-483f-8ad4-51b11cd4a9b2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-f9e4ef-kttpj"
Sep 15 13:57:10.914316 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:10.914282    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5572b30b-ab23-483f-8ad4-51b11cd4a9b2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-f9e4ef-kttpj\" (UID: \"5572b30b-ab23-483f-8ad4-51b11cd4a9b2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-f9e4ef-kttpj"
Sep 15 13:57:10.914495 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:10.914350    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wc4w\" (UniqueName: \"kubernetes.io/projected/5572b30b-ab23-483f-8ad4-51b11cd4a9b2-kube-api-access-9wc4w\") pod \"maas-api-revoke-keys-e2e-explicit-f9e4ef-kttpj\" (UID: \"5572b30b-ab23-483f-8ad4-51b11cd4a9b2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-f9e4ef-kttpj"
Sep 15 13:57:10.915580 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:10.915539    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5572b30b-ab23-483f-8ad4-51b11cd4a9b2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-f9e4ef-kttpj\" (UID: \"5572b30b-ab23-483f-8ad4-51b11cd4a9b2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-f9e4ef-kttpj"
Sep 15 13:57:10.924347 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:10.924320    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wc4w\" (UniqueName: \"kubernetes.io/projected/5572b30b-ab23-483f-8ad4-51b11cd4a9b2-kube-api-access-9wc4w\") pod \"maas-api-revoke-keys-e2e-explicit-f9e4ef-kttpj\" (UID: \"5572b30b-ab23-483f-8ad4-51b11cd4a9b2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-f9e4ef-kttpj"
Sep 15 13:57:10.995626 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:10.995554    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-f9e4ef-kttpj"
Sep 15 13:57:11.265989 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:11.265962    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-f9e4ef-kttpj"]
Sep 15 13:57:11.267647 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:57:11.267620    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5572b30b_ab23_483f_8ad4_51b11cd4a9b2.slice/crio-2f7ef128e59526d1d37c4d62711005bc07859f789691847f0d541b3d0281ff24 WatchSource:0}: Error finding container 2f7ef128e59526d1d37c4d62711005bc07859f789691847f0d541b3d0281ff24: Status 404 returned error can't find the container with id 2f7ef128e59526d1d37c4d62711005bc07859f789691847f0d541b3d0281ff24
Sep 15 13:57:11.808188 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:11.808155    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-f9e4ef-kttpj" event={"ID":"5572b30b-ab23-483f-8ad4-51b11cd4a9b2","Type":"ContainerStarted","Data":"3e70393e916fa97afbfa62f9ac2048d62b9410d7e177ccd7361dcf4163694f58"}
Sep 15 13:57:11.808577 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:11.808204    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-f9e4ef-kttpj" event={"ID":"5572b30b-ab23-483f-8ad4-51b11cd4a9b2","Type":"ContainerStarted","Data":"2f7ef128e59526d1d37c4d62711005bc07859f789691847f0d541b3d0281ff24"}
Sep 15 13:57:11.824587 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:11.824542    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-f9e4ef-kttpj" podStartSLOduration=1.824528685 podStartE2EDuration="1.824528685s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:57:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:57:11.822271173 +0000 UTC m=+1118.581397458" watchObservedRunningTime="2026-09-15 13:57:11.824528685 +0000 UTC m=+1118.583654970"
Sep 15 13:57:12.815915 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:12.815881    2578 generic.go:356] "Generic (PLEG): container finished" podID="5572b30b-ab23-483f-8ad4-51b11cd4a9b2" containerID="3e70393e916fa97afbfa62f9ac2048d62b9410d7e177ccd7361dcf4163694f58" exitCode=0
Sep 15 13:57:12.816306 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:12.815963    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-f9e4ef-kttpj" event={"ID":"5572b30b-ab23-483f-8ad4-51b11cd4a9b2","Type":"ContainerDied","Data":"3e70393e916fa97afbfa62f9ac2048d62b9410d7e177ccd7361dcf4163694f58"}
Sep 15 13:57:13.946666 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:13.946638    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-f9e4ef-kttpj"
Sep 15 13:57:14.048217 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:14.048185    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5572b30b-ab23-483f-8ad4-51b11cd4a9b2-maas-api-service-ca\") pod \"5572b30b-ab23-483f-8ad4-51b11cd4a9b2\" (UID: \"5572b30b-ab23-483f-8ad4-51b11cd4a9b2\") "
Sep 15 13:57:14.048392 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:14.048233    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9wc4w\" (UniqueName: \"kubernetes.io/projected/5572b30b-ab23-483f-8ad4-51b11cd4a9b2-kube-api-access-9wc4w\") pod \"5572b30b-ab23-483f-8ad4-51b11cd4a9b2\" (UID: \"5572b30b-ab23-483f-8ad4-51b11cd4a9b2\") "
Sep 15 13:57:14.048594 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:14.048568    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5572b30b-ab23-483f-8ad4-51b11cd4a9b2-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5572b30b-ab23-483f-8ad4-51b11cd4a9b2" (UID: "5572b30b-ab23-483f-8ad4-51b11cd4a9b2"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 13:57:14.050408 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:14.050385    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5572b30b-ab23-483f-8ad4-51b11cd4a9b2-kube-api-access-9wc4w" (OuterVolumeSpecName: "kube-api-access-9wc4w") pod "5572b30b-ab23-483f-8ad4-51b11cd4a9b2" (UID: "5572b30b-ab23-483f-8ad4-51b11cd4a9b2"). InnerVolumeSpecName "kube-api-access-9wc4w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:57:14.150026 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:14.149942    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5572b30b-ab23-483f-8ad4-51b11cd4a9b2-maas-api-service-ca\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:57:14.150026 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:14.149972    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9wc4w\" (UniqueName: \"kubernetes.io/projected/5572b30b-ab23-483f-8ad4-51b11cd4a9b2-kube-api-access-9wc4w\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:57:14.828566 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:14.828534    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-f9e4ef-kttpj"
Sep 15 13:57:14.828566 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:14.828546    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-f9e4ef-kttpj" event={"ID":"5572b30b-ab23-483f-8ad4-51b11cd4a9b2","Type":"ContainerDied","Data":"2f7ef128e59526d1d37c4d62711005bc07859f789691847f0d541b3d0281ff24"}
Sep 15 13:57:14.828776 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:14.828586    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2f7ef128e59526d1d37c4d62711005bc07859f789691847f0d541b3d0281ff24"
Sep 15 13:57:17.741086 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:17.741035    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-66261e/e2e-conflict-a-51bbeba1-kserve-79555777f6-cjl99"
Sep 15 13:57:17.741086 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:17.741093    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-66261e/e2e-conflict-a-51bbeba1-kserve-79555777f6-cjl99"
Sep 15 13:57:17.758483 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:17.758459    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-66261e/e2e-conflict-a-51bbeba1-kserve-79555777f6-cjl99"
Sep 15 13:57:17.866934 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:17.866907    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-66261e/e2e-conflict-a-51bbeba1-kserve-79555777f6-cjl99"
Sep 15 13:57:21.357434 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:21.357404    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-f9e4ef-8586584477-5ljzm"]
Sep 15 13:57:21.357860 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:21.357604    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-explicit-f9e4ef-8586584477-5ljzm" podUID="49ead8a2-c5ef-4dde-a0ab-b971df8191f0" containerName="payload-processing" containerID="cri-o://a8394ece5c73877f5504e822649bf7f04f2db8d8a4d38768a3d2532228f300f0" gracePeriod=30
Sep 15 13:57:21.369318 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:21.369280    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-f9e4ef-544469d9db-s4rrh"]
Sep 15 13:57:21.369546 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:21.369512    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-explicit-f9e4ef-544469d9db-s4rrh" podUID="af68b14d-c929-43e4-b802-09f91fa50848" containerName="payload-pre-processing" containerID="cri-o://727255874dabb4e4627fd7209a1b0694b7b2d673815439d41dbf3d92035bd27b" gracePeriod=30
Sep 15 13:57:21.609436 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:21.609404    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-f9e4ef-kttpj"]
Sep 15 13:57:21.613991 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:21.613960    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-f9e4ef-kttpj"]
Sep 15 13:57:21.629957 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:21.629933    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-f9e4ef-8586584477-5ljzm"
Sep 15 13:57:21.653281 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:21.653259    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-f9e4ef-544469d9db-s4rrh"
Sep 15 13:57:21.724422 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:21.724366    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vxgnm\" (UniqueName: \"kubernetes.io/projected/af68b14d-c929-43e4-b802-09f91fa50848-kube-api-access-vxgnm\") pod \"af68b14d-c929-43e4-b802-09f91fa50848\" (UID: \"af68b14d-c929-43e4-b802-09f91fa50848\") "
Sep 15 13:57:21.724663 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:21.724431    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/49ead8a2-c5ef-4dde-a0ab-b971df8191f0-plugins-config-volume\") pod \"49ead8a2-c5ef-4dde-a0ab-b971df8191f0\" (UID: \"49ead8a2-c5ef-4dde-a0ab-b971df8191f0\") "
Sep 15 13:57:21.724663 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:21.724575    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/af68b14d-c929-43e4-b802-09f91fa50848-plugins-config-volume\") pod \"af68b14d-c929-43e4-b802-09f91fa50848\" (UID: \"af68b14d-c929-43e4-b802-09f91fa50848\") "
Sep 15 13:57:21.724663 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:21.724650    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-th82c\" (UniqueName: \"kubernetes.io/projected/49ead8a2-c5ef-4dde-a0ab-b971df8191f0-kube-api-access-th82c\") pod \"49ead8a2-c5ef-4dde-a0ab-b971df8191f0\" (UID: \"49ead8a2-c5ef-4dde-a0ab-b971df8191f0\") "
Sep 15 13:57:21.725019 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:21.724991    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af68b14d-c929-43e4-b802-09f91fa50848-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "af68b14d-c929-43e4-b802-09f91fa50848" (UID: "af68b14d-c929-43e4-b802-09f91fa50848"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 13:57:21.725194 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:21.725098    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/af68b14d-c929-43e4-b802-09f91fa50848-plugins-config-volume\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:57:21.725265 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:21.725248    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49ead8a2-c5ef-4dde-a0ab-b971df8191f0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "49ead8a2-c5ef-4dde-a0ab-b971df8191f0" (UID: "49ead8a2-c5ef-4dde-a0ab-b971df8191f0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 13:57:21.726864 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:21.726842    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af68b14d-c929-43e4-b802-09f91fa50848-kube-api-access-vxgnm" (OuterVolumeSpecName: "kube-api-access-vxgnm") pod "af68b14d-c929-43e4-b802-09f91fa50848" (UID: "af68b14d-c929-43e4-b802-09f91fa50848"). InnerVolumeSpecName "kube-api-access-vxgnm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:57:21.727248 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:21.727228    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49ead8a2-c5ef-4dde-a0ab-b971df8191f0-kube-api-access-th82c" (OuterVolumeSpecName: "kube-api-access-th82c") pod "49ead8a2-c5ef-4dde-a0ab-b971df8191f0" (UID: "49ead8a2-c5ef-4dde-a0ab-b971df8191f0"). InnerVolumeSpecName "kube-api-access-th82c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:57:21.757696 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:21.757665    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5572b30b-ab23-483f-8ad4-51b11cd4a9b2" path="/var/lib/kubelet/pods/5572b30b-ab23-483f-8ad4-51b11cd4a9b2/volumes"
Sep 15 13:57:21.826303 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:21.826272    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vxgnm\" (UniqueName: \"kubernetes.io/projected/af68b14d-c929-43e4-b802-09f91fa50848-kube-api-access-vxgnm\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:57:21.826303 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:21.826300    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/49ead8a2-c5ef-4dde-a0ab-b971df8191f0-plugins-config-volume\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:57:21.826509 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:21.826315    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-th82c\" (UniqueName: \"kubernetes.io/projected/49ead8a2-c5ef-4dde-a0ab-b971df8191f0-kube-api-access-th82c\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:57:21.879707 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:21.879628    2578 generic.go:356] "Generic (PLEG): container finished" podID="af68b14d-c929-43e4-b802-09f91fa50848" containerID="727255874dabb4e4627fd7209a1b0694b7b2d673815439d41dbf3d92035bd27b" exitCode=0
Sep 15 13:57:21.879707 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:21.879688    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-f9e4ef-544469d9db-s4rrh"
Sep 15 13:57:21.879888 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:21.879726    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-f9e4ef-544469d9db-s4rrh" event={"ID":"af68b14d-c929-43e4-b802-09f91fa50848","Type":"ContainerDied","Data":"727255874dabb4e4627fd7209a1b0694b7b2d673815439d41dbf3d92035bd27b"}
Sep 15 13:57:21.879888 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:21.879807    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-f9e4ef-544469d9db-s4rrh" event={"ID":"af68b14d-c929-43e4-b802-09f91fa50848","Type":"ContainerDied","Data":"b3adf269263b17389a2c1e0abe3f69cb47ec0e547573a3f5cd8b5cdfa1a2845b"}
Sep 15 13:57:21.879888 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:21.879852    2578 scope.go:117] "RemoveContainer" containerID="727255874dabb4e4627fd7209a1b0694b7b2d673815439d41dbf3d92035bd27b"
Sep 15 13:57:21.881119 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:21.881096    2578 generic.go:356] "Generic (PLEG): container finished" podID="49ead8a2-c5ef-4dde-a0ab-b971df8191f0" containerID="a8394ece5c73877f5504e822649bf7f04f2db8d8a4d38768a3d2532228f300f0" exitCode=0
Sep 15 13:57:21.881239 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:21.881158    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-f9e4ef-8586584477-5ljzm" event={"ID":"49ead8a2-c5ef-4dde-a0ab-b971df8191f0","Type":"ContainerDied","Data":"a8394ece5c73877f5504e822649bf7f04f2db8d8a4d38768a3d2532228f300f0"}
Sep 15 13:57:21.881239 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:21.881212    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-f9e4ef-8586584477-5ljzm" event={"ID":"49ead8a2-c5ef-4dde-a0ab-b971df8191f0","Type":"ContainerDied","Data":"cb694ed987c63d306922fd87121be124658405a4ca405cb70a5cf54ba93bea69"}
Sep 15 13:57:21.881239 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:21.881169    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-f9e4ef-8586584477-5ljzm"
Sep 15 13:57:21.889551 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:21.889522    2578 scope.go:117] "RemoveContainer" containerID="727255874dabb4e4627fd7209a1b0694b7b2d673815439d41dbf3d92035bd27b"
Sep 15 13:57:21.889833 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:57:21.889811    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"727255874dabb4e4627fd7209a1b0694b7b2d673815439d41dbf3d92035bd27b\": container with ID starting with 727255874dabb4e4627fd7209a1b0694b7b2d673815439d41dbf3d92035bd27b not found: ID does not exist" containerID="727255874dabb4e4627fd7209a1b0694b7b2d673815439d41dbf3d92035bd27b"
Sep 15 13:57:21.889897 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:21.889844    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"727255874dabb4e4627fd7209a1b0694b7b2d673815439d41dbf3d92035bd27b"} err="failed to get container status \"727255874dabb4e4627fd7209a1b0694b7b2d673815439d41dbf3d92035bd27b\": rpc error: code = NotFound desc = could not find container \"727255874dabb4e4627fd7209a1b0694b7b2d673815439d41dbf3d92035bd27b\": container with ID starting with 727255874dabb4e4627fd7209a1b0694b7b2d673815439d41dbf3d92035bd27b not found: ID does not exist"
Sep 15 13:57:21.889897 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:21.889860    2578 scope.go:117] "RemoveContainer" containerID="a8394ece5c73877f5504e822649bf7f04f2db8d8a4d38768a3d2532228f300f0"
Sep 15 13:57:21.898375 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:21.898359    2578 scope.go:117] "RemoveContainer" containerID="a8394ece5c73877f5504e822649bf7f04f2db8d8a4d38768a3d2532228f300f0"
Sep 15 13:57:21.898612 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:57:21.898595    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8394ece5c73877f5504e822649bf7f04f2db8d8a4d38768a3d2532228f300f0\": container with ID starting with a8394ece5c73877f5504e822649bf7f04f2db8d8a4d38768a3d2532228f300f0 not found: ID does not exist" containerID="a8394ece5c73877f5504e822649bf7f04f2db8d8a4d38768a3d2532228f300f0"
Sep 15 13:57:21.898663 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:21.898618    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8394ece5c73877f5504e822649bf7f04f2db8d8a4d38768a3d2532228f300f0"} err="failed to get container status \"a8394ece5c73877f5504e822649bf7f04f2db8d8a4d38768a3d2532228f300f0\": rpc error: code = NotFound desc = could not find container \"a8394ece5c73877f5504e822649bf7f04f2db8d8a4d38768a3d2532228f300f0\": container with ID starting with a8394ece5c73877f5504e822649bf7f04f2db8d8a4d38768a3d2532228f300f0 not found: ID does not exist"
Sep 15 13:57:21.918451 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:21.918426    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-f9e4ef-8586584477-5ljzm"]
Sep 15 13:57:21.924951 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:21.924933    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-f9e4ef-8586584477-5ljzm"]
Sep 15 13:57:21.949347 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:21.949320    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-f9e4ef-544469d9db-s4rrh"]
Sep 15 13:57:21.961762 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:21.961739    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-f9e4ef-544469d9db-s4rrh"]
Sep 15 13:57:23.757756 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:23.757724    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="49ead8a2-c5ef-4dde-a0ab-b971df8191f0" path="/var/lib/kubelet/pods/49ead8a2-c5ef-4dde-a0ab-b971df8191f0/volumes"
Sep 15 13:57:23.758111 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:23.758075    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af68b14d-c929-43e4-b802-09f91fa50848" path="/var/lib/kubelet/pods/af68b14d-c929-43e4-b802-09f91fa50848/volumes"
Sep 15 13:57:27.902601 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:27.902572    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-f9e4ef-openshift-default-7884cdcffb-7vhp6"]
Sep 15 13:57:27.918875 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:27.918823    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-explicit-f9e4ef-openshift-default-7884cdcffb-7vhp6" podUID="a350d01b-8811-40dd-96d5-8a3bece1d1f3" containerName="istio-proxy" containerID="cri-o://317a2293d0147fb8b7bb8af02b7eefd1bd1707dfe01ba6aea0e8934ea45cf4e2" gracePeriod=30
Sep 15 13:57:28.215945 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:28.215854    2578 patch_prober.go:28] interesting pod/e2e-explicit-f9e4ef-openshift-default-7884cdcffb-7vhp6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 15 13:57:28.216093 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:28.215940    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-explicit-f9e4ef-openshift-default-7884cdcffb-7vhp6" podUID="a350d01b-8811-40dd-96d5-8a3bece1d1f3" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 15 13:57:28.590354 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:28.590324    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-noten-fa9465-openshift-default-7cb57d49d-lv2zt"]
Sep 15 13:57:28.590807 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:28.590789    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5572b30b-ab23-483f-8ad4-51b11cd4a9b2" containerName="revoke-keys"
Sep 15 13:57:28.590854 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:28.590811    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5572b30b-ab23-483f-8ad4-51b11cd4a9b2" containerName="revoke-keys"
Sep 15 13:57:28.590854 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:28.590827    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49ead8a2-c5ef-4dde-a0ab-b971df8191f0" containerName="payload-processing"
Sep 15 13:57:28.590854 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:28.590833    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="49ead8a2-c5ef-4dde-a0ab-b971df8191f0" containerName="payload-processing"
Sep 15 13:57:28.590854 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:28.590848    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af68b14d-c929-43e4-b802-09f91fa50848" containerName="payload-pre-processing"
Sep 15 13:57:28.590854 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:28.590854    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="af68b14d-c929-43e4-b802-09f91fa50848" containerName="payload-pre-processing"
Sep 15 13:57:28.591057 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:28.590932    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="49ead8a2-c5ef-4dde-a0ab-b971df8191f0" containerName="payload-processing"
Sep 15 13:57:28.591057 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:28.590944    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="5572b30b-ab23-483f-8ad4-51b11cd4a9b2" containerName="revoke-keys"
Sep 15 13:57:28.591057 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:28.590955    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="af68b14d-c929-43e4-b802-09f91fa50848" containerName="payload-pre-processing"
Sep 15 13:57:28.595993 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:28.595975    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-fa9465-openshift-default-7cb57d49d-lv2zt"
Sep 15 13:57:28.598272 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:28.598252    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-noten-fa9465-openshift-default-dockercfg-xqhcn\""
Sep 15 13:57:28.609687 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:28.609665    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-fa9465-openshift-default-7cb57d49d-lv2zt"]
Sep 15 13:57:28.698434 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:28.698400    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b32f75b3-6efd-48db-af6b-f114023377f9-workload-socket\") pod \"e2e-noten-fa9465-openshift-default-7cb57d49d-lv2zt\" (UID: \"b32f75b3-6efd-48db-af6b-f114023377f9\") " pod="openshift-ingress/e2e-noten-fa9465-openshift-default-7cb57d49d-lv2zt"
Sep 15 13:57:28.698434 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:28.698445    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b32f75b3-6efd-48db-af6b-f114023377f9-istio-envoy\") pod \"e2e-noten-fa9465-openshift-default-7cb57d49d-lv2zt\" (UID: \"b32f75b3-6efd-48db-af6b-f114023377f9\") " pod="openshift-ingress/e2e-noten-fa9465-openshift-default-7cb57d49d-lv2zt"
Sep 15 13:57:28.698685 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:28.698482    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b32f75b3-6efd-48db-af6b-f114023377f9-credential-socket\") pod \"e2e-noten-fa9465-openshift-default-7cb57d49d-lv2zt\" (UID: \"b32f75b3-6efd-48db-af6b-f114023377f9\") " pod="openshift-ingress/e2e-noten-fa9465-openshift-default-7cb57d49d-lv2zt"
Sep 15 13:57:28.698685 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:28.698504    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjv97\" (UniqueName: \"kubernetes.io/projected/b32f75b3-6efd-48db-af6b-f114023377f9-kube-api-access-vjv97\") pod \"e2e-noten-fa9465-openshift-default-7cb57d49d-lv2zt\" (UID: \"b32f75b3-6efd-48db-af6b-f114023377f9\") " pod="openshift-ingress/e2e-noten-fa9465-openshift-default-7cb57d49d-lv2zt"
Sep 15 13:57:28.698685 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:28.698660    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b32f75b3-6efd-48db-af6b-f114023377f9-istio-podinfo\") pod \"e2e-noten-fa9465-openshift-default-7cb57d49d-lv2zt\" (UID: \"b32f75b3-6efd-48db-af6b-f114023377f9\") " pod="openshift-ingress/e2e-noten-fa9465-openshift-default-7cb57d49d-lv2zt"
Sep 15 13:57:28.698838 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:28.698744    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b32f75b3-6efd-48db-af6b-f114023377f9-istiod-ca-cert\") pod \"e2e-noten-fa9465-openshift-default-7cb57d49d-lv2zt\" (UID: \"b32f75b3-6efd-48db-af6b-f114023377f9\") " pod="openshift-ingress/e2e-noten-fa9465-openshift-default-7cb57d49d-lv2zt"
Sep 15 13:57:28.698838 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:28.698817    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b32f75b3-6efd-48db-af6b-f114023377f9-istio-data\") pod \"e2e-noten-fa9465-openshift-default-7cb57d49d-lv2zt\" (UID: \"b32f75b3-6efd-48db-af6b-f114023377f9\") " pod="openshift-ingress/e2e-noten-fa9465-openshift-default-7cb57d49d-lv2zt"
Sep 15 13:57:28.698927 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:28.698843    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b32f75b3-6efd-48db-af6b-f114023377f9-istio-token\") pod \"e2e-noten-fa9465-openshift-default-7cb57d49d-lv2zt\" (UID: \"b32f75b3-6efd-48db-af6b-f114023377f9\") " pod="openshift-ingress/e2e-noten-fa9465-openshift-default-7cb57d49d-lv2zt"
Sep 15 13:57:28.698927 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:28.698878    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b32f75b3-6efd-48db-af6b-f114023377f9-workload-certs\") pod \"e2e-noten-fa9465-openshift-default-7cb57d49d-lv2zt\" (UID: \"b32f75b3-6efd-48db-af6b-f114023377f9\") " pod="openshift-ingress/e2e-noten-fa9465-openshift-default-7cb57d49d-lv2zt"
Sep 15 13:57:28.800225 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:28.800191    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b32f75b3-6efd-48db-af6b-f114023377f9-istiod-ca-cert\") pod \"e2e-noten-fa9465-openshift-default-7cb57d49d-lv2zt\" (UID: \"b32f75b3-6efd-48db-af6b-f114023377f9\") " pod="openshift-ingress/e2e-noten-fa9465-openshift-default-7cb57d49d-lv2zt"
Sep 15 13:57:28.800444 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:28.800252    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b32f75b3-6efd-48db-af6b-f114023377f9-istio-data\") pod \"e2e-noten-fa9465-openshift-default-7cb57d49d-lv2zt\" (UID: \"b32f75b3-6efd-48db-af6b-f114023377f9\") " pod="openshift-ingress/e2e-noten-fa9465-openshift-default-7cb57d49d-lv2zt"
Sep 15 13:57:28.800444 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:28.800270    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b32f75b3-6efd-48db-af6b-f114023377f9-istio-token\") pod \"e2e-noten-fa9465-openshift-default-7cb57d49d-lv2zt\" (UID: \"b32f75b3-6efd-48db-af6b-f114023377f9\") " pod="openshift-ingress/e2e-noten-fa9465-openshift-default-7cb57d49d-lv2zt"
Sep 15 13:57:28.800444 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:28.800289    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b32f75b3-6efd-48db-af6b-f114023377f9-workload-certs\") pod \"e2e-noten-fa9465-openshift-default-7cb57d49d-lv2zt\" (UID: \"b32f75b3-6efd-48db-af6b-f114023377f9\") " pod="openshift-ingress/e2e-noten-fa9465-openshift-default-7cb57d49d-lv2zt"
Sep 15 13:57:28.800444 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:28.800375    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b32f75b3-6efd-48db-af6b-f114023377f9-workload-socket\") pod \"e2e-noten-fa9465-openshift-default-7cb57d49d-lv2zt\" (UID: \"b32f75b3-6efd-48db-af6b-f114023377f9\") " pod="openshift-ingress/e2e-noten-fa9465-openshift-default-7cb57d49d-lv2zt"
Sep 15 13:57:28.800444 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:28.800398    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b32f75b3-6efd-48db-af6b-f114023377f9-istio-envoy\") pod \"e2e-noten-fa9465-openshift-default-7cb57d49d-lv2zt\" (UID: \"b32f75b3-6efd-48db-af6b-f114023377f9\") " pod="openshift-ingress/e2e-noten-fa9465-openshift-default-7cb57d49d-lv2zt"
Sep 15 13:57:28.800444 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:28.800430    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b32f75b3-6efd-48db-af6b-f114023377f9-credential-socket\") pod \"e2e-noten-fa9465-openshift-default-7cb57d49d-lv2zt\" (UID: \"b32f75b3-6efd-48db-af6b-f114023377f9\") " pod="openshift-ingress/e2e-noten-fa9465-openshift-default-7cb57d49d-lv2zt"
Sep 15 13:57:28.800758 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:28.800456    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjv97\" (UniqueName: \"kubernetes.io/projected/b32f75b3-6efd-48db-af6b-f114023377f9-kube-api-access-vjv97\") pod \"e2e-noten-fa9465-openshift-default-7cb57d49d-lv2zt\" (UID: \"b32f75b3-6efd-48db-af6b-f114023377f9\") " pod="openshift-ingress/e2e-noten-fa9465-openshift-default-7cb57d49d-lv2zt"
Sep 15 13:57:28.800758 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:28.800529    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b32f75b3-6efd-48db-af6b-f114023377f9-istio-podinfo\") pod \"e2e-noten-fa9465-openshift-default-7cb57d49d-lv2zt\" (UID: \"b32f75b3-6efd-48db-af6b-f114023377f9\") " pod="openshift-ingress/e2e-noten-fa9465-openshift-default-7cb57d49d-lv2zt"
Sep 15 13:57:28.800758 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:28.800661    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b32f75b3-6efd-48db-af6b-f114023377f9-istio-data\") pod \"e2e-noten-fa9465-openshift-default-7cb57d49d-lv2zt\" (UID: \"b32f75b3-6efd-48db-af6b-f114023377f9\") " pod="openshift-ingress/e2e-noten-fa9465-openshift-default-7cb57d49d-lv2zt"
Sep 15 13:57:28.800915 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:28.800833    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b32f75b3-6efd-48db-af6b-f114023377f9-workload-socket\") pod \"e2e-noten-fa9465-openshift-default-7cb57d49d-lv2zt\" (UID: \"b32f75b3-6efd-48db-af6b-f114023377f9\") " pod="openshift-ingress/e2e-noten-fa9465-openshift-default-7cb57d49d-lv2zt"
Sep 15 13:57:28.800915 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:28.800894    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b32f75b3-6efd-48db-af6b-f114023377f9-workload-certs\") pod \"e2e-noten-fa9465-openshift-default-7cb57d49d-lv2zt\" (UID: \"b32f75b3-6efd-48db-af6b-f114023377f9\") " pod="openshift-ingress/e2e-noten-fa9465-openshift-default-7cb57d49d-lv2zt"
Sep 15 13:57:28.801015 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:28.801001    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b32f75b3-6efd-48db-af6b-f114023377f9-credential-socket\") pod \"e2e-noten-fa9465-openshift-default-7cb57d49d-lv2zt\" (UID: \"b32f75b3-6efd-48db-af6b-f114023377f9\") " pod="openshift-ingress/e2e-noten-fa9465-openshift-default-7cb57d49d-lv2zt"
Sep 15 13:57:28.801073 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:28.801020    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b32f75b3-6efd-48db-af6b-f114023377f9-istiod-ca-cert\") pod \"e2e-noten-fa9465-openshift-default-7cb57d49d-lv2zt\" (UID: \"b32f75b3-6efd-48db-af6b-f114023377f9\") " pod="openshift-ingress/e2e-noten-fa9465-openshift-default-7cb57d49d-lv2zt"
Sep 15 13:57:28.802838 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:28.802812    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b32f75b3-6efd-48db-af6b-f114023377f9-istio-envoy\") pod \"e2e-noten-fa9465-openshift-default-7cb57d49d-lv2zt\" (UID: \"b32f75b3-6efd-48db-af6b-f114023377f9\") " pod="openshift-ingress/e2e-noten-fa9465-openshift-default-7cb57d49d-lv2zt"
Sep 15 13:57:28.803065 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:28.803046    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b32f75b3-6efd-48db-af6b-f114023377f9-istio-podinfo\") pod \"e2e-noten-fa9465-openshift-default-7cb57d49d-lv2zt\" (UID: \"b32f75b3-6efd-48db-af6b-f114023377f9\") " pod="openshift-ingress/e2e-noten-fa9465-openshift-default-7cb57d49d-lv2zt"
Sep 15 13:57:28.809484 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:28.809465    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b32f75b3-6efd-48db-af6b-f114023377f9-istio-token\") pod \"e2e-noten-fa9465-openshift-default-7cb57d49d-lv2zt\" (UID: \"b32f75b3-6efd-48db-af6b-f114023377f9\") " pod="openshift-ingress/e2e-noten-fa9465-openshift-default-7cb57d49d-lv2zt"
Sep 15 13:57:28.809715 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:28.809699    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjv97\" (UniqueName: \"kubernetes.io/projected/b32f75b3-6efd-48db-af6b-f114023377f9-kube-api-access-vjv97\") pod \"e2e-noten-fa9465-openshift-default-7cb57d49d-lv2zt\" (UID: \"b32f75b3-6efd-48db-af6b-f114023377f9\") " pod="openshift-ingress/e2e-noten-fa9465-openshift-default-7cb57d49d-lv2zt"
Sep 15 13:57:28.906843 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:28.906749    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-fa9465-openshift-default-7cb57d49d-lv2zt"
Sep 15 13:57:29.189457 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:29.189423    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-fa9465-openshift-default-7cb57d49d-lv2zt"]
Sep 15 13:57:29.190235 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:57:29.190205    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb32f75b3_6efd_48db_af6b_f114023377f9.slice/crio-7bcc8277a6f491eb3841af70aba7341c1740412097a5e6dadabefd9c6824e0c9 WatchSource:0}: Error finding container 7bcc8277a6f491eb3841af70aba7341c1740412097a5e6dadabefd9c6824e0c9: Status 404 returned error can't find the container with id 7bcc8277a6f491eb3841af70aba7341c1740412097a5e6dadabefd9c6824e0c9
Sep 15 13:57:29.192732 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:29.192699    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 15 13:57:29.192806 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:29.192786    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 15 13:57:29.192844 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:29.192830    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 15 13:57:29.932627 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:29.932596    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-fa9465-openshift-default-7cb57d49d-lv2zt" event={"ID":"b32f75b3-6efd-48db-af6b-f114023377f9","Type":"ContainerStarted","Data":"b817b8987ae593ffc7201f6afe3b36bfbe6ef58e92cfe863e7b1f74696be1d88"}
Sep 15 13:57:29.933099 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:29.932650    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-fa9465-openshift-default-7cb57d49d-lv2zt" event={"ID":"b32f75b3-6efd-48db-af6b-f114023377f9","Type":"ContainerStarted","Data":"7bcc8277a6f491eb3841af70aba7341c1740412097a5e6dadabefd9c6824e0c9"}
Sep 15 13:57:29.955735 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:29.955690    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-noten-fa9465-openshift-default-7cb57d49d-lv2zt" podStartSLOduration=1.955674822 podStartE2EDuration="1.955674822s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:57:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:57:29.95444535 +0000 UTC m=+1136.713571638" watchObservedRunningTime="2026-09-15 13:57:29.955674822 +0000 UTC m=+1136.714801108"
Sep 15 13:57:30.907911 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:30.907875    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-noten-fa9465-openshift-default-7cb57d49d-lv2zt"
Sep 15 13:57:30.912933 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:30.912909    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-noten-fa9465-openshift-default-7cb57d49d-lv2zt"
Sep 15 13:57:30.939389 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:30.939354    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-noten-fa9465-openshift-default-7cb57d49d-lv2zt"
Sep 15 13:57:30.940313 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:30.940295    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-noten-fa9465-openshift-default-7cb57d49d-lv2zt"
Sep 15 13:57:33.166812 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:33.166788    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-f9e4ef-openshift-default-7884cdcffb-7vhp6"
Sep 15 13:57:33.245847 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:33.245763    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a350d01b-8811-40dd-96d5-8a3bece1d1f3-istio-data\") pod \"a350d01b-8811-40dd-96d5-8a3bece1d1f3\" (UID: \"a350d01b-8811-40dd-96d5-8a3bece1d1f3\") "
Sep 15 13:57:33.245847 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:33.245811    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a350d01b-8811-40dd-96d5-8a3bece1d1f3-istio-token\") pod \"a350d01b-8811-40dd-96d5-8a3bece1d1f3\" (UID: \"a350d01b-8811-40dd-96d5-8a3bece1d1f3\") "
Sep 15 13:57:33.246050 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:33.245867    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a350d01b-8811-40dd-96d5-8a3bece1d1f3-istio-envoy\") pod \"a350d01b-8811-40dd-96d5-8a3bece1d1f3\" (UID: \"a350d01b-8811-40dd-96d5-8a3bece1d1f3\") "
Sep 15 13:57:33.246050 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:33.245914    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a350d01b-8811-40dd-96d5-8a3bece1d1f3-istiod-ca-cert\") pod \"a350d01b-8811-40dd-96d5-8a3bece1d1f3\" (UID: \"a350d01b-8811-40dd-96d5-8a3bece1d1f3\") "
Sep 15 13:57:33.246050 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:33.245942    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a350d01b-8811-40dd-96d5-8a3bece1d1f3-workload-socket\") pod \"a350d01b-8811-40dd-96d5-8a3bece1d1f3\" (UID: \"a350d01b-8811-40dd-96d5-8a3bece1d1f3\") "
Sep 15 13:57:33.246050 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:33.245974    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a350d01b-8811-40dd-96d5-8a3bece1d1f3-istio-podinfo\") pod \"a350d01b-8811-40dd-96d5-8a3bece1d1f3\" (UID: \"a350d01b-8811-40dd-96d5-8a3bece1d1f3\") "
Sep 15 13:57:33.246050 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:33.246029    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9gdzs\" (UniqueName: \"kubernetes.io/projected/a350d01b-8811-40dd-96d5-8a3bece1d1f3-kube-api-access-9gdzs\") pod \"a350d01b-8811-40dd-96d5-8a3bece1d1f3\" (UID: \"a350d01b-8811-40dd-96d5-8a3bece1d1f3\") "
Sep 15 13:57:33.246345 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:33.246079    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a350d01b-8811-40dd-96d5-8a3bece1d1f3-istio-data" (OuterVolumeSpecName: "istio-data") pod "a350d01b-8811-40dd-96d5-8a3bece1d1f3" (UID: "a350d01b-8811-40dd-96d5-8a3bece1d1f3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:57:33.246345 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:33.246106    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a350d01b-8811-40dd-96d5-8a3bece1d1f3-credential-socket\") pod \"a350d01b-8811-40dd-96d5-8a3bece1d1f3\" (UID: \"a350d01b-8811-40dd-96d5-8a3bece1d1f3\") "
Sep 15 13:57:33.246345 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:33.246181    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a350d01b-8811-40dd-96d5-8a3bece1d1f3-workload-certs\") pod \"a350d01b-8811-40dd-96d5-8a3bece1d1f3\" (UID: \"a350d01b-8811-40dd-96d5-8a3bece1d1f3\") "
Sep 15 13:57:33.246556 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:33.246338    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a350d01b-8811-40dd-96d5-8a3bece1d1f3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a350d01b-8811-40dd-96d5-8a3bece1d1f3" (UID: "a350d01b-8811-40dd-96d5-8a3bece1d1f3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:57:33.246556 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:33.246476    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a350d01b-8811-40dd-96d5-8a3bece1d1f3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a350d01b-8811-40dd-96d5-8a3bece1d1f3" (UID: "a350d01b-8811-40dd-96d5-8a3bece1d1f3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:57:33.246662 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:33.246556    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a350d01b-8811-40dd-96d5-8a3bece1d1f3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a350d01b-8811-40dd-96d5-8a3bece1d1f3" (UID: "a350d01b-8811-40dd-96d5-8a3bece1d1f3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:57:33.246662 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:33.246610    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a350d01b-8811-40dd-96d5-8a3bece1d1f3-credential-socket\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:57:33.246662 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:33.246631    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a350d01b-8811-40dd-96d5-8a3bece1d1f3-istio-data\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:57:33.246662 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:33.246646    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a350d01b-8811-40dd-96d5-8a3bece1d1f3-workload-socket\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:57:33.247028 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:33.246675    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a350d01b-8811-40dd-96d5-8a3bece1d1f3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a350d01b-8811-40dd-96d5-8a3bece1d1f3" (UID: "a350d01b-8811-40dd-96d5-8a3bece1d1f3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 13:57:33.248409 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:33.248384    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a350d01b-8811-40dd-96d5-8a3bece1d1f3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a350d01b-8811-40dd-96d5-8a3bece1d1f3" (UID: "a350d01b-8811-40dd-96d5-8a3bece1d1f3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 13:57:33.248499 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:33.248414    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a350d01b-8811-40dd-96d5-8a3bece1d1f3-kube-api-access-9gdzs" (OuterVolumeSpecName: "kube-api-access-9gdzs") pod "a350d01b-8811-40dd-96d5-8a3bece1d1f3" (UID: "a350d01b-8811-40dd-96d5-8a3bece1d1f3"). InnerVolumeSpecName "kube-api-access-9gdzs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:57:33.248684 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:33.248658    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a350d01b-8811-40dd-96d5-8a3bece1d1f3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a350d01b-8811-40dd-96d5-8a3bece1d1f3" (UID: "a350d01b-8811-40dd-96d5-8a3bece1d1f3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:57:33.248779 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:33.248665    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a350d01b-8811-40dd-96d5-8a3bece1d1f3-istio-token" (OuterVolumeSpecName: "istio-token") pod "a350d01b-8811-40dd-96d5-8a3bece1d1f3" (UID: "a350d01b-8811-40dd-96d5-8a3bece1d1f3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:57:33.347970 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:33.347933    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a350d01b-8811-40dd-96d5-8a3bece1d1f3-istio-podinfo\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:57:33.347970 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:33.347962    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9gdzs\" (UniqueName: \"kubernetes.io/projected/a350d01b-8811-40dd-96d5-8a3bece1d1f3-kube-api-access-9gdzs\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:57:33.347970 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:33.347972    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a350d01b-8811-40dd-96d5-8a3bece1d1f3-workload-certs\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:57:33.348238 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:33.347981    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a350d01b-8811-40dd-96d5-8a3bece1d1f3-istio-token\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:57:33.348238 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:33.347988    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a350d01b-8811-40dd-96d5-8a3bece1d1f3-istio-envoy\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:57:33.348238 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:33.347995    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a350d01b-8811-40dd-96d5-8a3bece1d1f3-istiod-ca-cert\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:57:33.958739 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:33.958709    2578 generic.go:356] "Generic (PLEG): container finished" podID="a350d01b-8811-40dd-96d5-8a3bece1d1f3" containerID="317a2293d0147fb8b7bb8af02b7eefd1bd1707dfe01ba6aea0e8934ea45cf4e2" exitCode=0
Sep 15 13:57:33.958965 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:33.958761    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-f9e4ef-openshift-default-7884cdcffb-7vhp6"
Sep 15 13:57:33.958965 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:33.958774    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-f9e4ef-openshift-default-7884cdcffb-7vhp6" event={"ID":"a350d01b-8811-40dd-96d5-8a3bece1d1f3","Type":"ContainerDied","Data":"317a2293d0147fb8b7bb8af02b7eefd1bd1707dfe01ba6aea0e8934ea45cf4e2"}
Sep 15 13:57:33.958965 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:33.958815    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-f9e4ef-openshift-default-7884cdcffb-7vhp6" event={"ID":"a350d01b-8811-40dd-96d5-8a3bece1d1f3","Type":"ContainerDied","Data":"4d43077e8cf775091e1ca130885e32c0e26abb638d4aa4a60abfa39fa2358b1d"}
Sep 15 13:57:33.958965 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:33.958837    2578 scope.go:117] "RemoveContainer" containerID="317a2293d0147fb8b7bb8af02b7eefd1bd1707dfe01ba6aea0e8934ea45cf4e2"
Sep 15 13:57:33.968266 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:33.968246    2578 scope.go:117] "RemoveContainer" containerID="eed12d0fde4dacb6e5f62fa4342b724c5a06451aa745ea8bbbe501b738f40bf2"
Sep 15 13:57:33.976726 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:33.976702    2578 scope.go:117] "RemoveContainer" containerID="317a2293d0147fb8b7bb8af02b7eefd1bd1707dfe01ba6aea0e8934ea45cf4e2"
Sep 15 13:57:33.976983 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:57:33.976964    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"317a2293d0147fb8b7bb8af02b7eefd1bd1707dfe01ba6aea0e8934ea45cf4e2\": container with ID starting with 317a2293d0147fb8b7bb8af02b7eefd1bd1707dfe01ba6aea0e8934ea45cf4e2 not found: ID does not exist" containerID="317a2293d0147fb8b7bb8af02b7eefd1bd1707dfe01ba6aea0e8934ea45cf4e2"
Sep 15 13:57:33.977045 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:33.976992    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"317a2293d0147fb8b7bb8af02b7eefd1bd1707dfe01ba6aea0e8934ea45cf4e2"} err="failed to get container status \"317a2293d0147fb8b7bb8af02b7eefd1bd1707dfe01ba6aea0e8934ea45cf4e2\": rpc error: code = NotFound desc = could not find container \"317a2293d0147fb8b7bb8af02b7eefd1bd1707dfe01ba6aea0e8934ea45cf4e2\": container with ID starting with 317a2293d0147fb8b7bb8af02b7eefd1bd1707dfe01ba6aea0e8934ea45cf4e2 not found: ID does not exist"
Sep 15 13:57:33.977045 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:33.977010    2578 scope.go:117] "RemoveContainer" containerID="eed12d0fde4dacb6e5f62fa4342b724c5a06451aa745ea8bbbe501b738f40bf2"
Sep 15 13:57:33.977282 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:57:33.977264    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eed12d0fde4dacb6e5f62fa4342b724c5a06451aa745ea8bbbe501b738f40bf2\": container with ID starting with eed12d0fde4dacb6e5f62fa4342b724c5a06451aa745ea8bbbe501b738f40bf2 not found: ID does not exist" containerID="eed12d0fde4dacb6e5f62fa4342b724c5a06451aa745ea8bbbe501b738f40bf2"
Sep 15 13:57:33.977345 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:33.977286    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eed12d0fde4dacb6e5f62fa4342b724c5a06451aa745ea8bbbe501b738f40bf2"} err="failed to get container status \"eed12d0fde4dacb6e5f62fa4342b724c5a06451aa745ea8bbbe501b738f40bf2\": rpc error: code = NotFound desc = could not find container \"eed12d0fde4dacb6e5f62fa4342b724c5a06451aa745ea8bbbe501b738f40bf2\": container with ID starting with eed12d0fde4dacb6e5f62fa4342b724c5a06451aa745ea8bbbe501b738f40bf2 not found: ID does not exist"
Sep 15 13:57:33.977541 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:33.977523    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-f9e4ef-openshift-default-7884cdcffb-7vhp6"]
Sep 15 13:57:33.981611 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:33.981588    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-explicit-f9e4ef-openshift-default-7884cdcffb-7vhp6"]
Sep 15 13:57:35.758103 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:57:35.758070    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a350d01b-8811-40dd-96d5-8a3bece1d1f3" path="/var/lib/kubelet/pods/a350d01b-8811-40dd-96d5-8a3bece1d1f3/volumes"
Sep 15 13:58:14.119389 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:14.119351    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-66261e/e2e-conflict-b-51bbeba1-kserve-5646588678-4jz44"]
Sep 15 13:58:14.119935 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:14.119919    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a350d01b-8811-40dd-96d5-8a3bece1d1f3" containerName="istio-proxy"
Sep 15 13:58:14.119998 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:14.119938    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a350d01b-8811-40dd-96d5-8a3bece1d1f3" containerName="istio-proxy"
Sep 15 13:58:14.120059 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:14.120048    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a350d01b-8811-40dd-96d5-8a3bece1d1f3" containerName="istio-proxy"
Sep 15 13:58:14.120095 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:14.120065    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a350d01b-8811-40dd-96d5-8a3bece1d1f3" containerName="istio-proxy"
Sep 15 13:58:14.123365 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:14.123348    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-66261e/e2e-conflict-b-51bbeba1-kserve-5646588678-4jz44"
Sep 15 13:58:14.125677 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:14.125658    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-66261e\"/\"e2e-conflict-b-51bbeba1-kserve-self-signed-certs\""
Sep 15 13:58:14.131548 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:14.131524    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-66261e/e2e-conflict-b-51bbeba1-kserve-5646588678-4jz44"]
Sep 15 13:58:14.140396 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:14.140364    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/da2c94f0-76e5-40db-82c2-6d91224eeecb-home\") pod \"e2e-conflict-b-51bbeba1-kserve-5646588678-4jz44\" (UID: \"da2c94f0-76e5-40db-82c2-6d91224eeecb\") " pod="e2e-models-e2e-worker-w4-66261e/e2e-conflict-b-51bbeba1-kserve-5646588678-4jz44"
Sep 15 13:58:14.140522 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:14.140414    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da2c94f0-76e5-40db-82c2-6d91224eeecb-tls-certs\") pod \"e2e-conflict-b-51bbeba1-kserve-5646588678-4jz44\" (UID: \"da2c94f0-76e5-40db-82c2-6d91224eeecb\") " pod="e2e-models-e2e-worker-w4-66261e/e2e-conflict-b-51bbeba1-kserve-5646588678-4jz44"
Sep 15 13:58:14.140522 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:14.140442    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/da2c94f0-76e5-40db-82c2-6d91224eeecb-tmp-dir\") pod \"e2e-conflict-b-51bbeba1-kserve-5646588678-4jz44\" (UID: \"da2c94f0-76e5-40db-82c2-6d91224eeecb\") " pod="e2e-models-e2e-worker-w4-66261e/e2e-conflict-b-51bbeba1-kserve-5646588678-4jz44"
Sep 15 13:58:14.140522 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:14.140473    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/da2c94f0-76e5-40db-82c2-6d91224eeecb-model-cache\") pod \"e2e-conflict-b-51bbeba1-kserve-5646588678-4jz44\" (UID: \"da2c94f0-76e5-40db-82c2-6d91224eeecb\") " pod="e2e-models-e2e-worker-w4-66261e/e2e-conflict-b-51bbeba1-kserve-5646588678-4jz44"
Sep 15 13:58:14.140522 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:14.140499    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqlmn\" (UniqueName: \"kubernetes.io/projected/da2c94f0-76e5-40db-82c2-6d91224eeecb-kube-api-access-vqlmn\") pod \"e2e-conflict-b-51bbeba1-kserve-5646588678-4jz44\" (UID: \"da2c94f0-76e5-40db-82c2-6d91224eeecb\") " pod="e2e-models-e2e-worker-w4-66261e/e2e-conflict-b-51bbeba1-kserve-5646588678-4jz44"
Sep 15 13:58:14.140733 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:14.140648    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/da2c94f0-76e5-40db-82c2-6d91224eeecb-dshm\") pod \"e2e-conflict-b-51bbeba1-kserve-5646588678-4jz44\" (UID: \"da2c94f0-76e5-40db-82c2-6d91224eeecb\") " pod="e2e-models-e2e-worker-w4-66261e/e2e-conflict-b-51bbeba1-kserve-5646588678-4jz44"
Sep 15 13:58:14.241450 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:14.241404    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/da2c94f0-76e5-40db-82c2-6d91224eeecb-home\") pod \"e2e-conflict-b-51bbeba1-kserve-5646588678-4jz44\" (UID: \"da2c94f0-76e5-40db-82c2-6d91224eeecb\") " pod="e2e-models-e2e-worker-w4-66261e/e2e-conflict-b-51bbeba1-kserve-5646588678-4jz44"
Sep 15 13:58:14.241450 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:14.241456    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da2c94f0-76e5-40db-82c2-6d91224eeecb-tls-certs\") pod \"e2e-conflict-b-51bbeba1-kserve-5646588678-4jz44\" (UID: \"da2c94f0-76e5-40db-82c2-6d91224eeecb\") " pod="e2e-models-e2e-worker-w4-66261e/e2e-conflict-b-51bbeba1-kserve-5646588678-4jz44"
Sep 15 13:58:14.241705 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:14.241481    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/da2c94f0-76e5-40db-82c2-6d91224eeecb-tmp-dir\") pod \"e2e-conflict-b-51bbeba1-kserve-5646588678-4jz44\" (UID: \"da2c94f0-76e5-40db-82c2-6d91224eeecb\") " pod="e2e-models-e2e-worker-w4-66261e/e2e-conflict-b-51bbeba1-kserve-5646588678-4jz44"
Sep 15 13:58:14.241705 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:14.241507    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/da2c94f0-76e5-40db-82c2-6d91224eeecb-model-cache\") pod \"e2e-conflict-b-51bbeba1-kserve-5646588678-4jz44\" (UID: \"da2c94f0-76e5-40db-82c2-6d91224eeecb\") " pod="e2e-models-e2e-worker-w4-66261e/e2e-conflict-b-51bbeba1-kserve-5646588678-4jz44"
Sep 15 13:58:14.241705 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:14.241528    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqlmn\" (UniqueName: \"kubernetes.io/projected/da2c94f0-76e5-40db-82c2-6d91224eeecb-kube-api-access-vqlmn\") pod \"e2e-conflict-b-51bbeba1-kserve-5646588678-4jz44\" (UID: \"da2c94f0-76e5-40db-82c2-6d91224eeecb\") " pod="e2e-models-e2e-worker-w4-66261e/e2e-conflict-b-51bbeba1-kserve-5646588678-4jz44"
Sep 15 13:58:14.241705 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:14.241606    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/da2c94f0-76e5-40db-82c2-6d91224eeecb-dshm\") pod \"e2e-conflict-b-51bbeba1-kserve-5646588678-4jz44\" (UID: \"da2c94f0-76e5-40db-82c2-6d91224eeecb\") " pod="e2e-models-e2e-worker-w4-66261e/e2e-conflict-b-51bbeba1-kserve-5646588678-4jz44"
Sep 15 13:58:14.241909 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:14.241835    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/da2c94f0-76e5-40db-82c2-6d91224eeecb-home\") pod \"e2e-conflict-b-51bbeba1-kserve-5646588678-4jz44\" (UID: \"da2c94f0-76e5-40db-82c2-6d91224eeecb\") " pod="e2e-models-e2e-worker-w4-66261e/e2e-conflict-b-51bbeba1-kserve-5646588678-4jz44"
Sep 15 13:58:14.241909 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:14.241879    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/da2c94f0-76e5-40db-82c2-6d91224eeecb-tmp-dir\") pod \"e2e-conflict-b-51bbeba1-kserve-5646588678-4jz44\" (UID: \"da2c94f0-76e5-40db-82c2-6d91224eeecb\") " pod="e2e-models-e2e-worker-w4-66261e/e2e-conflict-b-51bbeba1-kserve-5646588678-4jz44"
Sep 15 13:58:14.242022 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:14.241926    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/da2c94f0-76e5-40db-82c2-6d91224eeecb-model-cache\") pod \"e2e-conflict-b-51bbeba1-kserve-5646588678-4jz44\" (UID: \"da2c94f0-76e5-40db-82c2-6d91224eeecb\") " pod="e2e-models-e2e-worker-w4-66261e/e2e-conflict-b-51bbeba1-kserve-5646588678-4jz44"
Sep 15 13:58:14.243950 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:14.243930    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/da2c94f0-76e5-40db-82c2-6d91224eeecb-dshm\") pod \"e2e-conflict-b-51bbeba1-kserve-5646588678-4jz44\" (UID: \"da2c94f0-76e5-40db-82c2-6d91224eeecb\") " pod="e2e-models-e2e-worker-w4-66261e/e2e-conflict-b-51bbeba1-kserve-5646588678-4jz44"
Sep 15 13:58:14.244152 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:14.244137    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da2c94f0-76e5-40db-82c2-6d91224eeecb-tls-certs\") pod \"e2e-conflict-b-51bbeba1-kserve-5646588678-4jz44\" (UID: \"da2c94f0-76e5-40db-82c2-6d91224eeecb\") " pod="e2e-models-e2e-worker-w4-66261e/e2e-conflict-b-51bbeba1-kserve-5646588678-4jz44"
Sep 15 13:58:14.251628 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:14.251601    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqlmn\" (UniqueName: \"kubernetes.io/projected/da2c94f0-76e5-40db-82c2-6d91224eeecb-kube-api-access-vqlmn\") pod \"e2e-conflict-b-51bbeba1-kserve-5646588678-4jz44\" (UID: \"da2c94f0-76e5-40db-82c2-6d91224eeecb\") " pod="e2e-models-e2e-worker-w4-66261e/e2e-conflict-b-51bbeba1-kserve-5646588678-4jz44"
Sep 15 13:58:14.434848 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:14.434747    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-66261e/e2e-conflict-b-51bbeba1-kserve-5646588678-4jz44"
Sep 15 13:58:14.708462 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:14.708439    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-66261e/e2e-conflict-b-51bbeba1-kserve-5646588678-4jz44"]
Sep 15 13:58:14.711027 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:58:14.710998    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podda2c94f0_76e5_40db_82c2_6d91224eeecb.slice/crio-25ec4542e9f977de92b22d3926432918e1e4b06911234c360744aaf1a4086796 WatchSource:0}: Error finding container 25ec4542e9f977de92b22d3926432918e1e4b06911234c360744aaf1a4086796: Status 404 returned error can't find the container with id 25ec4542e9f977de92b22d3926432918e1e4b06911234c360744aaf1a4086796
Sep 15 13:58:15.199517 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:15.199481    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-66261e/e2e-conflict-b-51bbeba1-kserve-5646588678-4jz44" event={"ID":"da2c94f0-76e5-40db-82c2-6d91224eeecb","Type":"ContainerStarted","Data":"d89d7af6c116e600baf3127a7a394a211cdc34b42cf3ee5f388b83d0c871c108"}
Sep 15 13:58:15.199517 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:15.199532    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-66261e/e2e-conflict-b-51bbeba1-kserve-5646588678-4jz44" event={"ID":"da2c94f0-76e5-40db-82c2-6d91224eeecb","Type":"ContainerStarted","Data":"25ec4542e9f977de92b22d3926432918e1e4b06911234c360744aaf1a4086796"}
Sep 15 13:58:16.710513 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:16.710459    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-66261e/e2e-conflict-b-51bbeba1-kserve-5646588678-4jz44" podStartSLOduration=2.71043634 podStartE2EDuration="2.71043634s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:58:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:58:15.216398653 +0000 UTC m=+1181.975524951" watchObservedRunningTime="2026-09-15 13:58:16.71043634 +0000 UTC m=+1183.469562627"
Sep 15 13:58:16.710889 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:16.710816    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-fa9465-openshift-default-7cb57d49d-lv2zt"]
Sep 15 13:58:16.711025 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:16.711003    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-noten-fa9465-openshift-default-7cb57d49d-lv2zt" podUID="b32f75b3-6efd-48db-af6b-f114023377f9" containerName="istio-proxy" containerID="cri-o://b817b8987ae593ffc7201f6afe3b36bfbe6ef58e92cfe863e7b1f74696be1d88" gracePeriod=30
Sep 15 13:58:18.501682 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:18.501643    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-4441a1/test-model-4441a1-kserve-57b7d97547-d65cq"]
Sep 15 13:58:21.970895 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:21.970859    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-fa9465-openshift-default-7cb57d49d-lv2zt"
Sep 15 13:58:22.016776 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:22.016680    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b32f75b3-6efd-48db-af6b-f114023377f9-workload-socket\") pod \"b32f75b3-6efd-48db-af6b-f114023377f9\" (UID: \"b32f75b3-6efd-48db-af6b-f114023377f9\") "
Sep 15 13:58:22.016776 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:22.016734    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b32f75b3-6efd-48db-af6b-f114023377f9-istio-data\") pod \"b32f75b3-6efd-48db-af6b-f114023377f9\" (UID: \"b32f75b3-6efd-48db-af6b-f114023377f9\") "
Sep 15 13:58:22.016776 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:22.016767    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b32f75b3-6efd-48db-af6b-f114023377f9-workload-certs\") pod \"b32f75b3-6efd-48db-af6b-f114023377f9\" (UID: \"b32f75b3-6efd-48db-af6b-f114023377f9\") "
Sep 15 13:58:22.017105 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:22.016796    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b32f75b3-6efd-48db-af6b-f114023377f9-istio-podinfo\") pod \"b32f75b3-6efd-48db-af6b-f114023377f9\" (UID: \"b32f75b3-6efd-48db-af6b-f114023377f9\") "
Sep 15 13:58:22.017105 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:22.016847    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b32f75b3-6efd-48db-af6b-f114023377f9-istio-envoy\") pod \"b32f75b3-6efd-48db-af6b-f114023377f9\" (UID: \"b32f75b3-6efd-48db-af6b-f114023377f9\") "
Sep 15 13:58:22.017105 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:22.016962    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vjv97\" (UniqueName: \"kubernetes.io/projected/b32f75b3-6efd-48db-af6b-f114023377f9-kube-api-access-vjv97\") pod \"b32f75b3-6efd-48db-af6b-f114023377f9\" (UID: \"b32f75b3-6efd-48db-af6b-f114023377f9\") "
Sep 15 13:58:22.017105 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:22.016963    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b32f75b3-6efd-48db-af6b-f114023377f9-istio-data" (OuterVolumeSpecName: "istio-data") pod "b32f75b3-6efd-48db-af6b-f114023377f9" (UID: "b32f75b3-6efd-48db-af6b-f114023377f9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:58:22.017105 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:22.017002    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b32f75b3-6efd-48db-af6b-f114023377f9-credential-socket\") pod \"b32f75b3-6efd-48db-af6b-f114023377f9\" (UID: \"b32f75b3-6efd-48db-af6b-f114023377f9\") "
Sep 15 13:58:22.017105 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:22.017033    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b32f75b3-6efd-48db-af6b-f114023377f9-istio-token\") pod \"b32f75b3-6efd-48db-af6b-f114023377f9\" (UID: \"b32f75b3-6efd-48db-af6b-f114023377f9\") "
Sep 15 13:58:22.017105 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:22.017045    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b32f75b3-6efd-48db-af6b-f114023377f9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b32f75b3-6efd-48db-af6b-f114023377f9" (UID: "b32f75b3-6efd-48db-af6b-f114023377f9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:58:22.017540 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:22.017113    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b32f75b3-6efd-48db-af6b-f114023377f9-istiod-ca-cert\") pod \"b32f75b3-6efd-48db-af6b-f114023377f9\" (UID: \"b32f75b3-6efd-48db-af6b-f114023377f9\") "
Sep 15 13:58:22.017540 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:22.017408    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b32f75b3-6efd-48db-af6b-f114023377f9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b32f75b3-6efd-48db-af6b-f114023377f9" (UID: "b32f75b3-6efd-48db-af6b-f114023377f9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:58:22.017540 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:22.017534    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b32f75b3-6efd-48db-af6b-f114023377f9-credential-socket\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:58:22.017709 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:22.017552    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b32f75b3-6efd-48db-af6b-f114023377f9-istio-data\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:58:22.017709 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:22.017567    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b32f75b3-6efd-48db-af6b-f114023377f9-workload-certs\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:58:22.017709 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:22.017604    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b32f75b3-6efd-48db-af6b-f114023377f9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b32f75b3-6efd-48db-af6b-f114023377f9" (UID: "b32f75b3-6efd-48db-af6b-f114023377f9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:58:22.017869 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:22.017740    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b32f75b3-6efd-48db-af6b-f114023377f9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b32f75b3-6efd-48db-af6b-f114023377f9" (UID: "b32f75b3-6efd-48db-af6b-f114023377f9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 13:58:22.020399 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:22.020356    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b32f75b3-6efd-48db-af6b-f114023377f9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b32f75b3-6efd-48db-af6b-f114023377f9" (UID: "b32f75b3-6efd-48db-af6b-f114023377f9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:58:22.020399 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:22.020369    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b32f75b3-6efd-48db-af6b-f114023377f9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b32f75b3-6efd-48db-af6b-f114023377f9" (UID: "b32f75b3-6efd-48db-af6b-f114023377f9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 13:58:22.020399 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:22.020375    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b32f75b3-6efd-48db-af6b-f114023377f9-kube-api-access-vjv97" (OuterVolumeSpecName: "kube-api-access-vjv97") pod "b32f75b3-6efd-48db-af6b-f114023377f9" (UID: "b32f75b3-6efd-48db-af6b-f114023377f9"). InnerVolumeSpecName "kube-api-access-vjv97". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:58:22.020589 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:22.020407    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b32f75b3-6efd-48db-af6b-f114023377f9-istio-token" (OuterVolumeSpecName: "istio-token") pod "b32f75b3-6efd-48db-af6b-f114023377f9" (UID: "b32f75b3-6efd-48db-af6b-f114023377f9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:58:22.118707 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:22.118659    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b32f75b3-6efd-48db-af6b-f114023377f9-istiod-ca-cert\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:58:22.118707 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:22.118706    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b32f75b3-6efd-48db-af6b-f114023377f9-workload-socket\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:58:22.118917 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:22.118721    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b32f75b3-6efd-48db-af6b-f114023377f9-istio-podinfo\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:58:22.118917 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:22.118735    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b32f75b3-6efd-48db-af6b-f114023377f9-istio-envoy\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:58:22.118917 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:22.118749    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vjv97\" (UniqueName: \"kubernetes.io/projected/b32f75b3-6efd-48db-af6b-f114023377f9-kube-api-access-vjv97\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:58:22.118917 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:22.118767    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b32f75b3-6efd-48db-af6b-f114023377f9-istio-token\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:58:22.245214 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:22.245182    2578 generic.go:356] "Generic (PLEG): container finished" podID="b32f75b3-6efd-48db-af6b-f114023377f9" containerID="b817b8987ae593ffc7201f6afe3b36bfbe6ef58e92cfe863e7b1f74696be1d88" exitCode=0
Sep 15 13:58:22.245398 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:22.245234    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-fa9465-openshift-default-7cb57d49d-lv2zt"
Sep 15 13:58:22.245398 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:22.245270    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-fa9465-openshift-default-7cb57d49d-lv2zt" event={"ID":"b32f75b3-6efd-48db-af6b-f114023377f9","Type":"ContainerDied","Data":"b817b8987ae593ffc7201f6afe3b36bfbe6ef58e92cfe863e7b1f74696be1d88"}
Sep 15 13:58:22.245398 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:22.245323    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-fa9465-openshift-default-7cb57d49d-lv2zt" event={"ID":"b32f75b3-6efd-48db-af6b-f114023377f9","Type":"ContainerDied","Data":"7bcc8277a6f491eb3841af70aba7341c1740412097a5e6dadabefd9c6824e0c9"}
Sep 15 13:58:22.245398 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:22.245346    2578 scope.go:117] "RemoveContainer" containerID="b817b8987ae593ffc7201f6afe3b36bfbe6ef58e92cfe863e7b1f74696be1d88"
Sep 15 13:58:22.255213 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:22.255196    2578 scope.go:117] "RemoveContainer" containerID="b817b8987ae593ffc7201f6afe3b36bfbe6ef58e92cfe863e7b1f74696be1d88"
Sep 15 13:58:22.255498 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:58:22.255480    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b817b8987ae593ffc7201f6afe3b36bfbe6ef58e92cfe863e7b1f74696be1d88\": container with ID starting with b817b8987ae593ffc7201f6afe3b36bfbe6ef58e92cfe863e7b1f74696be1d88 not found: ID does not exist" containerID="b817b8987ae593ffc7201f6afe3b36bfbe6ef58e92cfe863e7b1f74696be1d88"
Sep 15 13:58:22.255558 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:22.255511    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b817b8987ae593ffc7201f6afe3b36bfbe6ef58e92cfe863e7b1f74696be1d88"} err="failed to get container status \"b817b8987ae593ffc7201f6afe3b36bfbe6ef58e92cfe863e7b1f74696be1d88\": rpc error: code = NotFound desc = could not find container \"b817b8987ae593ffc7201f6afe3b36bfbe6ef58e92cfe863e7b1f74696be1d88\": container with ID starting with b817b8987ae593ffc7201f6afe3b36bfbe6ef58e92cfe863e7b1f74696be1d88 not found: ID does not exist"
Sep 15 13:58:22.267008 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:22.266952    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-fa9465-openshift-default-7cb57d49d-lv2zt"]
Sep 15 13:58:22.270627 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:22.270604    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-noten-fa9465-openshift-default-7cb57d49d-lv2zt"]
Sep 15 13:58:23.757807 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:23.757769    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b32f75b3-6efd-48db-af6b-f114023377f9" path="/var/lib/kubelet/pods/b32f75b3-6efd-48db-af6b-f114023377f9/volumes"
Sep 15 13:58:24.435783 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:24.435744    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-66261e/e2e-conflict-b-51bbeba1-kserve-5646588678-4jz44"
Sep 15 13:58:24.435783 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:24.435793    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-66261e/e2e-conflict-b-51bbeba1-kserve-5646588678-4jz44"
Sep 15 13:58:24.448344 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:24.448318    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-66261e/e2e-conflict-b-51bbeba1-kserve-5646588678-4jz44"
Sep 15 13:58:25.274232 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:25.274206    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-66261e/e2e-conflict-b-51bbeba1-kserve-5646588678-4jz44"
Sep 15 13:58:33.521705 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:33.521640    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-4441a1/test-model-4441a1-kserve-57b7d97547-d65cq" podUID="c3318f2d-abc0-4000-a96d-05599233d4ae" containerName="main" containerID="cri-o://5a258a6158ff5fa5bdeba9bc9daca959da18b340efa6050a0d4eb7e2a272fc62" gracePeriod=45
Sep 15 13:58:33.773615 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:33.773545    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-4441a1/test-model-4441a1-kserve-57b7d97547-d65cq"
Sep 15 13:58:33.828681 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:33.828627    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c3318f2d-abc0-4000-a96d-05599233d4ae-tls-certs\") pod \"c3318f2d-abc0-4000-a96d-05599233d4ae\" (UID: \"c3318f2d-abc0-4000-a96d-05599233d4ae\") "
Sep 15 13:58:33.829728 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:33.828689    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c3318f2d-abc0-4000-a96d-05599233d4ae-tmp-dir\") pod \"c3318f2d-abc0-4000-a96d-05599233d4ae\" (UID: \"c3318f2d-abc0-4000-a96d-05599233d4ae\") "
Sep 15 13:58:33.829728 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:33.828732    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dzpkk\" (UniqueName: \"kubernetes.io/projected/c3318f2d-abc0-4000-a96d-05599233d4ae-kube-api-access-dzpkk\") pod \"c3318f2d-abc0-4000-a96d-05599233d4ae\" (UID: \"c3318f2d-abc0-4000-a96d-05599233d4ae\") "
Sep 15 13:58:33.829728 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:33.828848    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c3318f2d-abc0-4000-a96d-05599233d4ae-dshm\") pod \"c3318f2d-abc0-4000-a96d-05599233d4ae\" (UID: \"c3318f2d-abc0-4000-a96d-05599233d4ae\") "
Sep 15 13:58:33.829728 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:33.828892    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c3318f2d-abc0-4000-a96d-05599233d4ae-home\") pod \"c3318f2d-abc0-4000-a96d-05599233d4ae\" (UID: \"c3318f2d-abc0-4000-a96d-05599233d4ae\") "
Sep 15 13:58:33.829728 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:33.828935    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c3318f2d-abc0-4000-a96d-05599233d4ae-model-cache\") pod \"c3318f2d-abc0-4000-a96d-05599233d4ae\" (UID: \"c3318f2d-abc0-4000-a96d-05599233d4ae\") "
Sep 15 13:58:33.829728 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:33.828983    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3318f2d-abc0-4000-a96d-05599233d4ae-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c3318f2d-abc0-4000-a96d-05599233d4ae" (UID: "c3318f2d-abc0-4000-a96d-05599233d4ae"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:58:33.829728 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:33.829333    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c3318f2d-abc0-4000-a96d-05599233d4ae-tmp-dir\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:58:33.830199 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:33.829734    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3318f2d-abc0-4000-a96d-05599233d4ae-model-cache" (OuterVolumeSpecName: "model-cache") pod "c3318f2d-abc0-4000-a96d-05599233d4ae" (UID: "c3318f2d-abc0-4000-a96d-05599233d4ae"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:58:33.830199 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:33.829822    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3318f2d-abc0-4000-a96d-05599233d4ae-home" (OuterVolumeSpecName: "home") pod "c3318f2d-abc0-4000-a96d-05599233d4ae" (UID: "c3318f2d-abc0-4000-a96d-05599233d4ae"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:58:33.831670 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:33.831633    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3318f2d-abc0-4000-a96d-05599233d4ae-dshm" (OuterVolumeSpecName: "dshm") pod "c3318f2d-abc0-4000-a96d-05599233d4ae" (UID: "c3318f2d-abc0-4000-a96d-05599233d4ae"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:58:33.832354 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:33.831946    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c3318f2d-abc0-4000-a96d-05599233d4ae-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c3318f2d-abc0-4000-a96d-05599233d4ae" (UID: "c3318f2d-abc0-4000-a96d-05599233d4ae"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 13:58:33.832466 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:33.832424    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3318f2d-abc0-4000-a96d-05599233d4ae-kube-api-access-dzpkk" (OuterVolumeSpecName: "kube-api-access-dzpkk") pod "c3318f2d-abc0-4000-a96d-05599233d4ae" (UID: "c3318f2d-abc0-4000-a96d-05599233d4ae"). InnerVolumeSpecName "kube-api-access-dzpkk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:58:33.901920 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:33.901890    2578 scope.go:117] "RemoveContainer" containerID="0fc4d8730855664ccdb933e3f76d8fcd9379409b1ce4e149228ca72a785bae87"
Sep 15 13:58:33.929992 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:33.929974    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c3318f2d-abc0-4000-a96d-05599233d4ae-home\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:58:33.930063 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:33.929997    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c3318f2d-abc0-4000-a96d-05599233d4ae-model-cache\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:58:33.930063 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:33.930006    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c3318f2d-abc0-4000-a96d-05599233d4ae-tls-certs\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:58:33.930063 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:33.930015    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dzpkk\" (UniqueName: \"kubernetes.io/projected/c3318f2d-abc0-4000-a96d-05599233d4ae-kube-api-access-dzpkk\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:58:33.930063 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:33.930024    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c3318f2d-abc0-4000-a96d-05599233d4ae-dshm\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:58:34.313775 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:34.313737    2578 generic.go:356] "Generic (PLEG): container finished" podID="c3318f2d-abc0-4000-a96d-05599233d4ae" containerID="5a258a6158ff5fa5bdeba9bc9daca959da18b340efa6050a0d4eb7e2a272fc62" exitCode=0
Sep 15 13:58:34.313981 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:34.313800    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-4441a1/test-model-4441a1-kserve-57b7d97547-d65cq"
Sep 15 13:58:34.313981 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:34.313825    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-4441a1/test-model-4441a1-kserve-57b7d97547-d65cq" event={"ID":"c3318f2d-abc0-4000-a96d-05599233d4ae","Type":"ContainerDied","Data":"5a258a6158ff5fa5bdeba9bc9daca959da18b340efa6050a0d4eb7e2a272fc62"}
Sep 15 13:58:34.313981 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:34.313874    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-4441a1/test-model-4441a1-kserve-57b7d97547-d65cq" event={"ID":"c3318f2d-abc0-4000-a96d-05599233d4ae","Type":"ContainerDied","Data":"dcb60d9326bc362e0732371e500855d74a59ba4b3e597829b2749402c439e662"}
Sep 15 13:58:34.313981 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:34.313902    2578 scope.go:117] "RemoveContainer" containerID="5a258a6158ff5fa5bdeba9bc9daca959da18b340efa6050a0d4eb7e2a272fc62"
Sep 15 13:58:34.323433 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:34.323416    2578 scope.go:117] "RemoveContainer" containerID="5a258a6158ff5fa5bdeba9bc9daca959da18b340efa6050a0d4eb7e2a272fc62"
Sep 15 13:58:34.323698 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:58:34.323682    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a258a6158ff5fa5bdeba9bc9daca959da18b340efa6050a0d4eb7e2a272fc62\": container with ID starting with 5a258a6158ff5fa5bdeba9bc9daca959da18b340efa6050a0d4eb7e2a272fc62 not found: ID does not exist" containerID="5a258a6158ff5fa5bdeba9bc9daca959da18b340efa6050a0d4eb7e2a272fc62"
Sep 15 13:58:34.323738 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:34.323709    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a258a6158ff5fa5bdeba9bc9daca959da18b340efa6050a0d4eb7e2a272fc62"} err="failed to get container status \"5a258a6158ff5fa5bdeba9bc9daca959da18b340efa6050a0d4eb7e2a272fc62\": rpc error: code = NotFound desc = could not find container \"5a258a6158ff5fa5bdeba9bc9daca959da18b340efa6050a0d4eb7e2a272fc62\": container with ID starting with 5a258a6158ff5fa5bdeba9bc9daca959da18b340efa6050a0d4eb7e2a272fc62 not found: ID does not exist"
Sep 15 13:58:34.335002 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:34.334978    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-4441a1/test-model-4441a1-kserve-57b7d97547-d65cq"]
Sep 15 13:58:34.338899 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:34.338878    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-4441a1/test-model-4441a1-kserve-57b7d97547-d65cq"]
Sep 15 13:58:35.758337 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:35.758299    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c3318f2d-abc0-4000-a96d-05599233d4ae" path="/var/lib/kubelet/pods/c3318f2d-abc0-4000-a96d-05599233d4ae/volumes"
Sep 15 13:58:59.611536 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:59.611507    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-4441a1-d88sj"]
Sep 15 13:58:59.612015 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:59.611876    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a350d01b-8811-40dd-96d5-8a3bece1d1f3" containerName="istio-proxy"
Sep 15 13:58:59.612015 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:59.611887    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a350d01b-8811-40dd-96d5-8a3bece1d1f3" containerName="istio-proxy"
Sep 15 13:58:59.612015 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:59.611896    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b32f75b3-6efd-48db-af6b-f114023377f9" containerName="istio-proxy"
Sep 15 13:58:59.612015 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:59.611901    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b32f75b3-6efd-48db-af6b-f114023377f9" containerName="istio-proxy"
Sep 15 13:58:59.612015 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:59.611909    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3318f2d-abc0-4000-a96d-05599233d4ae" containerName="main"
Sep 15 13:58:59.612015 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:59.611915    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3318f2d-abc0-4000-a96d-05599233d4ae" containerName="main"
Sep 15 13:58:59.612015 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:59.611980    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3318f2d-abc0-4000-a96d-05599233d4ae" containerName="main"
Sep 15 13:58:59.612015 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:59.611990    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="b32f75b3-6efd-48db-af6b-f114023377f9" containerName="istio-proxy"
Sep 15 13:58:59.616751 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:59.616732    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-4441a1-d88sj"
Sep 15 13:58:59.619041 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:59.619014    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 15 13:58:59.619357 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:59.619338    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 13:58:59.619472 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:59.619340    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qzmkv\""
Sep 15 13:58:59.621934 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:59.621912    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-4441a1-d88sj"]
Sep 15 13:58:59.675364 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:59.675332    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef036711-aa65-49d2-88b1-6b092d274eff-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-4441a1-d88sj\" (UID: \"ef036711-aa65-49d2-88b1-6b092d274eff\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-4441a1-d88sj"
Sep 15 13:58:59.675523 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:59.675371    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bcnf\" (UniqueName: \"kubernetes.io/projected/ef036711-aa65-49d2-88b1-6b092d274eff-kube-api-access-7bcnf\") pod \"maas-api-revoke-keys-e2e-inf-a-4441a1-d88sj\" (UID: \"ef036711-aa65-49d2-88b1-6b092d274eff\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-4441a1-d88sj"
Sep 15 13:58:59.775970 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:59.775937    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef036711-aa65-49d2-88b1-6b092d274eff-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-4441a1-d88sj\" (UID: \"ef036711-aa65-49d2-88b1-6b092d274eff\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-4441a1-d88sj"
Sep 15 13:58:59.775970 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:59.775974    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bcnf\" (UniqueName: \"kubernetes.io/projected/ef036711-aa65-49d2-88b1-6b092d274eff-kube-api-access-7bcnf\") pod \"maas-api-revoke-keys-e2e-inf-a-4441a1-d88sj\" (UID: \"ef036711-aa65-49d2-88b1-6b092d274eff\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-4441a1-d88sj"
Sep 15 13:58:59.776556 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:59.776539    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef036711-aa65-49d2-88b1-6b092d274eff-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-4441a1-d88sj\" (UID: \"ef036711-aa65-49d2-88b1-6b092d274eff\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-4441a1-d88sj"
Sep 15 13:58:59.784102 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:59.784079    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bcnf\" (UniqueName: \"kubernetes.io/projected/ef036711-aa65-49d2-88b1-6b092d274eff-kube-api-access-7bcnf\") pod \"maas-api-revoke-keys-e2e-inf-a-4441a1-d88sj\" (UID: \"ef036711-aa65-49d2-88b1-6b092d274eff\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-4441a1-d88sj"
Sep 15 13:58:59.928354 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:58:59.928264    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-4441a1-d88sj"
Sep 15 13:59:00.205573 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:00.205541    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-4441a1-d88sj"]
Sep 15 13:59:00.206879 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:59:00.206855    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef036711_aa65_49d2_88b1_6b092d274eff.slice/crio-88c054ea7f72a9c0e98c06cb0a9b688290ab0584a4d49054af8f8c9bdf9b6bf4 WatchSource:0}: Error finding container 88c054ea7f72a9c0e98c06cb0a9b688290ab0584a4d49054af8f8c9bdf9b6bf4: Status 404 returned error can't find the container with id 88c054ea7f72a9c0e98c06cb0a9b688290ab0584a4d49054af8f8c9bdf9b6bf4
Sep 15 13:59:00.469885 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:00.469846    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-4441a1-d88sj" event={"ID":"ef036711-aa65-49d2-88b1-6b092d274eff","Type":"ContainerStarted","Data":"88c054ea7f72a9c0e98c06cb0a9b688290ab0584a4d49054af8f8c9bdf9b6bf4"}
Sep 15 13:59:01.478216 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:01.478181    2578 generic.go:356] "Generic (PLEG): container finished" podID="ef036711-aa65-49d2-88b1-6b092d274eff" containerID="d983611c23952682df8e70fdad25c7782b7e3becff0ed9cf1a8573c525731dfb" exitCode=0
Sep 15 13:59:01.478584 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:01.478264    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-4441a1-d88sj" event={"ID":"ef036711-aa65-49d2-88b1-6b092d274eff","Type":"ContainerDied","Data":"d983611c23952682df8e70fdad25c7782b7e3becff0ed9cf1a8573c525731dfb"}
Sep 15 13:59:02.123732 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:02.123700    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-66261e/e2e-conflict-b-51bbeba1-kserve-5646588678-4jz44"]
Sep 15 13:59:02.615418 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:02.615393    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-4441a1-d88sj"
Sep 15 13:59:02.705181 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:02.705148    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef036711-aa65-49d2-88b1-6b092d274eff-maas-api-service-ca\") pod \"ef036711-aa65-49d2-88b1-6b092d274eff\" (UID: \"ef036711-aa65-49d2-88b1-6b092d274eff\") "
Sep 15 13:59:02.705347 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:02.705195    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7bcnf\" (UniqueName: \"kubernetes.io/projected/ef036711-aa65-49d2-88b1-6b092d274eff-kube-api-access-7bcnf\") pod \"ef036711-aa65-49d2-88b1-6b092d274eff\" (UID: \"ef036711-aa65-49d2-88b1-6b092d274eff\") "
Sep 15 13:59:02.705482 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:02.705459    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef036711-aa65-49d2-88b1-6b092d274eff-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ef036711-aa65-49d2-88b1-6b092d274eff" (UID: "ef036711-aa65-49d2-88b1-6b092d274eff"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 13:59:02.707387 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:02.707360    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef036711-aa65-49d2-88b1-6b092d274eff-kube-api-access-7bcnf" (OuterVolumeSpecName: "kube-api-access-7bcnf") pod "ef036711-aa65-49d2-88b1-6b092d274eff" (UID: "ef036711-aa65-49d2-88b1-6b092d274eff"). InnerVolumeSpecName "kube-api-access-7bcnf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:59:02.806901 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:02.806870    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef036711-aa65-49d2-88b1-6b092d274eff-maas-api-service-ca\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:59:02.806901 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:02.806899    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7bcnf\" (UniqueName: \"kubernetes.io/projected/ef036711-aa65-49d2-88b1-6b092d274eff-kube-api-access-7bcnf\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:59:03.225793 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:03.225719    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-66261e/e2e-conflict-a-51bbeba1-kserve-79555777f6-cjl99"]
Sep 15 13:59:03.490813 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:03.490731    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-4441a1-d88sj"
Sep 15 13:59:03.490813 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:03.490779    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-4441a1-d88sj" event={"ID":"ef036711-aa65-49d2-88b1-6b092d274eff","Type":"ContainerDied","Data":"88c054ea7f72a9c0e98c06cb0a9b688290ab0584a4d49054af8f8c9bdf9b6bf4"}
Sep 15 13:59:03.490998 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:03.490829    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="88c054ea7f72a9c0e98c06cb0a9b688290ab0584a4d49054af8f8c9bdf9b6bf4"
Sep 15 13:59:12.206345 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:12.206311    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-66261e/distinct-w4-66261e-kserve-5bd55f855c-kqbr2"]
Sep 15 13:59:12.206896 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:12.206880    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef036711-aa65-49d2-88b1-6b092d274eff" containerName="revoke-keys"
Sep 15 13:59:12.206941 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:12.206900    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef036711-aa65-49d2-88b1-6b092d274eff" containerName="revoke-keys"
Sep 15 13:59:12.207003 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:12.206991    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef036711-aa65-49d2-88b1-6b092d274eff" containerName="revoke-keys"
Sep 15 13:59:12.210530 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:12.210513    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-66261e/distinct-w4-66261e-kserve-5bd55f855c-kqbr2"
Sep 15 13:59:12.212779 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:12.212757    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-66261e\"/\"distinct-w4-66261e-kserve-self-signed-certs\""
Sep 15 13:59:12.220602 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:12.220577    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-66261e/distinct-w4-66261e-kserve-5bd55f855c-kqbr2"]
Sep 15 13:59:12.296114 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:12.296079    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzqbr\" (UniqueName: \"kubernetes.io/projected/d83045a5-62ec-4400-a4b7-154331b6abf1-kube-api-access-hzqbr\") pod \"distinct-w4-66261e-kserve-5bd55f855c-kqbr2\" (UID: \"d83045a5-62ec-4400-a4b7-154331b6abf1\") " pod="e2e-models-e2e-worker-w4-66261e/distinct-w4-66261e-kserve-5bd55f855c-kqbr2"
Sep 15 13:59:12.296286 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:12.296117    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d83045a5-62ec-4400-a4b7-154331b6abf1-model-cache\") pod \"distinct-w4-66261e-kserve-5bd55f855c-kqbr2\" (UID: \"d83045a5-62ec-4400-a4b7-154331b6abf1\") " pod="e2e-models-e2e-worker-w4-66261e/distinct-w4-66261e-kserve-5bd55f855c-kqbr2"
Sep 15 13:59:12.296286 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:12.296196    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d83045a5-62ec-4400-a4b7-154331b6abf1-tls-certs\") pod \"distinct-w4-66261e-kserve-5bd55f855c-kqbr2\" (UID: \"d83045a5-62ec-4400-a4b7-154331b6abf1\") " pod="e2e-models-e2e-worker-w4-66261e/distinct-w4-66261e-kserve-5bd55f855c-kqbr2"
Sep 15 13:59:12.296286 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:12.296223    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d83045a5-62ec-4400-a4b7-154331b6abf1-dshm\") pod \"distinct-w4-66261e-kserve-5bd55f855c-kqbr2\" (UID: \"d83045a5-62ec-4400-a4b7-154331b6abf1\") " pod="e2e-models-e2e-worker-w4-66261e/distinct-w4-66261e-kserve-5bd55f855c-kqbr2"
Sep 15 13:59:12.296286 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:12.296254    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d83045a5-62ec-4400-a4b7-154331b6abf1-home\") pod \"distinct-w4-66261e-kserve-5bd55f855c-kqbr2\" (UID: \"d83045a5-62ec-4400-a4b7-154331b6abf1\") " pod="e2e-models-e2e-worker-w4-66261e/distinct-w4-66261e-kserve-5bd55f855c-kqbr2"
Sep 15 13:59:12.296286 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:12.296269    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d83045a5-62ec-4400-a4b7-154331b6abf1-tmp-dir\") pod \"distinct-w4-66261e-kserve-5bd55f855c-kqbr2\" (UID: \"d83045a5-62ec-4400-a4b7-154331b6abf1\") " pod="e2e-models-e2e-worker-w4-66261e/distinct-w4-66261e-kserve-5bd55f855c-kqbr2"
Sep 15 13:59:12.397486 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:12.397451    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzqbr\" (UniqueName: \"kubernetes.io/projected/d83045a5-62ec-4400-a4b7-154331b6abf1-kube-api-access-hzqbr\") pod \"distinct-w4-66261e-kserve-5bd55f855c-kqbr2\" (UID: \"d83045a5-62ec-4400-a4b7-154331b6abf1\") " pod="e2e-models-e2e-worker-w4-66261e/distinct-w4-66261e-kserve-5bd55f855c-kqbr2"
Sep 15 13:59:12.397693 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:12.397492    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d83045a5-62ec-4400-a4b7-154331b6abf1-model-cache\") pod \"distinct-w4-66261e-kserve-5bd55f855c-kqbr2\" (UID: \"d83045a5-62ec-4400-a4b7-154331b6abf1\") " pod="e2e-models-e2e-worker-w4-66261e/distinct-w4-66261e-kserve-5bd55f855c-kqbr2"
Sep 15 13:59:12.397693 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:12.397555    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d83045a5-62ec-4400-a4b7-154331b6abf1-tls-certs\") pod \"distinct-w4-66261e-kserve-5bd55f855c-kqbr2\" (UID: \"d83045a5-62ec-4400-a4b7-154331b6abf1\") " pod="e2e-models-e2e-worker-w4-66261e/distinct-w4-66261e-kserve-5bd55f855c-kqbr2"
Sep 15 13:59:12.397693 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:12.397595    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d83045a5-62ec-4400-a4b7-154331b6abf1-dshm\") pod \"distinct-w4-66261e-kserve-5bd55f855c-kqbr2\" (UID: \"d83045a5-62ec-4400-a4b7-154331b6abf1\") " pod="e2e-models-e2e-worker-w4-66261e/distinct-w4-66261e-kserve-5bd55f855c-kqbr2"
Sep 15 13:59:12.397693 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:12.397645    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d83045a5-62ec-4400-a4b7-154331b6abf1-home\") pod \"distinct-w4-66261e-kserve-5bd55f855c-kqbr2\" (UID: \"d83045a5-62ec-4400-a4b7-154331b6abf1\") " pod="e2e-models-e2e-worker-w4-66261e/distinct-w4-66261e-kserve-5bd55f855c-kqbr2"
Sep 15 13:59:12.397693 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:12.397673    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d83045a5-62ec-4400-a4b7-154331b6abf1-tmp-dir\") pod \"distinct-w4-66261e-kserve-5bd55f855c-kqbr2\" (UID: \"d83045a5-62ec-4400-a4b7-154331b6abf1\") " pod="e2e-models-e2e-worker-w4-66261e/distinct-w4-66261e-kserve-5bd55f855c-kqbr2"
Sep 15 13:59:12.398069 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:12.398040    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d83045a5-62ec-4400-a4b7-154331b6abf1-model-cache\") pod \"distinct-w4-66261e-kserve-5bd55f855c-kqbr2\" (UID: \"d83045a5-62ec-4400-a4b7-154331b6abf1\") " pod="e2e-models-e2e-worker-w4-66261e/distinct-w4-66261e-kserve-5bd55f855c-kqbr2"
Sep 15 13:59:12.398184 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:12.398076    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d83045a5-62ec-4400-a4b7-154331b6abf1-home\") pod \"distinct-w4-66261e-kserve-5bd55f855c-kqbr2\" (UID: \"d83045a5-62ec-4400-a4b7-154331b6abf1\") " pod="e2e-models-e2e-worker-w4-66261e/distinct-w4-66261e-kserve-5bd55f855c-kqbr2"
Sep 15 13:59:12.398184 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:12.398103    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d83045a5-62ec-4400-a4b7-154331b6abf1-tmp-dir\") pod \"distinct-w4-66261e-kserve-5bd55f855c-kqbr2\" (UID: \"d83045a5-62ec-4400-a4b7-154331b6abf1\") " pod="e2e-models-e2e-worker-w4-66261e/distinct-w4-66261e-kserve-5bd55f855c-kqbr2"
Sep 15 13:59:12.399902 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:12.399885    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d83045a5-62ec-4400-a4b7-154331b6abf1-dshm\") pod \"distinct-w4-66261e-kserve-5bd55f855c-kqbr2\" (UID: \"d83045a5-62ec-4400-a4b7-154331b6abf1\") " pod="e2e-models-e2e-worker-w4-66261e/distinct-w4-66261e-kserve-5bd55f855c-kqbr2"
Sep 15 13:59:12.400331 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:12.400312    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d83045a5-62ec-4400-a4b7-154331b6abf1-tls-certs\") pod \"distinct-w4-66261e-kserve-5bd55f855c-kqbr2\" (UID: \"d83045a5-62ec-4400-a4b7-154331b6abf1\") " pod="e2e-models-e2e-worker-w4-66261e/distinct-w4-66261e-kserve-5bd55f855c-kqbr2"
Sep 15 13:59:12.405684 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:12.405662    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzqbr\" (UniqueName: \"kubernetes.io/projected/d83045a5-62ec-4400-a4b7-154331b6abf1-kube-api-access-hzqbr\") pod \"distinct-w4-66261e-kserve-5bd55f855c-kqbr2\" (UID: \"d83045a5-62ec-4400-a4b7-154331b6abf1\") " pod="e2e-models-e2e-worker-w4-66261e/distinct-w4-66261e-kserve-5bd55f855c-kqbr2"
Sep 15 13:59:12.521895 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:12.521793    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-66261e/distinct-w4-66261e-kserve-5bd55f855c-kqbr2"
Sep 15 13:59:12.794923 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:12.794893    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-66261e/distinct-w4-66261e-kserve-5bd55f855c-kqbr2"]
Sep 15 13:59:12.796339 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:59:12.796314    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd83045a5_62ec_4400_a4b7_154331b6abf1.slice/crio-2470048ec1bef7a7fe6cc17441a4528b060ec6d9032384360ff6501f078ab0d8 WatchSource:0}: Error finding container 2470048ec1bef7a7fe6cc17441a4528b060ec6d9032384360ff6501f078ab0d8: Status 404 returned error can't find the container with id 2470048ec1bef7a7fe6cc17441a4528b060ec6d9032384360ff6501f078ab0d8
Sep 15 13:59:13.550226 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:13.550192    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-66261e/distinct-w4-66261e-kserve-5bd55f855c-kqbr2" event={"ID":"d83045a5-62ec-4400-a4b7-154331b6abf1","Type":"ContainerStarted","Data":"22f90491ba0c8b7ae12d5bb52f776b9b26e36cc7646c228695fef2ca8743098a"}
Sep 15 13:59:13.550577 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:13.550234    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-66261e/distinct-w4-66261e-kserve-5bd55f855c-kqbr2" event={"ID":"d83045a5-62ec-4400-a4b7-154331b6abf1","Type":"ContainerStarted","Data":"2470048ec1bef7a7fe6cc17441a4528b060ec6d9032384360ff6501f078ab0d8"}
Sep 15 13:59:13.567630 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:13.567578    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-66261e/distinct-w4-66261e-kserve-5bd55f855c-kqbr2" podStartSLOduration=1.5675630900000002 podStartE2EDuration="1.56756309s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:59:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:59:13.565657736 +0000 UTC m=+1240.324784023" watchObservedRunningTime="2026-09-15 13:59:13.56756309 +0000 UTC m=+1240.326689416"
Sep 15 13:59:17.143589 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:17.143525    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-66261e/e2e-conflict-b-51bbeba1-kserve-5646588678-4jz44" podUID="da2c94f0-76e5-40db-82c2-6d91224eeecb" containerName="main" containerID="cri-o://d89d7af6c116e600baf3127a7a394a211cdc34b42cf3ee5f388b83d0c871c108" gracePeriod=45
Sep 15 13:59:17.384819 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:17.384796    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-66261e/e2e-conflict-b-51bbeba1-kserve-5646588678-4jz44"
Sep 15 13:59:17.451656 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:17.451578    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/da2c94f0-76e5-40db-82c2-6d91224eeecb-home\") pod \"da2c94f0-76e5-40db-82c2-6d91224eeecb\" (UID: \"da2c94f0-76e5-40db-82c2-6d91224eeecb\") "
Sep 15 13:59:17.451656 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:17.451619    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da2c94f0-76e5-40db-82c2-6d91224eeecb-tls-certs\") pod \"da2c94f0-76e5-40db-82c2-6d91224eeecb\" (UID: \"da2c94f0-76e5-40db-82c2-6d91224eeecb\") "
Sep 15 13:59:17.451656 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:17.451641    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/da2c94f0-76e5-40db-82c2-6d91224eeecb-tmp-dir\") pod \"da2c94f0-76e5-40db-82c2-6d91224eeecb\" (UID: \"da2c94f0-76e5-40db-82c2-6d91224eeecb\") "
Sep 15 13:59:17.451934 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:17.451664    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vqlmn\" (UniqueName: \"kubernetes.io/projected/da2c94f0-76e5-40db-82c2-6d91224eeecb-kube-api-access-vqlmn\") pod \"da2c94f0-76e5-40db-82c2-6d91224eeecb\" (UID: \"da2c94f0-76e5-40db-82c2-6d91224eeecb\") "
Sep 15 13:59:17.451934 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:17.451753    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/da2c94f0-76e5-40db-82c2-6d91224eeecb-model-cache\") pod \"da2c94f0-76e5-40db-82c2-6d91224eeecb\" (UID: \"da2c94f0-76e5-40db-82c2-6d91224eeecb\") "
Sep 15 13:59:17.451934 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:17.451784    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/da2c94f0-76e5-40db-82c2-6d91224eeecb-dshm\") pod \"da2c94f0-76e5-40db-82c2-6d91224eeecb\" (UID: \"da2c94f0-76e5-40db-82c2-6d91224eeecb\") "
Sep 15 13:59:17.451934 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:17.451886    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da2c94f0-76e5-40db-82c2-6d91224eeecb-home" (OuterVolumeSpecName: "home") pod "da2c94f0-76e5-40db-82c2-6d91224eeecb" (UID: "da2c94f0-76e5-40db-82c2-6d91224eeecb"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:59:17.451934 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:17.451901    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da2c94f0-76e5-40db-82c2-6d91224eeecb-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "da2c94f0-76e5-40db-82c2-6d91224eeecb" (UID: "da2c94f0-76e5-40db-82c2-6d91224eeecb"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:59:17.452191 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:17.452080    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da2c94f0-76e5-40db-82c2-6d91224eeecb-model-cache" (OuterVolumeSpecName: "model-cache") pod "da2c94f0-76e5-40db-82c2-6d91224eeecb" (UID: "da2c94f0-76e5-40db-82c2-6d91224eeecb"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:59:17.452235 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:17.452197    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/da2c94f0-76e5-40db-82c2-6d91224eeecb-home\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:59:17.452235 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:17.452216    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/da2c94f0-76e5-40db-82c2-6d91224eeecb-tmp-dir\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:59:17.452235 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:17.452230    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/da2c94f0-76e5-40db-82c2-6d91224eeecb-model-cache\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:59:17.453992 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:17.453972    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da2c94f0-76e5-40db-82c2-6d91224eeecb-dshm" (OuterVolumeSpecName: "dshm") pod "da2c94f0-76e5-40db-82c2-6d91224eeecb" (UID: "da2c94f0-76e5-40db-82c2-6d91224eeecb"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:59:17.454092 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:17.454078    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da2c94f0-76e5-40db-82c2-6d91224eeecb-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "da2c94f0-76e5-40db-82c2-6d91224eeecb" (UID: "da2c94f0-76e5-40db-82c2-6d91224eeecb"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 13:59:17.454162 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:17.454081    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da2c94f0-76e5-40db-82c2-6d91224eeecb-kube-api-access-vqlmn" (OuterVolumeSpecName: "kube-api-access-vqlmn") pod "da2c94f0-76e5-40db-82c2-6d91224eeecb" (UID: "da2c94f0-76e5-40db-82c2-6d91224eeecb"). InnerVolumeSpecName "kube-api-access-vqlmn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:59:17.552867 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:17.552824    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/da2c94f0-76e5-40db-82c2-6d91224eeecb-dshm\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:59:17.552867 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:17.552859    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da2c94f0-76e5-40db-82c2-6d91224eeecb-tls-certs\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:59:17.552867 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:17.552874    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vqlmn\" (UniqueName: \"kubernetes.io/projected/da2c94f0-76e5-40db-82c2-6d91224eeecb-kube-api-access-vqlmn\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:59:17.573700 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:17.573667    2578 generic.go:356] "Generic (PLEG): container finished" podID="da2c94f0-76e5-40db-82c2-6d91224eeecb" containerID="d89d7af6c116e600baf3127a7a394a211cdc34b42cf3ee5f388b83d0c871c108" exitCode=0
Sep 15 13:59:17.573821 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:17.573710    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-66261e/e2e-conflict-b-51bbeba1-kserve-5646588678-4jz44"
Sep 15 13:59:17.573821 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:17.573756    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-66261e/e2e-conflict-b-51bbeba1-kserve-5646588678-4jz44" event={"ID":"da2c94f0-76e5-40db-82c2-6d91224eeecb","Type":"ContainerDied","Data":"d89d7af6c116e600baf3127a7a394a211cdc34b42cf3ee5f388b83d0c871c108"}
Sep 15 13:59:17.573821 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:17.573793    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-66261e/e2e-conflict-b-51bbeba1-kserve-5646588678-4jz44" event={"ID":"da2c94f0-76e5-40db-82c2-6d91224eeecb","Type":"ContainerDied","Data":"25ec4542e9f977de92b22d3926432918e1e4b06911234c360744aaf1a4086796"}
Sep 15 13:59:17.573821 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:17.573809    2578 scope.go:117] "RemoveContainer" containerID="d89d7af6c116e600baf3127a7a394a211cdc34b42cf3ee5f388b83d0c871c108"
Sep 15 13:59:17.583782 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:17.583767    2578 scope.go:117] "RemoveContainer" containerID="d89d7af6c116e600baf3127a7a394a211cdc34b42cf3ee5f388b83d0c871c108"
Sep 15 13:59:17.584065 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:59:17.584047    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d89d7af6c116e600baf3127a7a394a211cdc34b42cf3ee5f388b83d0c871c108\": container with ID starting with d89d7af6c116e600baf3127a7a394a211cdc34b42cf3ee5f388b83d0c871c108 not found: ID does not exist" containerID="d89d7af6c116e600baf3127a7a394a211cdc34b42cf3ee5f388b83d0c871c108"
Sep 15 13:59:17.584164 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:17.584073    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d89d7af6c116e600baf3127a7a394a211cdc34b42cf3ee5f388b83d0c871c108"} err="failed to get container status \"d89d7af6c116e600baf3127a7a394a211cdc34b42cf3ee5f388b83d0c871c108\": rpc error: code = NotFound desc = could not find container \"d89d7af6c116e600baf3127a7a394a211cdc34b42cf3ee5f388b83d0c871c108\": container with ID starting with d89d7af6c116e600baf3127a7a394a211cdc34b42cf3ee5f388b83d0c871c108 not found: ID does not exist"
Sep 15 13:59:17.594817 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:17.594793    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-66261e/e2e-conflict-b-51bbeba1-kserve-5646588678-4jz44"]
Sep 15 13:59:17.599034 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:17.599014    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-66261e/e2e-conflict-b-51bbeba1-kserve-5646588678-4jz44"]
Sep 15 13:59:17.758076 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:17.757982    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da2c94f0-76e5-40db-82c2-6d91224eeecb" path="/var/lib/kubelet/pods/da2c94f0-76e5-40db-82c2-6d91224eeecb/volumes"
Sep 15 13:59:18.245894 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:18.245854    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-66261e/e2e-conflict-a-51bbeba1-kserve-79555777f6-cjl99" podUID="5c5a959a-c352-43cf-bb54-cd19e59e0f09" containerName="main" containerID="cri-o://413153b8de09133819738cf83d3a090e7441f5faa1b24d6480da47ba353d64d5" gracePeriod=45
Sep 15 13:59:18.495478 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:18.495451    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-66261e/e2e-conflict-a-51bbeba1-kserve-79555777f6-cjl99"
Sep 15 13:59:18.580518 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:18.580477    2578 generic.go:356] "Generic (PLEG): container finished" podID="5c5a959a-c352-43cf-bb54-cd19e59e0f09" containerID="413153b8de09133819738cf83d3a090e7441f5faa1b24d6480da47ba353d64d5" exitCode=0
Sep 15 13:59:18.580518 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:18.580517    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-66261e/e2e-conflict-a-51bbeba1-kserve-79555777f6-cjl99"
Sep 15 13:59:18.580776 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:18.580570    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-66261e/e2e-conflict-a-51bbeba1-kserve-79555777f6-cjl99" event={"ID":"5c5a959a-c352-43cf-bb54-cd19e59e0f09","Type":"ContainerDied","Data":"413153b8de09133819738cf83d3a090e7441f5faa1b24d6480da47ba353d64d5"}
Sep 15 13:59:18.580776 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:18.580609    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-66261e/e2e-conflict-a-51bbeba1-kserve-79555777f6-cjl99" event={"ID":"5c5a959a-c352-43cf-bb54-cd19e59e0f09","Type":"ContainerDied","Data":"c090602abb2a764585ac878e0a5e871380e8dc8f219fd53517a1fd47078655f2"}
Sep 15 13:59:18.580776 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:18.580628    2578 scope.go:117] "RemoveContainer" containerID="413153b8de09133819738cf83d3a090e7441f5faa1b24d6480da47ba353d64d5"
Sep 15 13:59:18.589505 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:18.589486    2578 scope.go:117] "RemoveContainer" containerID="413153b8de09133819738cf83d3a090e7441f5faa1b24d6480da47ba353d64d5"
Sep 15 13:59:18.589768 ip-10-0-128-41 kubenswrapper[2578]: E0915 13:59:18.589747    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"413153b8de09133819738cf83d3a090e7441f5faa1b24d6480da47ba353d64d5\": container with ID starting with 413153b8de09133819738cf83d3a090e7441f5faa1b24d6480da47ba353d64d5 not found: ID does not exist" containerID="413153b8de09133819738cf83d3a090e7441f5faa1b24d6480da47ba353d64d5"
Sep 15 13:59:18.589816 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:18.589778    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"413153b8de09133819738cf83d3a090e7441f5faa1b24d6480da47ba353d64d5"} err="failed to get container status \"413153b8de09133819738cf83d3a090e7441f5faa1b24d6480da47ba353d64d5\": rpc error: code = NotFound desc = could not find container \"413153b8de09133819738cf83d3a090e7441f5faa1b24d6480da47ba353d64d5\": container with ID starting with 413153b8de09133819738cf83d3a090e7441f5faa1b24d6480da47ba353d64d5 not found: ID does not exist"
Sep 15 13:59:18.664022 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:18.663993    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l6k8r\" (UniqueName: \"kubernetes.io/projected/5c5a959a-c352-43cf-bb54-cd19e59e0f09-kube-api-access-l6k8r\") pod \"5c5a959a-c352-43cf-bb54-cd19e59e0f09\" (UID: \"5c5a959a-c352-43cf-bb54-cd19e59e0f09\") "
Sep 15 13:59:18.664187 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:18.664067    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5c5a959a-c352-43cf-bb54-cd19e59e0f09-dshm\") pod \"5c5a959a-c352-43cf-bb54-cd19e59e0f09\" (UID: \"5c5a959a-c352-43cf-bb54-cd19e59e0f09\") "
Sep 15 13:59:18.664187 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:18.664084    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5c5a959a-c352-43cf-bb54-cd19e59e0f09-home\") pod \"5c5a959a-c352-43cf-bb54-cd19e59e0f09\" (UID: \"5c5a959a-c352-43cf-bb54-cd19e59e0f09\") "
Sep 15 13:59:18.664187 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:18.664170    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5c5a959a-c352-43cf-bb54-cd19e59e0f09-model-cache\") pod \"5c5a959a-c352-43cf-bb54-cd19e59e0f09\" (UID: \"5c5a959a-c352-43cf-bb54-cd19e59e0f09\") "
Sep 15 13:59:18.664308 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:18.664202    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c5a959a-c352-43cf-bb54-cd19e59e0f09-tmp-dir\") pod \"5c5a959a-c352-43cf-bb54-cd19e59e0f09\" (UID: \"5c5a959a-c352-43cf-bb54-cd19e59e0f09\") "
Sep 15 13:59:18.664308 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:18.664219    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c5a959a-c352-43cf-bb54-cd19e59e0f09-tls-certs\") pod \"5c5a959a-c352-43cf-bb54-cd19e59e0f09\" (UID: \"5c5a959a-c352-43cf-bb54-cd19e59e0f09\") "
Sep 15 13:59:18.664486 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:18.664450    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c5a959a-c352-43cf-bb54-cd19e59e0f09-model-cache" (OuterVolumeSpecName: "model-cache") pod "5c5a959a-c352-43cf-bb54-cd19e59e0f09" (UID: "5c5a959a-c352-43cf-bb54-cd19e59e0f09"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:59:18.664486 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:18.664481    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c5a959a-c352-43cf-bb54-cd19e59e0f09-home" (OuterVolumeSpecName: "home") pod "5c5a959a-c352-43cf-bb54-cd19e59e0f09" (UID: "5c5a959a-c352-43cf-bb54-cd19e59e0f09"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:59:18.664674 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:18.664534    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c5a959a-c352-43cf-bb54-cd19e59e0f09-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5c5a959a-c352-43cf-bb54-cd19e59e0f09" (UID: "5c5a959a-c352-43cf-bb54-cd19e59e0f09"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:59:18.664674 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:18.664604    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5c5a959a-c352-43cf-bb54-cd19e59e0f09-model-cache\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:59:18.664674 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:18.664625    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5c5a959a-c352-43cf-bb54-cd19e59e0f09-home\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:59:18.666374 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:18.666342    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c5a959a-c352-43cf-bb54-cd19e59e0f09-dshm" (OuterVolumeSpecName: "dshm") pod "5c5a959a-c352-43cf-bb54-cd19e59e0f09" (UID: "5c5a959a-c352-43cf-bb54-cd19e59e0f09"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:59:18.666473 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:18.666414    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c5a959a-c352-43cf-bb54-cd19e59e0f09-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5c5a959a-c352-43cf-bb54-cd19e59e0f09" (UID: "5c5a959a-c352-43cf-bb54-cd19e59e0f09"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 13:59:18.666473 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:18.666423    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c5a959a-c352-43cf-bb54-cd19e59e0f09-kube-api-access-l6k8r" (OuterVolumeSpecName: "kube-api-access-l6k8r") pod "5c5a959a-c352-43cf-bb54-cd19e59e0f09" (UID: "5c5a959a-c352-43cf-bb54-cd19e59e0f09"). InnerVolumeSpecName "kube-api-access-l6k8r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:59:18.765093 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:18.765054    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c5a959a-c352-43cf-bb54-cd19e59e0f09-tmp-dir\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:59:18.765093 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:18.765088    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c5a959a-c352-43cf-bb54-cd19e59e0f09-tls-certs\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:59:18.765093 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:18.765098    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l6k8r\" (UniqueName: \"kubernetes.io/projected/5c5a959a-c352-43cf-bb54-cd19e59e0f09-kube-api-access-l6k8r\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:59:18.765093 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:18.765107    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5c5a959a-c352-43cf-bb54-cd19e59e0f09-dshm\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 13:59:18.903452 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:18.903420    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-66261e/e2e-conflict-a-51bbeba1-kserve-79555777f6-cjl99"]
Sep 15 13:59:18.909720 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:18.909695    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-66261e/e2e-conflict-a-51bbeba1-kserve-79555777f6-cjl99"]
Sep 15 13:59:19.758635 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:19.758601    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c5a959a-c352-43cf-bb54-cd19e59e0f09" path="/var/lib/kubelet/pods/5c5a959a-c352-43cf-bb54-cd19e59e0f09/volumes"
Sep 15 13:59:22.522208 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:22.522168    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-66261e/distinct-w4-66261e-kserve-5bd55f855c-kqbr2"
Sep 15 13:59:22.522696 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:22.522221    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-66261e/distinct-w4-66261e-kserve-5bd55f855c-kqbr2"
Sep 15 13:59:22.535190 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:22.535166    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-66261e/distinct-w4-66261e-kserve-5bd55f855c-kqbr2"
Sep 15 13:59:22.619362 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:22.619327    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-66261e/distinct-w4-66261e-kserve-5bd55f855c-kqbr2"
Sep 15 13:59:33.934320 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:33.934230    2578 scope.go:117] "RemoveContainer" containerID="bf0bddb43d703038fc03f13978b300c2c813eed681f75b7bcbf1b6736d65c151"
Sep 15 13:59:45.938899 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:45.938859    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-66261e/distinct-2-w4-66261e-kserve-5cd847d7db-vc5dv"]
Sep 15 13:59:45.939454 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:45.939434    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c5a959a-c352-43cf-bb54-cd19e59e0f09" containerName="main"
Sep 15 13:59:45.939545 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:45.939458    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c5a959a-c352-43cf-bb54-cd19e59e0f09" containerName="main"
Sep 15 13:59:45.939545 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:45.939469    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da2c94f0-76e5-40db-82c2-6d91224eeecb" containerName="main"
Sep 15 13:59:45.939545 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:45.939477    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="da2c94f0-76e5-40db-82c2-6d91224eeecb" containerName="main"
Sep 15 13:59:45.939704 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:45.939574    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c5a959a-c352-43cf-bb54-cd19e59e0f09" containerName="main"
Sep 15 13:59:45.939704 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:45.939586    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="da2c94f0-76e5-40db-82c2-6d91224eeecb" containerName="main"
Sep 15 13:59:45.943805 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:45.943785    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-66261e/distinct-2-w4-66261e-kserve-5cd847d7db-vc5dv"
Sep 15 13:59:45.946717 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:45.946698    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-66261e\"/\"distinct-2-w4-66261e-kserve-self-signed-certs\""
Sep 15 13:59:45.959181 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:45.959158    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-66261e/distinct-2-w4-66261e-kserve-5cd847d7db-vc5dv"]
Sep 15 13:59:46.035023 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:46.034990    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztv54\" (UniqueName: \"kubernetes.io/projected/59dae33f-5c20-4387-9578-b5a6152b88d8-kube-api-access-ztv54\") pod \"distinct-2-w4-66261e-kserve-5cd847d7db-vc5dv\" (UID: \"59dae33f-5c20-4387-9578-b5a6152b88d8\") " pod="e2e-models-e2e-worker-w4-66261e/distinct-2-w4-66261e-kserve-5cd847d7db-vc5dv"
Sep 15 13:59:46.035228 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:46.035034    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/59dae33f-5c20-4387-9578-b5a6152b88d8-tmp-dir\") pod \"distinct-2-w4-66261e-kserve-5cd847d7db-vc5dv\" (UID: \"59dae33f-5c20-4387-9578-b5a6152b88d8\") " pod="e2e-models-e2e-worker-w4-66261e/distinct-2-w4-66261e-kserve-5cd847d7db-vc5dv"
Sep 15 13:59:46.035228 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:46.035117    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/59dae33f-5c20-4387-9578-b5a6152b88d8-model-cache\") pod \"distinct-2-w4-66261e-kserve-5cd847d7db-vc5dv\" (UID: \"59dae33f-5c20-4387-9578-b5a6152b88d8\") " pod="e2e-models-e2e-worker-w4-66261e/distinct-2-w4-66261e-kserve-5cd847d7db-vc5dv"
Sep 15 13:59:46.035228 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:46.035210    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/59dae33f-5c20-4387-9578-b5a6152b88d8-tls-certs\") pod \"distinct-2-w4-66261e-kserve-5cd847d7db-vc5dv\" (UID: \"59dae33f-5c20-4387-9578-b5a6152b88d8\") " pod="e2e-models-e2e-worker-w4-66261e/distinct-2-w4-66261e-kserve-5cd847d7db-vc5dv"
Sep 15 13:59:46.035352 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:46.035234    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/59dae33f-5c20-4387-9578-b5a6152b88d8-home\") pod \"distinct-2-w4-66261e-kserve-5cd847d7db-vc5dv\" (UID: \"59dae33f-5c20-4387-9578-b5a6152b88d8\") " pod="e2e-models-e2e-worker-w4-66261e/distinct-2-w4-66261e-kserve-5cd847d7db-vc5dv"
Sep 15 13:59:46.035352 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:46.035292    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/59dae33f-5c20-4387-9578-b5a6152b88d8-dshm\") pod \"distinct-2-w4-66261e-kserve-5cd847d7db-vc5dv\" (UID: \"59dae33f-5c20-4387-9578-b5a6152b88d8\") " pod="e2e-models-e2e-worker-w4-66261e/distinct-2-w4-66261e-kserve-5cd847d7db-vc5dv"
Sep 15 13:59:46.140149 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:46.137392    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/59dae33f-5c20-4387-9578-b5a6152b88d8-tmp-dir\") pod \"distinct-2-w4-66261e-kserve-5cd847d7db-vc5dv\" (UID: \"59dae33f-5c20-4387-9578-b5a6152b88d8\") " pod="e2e-models-e2e-worker-w4-66261e/distinct-2-w4-66261e-kserve-5cd847d7db-vc5dv"
Sep 15 13:59:46.140149 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:46.137528    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/59dae33f-5c20-4387-9578-b5a6152b88d8-tmp-dir\") pod \"distinct-2-w4-66261e-kserve-5cd847d7db-vc5dv\" (UID: \"59dae33f-5c20-4387-9578-b5a6152b88d8\") " pod="e2e-models-e2e-worker-w4-66261e/distinct-2-w4-66261e-kserve-5cd847d7db-vc5dv"
Sep 15 13:59:46.140149 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:46.137604    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/59dae33f-5c20-4387-9578-b5a6152b88d8-model-cache\") pod \"distinct-2-w4-66261e-kserve-5cd847d7db-vc5dv\" (UID: \"59dae33f-5c20-4387-9578-b5a6152b88d8\") " pod="e2e-models-e2e-worker-w4-66261e/distinct-2-w4-66261e-kserve-5cd847d7db-vc5dv"
Sep 15 13:59:46.140149 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:46.137664    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/59dae33f-5c20-4387-9578-b5a6152b88d8-tls-certs\") pod \"distinct-2-w4-66261e-kserve-5cd847d7db-vc5dv\" (UID: \"59dae33f-5c20-4387-9578-b5a6152b88d8\") " pod="e2e-models-e2e-worker-w4-66261e/distinct-2-w4-66261e-kserve-5cd847d7db-vc5dv"
Sep 15 13:59:46.140149 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:46.137710    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/59dae33f-5c20-4387-9578-b5a6152b88d8-home\") pod \"distinct-2-w4-66261e-kserve-5cd847d7db-vc5dv\" (UID: \"59dae33f-5c20-4387-9578-b5a6152b88d8\") " pod="e2e-models-e2e-worker-w4-66261e/distinct-2-w4-66261e-kserve-5cd847d7db-vc5dv"
Sep 15 13:59:46.140149 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:46.137781    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/59dae33f-5c20-4387-9578-b5a6152b88d8-dshm\") pod \"distinct-2-w4-66261e-kserve-5cd847d7db-vc5dv\" (UID: \"59dae33f-5c20-4387-9578-b5a6152b88d8\") " pod="e2e-models-e2e-worker-w4-66261e/distinct-2-w4-66261e-kserve-5cd847d7db-vc5dv"
Sep 15 13:59:46.140149 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:46.137824    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztv54\" (UniqueName: \"kubernetes.io/projected/59dae33f-5c20-4387-9578-b5a6152b88d8-kube-api-access-ztv54\") pod \"distinct-2-w4-66261e-kserve-5cd847d7db-vc5dv\" (UID: \"59dae33f-5c20-4387-9578-b5a6152b88d8\") " pod="e2e-models-e2e-worker-w4-66261e/distinct-2-w4-66261e-kserve-5cd847d7db-vc5dv"
Sep 15 13:59:46.140149 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:46.138419    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/59dae33f-5c20-4387-9578-b5a6152b88d8-model-cache\") pod \"distinct-2-w4-66261e-kserve-5cd847d7db-vc5dv\" (UID: \"59dae33f-5c20-4387-9578-b5a6152b88d8\") " pod="e2e-models-e2e-worker-w4-66261e/distinct-2-w4-66261e-kserve-5cd847d7db-vc5dv"
Sep 15 13:59:46.142118 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:46.141591    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/59dae33f-5c20-4387-9578-b5a6152b88d8-tls-certs\") pod \"distinct-2-w4-66261e-kserve-5cd847d7db-vc5dv\" (UID: \"59dae33f-5c20-4387-9578-b5a6152b88d8\") " pod="e2e-models-e2e-worker-w4-66261e/distinct-2-w4-66261e-kserve-5cd847d7db-vc5dv"
Sep 15 13:59:46.142118 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:46.141848    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/59dae33f-5c20-4387-9578-b5a6152b88d8-home\") pod \"distinct-2-w4-66261e-kserve-5cd847d7db-vc5dv\" (UID: \"59dae33f-5c20-4387-9578-b5a6152b88d8\") " pod="e2e-models-e2e-worker-w4-66261e/distinct-2-w4-66261e-kserve-5cd847d7db-vc5dv"
Sep 15 13:59:46.144771 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:46.144745    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/59dae33f-5c20-4387-9578-b5a6152b88d8-dshm\") pod \"distinct-2-w4-66261e-kserve-5cd847d7db-vc5dv\" (UID: \"59dae33f-5c20-4387-9578-b5a6152b88d8\") " pod="e2e-models-e2e-worker-w4-66261e/distinct-2-w4-66261e-kserve-5cd847d7db-vc5dv"
Sep 15 13:59:46.153280 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:46.153261    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztv54\" (UniqueName: \"kubernetes.io/projected/59dae33f-5c20-4387-9578-b5a6152b88d8-kube-api-access-ztv54\") pod \"distinct-2-w4-66261e-kserve-5cd847d7db-vc5dv\" (UID: \"59dae33f-5c20-4387-9578-b5a6152b88d8\") " pod="e2e-models-e2e-worker-w4-66261e/distinct-2-w4-66261e-kserve-5cd847d7db-vc5dv"
Sep 15 13:59:46.253075 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:46.252988    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-66261e/distinct-2-w4-66261e-kserve-5cd847d7db-vc5dv"
Sep 15 13:59:46.537827 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:46.537804    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-66261e/distinct-2-w4-66261e-kserve-5cd847d7db-vc5dv"]
Sep 15 13:59:46.538105 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:59:46.538085    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod59dae33f_5c20_4387_9578_b5a6152b88d8.slice/crio-f5c23c7a682c3ec2a63923274cbcfaef22785b80939786e5cb5734b89b220797 WatchSource:0}: Error finding container f5c23c7a682c3ec2a63923274cbcfaef22785b80939786e5cb5734b89b220797: Status 404 returned error can't find the container with id f5c23c7a682c3ec2a63923274cbcfaef22785b80939786e5cb5734b89b220797
Sep 15 13:59:46.742684 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:46.742649    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-66261e/distinct-2-w4-66261e-kserve-5cd847d7db-vc5dv" event={"ID":"59dae33f-5c20-4387-9578-b5a6152b88d8","Type":"ContainerStarted","Data":"0bdeb65f9329844be69929258ac6f9c7b68b19c5f597150582236b0bc1a326e6"}
Sep 15 13:59:46.742684 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:46.742689    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-66261e/distinct-2-w4-66261e-kserve-5cd847d7db-vc5dv" event={"ID":"59dae33f-5c20-4387-9578-b5a6152b88d8","Type":"ContainerStarted","Data":"f5c23c7a682c3ec2a63923274cbcfaef22785b80939786e5cb5734b89b220797"}
Sep 15 13:59:46.762889 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:46.762840    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-66261e/distinct-2-w4-66261e-kserve-5cd847d7db-vc5dv" podStartSLOduration=1.762824538 podStartE2EDuration="1.762824538s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:59:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:59:46.759934628 +0000 UTC m=+1273.519060913" watchObservedRunningTime="2026-09-15 13:59:46.762824538 +0000 UTC m=+1273.521950823"
Sep 15 13:59:48.181306 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:48.181266    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-14c2563f-openshift-default-579cff8cb8-2hkzj"]
Sep 15 13:59:48.184776 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:48.184753    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-14c2563f-openshift-default-579cff8cb8-2hkzj"
Sep 15 13:59:48.187043 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:48.187015    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-14c2563f-openshift-default-dockercfg-tfz9v\""
Sep 15 13:59:48.197984 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:48.197962    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-14c2563f-openshift-default-579cff8cb8-2hkzj"]
Sep 15 13:59:48.259876 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:48.259834    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9f260fe0-7e7d-47cc-8f41-619e780e7e41-workload-certs\") pod \"e2e-mt-14c2563f-openshift-default-579cff8cb8-2hkzj\" (UID: \"9f260fe0-7e7d-47cc-8f41-619e780e7e41\") " pod="openshift-ingress/e2e-mt-14c2563f-openshift-default-579cff8cb8-2hkzj"
Sep 15 13:59:48.260075 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:48.259905    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f260fe0-7e7d-47cc-8f41-619e780e7e41-workload-socket\") pod \"e2e-mt-14c2563f-openshift-default-579cff8cb8-2hkzj\" (UID: \"9f260fe0-7e7d-47cc-8f41-619e780e7e41\") " pod="openshift-ingress/e2e-mt-14c2563f-openshift-default-579cff8cb8-2hkzj"
Sep 15 13:59:48.260075 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:48.259938    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9f260fe0-7e7d-47cc-8f41-619e780e7e41-istio-podinfo\") pod \"e2e-mt-14c2563f-openshift-default-579cff8cb8-2hkzj\" (UID: \"9f260fe0-7e7d-47cc-8f41-619e780e7e41\") " pod="openshift-ingress/e2e-mt-14c2563f-openshift-default-579cff8cb8-2hkzj"
Sep 15 13:59:48.260075 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:48.259975    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9f260fe0-7e7d-47cc-8f41-619e780e7e41-istio-data\") pod \"e2e-mt-14c2563f-openshift-default-579cff8cb8-2hkzj\" (UID: \"9f260fe0-7e7d-47cc-8f41-619e780e7e41\") " pod="openshift-ingress/e2e-mt-14c2563f-openshift-default-579cff8cb8-2hkzj"
Sep 15 13:59:48.260075 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:48.260000    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9f260fe0-7e7d-47cc-8f41-619e780e7e41-istiod-ca-cert\") pod \"e2e-mt-14c2563f-openshift-default-579cff8cb8-2hkzj\" (UID: \"9f260fe0-7e7d-47cc-8f41-619e780e7e41\") " pod="openshift-ingress/e2e-mt-14c2563f-openshift-default-579cff8cb8-2hkzj"
Sep 15 13:59:48.260075 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:48.260023    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9f260fe0-7e7d-47cc-8f41-619e780e7e41-istio-token\") pod \"e2e-mt-14c2563f-openshift-default-579cff8cb8-2hkzj\" (UID: \"9f260fe0-7e7d-47cc-8f41-619e780e7e41\") " pod="openshift-ingress/e2e-mt-14c2563f-openshift-default-579cff8cb8-2hkzj"
Sep 15 13:59:48.260335 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:48.260086    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9f260fe0-7e7d-47cc-8f41-619e780e7e41-istio-envoy\") pod \"e2e-mt-14c2563f-openshift-default-579cff8cb8-2hkzj\" (UID: \"9f260fe0-7e7d-47cc-8f41-619e780e7e41\") " pod="openshift-ingress/e2e-mt-14c2563f-openshift-default-579cff8cb8-2hkzj"
Sep 15 13:59:48.260335 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:48.260196    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-572h6\" (UniqueName: \"kubernetes.io/projected/9f260fe0-7e7d-47cc-8f41-619e780e7e41-kube-api-access-572h6\") pod \"e2e-mt-14c2563f-openshift-default-579cff8cb8-2hkzj\" (UID: \"9f260fe0-7e7d-47cc-8f41-619e780e7e41\") " pod="openshift-ingress/e2e-mt-14c2563f-openshift-default-579cff8cb8-2hkzj"
Sep 15 13:59:48.260335 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:48.260222    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f260fe0-7e7d-47cc-8f41-619e780e7e41-credential-socket\") pod \"e2e-mt-14c2563f-openshift-default-579cff8cb8-2hkzj\" (UID: \"9f260fe0-7e7d-47cc-8f41-619e780e7e41\") " pod="openshift-ingress/e2e-mt-14c2563f-openshift-default-579cff8cb8-2hkzj"
Sep 15 13:59:48.360891 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:48.360853    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-572h6\" (UniqueName: \"kubernetes.io/projected/9f260fe0-7e7d-47cc-8f41-619e780e7e41-kube-api-access-572h6\") pod \"e2e-mt-14c2563f-openshift-default-579cff8cb8-2hkzj\" (UID: \"9f260fe0-7e7d-47cc-8f41-619e780e7e41\") " pod="openshift-ingress/e2e-mt-14c2563f-openshift-default-579cff8cb8-2hkzj"
Sep 15 13:59:48.360891 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:48.360894    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f260fe0-7e7d-47cc-8f41-619e780e7e41-credential-socket\") pod \"e2e-mt-14c2563f-openshift-default-579cff8cb8-2hkzj\" (UID: \"9f260fe0-7e7d-47cc-8f41-619e780e7e41\") " pod="openshift-ingress/e2e-mt-14c2563f-openshift-default-579cff8cb8-2hkzj"
Sep 15 13:59:48.361192 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:48.360941    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9f260fe0-7e7d-47cc-8f41-619e780e7e41-workload-certs\") pod \"e2e-mt-14c2563f-openshift-default-579cff8cb8-2hkzj\" (UID: \"9f260fe0-7e7d-47cc-8f41-619e780e7e41\") " pod="openshift-ingress/e2e-mt-14c2563f-openshift-default-579cff8cb8-2hkzj"
Sep 15 13:59:48.361192 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:48.360992    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f260fe0-7e7d-47cc-8f41-619e780e7e41-workload-socket\") pod \"e2e-mt-14c2563f-openshift-default-579cff8cb8-2hkzj\" (UID: \"9f260fe0-7e7d-47cc-8f41-619e780e7e41\") " pod="openshift-ingress/e2e-mt-14c2563f-openshift-default-579cff8cb8-2hkzj"
Sep 15 13:59:48.361192 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:48.361024    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9f260fe0-7e7d-47cc-8f41-619e780e7e41-istio-podinfo\") pod \"e2e-mt-14c2563f-openshift-default-579cff8cb8-2hkzj\" (UID: \"9f260fe0-7e7d-47cc-8f41-619e780e7e41\") " pod="openshift-ingress/e2e-mt-14c2563f-openshift-default-579cff8cb8-2hkzj"
Sep 15 13:59:48.361192 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:48.361063    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9f260fe0-7e7d-47cc-8f41-619e780e7e41-istio-data\") pod \"e2e-mt-14c2563f-openshift-default-579cff8cb8-2hkzj\" (UID: \"9f260fe0-7e7d-47cc-8f41-619e780e7e41\") " pod="openshift-ingress/e2e-mt-14c2563f-openshift-default-579cff8cb8-2hkzj"
Sep 15 13:59:48.361192 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:48.361089    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9f260fe0-7e7d-47cc-8f41-619e780e7e41-istiod-ca-cert\") pod \"e2e-mt-14c2563f-openshift-default-579cff8cb8-2hkzj\" (UID: \"9f260fe0-7e7d-47cc-8f41-619e780e7e41\") " pod="openshift-ingress/e2e-mt-14c2563f-openshift-default-579cff8cb8-2hkzj"
Sep 15 13:59:48.361192 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:48.361113    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9f260fe0-7e7d-47cc-8f41-619e780e7e41-istio-token\") pod \"e2e-mt-14c2563f-openshift-default-579cff8cb8-2hkzj\" (UID: \"9f260fe0-7e7d-47cc-8f41-619e780e7e41\") " pod="openshift-ingress/e2e-mt-14c2563f-openshift-default-579cff8cb8-2hkzj"
Sep 15 13:59:48.361192 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:48.361173    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9f260fe0-7e7d-47cc-8f41-619e780e7e41-istio-envoy\") pod \"e2e-mt-14c2563f-openshift-default-579cff8cb8-2hkzj\" (UID: \"9f260fe0-7e7d-47cc-8f41-619e780e7e41\") " pod="openshift-ingress/e2e-mt-14c2563f-openshift-default-579cff8cb8-2hkzj"
Sep 15 13:59:48.361560 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:48.361522    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f260fe0-7e7d-47cc-8f41-619e780e7e41-credential-socket\") pod \"e2e-mt-14c2563f-openshift-default-579cff8cb8-2hkzj\" (UID: \"9f260fe0-7e7d-47cc-8f41-619e780e7e41\") " pod="openshift-ingress/e2e-mt-14c2563f-openshift-default-579cff8cb8-2hkzj"
Sep 15 13:59:48.361680 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:48.361564    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9f260fe0-7e7d-47cc-8f41-619e780e7e41-workload-certs\") pod \"e2e-mt-14c2563f-openshift-default-579cff8cb8-2hkzj\" (UID: \"9f260fe0-7e7d-47cc-8f41-619e780e7e41\") " pod="openshift-ingress/e2e-mt-14c2563f-openshift-default-579cff8cb8-2hkzj"
Sep 15 13:59:48.361680 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:48.361587    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9f260fe0-7e7d-47cc-8f41-619e780e7e41-istio-data\") pod \"e2e-mt-14c2563f-openshift-default-579cff8cb8-2hkzj\" (UID: \"9f260fe0-7e7d-47cc-8f41-619e780e7e41\") " pod="openshift-ingress/e2e-mt-14c2563f-openshift-default-579cff8cb8-2hkzj"
Sep 15 13:59:48.361680 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:48.361612    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f260fe0-7e7d-47cc-8f41-619e780e7e41-workload-socket\") pod \"e2e-mt-14c2563f-openshift-default-579cff8cb8-2hkzj\" (UID: \"9f260fe0-7e7d-47cc-8f41-619e780e7e41\") " pod="openshift-ingress/e2e-mt-14c2563f-openshift-default-579cff8cb8-2hkzj"
Sep 15 13:59:48.362168 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:48.362113    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9f260fe0-7e7d-47cc-8f41-619e780e7e41-istiod-ca-cert\") pod \"e2e-mt-14c2563f-openshift-default-579cff8cb8-2hkzj\" (UID: \"9f260fe0-7e7d-47cc-8f41-619e780e7e41\") " pod="openshift-ingress/e2e-mt-14c2563f-openshift-default-579cff8cb8-2hkzj"
Sep 15 13:59:48.363644 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:48.363625    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9f260fe0-7e7d-47cc-8f41-619e780e7e41-istio-envoy\") pod \"e2e-mt-14c2563f-openshift-default-579cff8cb8-2hkzj\" (UID: \"9f260fe0-7e7d-47cc-8f41-619e780e7e41\") " pod="openshift-ingress/e2e-mt-14c2563f-openshift-default-579cff8cb8-2hkzj"
Sep 15 13:59:48.363862 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:48.363844    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9f260fe0-7e7d-47cc-8f41-619e780e7e41-istio-podinfo\") pod \"e2e-mt-14c2563f-openshift-default-579cff8cb8-2hkzj\" (UID: \"9f260fe0-7e7d-47cc-8f41-619e780e7e41\") " pod="openshift-ingress/e2e-mt-14c2563f-openshift-default-579cff8cb8-2hkzj"
Sep 15 13:59:48.374425 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:48.374404    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9f260fe0-7e7d-47cc-8f41-619e780e7e41-istio-token\") pod \"e2e-mt-14c2563f-openshift-default-579cff8cb8-2hkzj\" (UID: \"9f260fe0-7e7d-47cc-8f41-619e780e7e41\") " pod="openshift-ingress/e2e-mt-14c2563f-openshift-default-579cff8cb8-2hkzj"
Sep 15 13:59:48.374676 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:48.374652    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-572h6\" (UniqueName: \"kubernetes.io/projected/9f260fe0-7e7d-47cc-8f41-619e780e7e41-kube-api-access-572h6\") pod \"e2e-mt-14c2563f-openshift-default-579cff8cb8-2hkzj\" (UID: \"9f260fe0-7e7d-47cc-8f41-619e780e7e41\") " pod="openshift-ingress/e2e-mt-14c2563f-openshift-default-579cff8cb8-2hkzj"
Sep 15 13:59:48.495349 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:48.495261    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-14c2563f-openshift-default-579cff8cb8-2hkzj"
Sep 15 13:59:48.902243 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:48.902212    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-14c2563f-openshift-default-579cff8cb8-2hkzj"]
Sep 15 13:59:48.905582 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:59:48.905547    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f260fe0_7e7d_47cc_8f41_619e780e7e41.slice/crio-6e45f8405767d6ca8d66063fd9bfee6e4bc036f04c75cfb11e3a4d029e1aaebf WatchSource:0}: Error finding container 6e45f8405767d6ca8d66063fd9bfee6e4bc036f04c75cfb11e3a4d029e1aaebf: Status 404 returned error can't find the container with id 6e45f8405767d6ca8d66063fd9bfee6e4bc036f04c75cfb11e3a4d029e1aaebf
Sep 15 13:59:48.910148 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:48.910090    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 15 13:59:48.910231 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:48.910183    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 15 13:59:48.910231 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:48.910212    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 15 13:59:49.766868 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:49.766837    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-14c2563f-openshift-default-579cff8cb8-2hkzj" event={"ID":"9f260fe0-7e7d-47cc-8f41-619e780e7e41","Type":"ContainerStarted","Data":"9e6dce09a2481237fca8ba2efe128d6c2e10221b0677167665343504101ddace"}
Sep 15 13:59:49.767255 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:49.766877    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-14c2563f-openshift-default-579cff8cb8-2hkzj" event={"ID":"9f260fe0-7e7d-47cc-8f41-619e780e7e41","Type":"ContainerStarted","Data":"6e45f8405767d6ca8d66063fd9bfee6e4bc036f04c75cfb11e3a4d029e1aaebf"}
Sep 15 13:59:49.790342 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:49.790294    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-14c2563f-openshift-default-579cff8cb8-2hkzj" podStartSLOduration=1.790279738 podStartE2EDuration="1.790279738s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:59:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:59:49.789053209 +0000 UTC m=+1276.548179507" watchObservedRunningTime="2026-09-15 13:59:49.790279738 +0000 UTC m=+1276.549406026"
Sep 15 13:59:50.496418 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:50.496382    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-14c2563f-openshift-default-579cff8cb8-2hkzj"
Sep 15 13:59:50.501316 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:50.501294    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-14c2563f-openshift-default-579cff8cb8-2hkzj"
Sep 15 13:59:50.773723 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:50.773641    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-14c2563f-openshift-default-579cff8cb8-2hkzj"
Sep 15 13:59:50.774677 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:50.774658    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-14c2563f-openshift-default-579cff8cb8-2hkzj"
Sep 15 13:59:56.253773 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:56.253735    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-66261e/distinct-2-w4-66261e-kserve-5cd847d7db-vc5dv"
Sep 15 13:59:56.254234 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:56.253918    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-66261e/distinct-2-w4-66261e-kserve-5cd847d7db-vc5dv"
Sep 15 13:59:56.267544 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:56.267517    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-66261e/distinct-2-w4-66261e-kserve-5cd847d7db-vc5dv"
Sep 15 13:59:56.818579 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:56.818549    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-66261e/distinct-2-w4-66261e-kserve-5cd847d7db-vc5dv"
Sep 15 13:59:58.491272 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:58.491238    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-14c2563f-7b979dc546-4gjtz"]
Sep 15 13:59:58.494902 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:58.494886    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-14c2563f-7b979dc546-4gjtz"
Sep 15 13:59:58.497248 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:58.497229    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-14c2563f-dockercfg-28rdb\""
Sep 15 13:59:58.497346 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:58.497309    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-14c2563f\""
Sep 15 13:59:58.504995 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:58.504967    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-14c2563f-7b979dc546-4gjtz"]
Sep 15 13:59:58.513413 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:58.513394    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-14c2563f-57cf8b4cdf-tgrkz"]
Sep 15 13:59:58.516680 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:58.516664    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-14c2563f-57cf8b4cdf-tgrkz"
Sep 15 13:59:58.526594 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:58.526573    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-14c2563f-57cf8b4cdf-tgrkz"]
Sep 15 13:59:58.669776 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:58.669736    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txf6k\" (UniqueName: \"kubernetes.io/projected/eff48d41-ad9a-4930-8b37-aaff4c48b225-kube-api-access-txf6k\") pod \"payload-pre-processing-e2e-mt-14c2563f-7b979dc546-4gjtz\" (UID: \"eff48d41-ad9a-4930-8b37-aaff4c48b225\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-14c2563f-7b979dc546-4gjtz"
Sep 15 13:59:58.669954 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:58.669784    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4lz7l\" (UniqueName: \"kubernetes.io/projected/42ca8dbb-e44c-4065-96ba-ba84cd09dd49-kube-api-access-4lz7l\") pod \"payload-processing-e2e-mt-14c2563f-57cf8b4cdf-tgrkz\" (UID: \"42ca8dbb-e44c-4065-96ba-ba84cd09dd49\") " pod="openshift-ingress/payload-processing-e2e-mt-14c2563f-57cf8b4cdf-tgrkz"
Sep 15 13:59:58.669954 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:58.669836    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eff48d41-ad9a-4930-8b37-aaff4c48b225-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-14c2563f-7b979dc546-4gjtz\" (UID: \"eff48d41-ad9a-4930-8b37-aaff4c48b225\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-14c2563f-7b979dc546-4gjtz"
Sep 15 13:59:58.669954 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:58.669868    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/42ca8dbb-e44c-4065-96ba-ba84cd09dd49-plugins-config-volume\") pod \"payload-processing-e2e-mt-14c2563f-57cf8b4cdf-tgrkz\" (UID: \"42ca8dbb-e44c-4065-96ba-ba84cd09dd49\") " pod="openshift-ingress/payload-processing-e2e-mt-14c2563f-57cf8b4cdf-tgrkz"
Sep 15 13:59:58.771066 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:58.770983    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txf6k\" (UniqueName: \"kubernetes.io/projected/eff48d41-ad9a-4930-8b37-aaff4c48b225-kube-api-access-txf6k\") pod \"payload-pre-processing-e2e-mt-14c2563f-7b979dc546-4gjtz\" (UID: \"eff48d41-ad9a-4930-8b37-aaff4c48b225\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-14c2563f-7b979dc546-4gjtz"
Sep 15 13:59:58.771066 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:58.771024    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4lz7l\" (UniqueName: \"kubernetes.io/projected/42ca8dbb-e44c-4065-96ba-ba84cd09dd49-kube-api-access-4lz7l\") pod \"payload-processing-e2e-mt-14c2563f-57cf8b4cdf-tgrkz\" (UID: \"42ca8dbb-e44c-4065-96ba-ba84cd09dd49\") " pod="openshift-ingress/payload-processing-e2e-mt-14c2563f-57cf8b4cdf-tgrkz"
Sep 15 13:59:58.771273 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:58.771081    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eff48d41-ad9a-4930-8b37-aaff4c48b225-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-14c2563f-7b979dc546-4gjtz\" (UID: \"eff48d41-ad9a-4930-8b37-aaff4c48b225\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-14c2563f-7b979dc546-4gjtz"
Sep 15 13:59:58.771312 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:58.771264    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/42ca8dbb-e44c-4065-96ba-ba84cd09dd49-plugins-config-volume\") pod \"payload-processing-e2e-mt-14c2563f-57cf8b4cdf-tgrkz\" (UID: \"42ca8dbb-e44c-4065-96ba-ba84cd09dd49\") " pod="openshift-ingress/payload-processing-e2e-mt-14c2563f-57cf8b4cdf-tgrkz"
Sep 15 13:59:58.771837 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:58.771819    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eff48d41-ad9a-4930-8b37-aaff4c48b225-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-14c2563f-7b979dc546-4gjtz\" (UID: \"eff48d41-ad9a-4930-8b37-aaff4c48b225\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-14c2563f-7b979dc546-4gjtz"
Sep 15 13:59:58.771881 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:58.771846    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/42ca8dbb-e44c-4065-96ba-ba84cd09dd49-plugins-config-volume\") pod \"payload-processing-e2e-mt-14c2563f-57cf8b4cdf-tgrkz\" (UID: \"42ca8dbb-e44c-4065-96ba-ba84cd09dd49\") " pod="openshift-ingress/payload-processing-e2e-mt-14c2563f-57cf8b4cdf-tgrkz"
Sep 15 13:59:58.779409 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:58.779377    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4lz7l\" (UniqueName: \"kubernetes.io/projected/42ca8dbb-e44c-4065-96ba-ba84cd09dd49-kube-api-access-4lz7l\") pod \"payload-processing-e2e-mt-14c2563f-57cf8b4cdf-tgrkz\" (UID: \"42ca8dbb-e44c-4065-96ba-ba84cd09dd49\") " pod="openshift-ingress/payload-processing-e2e-mt-14c2563f-57cf8b4cdf-tgrkz"
Sep 15 13:59:58.779635 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:58.779619    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-txf6k\" (UniqueName: \"kubernetes.io/projected/eff48d41-ad9a-4930-8b37-aaff4c48b225-kube-api-access-txf6k\") pod \"payload-pre-processing-e2e-mt-14c2563f-7b979dc546-4gjtz\" (UID: \"eff48d41-ad9a-4930-8b37-aaff4c48b225\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-14c2563f-7b979dc546-4gjtz"
Sep 15 13:59:58.806598 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:58.806559    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-14c2563f-7b979dc546-4gjtz"
Sep 15 13:59:58.828253 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:58.828230    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-14c2563f-57cf8b4cdf-tgrkz"
Sep 15 13:59:59.084492 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:59.084468    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-14c2563f-7b979dc546-4gjtz"]
Sep 15 13:59:59.085714 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:59:59.085680    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeff48d41_ad9a_4930_8b37_aaff4c48b225.slice/crio-0dad2813546c176813413fab92ed30e675ccb80e2fe58777c2ecf325c3c69ad5 WatchSource:0}: Error finding container 0dad2813546c176813413fab92ed30e675ccb80e2fe58777c2ecf325c3c69ad5: Status 404 returned error can't find the container with id 0dad2813546c176813413fab92ed30e675ccb80e2fe58777c2ecf325c3c69ad5
Sep 15 13:59:59.116802 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:59.116781    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-14c2563f-57cf8b4cdf-tgrkz"]
Sep 15 13:59:59.122191 ip-10-0-128-41 kubenswrapper[2578]: W0915 13:59:59.122157    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42ca8dbb_e44c_4065_96ba_ba84cd09dd49.slice/crio-745812d5d1b234f555ef7e2f29dbba266f24ef8189c8dfc63d8fef1457dd7660 WatchSource:0}: Error finding container 745812d5d1b234f555ef7e2f29dbba266f24ef8189c8dfc63d8fef1457dd7660: Status 404 returned error can't find the container with id 745812d5d1b234f555ef7e2f29dbba266f24ef8189c8dfc63d8fef1457dd7660
Sep 15 13:59:59.828041 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:59.828009    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-14c2563f-57cf8b4cdf-tgrkz" event={"ID":"42ca8dbb-e44c-4065-96ba-ba84cd09dd49","Type":"ContainerStarted","Data":"c69b152c5cf12f3fc30b082558b21c0f33f59fb2787af7b7ba43b76aad66397c"}
Sep 15 13:59:59.828505 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:59.828059    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-14c2563f-57cf8b4cdf-tgrkz" event={"ID":"42ca8dbb-e44c-4065-96ba-ba84cd09dd49","Type":"ContainerStarted","Data":"745812d5d1b234f555ef7e2f29dbba266f24ef8189c8dfc63d8fef1457dd7660"}
Sep 15 13:59:59.828505 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:59.828104    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-14c2563f-57cf8b4cdf-tgrkz"
Sep 15 13:59:59.829824 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:59.829801    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-14c2563f-7b979dc546-4gjtz" event={"ID":"eff48d41-ad9a-4930-8b37-aaff4c48b225","Type":"ContainerStarted","Data":"47863b60b12534c6f1f237dbb103357818b0eb97f89b0d7fcd211de74b864634"}
Sep 15 13:59:59.829920 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:59.829850    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-14c2563f-7b979dc546-4gjtz" event={"ID":"eff48d41-ad9a-4930-8b37-aaff4c48b225","Type":"ContainerStarted","Data":"0dad2813546c176813413fab92ed30e675ccb80e2fe58777c2ecf325c3c69ad5"}
Sep 15 13:59:59.829920 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:59.829879    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-14c2563f-7b979dc546-4gjtz"
Sep 15 13:59:59.850819 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:59.849523    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-14c2563f-57cf8b4cdf-tgrkz" podStartSLOduration=1.849503752 podStartE2EDuration="1.849503752s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:59:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:59:59.845953008 +0000 UTC m=+1286.605079304" watchObservedRunningTime="2026-09-15 13:59:59.849503752 +0000 UTC m=+1286.608630038"
Sep 15 13:59:59.863994 ip-10-0-128-41 kubenswrapper[2578]: I0915 13:59:59.863940    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-14c2563f-7b979dc546-4gjtz" podStartSLOduration=1.863916572 podStartE2EDuration="1.863916572s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:59:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:59:59.862258957 +0000 UTC m=+1286.621385268" watchObservedRunningTime="2026-09-15 13:59:59.863916572 +0000 UTC m=+1286.623042863"
Sep 15 14:00:00.143626 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:00.143539    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-2aa332-29824680-n647m"]
Sep 15 14:00:00.147271 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:00.147246    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-4441a1-29824680-5hlnr"]
Sep 15 14:00:00.147415 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:00.147394    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-2aa332-29824680-n647m"
Sep 15 14:00:00.150217 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:00.150197    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 14:00:00.150331 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:00.150248    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 15 14:00:00.150413 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:00.150399    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qzmkv\""
Sep 15 14:00:00.150851 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:00.150835    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29824680-s9fdj"]
Sep 15 14:00:00.150958 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:00.150944    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-4441a1-29824680-5hlnr"
Sep 15 14:00:00.154593 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:00.154576    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824680-s9fdj"
Sep 15 14:00:00.159824 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:00.159803    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-4441a1-29824680-5hlnr"]
Sep 15 14:00:00.163708 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:00.163683    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-2aa332-29824680-n647m"]
Sep 15 14:00:00.168174 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:00.168152    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29824680-s9fdj"]
Sep 15 14:00:00.173942 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:00.173918    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-14c2563f-29824680-b59hj"]
Sep 15 14:00:00.177366 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:00.177348    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-14c2563f-29824680-b59hj"
Sep 15 14:00:00.190015 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:00.189580    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-14c2563f-29824680-b59hj"]
Sep 15 14:00:00.286628 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:00.286592    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75h9q\" (UniqueName: \"kubernetes.io/projected/0b733285-2d1c-4ad2-8551-94c8d89cd1a3-kube-api-access-75h9q\") pod \"maas-api-key-cleanup-e2e-inf-b-2aa332-29824680-n647m\" (UID: \"0b733285-2d1c-4ad2-8551-94c8d89cd1a3\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-2aa332-29824680-n647m"
Sep 15 14:00:00.286841 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:00.286661    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdt8f\" (UniqueName: \"kubernetes.io/projected/19766772-6ae9-4d82-8768-cac7f2dfea80-kube-api-access-kdt8f\") pod \"maas-api-key-cleanup-29824680-s9fdj\" (UID: \"19766772-6ae9-4d82-8768-cac7f2dfea80\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824680-s9fdj"
Sep 15 14:00:00.286841 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:00.286732    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sf74j\" (UniqueName: \"kubernetes.io/projected/f6a51ab4-59f1-49ab-8e3c-3d84f45b42cb-kube-api-access-sf74j\") pod \"maas-api-key-cleanup-e2e-mt-14c2563f-29824680-b59hj\" (UID: \"f6a51ab4-59f1-49ab-8e3c-3d84f45b42cb\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-14c2563f-29824680-b59hj"
Sep 15 14:00:00.286841 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:00.286817    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cb7np\" (UniqueName: \"kubernetes.io/projected/2d17f181-77aa-4775-9613-f7fdc04ce7a7-kube-api-access-cb7np\") pod \"maas-api-key-cleanup-e2e-inf-a-4441a1-29824680-5hlnr\" (UID: \"2d17f181-77aa-4775-9613-f7fdc04ce7a7\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-4441a1-29824680-5hlnr"
Sep 15 14:00:00.388247 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:00.388215    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdt8f\" (UniqueName: \"kubernetes.io/projected/19766772-6ae9-4d82-8768-cac7f2dfea80-kube-api-access-kdt8f\") pod \"maas-api-key-cleanup-29824680-s9fdj\" (UID: \"19766772-6ae9-4d82-8768-cac7f2dfea80\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824680-s9fdj"
Sep 15 14:00:00.388247 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:00.388247    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sf74j\" (UniqueName: \"kubernetes.io/projected/f6a51ab4-59f1-49ab-8e3c-3d84f45b42cb-kube-api-access-sf74j\") pod \"maas-api-key-cleanup-e2e-mt-14c2563f-29824680-b59hj\" (UID: \"f6a51ab4-59f1-49ab-8e3c-3d84f45b42cb\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-14c2563f-29824680-b59hj"
Sep 15 14:00:00.388495 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:00.388444    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cb7np\" (UniqueName: \"kubernetes.io/projected/2d17f181-77aa-4775-9613-f7fdc04ce7a7-kube-api-access-cb7np\") pod \"maas-api-key-cleanup-e2e-inf-a-4441a1-29824680-5hlnr\" (UID: \"2d17f181-77aa-4775-9613-f7fdc04ce7a7\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-4441a1-29824680-5hlnr"
Sep 15 14:00:00.388561 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:00.388541    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75h9q\" (UniqueName: \"kubernetes.io/projected/0b733285-2d1c-4ad2-8551-94c8d89cd1a3-kube-api-access-75h9q\") pod \"maas-api-key-cleanup-e2e-inf-b-2aa332-29824680-n647m\" (UID: \"0b733285-2d1c-4ad2-8551-94c8d89cd1a3\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-2aa332-29824680-n647m"
Sep 15 14:00:00.397338 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:00.397284    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdt8f\" (UniqueName: \"kubernetes.io/projected/19766772-6ae9-4d82-8768-cac7f2dfea80-kube-api-access-kdt8f\") pod \"maas-api-key-cleanup-29824680-s9fdj\" (UID: \"19766772-6ae9-4d82-8768-cac7f2dfea80\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824680-s9fdj"
Sep 15 14:00:00.397459 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:00.397432    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sf74j\" (UniqueName: \"kubernetes.io/projected/f6a51ab4-59f1-49ab-8e3c-3d84f45b42cb-kube-api-access-sf74j\") pod \"maas-api-key-cleanup-e2e-mt-14c2563f-29824680-b59hj\" (UID: \"f6a51ab4-59f1-49ab-8e3c-3d84f45b42cb\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-14c2563f-29824680-b59hj"
Sep 15 14:00:00.397878 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:00.397860    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-75h9q\" (UniqueName: \"kubernetes.io/projected/0b733285-2d1c-4ad2-8551-94c8d89cd1a3-kube-api-access-75h9q\") pod \"maas-api-key-cleanup-e2e-inf-b-2aa332-29824680-n647m\" (UID: \"0b733285-2d1c-4ad2-8551-94c8d89cd1a3\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-2aa332-29824680-n647m"
Sep 15 14:00:00.398035 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:00.398016    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cb7np\" (UniqueName: \"kubernetes.io/projected/2d17f181-77aa-4775-9613-f7fdc04ce7a7-kube-api-access-cb7np\") pod \"maas-api-key-cleanup-e2e-inf-a-4441a1-29824680-5hlnr\" (UID: \"2d17f181-77aa-4775-9613-f7fdc04ce7a7\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-4441a1-29824680-5hlnr"
Sep 15 14:00:00.462343 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:00.462306    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-2aa332-29824680-n647m"
Sep 15 14:00:00.472690 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:00.472664    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-4441a1-29824680-5hlnr"
Sep 15 14:00:00.482667 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:00.482644    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824680-s9fdj"
Sep 15 14:00:00.494002 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:00.493974    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-14c2563f-29824680-b59hj"
Sep 15 14:00:00.746270 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:00.746227    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-2aa332-29824680-n647m"]
Sep 15 14:00:00.747271 ip-10-0-128-41 kubenswrapper[2578]: W0915 14:00:00.747244    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b733285_2d1c_4ad2_8551_94c8d89cd1a3.slice/crio-e777d58170500b062c50188c7d2c0ed3ec613ad6b9cd7d78f5485450ef66855d WatchSource:0}: Error finding container e777d58170500b062c50188c7d2c0ed3ec613ad6b9cd7d78f5485450ef66855d: Status 404 returned error can't find the container with id e777d58170500b062c50188c7d2c0ed3ec613ad6b9cd7d78f5485450ef66855d
Sep 15 14:00:00.766455 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:00.766431    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-4441a1-29824680-5hlnr"]
Sep 15 14:00:00.767708 ip-10-0-128-41 kubenswrapper[2578]: W0915 14:00:00.767678    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d17f181_77aa_4775_9613_f7fdc04ce7a7.slice/crio-874aba819fb4a4346643979dcdd94ae008976133d897a5ce0b714d8f0559bfc8 WatchSource:0}: Error finding container 874aba819fb4a4346643979dcdd94ae008976133d897a5ce0b714d8f0559bfc8: Status 404 returned error can't find the container with id 874aba819fb4a4346643979dcdd94ae008976133d897a5ce0b714d8f0559bfc8
Sep 15 14:00:00.783423 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:00.783393    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29824680-s9fdj"]
Sep 15 14:00:00.784600 ip-10-0-128-41 kubenswrapper[2578]: W0915 14:00:00.784576    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19766772_6ae9_4d82_8768_cac7f2dfea80.slice/crio-67900e855e8e7f631256d3337e2524a3da0f775f609feb61dc1f1f7f81378d92 WatchSource:0}: Error finding container 67900e855e8e7f631256d3337e2524a3da0f775f609feb61dc1f1f7f81378d92: Status 404 returned error can't find the container with id 67900e855e8e7f631256d3337e2524a3da0f775f609feb61dc1f1f7f81378d92
Sep 15 14:00:00.790730 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:00.790706    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-14c2563f-29824680-b59hj"]
Sep 15 14:00:00.793398 ip-10-0-128-41 kubenswrapper[2578]: W0915 14:00:00.793377    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6a51ab4_59f1_49ab_8e3c_3d84f45b42cb.slice/crio-87818e7a7cf7d1c21ce94ff8f19aaa5ca394291d854012e81d6119a4ceb1b960 WatchSource:0}: Error finding container 87818e7a7cf7d1c21ce94ff8f19aaa5ca394291d854012e81d6119a4ceb1b960: Status 404 returned error can't find the container with id 87818e7a7cf7d1c21ce94ff8f19aaa5ca394291d854012e81d6119a4ceb1b960
Sep 15 14:00:00.838046 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:00.838013    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-4441a1-29824680-5hlnr" event={"ID":"2d17f181-77aa-4775-9613-f7fdc04ce7a7","Type":"ContainerStarted","Data":"874aba819fb4a4346643979dcdd94ae008976133d897a5ce0b714d8f0559bfc8"}
Sep 15 14:00:00.839375 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:00.839351    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824680-s9fdj" event={"ID":"19766772-6ae9-4d82-8768-cac7f2dfea80","Type":"ContainerStarted","Data":"67900e855e8e7f631256d3337e2524a3da0f775f609feb61dc1f1f7f81378d92"}
Sep 15 14:00:00.840525 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:00.840506    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-14c2563f-29824680-b59hj" event={"ID":"f6a51ab4-59f1-49ab-8e3c-3d84f45b42cb","Type":"ContainerStarted","Data":"87818e7a7cf7d1c21ce94ff8f19aaa5ca394291d854012e81d6119a4ceb1b960"}
Sep 15 14:00:00.841624 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:00.841604    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-2aa332-29824680-n647m" event={"ID":"0b733285-2d1c-4ad2-8551-94c8d89cd1a3","Type":"ContainerStarted","Data":"e777d58170500b062c50188c7d2c0ed3ec613ad6b9cd7d78f5485450ef66855d"}
Sep 15 14:00:01.849568 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:01.849534    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-4441a1-29824680-5hlnr" event={"ID":"2d17f181-77aa-4775-9613-f7fdc04ce7a7","Type":"ContainerStarted","Data":"bb841847de8c5f654802f674a19bef62c9485858edc0fb192c9891ed6c1e878f"}
Sep 15 14:00:01.851057 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:01.851032    2578 generic.go:356] "Generic (PLEG): container finished" podID="19766772-6ae9-4d82-8768-cac7f2dfea80" containerID="a562ee1c2e3baa1a18e1de4e2ac8704cb4cd98b7b89d9629c96fe06e6e68ed04" exitCode=0
Sep 15 14:00:01.851192 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:01.851114    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824680-s9fdj" event={"ID":"19766772-6ae9-4d82-8768-cac7f2dfea80","Type":"ContainerDied","Data":"a562ee1c2e3baa1a18e1de4e2ac8704cb4cd98b7b89d9629c96fe06e6e68ed04"}
Sep 15 14:00:01.852772 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:01.852750    2578 generic.go:356] "Generic (PLEG): container finished" podID="f6a51ab4-59f1-49ab-8e3c-3d84f45b42cb" containerID="d9e6556115f6585818dc33f437d3610166a06df013b1414cc92a95ec8d1f83f4" exitCode=7
Sep 15 14:00:01.852866 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:01.852777    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-14c2563f-29824680-b59hj" event={"ID":"f6a51ab4-59f1-49ab-8e3c-3d84f45b42cb","Type":"ContainerDied","Data":"d9e6556115f6585818dc33f437d3610166a06df013b1414cc92a95ec8d1f83f4"}
Sep 15 14:00:01.852978 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:01.852963    2578 scope.go:117] "RemoveContainer" containerID="d9e6556115f6585818dc33f437d3610166a06df013b1414cc92a95ec8d1f83f4"
Sep 15 14:00:01.854498 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:01.854477    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-2aa332-29824680-n647m" event={"ID":"0b733285-2d1c-4ad2-8551-94c8d89cd1a3","Type":"ContainerStarted","Data":"d45fa55fdd7f7bacbf0b2ff87d105c7a8639f4d455ea3e2e2f5b6622df39eb98"}
Sep 15 14:00:01.868017 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:01.867963    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-4441a1-29824680-5hlnr" podStartSLOduration=1.86794327 podStartE2EDuration="1.86794327s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 14:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 14:00:01.865433905 +0000 UTC m=+1288.624560191" watchObservedRunningTime="2026-09-15 14:00:01.86794327 +0000 UTC m=+1288.627069556"
Sep 15 14:00:01.881648 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:01.881607    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-2aa332-29824680-n647m" podStartSLOduration=1.88159258 podStartE2EDuration="1.88159258s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 14:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 14:00:01.880398455 +0000 UTC m=+1288.639524741" watchObservedRunningTime="2026-09-15 14:00:01.88159258 +0000 UTC m=+1288.640718865"
Sep 15 14:00:02.862496 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:02.862406    2578 generic.go:356] "Generic (PLEG): container finished" podID="f6a51ab4-59f1-49ab-8e3c-3d84f45b42cb" containerID="15e0db0ae2076eadf02a0ff95bf303329c0daa94aca50155e58dafc23548152f" exitCode=7
Sep 15 14:00:02.862496 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:02.862485    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-14c2563f-29824680-b59hj" event={"ID":"f6a51ab4-59f1-49ab-8e3c-3d84f45b42cb","Type":"ContainerDied","Data":"15e0db0ae2076eadf02a0ff95bf303329c0daa94aca50155e58dafc23548152f"}
Sep 15 14:00:02.862964 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:02.862536    2578 scope.go:117] "RemoveContainer" containerID="d9e6556115f6585818dc33f437d3610166a06df013b1414cc92a95ec8d1f83f4"
Sep 15 14:00:02.862964 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:02.862713    2578 scope.go:117] "RemoveContainer" containerID="15e0db0ae2076eadf02a0ff95bf303329c0daa94aca50155e58dafc23548152f"
Sep 15 14:00:02.863068 ip-10-0-128-41 kubenswrapper[2578]: E0915 14:00:02.862963    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-mt-14c2563f-29824680-b59hj_odh-ai-gateway-infra(f6a51ab4-59f1-49ab-8e3c-3d84f45b42cb)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-14c2563f-29824680-b59hj" podUID="f6a51ab4-59f1-49ab-8e3c-3d84f45b42cb"
Sep 15 14:00:02.864199 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:02.864176    2578 generic.go:356] "Generic (PLEG): container finished" podID="0b733285-2d1c-4ad2-8551-94c8d89cd1a3" containerID="d45fa55fdd7f7bacbf0b2ff87d105c7a8639f4d455ea3e2e2f5b6622df39eb98" exitCode=0
Sep 15 14:00:02.864302 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:02.864258    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-2aa332-29824680-n647m" event={"ID":"0b733285-2d1c-4ad2-8551-94c8d89cd1a3","Type":"ContainerDied","Data":"d45fa55fdd7f7bacbf0b2ff87d105c7a8639f4d455ea3e2e2f5b6622df39eb98"}
Sep 15 14:00:02.865718 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:02.865700    2578 generic.go:356] "Generic (PLEG): container finished" podID="2d17f181-77aa-4775-9613-f7fdc04ce7a7" containerID="bb841847de8c5f654802f674a19bef62c9485858edc0fb192c9891ed6c1e878f" exitCode=0
Sep 15 14:00:02.865802 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:02.865761    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-4441a1-29824680-5hlnr" event={"ID":"2d17f181-77aa-4775-9613-f7fdc04ce7a7","Type":"ContainerDied","Data":"bb841847de8c5f654802f674a19bef62c9485858edc0fb192c9891ed6c1e878f"}
Sep 15 14:00:03.006798 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:03.006773    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824680-s9fdj"
Sep 15 14:00:03.016029 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:03.016007    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kdt8f\" (UniqueName: \"kubernetes.io/projected/19766772-6ae9-4d82-8768-cac7f2dfea80-kube-api-access-kdt8f\") pod \"19766772-6ae9-4d82-8768-cac7f2dfea80\" (UID: \"19766772-6ae9-4d82-8768-cac7f2dfea80\") "
Sep 15 14:00:03.018011 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:03.017980    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19766772-6ae9-4d82-8768-cac7f2dfea80-kube-api-access-kdt8f" (OuterVolumeSpecName: "kube-api-access-kdt8f") pod "19766772-6ae9-4d82-8768-cac7f2dfea80" (UID: "19766772-6ae9-4d82-8768-cac7f2dfea80"). InnerVolumeSpecName "kube-api-access-kdt8f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 14:00:03.117534 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:03.117449    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kdt8f\" (UniqueName: \"kubernetes.io/projected/19766772-6ae9-4d82-8768-cac7f2dfea80-kube-api-access-kdt8f\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:00:03.873198 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:03.873170    2578 scope.go:117] "RemoveContainer" containerID="15e0db0ae2076eadf02a0ff95bf303329c0daa94aca50155e58dafc23548152f"
Sep 15 14:00:03.873694 ip-10-0-128-41 kubenswrapper[2578]: E0915 14:00:03.873453    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-mt-14c2563f-29824680-b59hj_odh-ai-gateway-infra(f6a51ab4-59f1-49ab-8e3c-3d84f45b42cb)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-14c2563f-29824680-b59hj" podUID="f6a51ab4-59f1-49ab-8e3c-3d84f45b42cb"
Sep 15 14:00:03.874343 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:03.874320    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824680-s9fdj"
Sep 15 14:00:03.874475 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:03.874361    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824680-s9fdj" event={"ID":"19766772-6ae9-4d82-8768-cac7f2dfea80","Type":"ContainerDied","Data":"67900e855e8e7f631256d3337e2524a3da0f775f609feb61dc1f1f7f81378d92"}
Sep 15 14:00:03.874475 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:03.874415    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="67900e855e8e7f631256d3337e2524a3da0f775f609feb61dc1f1f7f81378d92"
Sep 15 14:00:04.036419 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:04.036399    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-4441a1-29824680-5hlnr"
Sep 15 14:00:04.038369 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:04.038354    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-2aa332-29824680-n647m"
Sep 15 14:00:04.127333 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:04.127301    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cb7np\" (UniqueName: \"kubernetes.io/projected/2d17f181-77aa-4775-9613-f7fdc04ce7a7-kube-api-access-cb7np\") pod \"2d17f181-77aa-4775-9613-f7fdc04ce7a7\" (UID: \"2d17f181-77aa-4775-9613-f7fdc04ce7a7\") "
Sep 15 14:00:04.127545 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:04.127368    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-75h9q\" (UniqueName: \"kubernetes.io/projected/0b733285-2d1c-4ad2-8551-94c8d89cd1a3-kube-api-access-75h9q\") pod \"0b733285-2d1c-4ad2-8551-94c8d89cd1a3\" (UID: \"0b733285-2d1c-4ad2-8551-94c8d89cd1a3\") "
Sep 15 14:00:04.129575 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:04.129544    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d17f181-77aa-4775-9613-f7fdc04ce7a7-kube-api-access-cb7np" (OuterVolumeSpecName: "kube-api-access-cb7np") pod "2d17f181-77aa-4775-9613-f7fdc04ce7a7" (UID: "2d17f181-77aa-4775-9613-f7fdc04ce7a7"). InnerVolumeSpecName "kube-api-access-cb7np". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 14:00:04.129692 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:04.129660    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b733285-2d1c-4ad2-8551-94c8d89cd1a3-kube-api-access-75h9q" (OuterVolumeSpecName: "kube-api-access-75h9q") pod "0b733285-2d1c-4ad2-8551-94c8d89cd1a3" (UID: "0b733285-2d1c-4ad2-8551-94c8d89cd1a3"). InnerVolumeSpecName "kube-api-access-75h9q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 14:00:04.229078 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:04.229037    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cb7np\" (UniqueName: \"kubernetes.io/projected/2d17f181-77aa-4775-9613-f7fdc04ce7a7-kube-api-access-cb7np\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:00:04.229078 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:04.229070    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-75h9q\" (UniqueName: \"kubernetes.io/projected/0b733285-2d1c-4ad2-8551-94c8d89cd1a3-kube-api-access-75h9q\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:00:04.882681 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:04.882651    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-4441a1-29824680-5hlnr"
Sep 15 14:00:04.883284 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:04.882690    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-4441a1-29824680-5hlnr" event={"ID":"2d17f181-77aa-4775-9613-f7fdc04ce7a7","Type":"ContainerDied","Data":"874aba819fb4a4346643979dcdd94ae008976133d897a5ce0b714d8f0559bfc8"}
Sep 15 14:00:04.883284 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:04.882741    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="874aba819fb4a4346643979dcdd94ae008976133d897a5ce0b714d8f0559bfc8"
Sep 15 14:00:04.884109 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:04.884088    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-2aa332-29824680-n647m" event={"ID":"0b733285-2d1c-4ad2-8551-94c8d89cd1a3","Type":"ContainerDied","Data":"e777d58170500b062c50188c7d2c0ed3ec613ad6b9cd7d78f5485450ef66855d"}
Sep 15 14:00:04.884266 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:04.884135    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e777d58170500b062c50188c7d2c0ed3ec613ad6b9cd7d78f5485450ef66855d"
Sep 15 14:00:04.884266 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:04.884146    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-2aa332-29824680-n647m"
Sep 15 14:00:10.843865 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:10.843833    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-14c2563f-7b979dc546-4gjtz"
Sep 15 14:00:10.844291 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:10.844009    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-14c2563f-57cf8b4cdf-tgrkz"
Sep 15 14:00:17.752730 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:17.752697    2578 scope.go:117] "RemoveContainer" containerID="15e0db0ae2076eadf02a0ff95bf303329c0daa94aca50155e58dafc23548152f"
Sep 15 14:00:18.976470 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:18.976438    2578 generic.go:356] "Generic (PLEG): container finished" podID="f6a51ab4-59f1-49ab-8e3c-3d84f45b42cb" containerID="4bd804373b72ca5285e3b062275be166173871e6035564a8d71999650200054d" exitCode=0
Sep 15 14:00:18.976862 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:18.976518    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-14c2563f-29824680-b59hj" event={"ID":"f6a51ab4-59f1-49ab-8e3c-3d84f45b42cb","Type":"ContainerDied","Data":"4bd804373b72ca5285e3b062275be166173871e6035564a8d71999650200054d"}
Sep 15 14:00:18.976862 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:18.976596    2578 scope.go:117] "RemoveContainer" containerID="15e0db0ae2076eadf02a0ff95bf303329c0daa94aca50155e58dafc23548152f"
Sep 15 14:00:20.012988 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:20.012950    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-14c2563f-29824680-b59hj"]
Sep 15 14:00:20.130531 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:20.130508    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-14c2563f-29824680-b59hj"
Sep 15 14:00:20.188344 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:20.188314    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sf74j\" (UniqueName: \"kubernetes.io/projected/f6a51ab4-59f1-49ab-8e3c-3d84f45b42cb-kube-api-access-sf74j\") pod \"f6a51ab4-59f1-49ab-8e3c-3d84f45b42cb\" (UID: \"f6a51ab4-59f1-49ab-8e3c-3d84f45b42cb\") "
Sep 15 14:00:20.190645 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:20.190615    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6a51ab4-59f1-49ab-8e3c-3d84f45b42cb-kube-api-access-sf74j" (OuterVolumeSpecName: "kube-api-access-sf74j") pod "f6a51ab4-59f1-49ab-8e3c-3d84f45b42cb" (UID: "f6a51ab4-59f1-49ab-8e3c-3d84f45b42cb"). InnerVolumeSpecName "kube-api-access-sf74j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 14:00:20.289514 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:20.289478    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sf74j\" (UniqueName: \"kubernetes.io/projected/f6a51ab4-59f1-49ab-8e3c-3d84f45b42cb-kube-api-access-sf74j\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:00:20.774999 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:20.774961    2578 patch_prober.go:28] interesting pod/e2e-mt-14c2563f-openshift-default-579cff8cb8-2hkzj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused" start-of-body=
Sep 15 14:00:20.775185 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:20.775052    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-14c2563f-openshift-default-579cff8cb8-2hkzj" podUID="9f260fe0-7e7d-47cc-8f41-619e780e7e41" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused"
Sep 15 14:00:20.991463 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:20.991434    2578 generic.go:356] "Generic (PLEG): container finished" podID="9f260fe0-7e7d-47cc-8f41-619e780e7e41" containerID="9e6dce09a2481237fca8ba2efe128d6c2e10221b0677167665343504101ddace" exitCode=0
Sep 15 14:00:20.991647 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:20.991509    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-14c2563f-openshift-default-579cff8cb8-2hkzj" event={"ID":"9f260fe0-7e7d-47cc-8f41-619e780e7e41","Type":"ContainerDied","Data":"9e6dce09a2481237fca8ba2efe128d6c2e10221b0677167665343504101ddace"}
Sep 15 14:00:20.991955 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:20.991935    2578 scope.go:117] "RemoveContainer" containerID="9e6dce09a2481237fca8ba2efe128d6c2e10221b0677167665343504101ddace"
Sep 15 14:00:20.993086 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:20.993068    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-14c2563f-29824680-b59hj"
Sep 15 14:00:20.993216 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:20.993109    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-14c2563f-29824680-b59hj" event={"ID":"f6a51ab4-59f1-49ab-8e3c-3d84f45b42cb","Type":"ContainerDied","Data":"87818e7a7cf7d1c21ce94ff8f19aaa5ca394291d854012e81d6119a4ceb1b960"}
Sep 15 14:00:20.993216 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:20.993169    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="87818e7a7cf7d1c21ce94ff8f19aaa5ca394291d854012e81d6119a4ceb1b960"
Sep 15 14:00:20.993216 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:20.993176    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 15 14:00:20.993328 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:20.993253    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 15 14:00:20.993328 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:20.993299    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 15 14:00:21.048692 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:21.048665    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-14c2563f-29824680-b59hj"]
Sep 15 14:00:21.058842 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:21.058818    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-14c2563f-29824680-b59hj"]
Sep 15 14:00:21.757786 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:21.757753    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f6a51ab4-59f1-49ab-8e3c-3d84f45b42cb" path="/var/lib/kubelet/pods/f6a51ab4-59f1-49ab-8e3c-3d84f45b42cb/volumes"
Sep 15 14:00:22.002161 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:22.002110    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-14c2563f-openshift-default-579cff8cb8-2hkzj" event={"ID":"9f260fe0-7e7d-47cc-8f41-619e780e7e41","Type":"ContainerStarted","Data":"0030ceaec7590e6f9c8fd6d7563a880e9f63d469990b29e23a8ea7c004c169b2"}
Sep 15 14:00:22.496211 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:22.496172    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-14c2563f-openshift-default-579cff8cb8-2hkzj"
Sep 15 14:00:22.496713 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:22.496366    2578 patch_prober.go:28] interesting pod/e2e-mt-14c2563f-openshift-default-579cff8cb8-2hkzj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused" start-of-body=
Sep 15 14:00:22.496713 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:22.496414    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-14c2563f-openshift-default-579cff8cb8-2hkzj" podUID="9f260fe0-7e7d-47cc-8f41-619e780e7e41" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused"
Sep 15 14:00:23.496081 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:23.496044    2578 patch_prober.go:28] interesting pod/e2e-mt-14c2563f-openshift-default-579cff8cb8-2hkzj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused" start-of-body=
Sep 15 14:00:23.496289 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:23.496106    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-14c2563f-openshift-default-579cff8cb8-2hkzj" podUID="9f260fe0-7e7d-47cc-8f41-619e780e7e41" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused"
Sep 15 14:00:24.496236 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:24.496195    2578 patch_prober.go:28] interesting pod/e2e-mt-14c2563f-openshift-default-579cff8cb8-2hkzj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused" start-of-body=
Sep 15 14:00:24.496418 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:24.496264    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-14c2563f-openshift-default-579cff8cb8-2hkzj" podUID="9f260fe0-7e7d-47cc-8f41-619e780e7e41" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused"
Sep 15 14:00:25.495841 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:25.495808    2578 patch_prober.go:28] interesting pod/e2e-mt-14c2563f-openshift-default-579cff8cb8-2hkzj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused" start-of-body=
Sep 15 14:00:25.496042 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:25.495875    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-14c2563f-openshift-default-579cff8cb8-2hkzj" podUID="9f260fe0-7e7d-47cc-8f41-619e780e7e41" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused"
Sep 15 14:00:26.495636 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:26.495596    2578 patch_prober.go:28] interesting pod/e2e-mt-14c2563f-openshift-default-579cff8cb8-2hkzj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused" start-of-body=
Sep 15 14:00:26.495994 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:26.495675    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-14c2563f-openshift-default-579cff8cb8-2hkzj" podUID="9f260fe0-7e7d-47cc-8f41-619e780e7e41" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused"
Sep 15 14:00:27.417787 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:27.417750    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-14c2563f-7hckn"]
Sep 15 14:00:27.418227 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:27.418214    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6a51ab4-59f1-49ab-8e3c-3d84f45b42cb" containerName="cleanup"
Sep 15 14:00:27.418271 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:27.418229    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6a51ab4-59f1-49ab-8e3c-3d84f45b42cb" containerName="cleanup"
Sep 15 14:00:27.418271 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:27.418236    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6a51ab4-59f1-49ab-8e3c-3d84f45b42cb" containerName="cleanup"
Sep 15 14:00:27.418271 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:27.418242    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6a51ab4-59f1-49ab-8e3c-3d84f45b42cb" containerName="cleanup"
Sep 15 14:00:27.418271 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:27.418255    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19766772-6ae9-4d82-8768-cac7f2dfea80" containerName="cleanup"
Sep 15 14:00:27.418271 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:27.418261    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="19766772-6ae9-4d82-8768-cac7f2dfea80" containerName="cleanup"
Sep 15 14:00:27.418427 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:27.418284    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b733285-2d1c-4ad2-8551-94c8d89cd1a3" containerName="cleanup"
Sep 15 14:00:27.418427 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:27.418290    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b733285-2d1c-4ad2-8551-94c8d89cd1a3" containerName="cleanup"
Sep 15 14:00:27.418427 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:27.418301    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d17f181-77aa-4775-9613-f7fdc04ce7a7" containerName="cleanup"
Sep 15 14:00:27.418427 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:27.418306    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d17f181-77aa-4775-9613-f7fdc04ce7a7" containerName="cleanup"
Sep 15 14:00:27.418427 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:27.418363    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d17f181-77aa-4775-9613-f7fdc04ce7a7" containerName="cleanup"
Sep 15 14:00:27.418427 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:27.418371    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6a51ab4-59f1-49ab-8e3c-3d84f45b42cb" containerName="cleanup"
Sep 15 14:00:27.418427 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:27.418378    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6a51ab4-59f1-49ab-8e3c-3d84f45b42cb" containerName="cleanup"
Sep 15 14:00:27.418427 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:27.418384    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="19766772-6ae9-4d82-8768-cac7f2dfea80" containerName="cleanup"
Sep 15 14:00:27.418427 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:27.418391    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b733285-2d1c-4ad2-8551-94c8d89cd1a3" containerName="cleanup"
Sep 15 14:00:27.422531 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:27.422515    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-14c2563f-7hckn"
Sep 15 14:00:27.424992 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:27.424972    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qzmkv\""
Sep 15 14:00:27.425693 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:27.425676    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 14:00:27.427396 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:27.427382    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 15 14:00:27.434725 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:27.434700    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-14c2563f-7hckn"]
Sep 15 14:00:27.528998 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:27.528957    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-14c2563f-openshift-default-579cff8cb8-2hkzj"
Sep 15 14:00:27.529498 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:27.529411    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-14c2563f-openshift-default-579cff8cb8-2hkzj"
Sep 15 14:00:27.531459 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:27.531439    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-14c2563f-openshift-default-579cff8cb8-2hkzj"
Sep 15 14:00:27.564220 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:27.564186    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zz4zx\" (UniqueName: \"kubernetes.io/projected/e0294c28-7634-48b1-882b-da88a49333f4-kube-api-access-zz4zx\") pod \"maas-api-revoke-keys-e2e-mt-14c2563f-7hckn\" (UID: \"e0294c28-7634-48b1-882b-da88a49333f4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-14c2563f-7hckn"
Sep 15 14:00:27.564377 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:27.564262    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0294c28-7634-48b1-882b-da88a49333f4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-14c2563f-7hckn\" (UID: \"e0294c28-7634-48b1-882b-da88a49333f4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-14c2563f-7hckn"
Sep 15 14:00:27.665862 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:27.665827    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zz4zx\" (UniqueName: \"kubernetes.io/projected/e0294c28-7634-48b1-882b-da88a49333f4-kube-api-access-zz4zx\") pod \"maas-api-revoke-keys-e2e-mt-14c2563f-7hckn\" (UID: \"e0294c28-7634-48b1-882b-da88a49333f4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-14c2563f-7hckn"
Sep 15 14:00:27.666025 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:27.665961    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0294c28-7634-48b1-882b-da88a49333f4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-14c2563f-7hckn\" (UID: \"e0294c28-7634-48b1-882b-da88a49333f4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-14c2563f-7hckn"
Sep 15 14:00:27.666565 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:27.666544    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0294c28-7634-48b1-882b-da88a49333f4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-14c2563f-7hckn\" (UID: \"e0294c28-7634-48b1-882b-da88a49333f4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-14c2563f-7hckn"
Sep 15 14:00:27.674720 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:27.674651    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zz4zx\" (UniqueName: \"kubernetes.io/projected/e0294c28-7634-48b1-882b-da88a49333f4-kube-api-access-zz4zx\") pod \"maas-api-revoke-keys-e2e-mt-14c2563f-7hckn\" (UID: \"e0294c28-7634-48b1-882b-da88a49333f4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-14c2563f-7hckn"
Sep 15 14:00:27.733788 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:27.733755    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-14c2563f-7hckn"
Sep 15 14:00:28.007942 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:28.007918    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-14c2563f-7hckn"]
Sep 15 14:00:28.009619 ip-10-0-128-41 kubenswrapper[2578]: W0915 14:00:28.009596    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0294c28_7634_48b1_882b_da88a49333f4.slice/crio-1b89f5e9ad3c8a82c03de1cf886bd05a674f58c2f099daa768adf00a823885ba WatchSource:0}: Error finding container 1b89f5e9ad3c8a82c03de1cf886bd05a674f58c2f099daa768adf00a823885ba: Status 404 returned error can't find the container with id 1b89f5e9ad3c8a82c03de1cf886bd05a674f58c2f099daa768adf00a823885ba
Sep 15 14:00:28.045733 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:28.045702    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-14c2563f-7hckn" event={"ID":"e0294c28-7634-48b1-882b-da88a49333f4","Type":"ContainerStarted","Data":"1b89f5e9ad3c8a82c03de1cf886bd05a674f58c2f099daa768adf00a823885ba"}
Sep 15 14:00:29.053743 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:29.053701    2578 generic.go:356] "Generic (PLEG): container finished" podID="e0294c28-7634-48b1-882b-da88a49333f4" containerID="53635739e4ed51aa32d89c2d44f2ce02094eb5871f4682569d78afadfa6e7259" exitCode=0
Sep 15 14:00:29.054231 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:29.053786    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-14c2563f-7hckn" event={"ID":"e0294c28-7634-48b1-882b-da88a49333f4","Type":"ContainerDied","Data":"53635739e4ed51aa32d89c2d44f2ce02094eb5871f4682569d78afadfa6e7259"}
Sep 15 14:00:30.194841 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:30.194816    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-14c2563f-7hckn"
Sep 15 14:00:30.296251 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:30.296221    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0294c28-7634-48b1-882b-da88a49333f4-maas-api-service-ca\") pod \"e0294c28-7634-48b1-882b-da88a49333f4\" (UID: \"e0294c28-7634-48b1-882b-da88a49333f4\") "
Sep 15 14:00:30.296412 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:30.296291    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zz4zx\" (UniqueName: \"kubernetes.io/projected/e0294c28-7634-48b1-882b-da88a49333f4-kube-api-access-zz4zx\") pod \"e0294c28-7634-48b1-882b-da88a49333f4\" (UID: \"e0294c28-7634-48b1-882b-da88a49333f4\") "
Sep 15 14:00:30.296657 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:30.296633    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0294c28-7634-48b1-882b-da88a49333f4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e0294c28-7634-48b1-882b-da88a49333f4" (UID: "e0294c28-7634-48b1-882b-da88a49333f4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 14:00:30.296729 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:30.296712    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0294c28-7634-48b1-882b-da88a49333f4-maas-api-service-ca\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:00:30.298512 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:30.298490    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0294c28-7634-48b1-882b-da88a49333f4-kube-api-access-zz4zx" (OuterVolumeSpecName: "kube-api-access-zz4zx") pod "e0294c28-7634-48b1-882b-da88a49333f4" (UID: "e0294c28-7634-48b1-882b-da88a49333f4"). InnerVolumeSpecName "kube-api-access-zz4zx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 14:00:30.398250 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:30.398159    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zz4zx\" (UniqueName: \"kubernetes.io/projected/e0294c28-7634-48b1-882b-da88a49333f4-kube-api-access-zz4zx\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:00:31.066966 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:31.066936    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-14c2563f-7hckn"
Sep 15 14:00:31.067178 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:31.066969    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-14c2563f-7hckn" event={"ID":"e0294c28-7634-48b1-882b-da88a49333f4","Type":"ContainerDied","Data":"1b89f5e9ad3c8a82c03de1cf886bd05a674f58c2f099daa768adf00a823885ba"}
Sep 15 14:00:31.067178 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:31.067016    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1b89f5e9ad3c8a82c03de1cf886bd05a674f58c2f099daa768adf00a823885ba"
Sep 15 14:00:33.969366 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:33.969331    2578 scope.go:117] "RemoveContainer" containerID="7987fa5366b2c0dc62e45a6d45514767eba25985cf38d25a9cba6db231364e0b"
Sep 15 14:00:33.978317 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:33.978290    2578 scope.go:117] "RemoveContainer" containerID="a803aa68c222e88ce257f1630007367560e60ba76a2abcc573dc345cc2cfb5a6"
Sep 15 14:00:33.986465 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:33.986432    2578 scope.go:117] "RemoveContainer" containerID="0dd5283cb14c439c74887f1cae2e293a67649aefe408feddd487bdfc307b4175"
Sep 15 14:00:37.948192 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:37.948150    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-14c2563f-57cf8b4cdf-tgrkz"]
Sep 15 14:00:37.948710 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:37.948385    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-14c2563f-57cf8b4cdf-tgrkz" podUID="42ca8dbb-e44c-4065-96ba-ba84cd09dd49" containerName="payload-processing" containerID="cri-o://c69b152c5cf12f3fc30b082558b21c0f33f59fb2787af7b7ba43b76aad66397c" gracePeriod=30
Sep 15 14:00:37.962733 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:37.962706    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-14c2563f-7b979dc546-4gjtz"]
Sep 15 14:00:37.962987 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:37.962963    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-14c2563f-7b979dc546-4gjtz" podUID="eff48d41-ad9a-4930-8b37-aaff4c48b225" containerName="payload-pre-processing" containerID="cri-o://47863b60b12534c6f1f237dbb103357818b0eb97f89b0d7fcd211de74b864634" gracePeriod=30
Sep 15 14:00:38.113204 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:38.113171    2578 generic.go:356] "Generic (PLEG): container finished" podID="42ca8dbb-e44c-4065-96ba-ba84cd09dd49" containerID="c69b152c5cf12f3fc30b082558b21c0f33f59fb2787af7b7ba43b76aad66397c" exitCode=0
Sep 15 14:00:38.113391 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:38.113244    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-14c2563f-57cf8b4cdf-tgrkz" event={"ID":"42ca8dbb-e44c-4065-96ba-ba84cd09dd49","Type":"ContainerDied","Data":"c69b152c5cf12f3fc30b082558b21c0f33f59fb2787af7b7ba43b76aad66397c"}
Sep 15 14:00:38.114567 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:38.114546    2578 generic.go:356] "Generic (PLEG): container finished" podID="eff48d41-ad9a-4930-8b37-aaff4c48b225" containerID="47863b60b12534c6f1f237dbb103357818b0eb97f89b0d7fcd211de74b864634" exitCode=0
Sep 15 14:00:38.114680 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:38.114636    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-14c2563f-7b979dc546-4gjtz" event={"ID":"eff48d41-ad9a-4930-8b37-aaff4c48b225","Type":"ContainerDied","Data":"47863b60b12534c6f1f237dbb103357818b0eb97f89b0d7fcd211de74b864634"}
Sep 15 14:00:38.126930 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:38.126909    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-14c2563f-7hckn"]
Sep 15 14:00:38.132902 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:38.130768    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-14c2563f-7hckn"]
Sep 15 14:00:38.248849 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:38.248828    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-14c2563f-57cf8b4cdf-tgrkz"
Sep 15 14:00:38.251857 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:38.251837    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-14c2563f-7b979dc546-4gjtz"
Sep 15 14:00:38.384200 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:38.384159    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-txf6k\" (UniqueName: \"kubernetes.io/projected/eff48d41-ad9a-4930-8b37-aaff4c48b225-kube-api-access-txf6k\") pod \"eff48d41-ad9a-4930-8b37-aaff4c48b225\" (UID: \"eff48d41-ad9a-4930-8b37-aaff4c48b225\") "
Sep 15 14:00:38.384200 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:38.384200    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eff48d41-ad9a-4930-8b37-aaff4c48b225-plugins-config-volume\") pod \"eff48d41-ad9a-4930-8b37-aaff4c48b225\" (UID: \"eff48d41-ad9a-4930-8b37-aaff4c48b225\") "
Sep 15 14:00:38.384489 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:38.384240    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/42ca8dbb-e44c-4065-96ba-ba84cd09dd49-plugins-config-volume\") pod \"42ca8dbb-e44c-4065-96ba-ba84cd09dd49\" (UID: \"42ca8dbb-e44c-4065-96ba-ba84cd09dd49\") "
Sep 15 14:00:38.384489 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:38.384271    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4lz7l\" (UniqueName: \"kubernetes.io/projected/42ca8dbb-e44c-4065-96ba-ba84cd09dd49-kube-api-access-4lz7l\") pod \"42ca8dbb-e44c-4065-96ba-ba84cd09dd49\" (UID: \"42ca8dbb-e44c-4065-96ba-ba84cd09dd49\") "
Sep 15 14:00:38.384685 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:38.384659    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42ca8dbb-e44c-4065-96ba-ba84cd09dd49-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "42ca8dbb-e44c-4065-96ba-ba84cd09dd49" (UID: "42ca8dbb-e44c-4065-96ba-ba84cd09dd49"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 14:00:38.384773 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:38.384723    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eff48d41-ad9a-4930-8b37-aaff4c48b225-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "eff48d41-ad9a-4930-8b37-aaff4c48b225" (UID: "eff48d41-ad9a-4930-8b37-aaff4c48b225"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 14:00:38.386647 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:38.386616    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eff48d41-ad9a-4930-8b37-aaff4c48b225-kube-api-access-txf6k" (OuterVolumeSpecName: "kube-api-access-txf6k") pod "eff48d41-ad9a-4930-8b37-aaff4c48b225" (UID: "eff48d41-ad9a-4930-8b37-aaff4c48b225"). InnerVolumeSpecName "kube-api-access-txf6k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 14:00:38.386749 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:38.386646    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42ca8dbb-e44c-4065-96ba-ba84cd09dd49-kube-api-access-4lz7l" (OuterVolumeSpecName: "kube-api-access-4lz7l") pod "42ca8dbb-e44c-4065-96ba-ba84cd09dd49" (UID: "42ca8dbb-e44c-4065-96ba-ba84cd09dd49"). InnerVolumeSpecName "kube-api-access-4lz7l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 14:00:38.485886 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:38.485804    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/42ca8dbb-e44c-4065-96ba-ba84cd09dd49-plugins-config-volume\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:00:38.485886 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:38.485829    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4lz7l\" (UniqueName: \"kubernetes.io/projected/42ca8dbb-e44c-4065-96ba-ba84cd09dd49-kube-api-access-4lz7l\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:00:38.485886 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:38.485839    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-txf6k\" (UniqueName: \"kubernetes.io/projected/eff48d41-ad9a-4930-8b37-aaff4c48b225-kube-api-access-txf6k\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:00:38.485886 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:38.485848    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eff48d41-ad9a-4930-8b37-aaff4c48b225-plugins-config-volume\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:00:39.122918 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:39.122886    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-14c2563f-57cf8b4cdf-tgrkz"
Sep 15 14:00:39.122918 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:39.122904    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-14c2563f-57cf8b4cdf-tgrkz" event={"ID":"42ca8dbb-e44c-4065-96ba-ba84cd09dd49","Type":"ContainerDied","Data":"745812d5d1b234f555ef7e2f29dbba266f24ef8189c8dfc63d8fef1457dd7660"}
Sep 15 14:00:39.123480 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:39.122973    2578 scope.go:117] "RemoveContainer" containerID="c69b152c5cf12f3fc30b082558b21c0f33f59fb2787af7b7ba43b76aad66397c"
Sep 15 14:00:39.124484 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:39.124451    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-14c2563f-7b979dc546-4gjtz"
Sep 15 14:00:39.124484 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:39.124476    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-14c2563f-7b979dc546-4gjtz" event={"ID":"eff48d41-ad9a-4930-8b37-aaff4c48b225","Type":"ContainerDied","Data":"0dad2813546c176813413fab92ed30e675ccb80e2fe58777c2ecf325c3c69ad5"}
Sep 15 14:00:39.135456 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:39.135431    2578 scope.go:117] "RemoveContainer" containerID="47863b60b12534c6f1f237dbb103357818b0eb97f89b0d7fcd211de74b864634"
Sep 15 14:00:39.152720 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:39.152686    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-14c2563f-57cf8b4cdf-tgrkz"]
Sep 15 14:00:39.162164 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:39.162136    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-14c2563f-57cf8b4cdf-tgrkz"]
Sep 15 14:00:39.172823 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:39.172800    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-14c2563f-7b979dc546-4gjtz"]
Sep 15 14:00:39.176783 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:39.176760    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-14c2563f-7b979dc546-4gjtz"]
Sep 15 14:00:39.759292 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:39.759264    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42ca8dbb-e44c-4065-96ba-ba84cd09dd49" path="/var/lib/kubelet/pods/42ca8dbb-e44c-4065-96ba-ba84cd09dd49/volumes"
Sep 15 14:00:39.759645 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:39.759632    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0294c28-7634-48b1-882b-da88a49333f4" path="/var/lib/kubelet/pods/e0294c28-7634-48b1-882b-da88a49333f4/volumes"
Sep 15 14:00:39.759947 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:39.759935    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eff48d41-ad9a-4930-8b37-aaff4c48b225" path="/var/lib/kubelet/pods/eff48d41-ad9a-4930-8b37-aaff4c48b225/volumes"
Sep 15 14:00:44.520343 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:44.520309    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-14c2563f-openshift-default-579cff8cb8-2hkzj"]
Sep 15 14:00:44.520753 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:44.520587    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-14c2563f-openshift-default-579cff8cb8-2hkzj" podUID="9f260fe0-7e7d-47cc-8f41-619e780e7e41" containerName="istio-proxy" containerID="cri-o://0030ceaec7590e6f9c8fd6d7563a880e9f63d469990b29e23a8ea7c004c169b2" gracePeriod=30
Sep 15 14:00:49.772160 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:49.772116    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-14c2563f-openshift-default-579cff8cb8-2hkzj"
Sep 15 14:00:49.777682 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:49.777663    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9f260fe0-7e7d-47cc-8f41-619e780e7e41-istio-data\") pod \"9f260fe0-7e7d-47cc-8f41-619e780e7e41\" (UID: \"9f260fe0-7e7d-47cc-8f41-619e780e7e41\") "
Sep 15 14:00:49.777800 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:49.777780    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9f260fe0-7e7d-47cc-8f41-619e780e7e41-istiod-ca-cert\") pod \"9f260fe0-7e7d-47cc-8f41-619e780e7e41\" (UID: \"9f260fe0-7e7d-47cc-8f41-619e780e7e41\") "
Sep 15 14:00:49.777840 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:49.777813    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9f260fe0-7e7d-47cc-8f41-619e780e7e41-istio-token\") pod \"9f260fe0-7e7d-47cc-8f41-619e780e7e41\" (UID: \"9f260fe0-7e7d-47cc-8f41-619e780e7e41\") "
Sep 15 14:00:49.777840 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:49.777833    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f260fe0-7e7d-47cc-8f41-619e780e7e41-istio-data" (OuterVolumeSpecName: "istio-data") pod "9f260fe0-7e7d-47cc-8f41-619e780e7e41" (UID: "9f260fe0-7e7d-47cc-8f41-619e780e7e41"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 14:00:49.777912 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:49.777845    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9f260fe0-7e7d-47cc-8f41-619e780e7e41-istio-envoy\") pod \"9f260fe0-7e7d-47cc-8f41-619e780e7e41\" (UID: \"9f260fe0-7e7d-47cc-8f41-619e780e7e41\") "
Sep 15 14:00:49.777986 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:49.777966    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9f260fe0-7e7d-47cc-8f41-619e780e7e41-workload-certs\") pod \"9f260fe0-7e7d-47cc-8f41-619e780e7e41\" (UID: \"9f260fe0-7e7d-47cc-8f41-619e780e7e41\") "
Sep 15 14:00:49.778035 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:49.778006    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-572h6\" (UniqueName: \"kubernetes.io/projected/9f260fe0-7e7d-47cc-8f41-619e780e7e41-kube-api-access-572h6\") pod \"9f260fe0-7e7d-47cc-8f41-619e780e7e41\" (UID: \"9f260fe0-7e7d-47cc-8f41-619e780e7e41\") "
Sep 15 14:00:49.778090 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:49.778075    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f260fe0-7e7d-47cc-8f41-619e780e7e41-workload-socket\") pod \"9f260fe0-7e7d-47cc-8f41-619e780e7e41\" (UID: \"9f260fe0-7e7d-47cc-8f41-619e780e7e41\") "
Sep 15 14:00:49.778181 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:49.778166    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f260fe0-7e7d-47cc-8f41-619e780e7e41-credential-socket\") pod \"9f260fe0-7e7d-47cc-8f41-619e780e7e41\" (UID: \"9f260fe0-7e7d-47cc-8f41-619e780e7e41\") "
Sep 15 14:00:49.778292 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:49.778183    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f260fe0-7e7d-47cc-8f41-619e780e7e41-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9f260fe0-7e7d-47cc-8f41-619e780e7e41" (UID: "9f260fe0-7e7d-47cc-8f41-619e780e7e41"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 14:00:49.778366 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:49.778223    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9f260fe0-7e7d-47cc-8f41-619e780e7e41-istio-podinfo\") pod \"9f260fe0-7e7d-47cc-8f41-619e780e7e41\" (UID: \"9f260fe0-7e7d-47cc-8f41-619e780e7e41\") "
Sep 15 14:00:49.778480 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:49.778264    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f260fe0-7e7d-47cc-8f41-619e780e7e41-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9f260fe0-7e7d-47cc-8f41-619e780e7e41" (UID: "9f260fe0-7e7d-47cc-8f41-619e780e7e41"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 14:00:49.778539 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:49.778410    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f260fe0-7e7d-47cc-8f41-619e780e7e41-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9f260fe0-7e7d-47cc-8f41-619e780e7e41" (UID: "9f260fe0-7e7d-47cc-8f41-619e780e7e41"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 14:00:49.778539 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:49.778498    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f260fe0-7e7d-47cc-8f41-619e780e7e41-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9f260fe0-7e7d-47cc-8f41-619e780e7e41" (UID: "9f260fe0-7e7d-47cc-8f41-619e780e7e41"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 14:00:49.778884 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:49.778858    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9f260fe0-7e7d-47cc-8f41-619e780e7e41-workload-certs\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:00:49.778999 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:49.778887    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f260fe0-7e7d-47cc-8f41-619e780e7e41-workload-socket\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:00:49.778999 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:49.778902    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f260fe0-7e7d-47cc-8f41-619e780e7e41-credential-socket\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:00:49.778999 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:49.778917    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9f260fe0-7e7d-47cc-8f41-619e780e7e41-istio-data\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:00:49.778999 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:49.778930    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9f260fe0-7e7d-47cc-8f41-619e780e7e41-istiod-ca-cert\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:00:49.780219 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:49.780190    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f260fe0-7e7d-47cc-8f41-619e780e7e41-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9f260fe0-7e7d-47cc-8f41-619e780e7e41" (UID: "9f260fe0-7e7d-47cc-8f41-619e780e7e41"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 14:00:49.780327 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:49.780282    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f260fe0-7e7d-47cc-8f41-619e780e7e41-kube-api-access-572h6" (OuterVolumeSpecName: "kube-api-access-572h6") pod "9f260fe0-7e7d-47cc-8f41-619e780e7e41" (UID: "9f260fe0-7e7d-47cc-8f41-619e780e7e41"). InnerVolumeSpecName "kube-api-access-572h6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 14:00:49.780327 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:49.780293    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f260fe0-7e7d-47cc-8f41-619e780e7e41-istio-token" (OuterVolumeSpecName: "istio-token") pod "9f260fe0-7e7d-47cc-8f41-619e780e7e41" (UID: "9f260fe0-7e7d-47cc-8f41-619e780e7e41"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 14:00:49.780478 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:49.780460    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9f260fe0-7e7d-47cc-8f41-619e780e7e41-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9f260fe0-7e7d-47cc-8f41-619e780e7e41" (UID: "9f260fe0-7e7d-47cc-8f41-619e780e7e41"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 14:00:49.879550 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:49.879517    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9f260fe0-7e7d-47cc-8f41-619e780e7e41-istio-podinfo\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:00:49.879550 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:49.879546    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9f260fe0-7e7d-47cc-8f41-619e780e7e41-istio-token\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:00:49.879550 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:49.879558    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9f260fe0-7e7d-47cc-8f41-619e780e7e41-istio-envoy\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:00:49.879825 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:49.879570    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-572h6\" (UniqueName: \"kubernetes.io/projected/9f260fe0-7e7d-47cc-8f41-619e780e7e41-kube-api-access-572h6\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:00:50.191107 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:50.191018    2578 generic.go:356] "Generic (PLEG): container finished" podID="9f260fe0-7e7d-47cc-8f41-619e780e7e41" containerID="0030ceaec7590e6f9c8fd6d7563a880e9f63d469990b29e23a8ea7c004c169b2" exitCode=0
Sep 15 14:00:50.191107 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:50.191059    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-14c2563f-openshift-default-579cff8cb8-2hkzj" event={"ID":"9f260fe0-7e7d-47cc-8f41-619e780e7e41","Type":"ContainerDied","Data":"0030ceaec7590e6f9c8fd6d7563a880e9f63d469990b29e23a8ea7c004c169b2"}
Sep 15 14:00:50.191337 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:50.191111    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-14c2563f-openshift-default-579cff8cb8-2hkzj" event={"ID":"9f260fe0-7e7d-47cc-8f41-619e780e7e41","Type":"ContainerDied","Data":"6e45f8405767d6ca8d66063fd9bfee6e4bc036f04c75cfb11e3a4d029e1aaebf"}
Sep 15 14:00:50.191337 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:50.191072    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-14c2563f-openshift-default-579cff8cb8-2hkzj"
Sep 15 14:00:50.191337 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:50.191152    2578 scope.go:117] "RemoveContainer" containerID="0030ceaec7590e6f9c8fd6d7563a880e9f63d469990b29e23a8ea7c004c169b2"
Sep 15 14:00:50.201611 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:50.201594    2578 scope.go:117] "RemoveContainer" containerID="9e6dce09a2481237fca8ba2efe128d6c2e10221b0677167665343504101ddace"
Sep 15 14:00:50.210217 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:50.210200    2578 scope.go:117] "RemoveContainer" containerID="0030ceaec7590e6f9c8fd6d7563a880e9f63d469990b29e23a8ea7c004c169b2"
Sep 15 14:00:50.210456 ip-10-0-128-41 kubenswrapper[2578]: E0915 14:00:50.210438    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0030ceaec7590e6f9c8fd6d7563a880e9f63d469990b29e23a8ea7c004c169b2\": container with ID starting with 0030ceaec7590e6f9c8fd6d7563a880e9f63d469990b29e23a8ea7c004c169b2 not found: ID does not exist" containerID="0030ceaec7590e6f9c8fd6d7563a880e9f63d469990b29e23a8ea7c004c169b2"
Sep 15 14:00:50.210499 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:50.210463    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0030ceaec7590e6f9c8fd6d7563a880e9f63d469990b29e23a8ea7c004c169b2"} err="failed to get container status \"0030ceaec7590e6f9c8fd6d7563a880e9f63d469990b29e23a8ea7c004c169b2\": rpc error: code = NotFound desc = could not find container \"0030ceaec7590e6f9c8fd6d7563a880e9f63d469990b29e23a8ea7c004c169b2\": container with ID starting with 0030ceaec7590e6f9c8fd6d7563a880e9f63d469990b29e23a8ea7c004c169b2 not found: ID does not exist"
Sep 15 14:00:50.210499 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:50.210479    2578 scope.go:117] "RemoveContainer" containerID="9e6dce09a2481237fca8ba2efe128d6c2e10221b0677167665343504101ddace"
Sep 15 14:00:50.210734 ip-10-0-128-41 kubenswrapper[2578]: E0915 14:00:50.210716    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e6dce09a2481237fca8ba2efe128d6c2e10221b0677167665343504101ddace\": container with ID starting with 9e6dce09a2481237fca8ba2efe128d6c2e10221b0677167665343504101ddace not found: ID does not exist" containerID="9e6dce09a2481237fca8ba2efe128d6c2e10221b0677167665343504101ddace"
Sep 15 14:00:50.210789 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:50.210744    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e6dce09a2481237fca8ba2efe128d6c2e10221b0677167665343504101ddace"} err="failed to get container status \"9e6dce09a2481237fca8ba2efe128d6c2e10221b0677167665343504101ddace\": rpc error: code = NotFound desc = could not find container \"9e6dce09a2481237fca8ba2efe128d6c2e10221b0677167665343504101ddace\": container with ID starting with 9e6dce09a2481237fca8ba2efe128d6c2e10221b0677167665343504101ddace not found: ID does not exist"
Sep 15 14:00:50.214829 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:50.214807    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-14c2563f-openshift-default-579cff8cb8-2hkzj"]
Sep 15 14:00:50.220649 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:50.220623    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-14c2563f-openshift-default-579cff8cb8-2hkzj"]
Sep 15 14:00:51.758456 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:51.758423    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f260fe0-7e7d-47cc-8f41-619e780e7e41" path="/var/lib/kubelet/pods/9f260fe0-7e7d-47cc-8f41-619e780e7e41/volumes"
Sep 15 14:00:59.110476 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:59.110403    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-583e9a-openshift-default-5556fff988-9rrgj"]
Sep 15 14:00:59.110832 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:59.110817    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0294c28-7634-48b1-882b-da88a49333f4" containerName="revoke-keys"
Sep 15 14:00:59.110873 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:59.110835    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0294c28-7634-48b1-882b-da88a49333f4" containerName="revoke-keys"
Sep 15 14:00:59.110873 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:59.110846    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f260fe0-7e7d-47cc-8f41-619e780e7e41" containerName="istio-proxy"
Sep 15 14:00:59.110873 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:59.110852    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f260fe0-7e7d-47cc-8f41-619e780e7e41" containerName="istio-proxy"
Sep 15 14:00:59.110873 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:59.110860    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eff48d41-ad9a-4930-8b37-aaff4c48b225" containerName="payload-pre-processing"
Sep 15 14:00:59.110873 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:59.110865    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="eff48d41-ad9a-4930-8b37-aaff4c48b225" containerName="payload-pre-processing"
Sep 15 14:00:59.110873 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:59.110874    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6a51ab4-59f1-49ab-8e3c-3d84f45b42cb" containerName="cleanup"
Sep 15 14:00:59.111053 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:59.110879    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6a51ab4-59f1-49ab-8e3c-3d84f45b42cb" containerName="cleanup"
Sep 15 14:00:59.111053 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:59.110892    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42ca8dbb-e44c-4065-96ba-ba84cd09dd49" containerName="payload-processing"
Sep 15 14:00:59.111053 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:59.110897    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="42ca8dbb-e44c-4065-96ba-ba84cd09dd49" containerName="payload-processing"
Sep 15 14:00:59.111053 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:59.110959    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6a51ab4-59f1-49ab-8e3c-3d84f45b42cb" containerName="cleanup"
Sep 15 14:00:59.111053 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:59.110969    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f260fe0-7e7d-47cc-8f41-619e780e7e41" containerName="istio-proxy"
Sep 15 14:00:59.111053 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:59.110976    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f260fe0-7e7d-47cc-8f41-619e780e7e41" containerName="istio-proxy"
Sep 15 14:00:59.111053 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:59.110982    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0294c28-7634-48b1-882b-da88a49333f4" containerName="revoke-keys"
Sep 15 14:00:59.111053 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:59.110989    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="42ca8dbb-e44c-4065-96ba-ba84cd09dd49" containerName="payload-processing"
Sep 15 14:00:59.111053 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:59.110994    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="eff48d41-ad9a-4930-8b37-aaff4c48b225" containerName="payload-pre-processing"
Sep 15 14:00:59.115266 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:59.115244    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-583e9a-openshift-default-5556fff988-9rrgj"
Sep 15 14:00:59.118004 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:59.117981    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-583e9a-openshift-default-dockercfg-648qc\""
Sep 15 14:00:59.137673 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:59.137646    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-583e9a-openshift-default-5556fff988-9rrgj"]
Sep 15 14:00:59.166113 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:59.166080    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5df03f8b-f687-4a74-8784-082485d4807d-istio-podinfo\") pod \"e2e-shared-a-w2-583e9a-openshift-default-5556fff988-9rrgj\" (UID: \"5df03f8b-f687-4a74-8784-082485d4807d\") " pod="openshift-ingress/e2e-shared-a-w2-583e9a-openshift-default-5556fff988-9rrgj"
Sep 15 14:00:59.166291 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:59.166160    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5df03f8b-f687-4a74-8784-082485d4807d-istio-token\") pod \"e2e-shared-a-w2-583e9a-openshift-default-5556fff988-9rrgj\" (UID: \"5df03f8b-f687-4a74-8784-082485d4807d\") " pod="openshift-ingress/e2e-shared-a-w2-583e9a-openshift-default-5556fff988-9rrgj"
Sep 15 14:00:59.166291 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:59.166245    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbpwz\" (UniqueName: \"kubernetes.io/projected/5df03f8b-f687-4a74-8784-082485d4807d-kube-api-access-xbpwz\") pod \"e2e-shared-a-w2-583e9a-openshift-default-5556fff988-9rrgj\" (UID: \"5df03f8b-f687-4a74-8784-082485d4807d\") " pod="openshift-ingress/e2e-shared-a-w2-583e9a-openshift-default-5556fff988-9rrgj"
Sep 15 14:00:59.166291 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:59.166279    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5df03f8b-f687-4a74-8784-082485d4807d-credential-socket\") pod \"e2e-shared-a-w2-583e9a-openshift-default-5556fff988-9rrgj\" (UID: \"5df03f8b-f687-4a74-8784-082485d4807d\") " pod="openshift-ingress/e2e-shared-a-w2-583e9a-openshift-default-5556fff988-9rrgj"
Sep 15 14:00:59.166434 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:59.166332    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5df03f8b-f687-4a74-8784-082485d4807d-workload-certs\") pod \"e2e-shared-a-w2-583e9a-openshift-default-5556fff988-9rrgj\" (UID: \"5df03f8b-f687-4a74-8784-082485d4807d\") " pod="openshift-ingress/e2e-shared-a-w2-583e9a-openshift-default-5556fff988-9rrgj"
Sep 15 14:00:59.166434 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:59.166404    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5df03f8b-f687-4a74-8784-082485d4807d-istiod-ca-cert\") pod \"e2e-shared-a-w2-583e9a-openshift-default-5556fff988-9rrgj\" (UID: \"5df03f8b-f687-4a74-8784-082485d4807d\") " pod="openshift-ingress/e2e-shared-a-w2-583e9a-openshift-default-5556fff988-9rrgj"
Sep 15 14:00:59.166494 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:59.166435    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5df03f8b-f687-4a74-8784-082485d4807d-istio-envoy\") pod \"e2e-shared-a-w2-583e9a-openshift-default-5556fff988-9rrgj\" (UID: \"5df03f8b-f687-4a74-8784-082485d4807d\") " pod="openshift-ingress/e2e-shared-a-w2-583e9a-openshift-default-5556fff988-9rrgj"
Sep 15 14:00:59.166494 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:59.166483    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5df03f8b-f687-4a74-8784-082485d4807d-istio-data\") pod \"e2e-shared-a-w2-583e9a-openshift-default-5556fff988-9rrgj\" (UID: \"5df03f8b-f687-4a74-8784-082485d4807d\") " pod="openshift-ingress/e2e-shared-a-w2-583e9a-openshift-default-5556fff988-9rrgj"
Sep 15 14:00:59.166559 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:59.166508    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5df03f8b-f687-4a74-8784-082485d4807d-workload-socket\") pod \"e2e-shared-a-w2-583e9a-openshift-default-5556fff988-9rrgj\" (UID: \"5df03f8b-f687-4a74-8784-082485d4807d\") " pod="openshift-ingress/e2e-shared-a-w2-583e9a-openshift-default-5556fff988-9rrgj"
Sep 15 14:00:59.267341 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:59.267303    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5df03f8b-f687-4a74-8784-082485d4807d-istiod-ca-cert\") pod \"e2e-shared-a-w2-583e9a-openshift-default-5556fff988-9rrgj\" (UID: \"5df03f8b-f687-4a74-8784-082485d4807d\") " pod="openshift-ingress/e2e-shared-a-w2-583e9a-openshift-default-5556fff988-9rrgj"
Sep 15 14:00:59.267561 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:59.267372    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5df03f8b-f687-4a74-8784-082485d4807d-istio-envoy\") pod \"e2e-shared-a-w2-583e9a-openshift-default-5556fff988-9rrgj\" (UID: \"5df03f8b-f687-4a74-8784-082485d4807d\") " pod="openshift-ingress/e2e-shared-a-w2-583e9a-openshift-default-5556fff988-9rrgj"
Sep 15 14:00:59.267561 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:59.267435    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5df03f8b-f687-4a74-8784-082485d4807d-istio-data\") pod \"e2e-shared-a-w2-583e9a-openshift-default-5556fff988-9rrgj\" (UID: \"5df03f8b-f687-4a74-8784-082485d4807d\") " pod="openshift-ingress/e2e-shared-a-w2-583e9a-openshift-default-5556fff988-9rrgj"
Sep 15 14:00:59.267561 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:59.267468    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5df03f8b-f687-4a74-8784-082485d4807d-workload-socket\") pod \"e2e-shared-a-w2-583e9a-openshift-default-5556fff988-9rrgj\" (UID: \"5df03f8b-f687-4a74-8784-082485d4807d\") " pod="openshift-ingress/e2e-shared-a-w2-583e9a-openshift-default-5556fff988-9rrgj"
Sep 15 14:00:59.267561 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:59.267539    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5df03f8b-f687-4a74-8784-082485d4807d-istio-podinfo\") pod \"e2e-shared-a-w2-583e9a-openshift-default-5556fff988-9rrgj\" (UID: \"5df03f8b-f687-4a74-8784-082485d4807d\") " pod="openshift-ingress/e2e-shared-a-w2-583e9a-openshift-default-5556fff988-9rrgj"
Sep 15 14:00:59.267779 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:59.267579    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5df03f8b-f687-4a74-8784-082485d4807d-istio-token\") pod \"e2e-shared-a-w2-583e9a-openshift-default-5556fff988-9rrgj\" (UID: \"5df03f8b-f687-4a74-8784-082485d4807d\") " pod="openshift-ingress/e2e-shared-a-w2-583e9a-openshift-default-5556fff988-9rrgj"
Sep 15 14:00:59.267779 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:59.267608    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbpwz\" (UniqueName: \"kubernetes.io/projected/5df03f8b-f687-4a74-8784-082485d4807d-kube-api-access-xbpwz\") pod \"e2e-shared-a-w2-583e9a-openshift-default-5556fff988-9rrgj\" (UID: \"5df03f8b-f687-4a74-8784-082485d4807d\") " pod="openshift-ingress/e2e-shared-a-w2-583e9a-openshift-default-5556fff988-9rrgj"
Sep 15 14:00:59.267779 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:59.267639    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5df03f8b-f687-4a74-8784-082485d4807d-credential-socket\") pod \"e2e-shared-a-w2-583e9a-openshift-default-5556fff988-9rrgj\" (UID: \"5df03f8b-f687-4a74-8784-082485d4807d\") " pod="openshift-ingress/e2e-shared-a-w2-583e9a-openshift-default-5556fff988-9rrgj"
Sep 15 14:00:59.267779 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:59.267687    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5df03f8b-f687-4a74-8784-082485d4807d-workload-certs\") pod \"e2e-shared-a-w2-583e9a-openshift-default-5556fff988-9rrgj\" (UID: \"5df03f8b-f687-4a74-8784-082485d4807d\") " pod="openshift-ingress/e2e-shared-a-w2-583e9a-openshift-default-5556fff988-9rrgj"
Sep 15 14:00:59.268083 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:59.268055    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5df03f8b-f687-4a74-8784-082485d4807d-workload-certs\") pod \"e2e-shared-a-w2-583e9a-openshift-default-5556fff988-9rrgj\" (UID: \"5df03f8b-f687-4a74-8784-082485d4807d\") " pod="openshift-ingress/e2e-shared-a-w2-583e9a-openshift-default-5556fff988-9rrgj"
Sep 15 14:00:59.268234 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:59.268210    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5df03f8b-f687-4a74-8784-082485d4807d-istiod-ca-cert\") pod \"e2e-shared-a-w2-583e9a-openshift-default-5556fff988-9rrgj\" (UID: \"5df03f8b-f687-4a74-8784-082485d4807d\") " pod="openshift-ingress/e2e-shared-a-w2-583e9a-openshift-default-5556fff988-9rrgj"
Sep 15 14:00:59.268516 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:59.268491    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5df03f8b-f687-4a74-8784-082485d4807d-istio-data\") pod \"e2e-shared-a-w2-583e9a-openshift-default-5556fff988-9rrgj\" (UID: \"5df03f8b-f687-4a74-8784-082485d4807d\") " pod="openshift-ingress/e2e-shared-a-w2-583e9a-openshift-default-5556fff988-9rrgj"
Sep 15 14:00:59.268675 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:59.268650    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5df03f8b-f687-4a74-8784-082485d4807d-credential-socket\") pod \"e2e-shared-a-w2-583e9a-openshift-default-5556fff988-9rrgj\" (UID: \"5df03f8b-f687-4a74-8784-082485d4807d\") " pod="openshift-ingress/e2e-shared-a-w2-583e9a-openshift-default-5556fff988-9rrgj"
Sep 15 14:00:59.268757 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:59.268617    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5df03f8b-f687-4a74-8784-082485d4807d-workload-socket\") pod \"e2e-shared-a-w2-583e9a-openshift-default-5556fff988-9rrgj\" (UID: \"5df03f8b-f687-4a74-8784-082485d4807d\") " pod="openshift-ingress/e2e-shared-a-w2-583e9a-openshift-default-5556fff988-9rrgj"
Sep 15 14:00:59.271105 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:59.271080    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5df03f8b-f687-4a74-8784-082485d4807d-istio-envoy\") pod \"e2e-shared-a-w2-583e9a-openshift-default-5556fff988-9rrgj\" (UID: \"5df03f8b-f687-4a74-8784-082485d4807d\") " pod="openshift-ingress/e2e-shared-a-w2-583e9a-openshift-default-5556fff988-9rrgj"
Sep 15 14:00:59.271249 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:59.271109    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5df03f8b-f687-4a74-8784-082485d4807d-istio-podinfo\") pod \"e2e-shared-a-w2-583e9a-openshift-default-5556fff988-9rrgj\" (UID: \"5df03f8b-f687-4a74-8784-082485d4807d\") " pod="openshift-ingress/e2e-shared-a-w2-583e9a-openshift-default-5556fff988-9rrgj"
Sep 15 14:00:59.286110 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:59.286033    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5df03f8b-f687-4a74-8784-082485d4807d-istio-token\") pod \"e2e-shared-a-w2-583e9a-openshift-default-5556fff988-9rrgj\" (UID: \"5df03f8b-f687-4a74-8784-082485d4807d\") " pod="openshift-ingress/e2e-shared-a-w2-583e9a-openshift-default-5556fff988-9rrgj"
Sep 15 14:00:59.286301 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:59.286156    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbpwz\" (UniqueName: \"kubernetes.io/projected/5df03f8b-f687-4a74-8784-082485d4807d-kube-api-access-xbpwz\") pod \"e2e-shared-a-w2-583e9a-openshift-default-5556fff988-9rrgj\" (UID: \"5df03f8b-f687-4a74-8784-082485d4807d\") " pod="openshift-ingress/e2e-shared-a-w2-583e9a-openshift-default-5556fff988-9rrgj"
Sep 15 14:00:59.425264 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:59.425183    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-583e9a-openshift-default-5556fff988-9rrgj"
Sep 15 14:00:59.704786 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:59.704761    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-583e9a-openshift-default-5556fff988-9rrgj"]
Sep 15 14:00:59.706430 ip-10-0-128-41 kubenswrapper[2578]: W0915 14:00:59.706408    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5df03f8b_f687_4a74_8784_082485d4807d.slice/crio-e4e2cedba7e7f617797363947f6830e9e4f9629b3fe4d1f1428ddbbb92f31bdf WatchSource:0}: Error finding container e4e2cedba7e7f617797363947f6830e9e4f9629b3fe4d1f1428ddbbb92f31bdf: Status 404 returned error can't find the container with id e4e2cedba7e7f617797363947f6830e9e4f9629b3fe4d1f1428ddbbb92f31bdf
Sep 15 14:00:59.708571 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:59.708543    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 15 14:00:59.708650 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:59.708605    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 15 14:00:59.708650 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:00:59.708631    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 15 14:01:00.250185 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:00.250152    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-583e9a-openshift-default-5556fff988-9rrgj" event={"ID":"5df03f8b-f687-4a74-8784-082485d4807d","Type":"ContainerStarted","Data":"7accb0ccc26f1b8368708e1335107b6c966ca7770667069507f7a65668198d0d"}
Sep 15 14:01:00.250571 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:00.250208    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-583e9a-openshift-default-5556fff988-9rrgj" event={"ID":"5df03f8b-f687-4a74-8784-082485d4807d","Type":"ContainerStarted","Data":"e4e2cedba7e7f617797363947f6830e9e4f9629b3fe4d1f1428ddbbb92f31bdf"}
Sep 15 14:01:00.275386 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:00.275323    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-583e9a-openshift-default-5556fff988-9rrgj" podStartSLOduration=1.2753016019999999 podStartE2EDuration="1.275301602s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 14:00:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 14:01:00.272491086 +0000 UTC m=+1347.031617373" watchObservedRunningTime="2026-09-15 14:01:00.275301602 +0000 UTC m=+1347.034427889"
Sep 15 14:01:00.425575 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:00.425534    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-583e9a-openshift-default-5556fff988-9rrgj"
Sep 15 14:01:00.430547 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:00.430522    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-583e9a-openshift-default-5556fff988-9rrgj"
Sep 15 14:01:01.256738 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:01.256706    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-583e9a-openshift-default-5556fff988-9rrgj"
Sep 15 14:01:01.257810 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:01.257790    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-583e9a-openshift-default-5556fff988-9rrgj"
Sep 15 14:01:05.534875 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:05.534846    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-583e9a-7854fbc79-vx72w"]
Sep 15 14:01:05.535520 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:05.535239    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f260fe0-7e7d-47cc-8f41-619e780e7e41" containerName="istio-proxy"
Sep 15 14:01:05.535520 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:05.535251    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f260fe0-7e7d-47cc-8f41-619e780e7e41" containerName="istio-proxy"
Sep 15 14:01:05.545163 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:05.545116    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-583e9a-7854fbc79-vx72w"
Sep 15 14:01:05.547830 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:05.547808    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w2-583e9a-dockercfg-tz8jv\""
Sep 15 14:01:05.548101 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:05.548075    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w2-583e9a\""
Sep 15 14:01:05.555514 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:05.555493    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-583e9a-7854fbc79-vx72w"]
Sep 15 14:01:05.595392 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:05.595365    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-583e9a-798555686-8vmrc"]
Sep 15 14:01:05.598818 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:05.598803    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-583e9a-798555686-8vmrc"
Sep 15 14:01:05.609096 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:05.609075    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-583e9a-798555686-8vmrc"]
Sep 15 14:01:05.633528 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:05.633494    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a0904f8e-14aa-41ea-9574-82d95df0a62d-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-583e9a-7854fbc79-vx72w\" (UID: \"a0904f8e-14aa-41ea-9574-82d95df0a62d\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-583e9a-7854fbc79-vx72w"
Sep 15 14:01:05.633729 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:05.633674    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b5653541-7ead-45de-830a-5b29b2989925-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-583e9a-798555686-8vmrc\" (UID: \"b5653541-7ead-45de-830a-5b29b2989925\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-583e9a-798555686-8vmrc"
Sep 15 14:01:05.633729 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:05.633719    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-594cj\" (UniqueName: \"kubernetes.io/projected/b5653541-7ead-45de-830a-5b29b2989925-kube-api-access-594cj\") pod \"payload-pre-processing-e2e-shared-a-w2-583e9a-798555686-8vmrc\" (UID: \"b5653541-7ead-45de-830a-5b29b2989925\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-583e9a-798555686-8vmrc"
Sep 15 14:01:05.633911 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:05.633879    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbpqp\" (UniqueName: \"kubernetes.io/projected/a0904f8e-14aa-41ea-9574-82d95df0a62d-kube-api-access-rbpqp\") pod \"payload-processing-e2e-shared-a-w2-583e9a-7854fbc79-vx72w\" (UID: \"a0904f8e-14aa-41ea-9574-82d95df0a62d\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-583e9a-7854fbc79-vx72w"
Sep 15 14:01:05.735483 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:05.735440    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbpqp\" (UniqueName: \"kubernetes.io/projected/a0904f8e-14aa-41ea-9574-82d95df0a62d-kube-api-access-rbpqp\") pod \"payload-processing-e2e-shared-a-w2-583e9a-7854fbc79-vx72w\" (UID: \"a0904f8e-14aa-41ea-9574-82d95df0a62d\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-583e9a-7854fbc79-vx72w"
Sep 15 14:01:05.735483 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:05.735491    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a0904f8e-14aa-41ea-9574-82d95df0a62d-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-583e9a-7854fbc79-vx72w\" (UID: \"a0904f8e-14aa-41ea-9574-82d95df0a62d\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-583e9a-7854fbc79-vx72w"
Sep 15 14:01:05.735752 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:05.735542    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b5653541-7ead-45de-830a-5b29b2989925-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-583e9a-798555686-8vmrc\" (UID: \"b5653541-7ead-45de-830a-5b29b2989925\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-583e9a-798555686-8vmrc"
Sep 15 14:01:05.735752 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:05.735558    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-594cj\" (UniqueName: \"kubernetes.io/projected/b5653541-7ead-45de-830a-5b29b2989925-kube-api-access-594cj\") pod \"payload-pre-processing-e2e-shared-a-w2-583e9a-798555686-8vmrc\" (UID: \"b5653541-7ead-45de-830a-5b29b2989925\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-583e9a-798555686-8vmrc"
Sep 15 14:01:05.736330 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:05.736310    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a0904f8e-14aa-41ea-9574-82d95df0a62d-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-583e9a-7854fbc79-vx72w\" (UID: \"a0904f8e-14aa-41ea-9574-82d95df0a62d\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-583e9a-7854fbc79-vx72w"
Sep 15 14:01:05.736399 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:05.736345    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b5653541-7ead-45de-830a-5b29b2989925-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-583e9a-798555686-8vmrc\" (UID: \"b5653541-7ead-45de-830a-5b29b2989925\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-583e9a-798555686-8vmrc"
Sep 15 14:01:05.743885 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:05.743864    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-594cj\" (UniqueName: \"kubernetes.io/projected/b5653541-7ead-45de-830a-5b29b2989925-kube-api-access-594cj\") pod \"payload-pre-processing-e2e-shared-a-w2-583e9a-798555686-8vmrc\" (UID: \"b5653541-7ead-45de-830a-5b29b2989925\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-583e9a-798555686-8vmrc"
Sep 15 14:01:05.744556 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:05.744535    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbpqp\" (UniqueName: \"kubernetes.io/projected/a0904f8e-14aa-41ea-9574-82d95df0a62d-kube-api-access-rbpqp\") pod \"payload-processing-e2e-shared-a-w2-583e9a-7854fbc79-vx72w\" (UID: \"a0904f8e-14aa-41ea-9574-82d95df0a62d\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-583e9a-7854fbc79-vx72w"
Sep 15 14:01:05.859263 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:05.859181    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-583e9a-7854fbc79-vx72w"
Sep 15 14:01:05.909311 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:05.909241    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-583e9a-798555686-8vmrc"
Sep 15 14:01:06.137226 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:06.137198    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-583e9a-7854fbc79-vx72w"]
Sep 15 14:01:06.137746 ip-10-0-128-41 kubenswrapper[2578]: W0915 14:01:06.137720    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0904f8e_14aa_41ea_9574_82d95df0a62d.slice/crio-dfea49843de06b98a829e9bdb2f099c83c37000a21660061c9b6ee6599a2e084 WatchSource:0}: Error finding container dfea49843de06b98a829e9bdb2f099c83c37000a21660061c9b6ee6599a2e084: Status 404 returned error can't find the container with id dfea49843de06b98a829e9bdb2f099c83c37000a21660061c9b6ee6599a2e084
Sep 15 14:01:06.199921 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:06.199895    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-583e9a-798555686-8vmrc"]
Sep 15 14:01:06.200399 ip-10-0-128-41 kubenswrapper[2578]: W0915 14:01:06.200376    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5653541_7ead_45de_830a_5b29b2989925.slice/crio-a5d4760885dfb0a6f36614be7076eb31375a72e36b1df1d7ebe3fcf4cfda3ff4 WatchSource:0}: Error finding container a5d4760885dfb0a6f36614be7076eb31375a72e36b1df1d7ebe3fcf4cfda3ff4: Status 404 returned error can't find the container with id a5d4760885dfb0a6f36614be7076eb31375a72e36b1df1d7ebe3fcf4cfda3ff4
Sep 15 14:01:06.293883 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:06.293850    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-583e9a-7854fbc79-vx72w" event={"ID":"a0904f8e-14aa-41ea-9574-82d95df0a62d","Type":"ContainerStarted","Data":"4f1aa739761606b64b34ab26d9f80cd55d54d0875297233ea342c2bb7693b988"}
Sep 15 14:01:06.294109 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:06.293913    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-583e9a-7854fbc79-vx72w" event={"ID":"a0904f8e-14aa-41ea-9574-82d95df0a62d","Type":"ContainerStarted","Data":"dfea49843de06b98a829e9bdb2f099c83c37000a21660061c9b6ee6599a2e084"}
Sep 15 14:01:06.294109 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:06.294006    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-583e9a-7854fbc79-vx72w"
Sep 15 14:01:06.295651 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:06.295627    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-583e9a-798555686-8vmrc" event={"ID":"b5653541-7ead-45de-830a-5b29b2989925","Type":"ContainerStarted","Data":"f342edd1c04d15d4c5d63c04c0f30408fec08bf2825fbeba80aef31613f67da6"}
Sep 15 14:01:06.295820 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:06.295666    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-583e9a-798555686-8vmrc" event={"ID":"b5653541-7ead-45de-830a-5b29b2989925","Type":"ContainerStarted","Data":"a5d4760885dfb0a6f36614be7076eb31375a72e36b1df1d7ebe3fcf4cfda3ff4"}
Sep 15 14:01:06.295820 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:06.295757    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-583e9a-798555686-8vmrc"
Sep 15 14:01:06.312965 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:06.312923    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-583e9a-7854fbc79-vx72w" podStartSLOduration=1.312911145 podStartE2EDuration="1.312911145s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 14:01:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 14:01:06.309809809 +0000 UTC m=+1353.068936095" watchObservedRunningTime="2026-09-15 14:01:06.312911145 +0000 UTC m=+1353.072037459"
Sep 15 14:01:06.325867 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:06.325816    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-583e9a-798555686-8vmrc" podStartSLOduration=1.325803206 podStartE2EDuration="1.325803206s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 14:01:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 14:01:06.324675743 +0000 UTC m=+1353.083802028" watchObservedRunningTime="2026-09-15 14:01:06.325803206 +0000 UTC m=+1353.084929492"
Sep 15 14:01:17.305279 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:17.305244    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-583e9a-7854fbc79-vx72w"
Sep 15 14:01:17.305760 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:17.305333    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-583e9a-798555686-8vmrc"
Sep 15 14:01:27.692279 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:27.692248    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd-9cwtb"]
Sep 15 14:01:27.696054 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:27.696037    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd-9cwtb"
Sep 15 14:01:27.698577 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:27.698556    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w2-4bb7b3-openshift-default-dockercfg-x7m69\""
Sep 15 14:01:27.709422 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:27.709386    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd-9cwtb"]
Sep 15 14:01:27.762590 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:27.762558    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2f52deba-0572-46ea-a401-4c8e1165767b-istio-data\") pod \"e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd-9cwtb\" (UID: \"2f52deba-0572-46ea-a401-4c8e1165767b\") " pod="openshift-ingress/e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd-9cwtb"
Sep 15 14:01:27.762766 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:27.762601    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2f52deba-0572-46ea-a401-4c8e1165767b-istio-podinfo\") pod \"e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd-9cwtb\" (UID: \"2f52deba-0572-46ea-a401-4c8e1165767b\") " pod="openshift-ingress/e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd-9cwtb"
Sep 15 14:01:27.762766 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:27.762631    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2f52deba-0572-46ea-a401-4c8e1165767b-istio-token\") pod \"e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd-9cwtb\" (UID: \"2f52deba-0572-46ea-a401-4c8e1165767b\") " pod="openshift-ingress/e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd-9cwtb"
Sep 15 14:01:27.762766 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:27.762659    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzcdd\" (UniqueName: \"kubernetes.io/projected/2f52deba-0572-46ea-a401-4c8e1165767b-kube-api-access-mzcdd\") pod \"e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd-9cwtb\" (UID: \"2f52deba-0572-46ea-a401-4c8e1165767b\") " pod="openshift-ingress/e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd-9cwtb"
Sep 15 14:01:27.762766 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:27.762678    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2f52deba-0572-46ea-a401-4c8e1165767b-workload-certs\") pod \"e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd-9cwtb\" (UID: \"2f52deba-0572-46ea-a401-4c8e1165767b\") " pod="openshift-ingress/e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd-9cwtb"
Sep 15 14:01:27.762766 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:27.762702    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2f52deba-0572-46ea-a401-4c8e1165767b-istio-envoy\") pod \"e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd-9cwtb\" (UID: \"2f52deba-0572-46ea-a401-4c8e1165767b\") " pod="openshift-ingress/e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd-9cwtb"
Sep 15 14:01:27.762766 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:27.762747    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f52deba-0572-46ea-a401-4c8e1165767b-workload-socket\") pod \"e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd-9cwtb\" (UID: \"2f52deba-0572-46ea-a401-4c8e1165767b\") " pod="openshift-ingress/e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd-9cwtb"
Sep 15 14:01:27.762982 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:27.762781    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f52deba-0572-46ea-a401-4c8e1165767b-credential-socket\") pod \"e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd-9cwtb\" (UID: \"2f52deba-0572-46ea-a401-4c8e1165767b\") " pod="openshift-ingress/e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd-9cwtb"
Sep 15 14:01:27.762982 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:27.762826    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2f52deba-0572-46ea-a401-4c8e1165767b-istiod-ca-cert\") pod \"e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd-9cwtb\" (UID: \"2f52deba-0572-46ea-a401-4c8e1165767b\") " pod="openshift-ingress/e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd-9cwtb"
Sep 15 14:01:27.863800 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:27.863759    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f52deba-0572-46ea-a401-4c8e1165767b-workload-socket\") pod \"e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd-9cwtb\" (UID: \"2f52deba-0572-46ea-a401-4c8e1165767b\") " pod="openshift-ingress/e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd-9cwtb"
Sep 15 14:01:27.863985 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:27.863811    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f52deba-0572-46ea-a401-4c8e1165767b-credential-socket\") pod \"e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd-9cwtb\" (UID: \"2f52deba-0572-46ea-a401-4c8e1165767b\") " pod="openshift-ingress/e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd-9cwtb"
Sep 15 14:01:27.863985 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:27.863837    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2f52deba-0572-46ea-a401-4c8e1165767b-istiod-ca-cert\") pod \"e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd-9cwtb\" (UID: \"2f52deba-0572-46ea-a401-4c8e1165767b\") " pod="openshift-ingress/e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd-9cwtb"
Sep 15 14:01:27.863985 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:27.863948    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2f52deba-0572-46ea-a401-4c8e1165767b-istio-data\") pod \"e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd-9cwtb\" (UID: \"2f52deba-0572-46ea-a401-4c8e1165767b\") " pod="openshift-ingress/e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd-9cwtb"
Sep 15 14:01:27.864205 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:27.864169    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2f52deba-0572-46ea-a401-4c8e1165767b-istio-podinfo\") pod \"e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd-9cwtb\" (UID: \"2f52deba-0572-46ea-a401-4c8e1165767b\") " pod="openshift-ingress/e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd-9cwtb"
Sep 15 14:01:27.864266 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:27.864201    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f52deba-0572-46ea-a401-4c8e1165767b-workload-socket\") pod \"e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd-9cwtb\" (UID: \"2f52deba-0572-46ea-a401-4c8e1165767b\") " pod="openshift-ingress/e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd-9cwtb"
Sep 15 14:01:27.864266 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:27.864210    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2f52deba-0572-46ea-a401-4c8e1165767b-istio-token\") pod \"e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd-9cwtb\" (UID: \"2f52deba-0572-46ea-a401-4c8e1165767b\") " pod="openshift-ingress/e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd-9cwtb"
Sep 15 14:01:27.864387 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:27.864267    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzcdd\" (UniqueName: \"kubernetes.io/projected/2f52deba-0572-46ea-a401-4c8e1165767b-kube-api-access-mzcdd\") pod \"e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd-9cwtb\" (UID: \"2f52deba-0572-46ea-a401-4c8e1165767b\") " pod="openshift-ingress/e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd-9cwtb"
Sep 15 14:01:27.864387 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:27.864299    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2f52deba-0572-46ea-a401-4c8e1165767b-workload-certs\") pod \"e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd-9cwtb\" (UID: \"2f52deba-0572-46ea-a401-4c8e1165767b\") " pod="openshift-ingress/e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd-9cwtb"
Sep 15 14:01:27.864387 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:27.864296    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f52deba-0572-46ea-a401-4c8e1165767b-credential-socket\") pod \"e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd-9cwtb\" (UID: \"2f52deba-0572-46ea-a401-4c8e1165767b\") " pod="openshift-ingress/e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd-9cwtb"
Sep 15 14:01:27.864558 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:27.864488    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2f52deba-0572-46ea-a401-4c8e1165767b-istio-envoy\") pod \"e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd-9cwtb\" (UID: \"2f52deba-0572-46ea-a401-4c8e1165767b\") " pod="openshift-ingress/e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd-9cwtb"
Sep 15 14:01:27.864640 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:27.864621    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2f52deba-0572-46ea-a401-4c8e1165767b-workload-certs\") pod \"e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd-9cwtb\" (UID: \"2f52deba-0572-46ea-a401-4c8e1165767b\") " pod="openshift-ingress/e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd-9cwtb"
Sep 15 14:01:27.864694 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:27.864638    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2f52deba-0572-46ea-a401-4c8e1165767b-istiod-ca-cert\") pod \"e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd-9cwtb\" (UID: \"2f52deba-0572-46ea-a401-4c8e1165767b\") " pod="openshift-ingress/e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd-9cwtb"
Sep 15 14:01:27.864852 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:27.864823    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2f52deba-0572-46ea-a401-4c8e1165767b-istio-data\") pod \"e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd-9cwtb\" (UID: \"2f52deba-0572-46ea-a401-4c8e1165767b\") " pod="openshift-ingress/e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd-9cwtb"
Sep 15 14:01:27.866906 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:27.866857    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2f52deba-0572-46ea-a401-4c8e1165767b-istio-envoy\") pod \"e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd-9cwtb\" (UID: \"2f52deba-0572-46ea-a401-4c8e1165767b\") " pod="openshift-ingress/e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd-9cwtb"
Sep 15 14:01:27.867036 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:27.867009    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2f52deba-0572-46ea-a401-4c8e1165767b-istio-podinfo\") pod \"e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd-9cwtb\" (UID: \"2f52deba-0572-46ea-a401-4c8e1165767b\") " pod="openshift-ingress/e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd-9cwtb"
Sep 15 14:01:27.874520 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:27.874498    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2f52deba-0572-46ea-a401-4c8e1165767b-istio-token\") pod \"e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd-9cwtb\" (UID: \"2f52deba-0572-46ea-a401-4c8e1165767b\") " pod="openshift-ingress/e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd-9cwtb"
Sep 15 14:01:27.874625 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:27.874605    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzcdd\" (UniqueName: \"kubernetes.io/projected/2f52deba-0572-46ea-a401-4c8e1165767b-kube-api-access-mzcdd\") pod \"e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd-9cwtb\" (UID: \"2f52deba-0572-46ea-a401-4c8e1165767b\") " pod="openshift-ingress/e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd-9cwtb"
Sep 15 14:01:28.008171 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:28.007808    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd-9cwtb"
Sep 15 14:01:28.303799 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:28.303775    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd-9cwtb"]
Sep 15 14:01:28.305796 ip-10-0-128-41 kubenswrapper[2578]: W0915 14:01:28.305767    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f52deba_0572_46ea_a401_4c8e1165767b.slice/crio-d64be834ccc0912eb951344f18f31eb0888af0a8cce83f21eb14b73da0a188b5 WatchSource:0}: Error finding container d64be834ccc0912eb951344f18f31eb0888af0a8cce83f21eb14b73da0a188b5: Status 404 returned error can't find the container with id d64be834ccc0912eb951344f18f31eb0888af0a8cce83f21eb14b73da0a188b5
Sep 15 14:01:28.308508 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:28.308474    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 15 14:01:28.308594 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:28.308542    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 15 14:01:28.308594 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:28.308568    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 15 14:01:28.443994 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:28.443955    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd-9cwtb" event={"ID":"2f52deba-0572-46ea-a401-4c8e1165767b","Type":"ContainerStarted","Data":"e9bcb22ed6ff4c10325c40ac0beb040b036bb39674bea1ff974cf75f9062707a"}
Sep 15 14:01:28.444176 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:28.444019    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd-9cwtb" event={"ID":"2f52deba-0572-46ea-a401-4c8e1165767b","Type":"ContainerStarted","Data":"d64be834ccc0912eb951344f18f31eb0888af0a8cce83f21eb14b73da0a188b5"}
Sep 15 14:01:28.463573 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:28.463513    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd-9cwtb" podStartSLOduration=1.463493813 podStartE2EDuration="1.463493813s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 14:01:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 14:01:28.462351962 +0000 UTC m=+1375.221478244" watchObservedRunningTime="2026-09-15 14:01:28.463493813 +0000 UTC m=+1375.222620105"
Sep 15 14:01:29.008933 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:29.008847    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd-9cwtb"
Sep 15 14:01:29.010468 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:29.010444    2578 patch_prober.go:28] interesting pod/e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd-9cwtb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.93:15021/healthz/ready\": dial tcp 10.133.0.93:15021: connect: connection refused" start-of-body=
Sep 15 14:01:29.010582 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:29.010500    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd-9cwtb" podUID="2f52deba-0572-46ea-a401-4c8e1165767b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.93:15021/healthz/ready\": dial tcp 10.133.0.93:15021: connect: connection refused"
Sep 15 14:01:29.451657 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:29.451619    2578 generic.go:356] "Generic (PLEG): container finished" podID="5df03f8b-f687-4a74-8784-082485d4807d" containerID="7accb0ccc26f1b8368708e1335107b6c966ca7770667069507f7a65668198d0d" exitCode=0
Sep 15 14:01:29.451857 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:29.451695    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-583e9a-openshift-default-5556fff988-9rrgj" event={"ID":"5df03f8b-f687-4a74-8784-082485d4807d","Type":"ContainerDied","Data":"7accb0ccc26f1b8368708e1335107b6c966ca7770667069507f7a65668198d0d"}
Sep 15 14:01:29.452281 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:29.452261    2578 scope.go:117] "RemoveContainer" containerID="7accb0ccc26f1b8368708e1335107b6c966ca7770667069507f7a65668198d0d"
Sep 15 14:01:29.453495 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:29.453470    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 15 14:01:29.453555 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:29.453544    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 15 14:01:29.453600 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:29.453589    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 15 14:01:30.017558 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:30.017530    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd-9cwtb"
Sep 15 14:01:30.460324 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:30.460280    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-583e9a-openshift-default-5556fff988-9rrgj" event={"ID":"5df03f8b-f687-4a74-8784-082485d4807d","Type":"ContainerStarted","Data":"923ef4c9aeba475fc214940db26e2a397b76cc132689ac9a276efd6ebad5de0d"}
Sep 15 14:01:30.461235 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:30.461204    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd-9cwtb"
Sep 15 14:01:30.466082 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:30.466055    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd-9cwtb"
Sep 15 14:01:31.257100 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:31.257069    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-583e9a-openshift-default-5556fff988-9rrgj"
Sep 15 14:01:31.425830 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:31.425797    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-583e9a-openshift-default-5556fff988-9rrgj"
Sep 15 14:01:31.427077 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:31.427056    2578 patch_prober.go:28] interesting pod/e2e-shared-a-w2-583e9a-openshift-default-5556fff988-9rrgj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.90:15021/healthz/ready\": dial tcp 10.133.0.90:15021: connect: connection refused" start-of-body=
Sep 15 14:01:31.427154 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:31.427107    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-583e9a-openshift-default-5556fff988-9rrgj" podUID="5df03f8b-f687-4a74-8784-082485d4807d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.90:15021/healthz/ready\": dial tcp 10.133.0.90:15021: connect: connection refused"
Sep 15 14:01:32.426361 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:32.426324    2578 patch_prober.go:28] interesting pod/e2e-shared-a-w2-583e9a-openshift-default-5556fff988-9rrgj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.90:15021/healthz/ready\": dial tcp 10.133.0.90:15021: connect: connection refused" start-of-body=
Sep 15 14:01:32.426746 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:32.426389    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-583e9a-openshift-default-5556fff988-9rrgj" podUID="5df03f8b-f687-4a74-8784-082485d4807d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.90:15021/healthz/ready\": dial tcp 10.133.0.90:15021: connect: connection refused"
Sep 15 14:01:33.426567 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:33.426530    2578 patch_prober.go:28] interesting pod/e2e-shared-a-w2-583e9a-openshift-default-5556fff988-9rrgj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.90:15021/healthz/ready\": dial tcp 10.133.0.90:15021: connect: connection refused" start-of-body=
Sep 15 14:01:33.426958 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:33.426586    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-583e9a-openshift-default-5556fff988-9rrgj" podUID="5df03f8b-f687-4a74-8784-082485d4807d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.90:15021/healthz/ready\": dial tcp 10.133.0.90:15021: connect: connection refused"
Sep 15 14:01:34.425856 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:34.425812    2578 patch_prober.go:28] interesting pod/e2e-shared-a-w2-583e9a-openshift-default-5556fff988-9rrgj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.90:15021/healthz/ready\": dial tcp 10.133.0.90:15021: connect: connection refused" start-of-body=
Sep 15 14:01:34.426016 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:34.425874    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-583e9a-openshift-default-5556fff988-9rrgj" podUID="5df03f8b-f687-4a74-8784-082485d4807d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.90:15021/healthz/ready\": dial tcp 10.133.0.90:15021: connect: connection refused"
Sep 15 14:01:35.425938 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:35.425898    2578 patch_prober.go:28] interesting pod/e2e-shared-a-w2-583e9a-openshift-default-5556fff988-9rrgj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.90:15021/healthz/ready\": dial tcp 10.133.0.90:15021: connect: connection refused" start-of-body=
Sep 15 14:01:35.426322 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:35.425957    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-583e9a-openshift-default-5556fff988-9rrgj" podUID="5df03f8b-f687-4a74-8784-082485d4807d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.90:15021/healthz/ready\": dial tcp 10.133.0.90:15021: connect: connection refused"
Sep 15 14:01:36.430518 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:36.430491    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-583e9a-openshift-default-5556fff988-9rrgj"
Sep 15 14:01:36.432019 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:36.431996    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-583e9a-openshift-default-5556fff988-9rrgj"
Sep 15 14:01:49.588158 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:49.588102    2578 generic.go:356] "Generic (PLEG): container finished" podID="2f52deba-0572-46ea-a401-4c8e1165767b" containerID="e9bcb22ed6ff4c10325c40ac0beb040b036bb39674bea1ff974cf75f9062707a" exitCode=0
Sep 15 14:01:49.588587 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:49.588176    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd-9cwtb" event={"ID":"2f52deba-0572-46ea-a401-4c8e1165767b","Type":"ContainerDied","Data":"e9bcb22ed6ff4c10325c40ac0beb040b036bb39674bea1ff974cf75f9062707a"}
Sep 15 14:01:49.588635 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:49.588605    2578 scope.go:117] "RemoveContainer" containerID="e9bcb22ed6ff4c10325c40ac0beb040b036bb39674bea1ff974cf75f9062707a"
Sep 15 14:01:49.589818 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:49.589793    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 15 14:01:49.589882 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:49.589858    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 15 14:01:49.589918 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:49.589887    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 15 14:01:50.596036 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:50.596000    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd-9cwtb" event={"ID":"2f52deba-0572-46ea-a401-4c8e1165767b","Type":"ContainerStarted","Data":"12153200d16a213d85c6aa1865deb47ddf3a97e0cc39f6fcb2474d2a46ab4a2c"}
Sep 15 14:01:51.008678 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:51.008573    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd-9cwtb"
Sep 15 14:01:51.008850 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:51.008826    2578 patch_prober.go:28] interesting pod/e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd-9cwtb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.93:15021/healthz/ready\": dial tcp 10.133.0.93:15021: connect: connection refused" start-of-body=
Sep 15 14:01:51.008944 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:51.008891    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd-9cwtb" podUID="2f52deba-0572-46ea-a401-4c8e1165767b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.93:15021/healthz/ready\": dial tcp 10.133.0.93:15021: connect: connection refused"
Sep 15 14:01:52.009050 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:52.009017    2578 patch_prober.go:28] interesting pod/e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd-9cwtb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.93:15021/healthz/ready\": dial tcp 10.133.0.93:15021: connect: connection refused" start-of-body=
Sep 15 14:01:52.009455 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:52.009078    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd-9cwtb" podUID="2f52deba-0572-46ea-a401-4c8e1165767b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.93:15021/healthz/ready\": dial tcp 10.133.0.93:15021: connect: connection refused"
Sep 15 14:01:53.008926 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:53.008893    2578 patch_prober.go:28] interesting pod/e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd-9cwtb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.93:15021/healthz/ready\": dial tcp 10.133.0.93:15021: connect: connection refused" start-of-body=
Sep 15 14:01:53.009106 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:53.008948    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd-9cwtb" podUID="2f52deba-0572-46ea-a401-4c8e1165767b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.93:15021/healthz/ready\": dial tcp 10.133.0.93:15021: connect: connection refused"
Sep 15 14:01:54.008523 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:54.008486    2578 patch_prober.go:28] interesting pod/e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd-9cwtb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.93:15021/healthz/ready\": dial tcp 10.133.0.93:15021: connect: connection refused" start-of-body=
Sep 15 14:01:54.008700 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:54.008541    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd-9cwtb" podUID="2f52deba-0572-46ea-a401-4c8e1165767b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.93:15021/healthz/ready\": dial tcp 10.133.0.93:15021: connect: connection refused"
Sep 15 14:01:55.009210 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:55.009172    2578 patch_prober.go:28] interesting pod/e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd-9cwtb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.93:15021/healthz/ready\": dial tcp 10.133.0.93:15021: connect: connection refused" start-of-body=
Sep 15 14:01:55.009692 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:55.009234    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd-9cwtb" podUID="2f52deba-0572-46ea-a401-4c8e1165767b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.93:15021/healthz/ready\": dial tcp 10.133.0.93:15021: connect: connection refused"
Sep 15 14:01:55.957913 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:55.957874    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7711-b5650c"]
Sep 15 14:01:55.961164 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:55.961115    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7711-b5650c"
Sep 15 14:01:55.964155 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:55.964114    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-4xtjh\""
Sep 15 14:01:55.971212 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:55.971188    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7711-b5650c"]
Sep 15 14:01:56.012525 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:56.012496    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd-9cwtb"
Sep 15 14:01:56.012990 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:56.012956    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd-9cwtb"
Sep 15 14:01:56.013770 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:56.013756    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd-9cwtb"
Sep 15 14:01:56.073094 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:56.073063    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmqkr\" (UniqueName: \"kubernetes.io/projected/6dede009-4f7c-44da-81e7-36ed4c7abac2-kube-api-access-lmqkr\") pod \"test-curl-7711-b5650c\" (UID: \"6dede009-4f7c-44da-81e7-36ed4c7abac2\") " pod="opendatahub/test-curl-7711-b5650c"
Sep 15 14:01:56.174471 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:56.174433    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmqkr\" (UniqueName: \"kubernetes.io/projected/6dede009-4f7c-44da-81e7-36ed4c7abac2-kube-api-access-lmqkr\") pod \"test-curl-7711-b5650c\" (UID: \"6dede009-4f7c-44da-81e7-36ed4c7abac2\") " pod="opendatahub/test-curl-7711-b5650c"
Sep 15 14:01:56.182427 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:56.182397    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmqkr\" (UniqueName: \"kubernetes.io/projected/6dede009-4f7c-44da-81e7-36ed4c7abac2-kube-api-access-lmqkr\") pod \"test-curl-7711-b5650c\" (UID: \"6dede009-4f7c-44da-81e7-36ed4c7abac2\") " pod="opendatahub/test-curl-7711-b5650c"
Sep 15 14:01:56.272338 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:56.272246    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7711-b5650c"
Sep 15 14:01:56.544604 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:56.544575    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7711-b5650c"]
Sep 15 14:01:56.546251 ip-10-0-128-41 kubenswrapper[2578]: W0915 14:01:56.546225    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6dede009_4f7c_44da_81e7_36ed4c7abac2.slice/crio-caaaf1cce84ad0de5e6071ef83e054790e22d6c1f5000a6190a2c6c0d98a3e94 WatchSource:0}: Error finding container caaaf1cce84ad0de5e6071ef83e054790e22d6c1f5000a6190a2c6c0d98a3e94: Status 404 returned error can't find the container with id caaaf1cce84ad0de5e6071ef83e054790e22d6c1f5000a6190a2c6c0d98a3e94
Sep 15 14:01:56.633516 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:56.633480    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7711-b5650c" event={"ID":"6dede009-4f7c-44da-81e7-36ed4c7abac2","Type":"ContainerStarted","Data":"83be93f6ae01d9038d7c58df39d081b556d1b0a81b03117712f65be204165e8c"}
Sep 15 14:01:56.633666 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:56.633523    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7711-b5650c" event={"ID":"6dede009-4f7c-44da-81e7-36ed4c7abac2","Type":"ContainerStarted","Data":"caaaf1cce84ad0de5e6071ef83e054790e22d6c1f5000a6190a2c6c0d98a3e94"}
Sep 15 14:01:56.649486 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:56.649429    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7711-b5650c" podStartSLOduration=1.649413992 podStartE2EDuration="1.649413992s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 14:01:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 14:01:56.647306298 +0000 UTC m=+1403.406432585" watchObservedRunningTime="2026-09-15 14:01:56.649413992 +0000 UTC m=+1403.408540326"
Sep 15 14:01:57.250836 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:57.250747    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7711-b5650c"]
Sep 15 14:01:57.254903 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:57.254876    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7711-b5650c"]
Sep 15 14:01:57.365238 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:57.365203    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7711-76c080"]
Sep 15 14:01:57.365684 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:57.365668    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6dede009-4f7c-44da-81e7-36ed4c7abac2" containerName="test-curl-7711-b5650c"
Sep 15 14:01:57.365738 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:57.365686    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="6dede009-4f7c-44da-81e7-36ed4c7abac2" containerName="test-curl-7711-b5650c"
Sep 15 14:01:57.365770 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:57.365754    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="6dede009-4f7c-44da-81e7-36ed4c7abac2" containerName="test-curl-7711-b5650c"
Sep 15 14:01:57.367878 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:57.367864    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7711-76c080"
Sep 15 14:01:57.378612 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:57.378588    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7711-76c080"]
Sep 15 14:01:57.487022 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:57.486989    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgvqw\" (UniqueName: \"kubernetes.io/projected/6b7acb7d-ef11-4296-b66a-d104c5d6b104-kube-api-access-vgvqw\") pod \"test-curl-7711-76c080\" (UID: \"6b7acb7d-ef11-4296-b66a-d104c5d6b104\") " pod="opendatahub/test-curl-7711-76c080"
Sep 15 14:01:57.588199 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:57.588158    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgvqw\" (UniqueName: \"kubernetes.io/projected/6b7acb7d-ef11-4296-b66a-d104c5d6b104-kube-api-access-vgvqw\") pod \"test-curl-7711-76c080\" (UID: \"6b7acb7d-ef11-4296-b66a-d104c5d6b104\") " pod="opendatahub/test-curl-7711-76c080"
Sep 15 14:01:57.597090 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:57.597061    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgvqw\" (UniqueName: \"kubernetes.io/projected/6b7acb7d-ef11-4296-b66a-d104c5d6b104-kube-api-access-vgvqw\") pod \"test-curl-7711-76c080\" (UID: \"6b7acb7d-ef11-4296-b66a-d104c5d6b104\") " pod="opendatahub/test-curl-7711-76c080"
Sep 15 14:01:57.639366 ip-10-0-128-41 kubenswrapper[2578]: E0915 14:01:57.639336    2578 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7711-b5650c" container="test-curl-7711-b5650c"
Sep 15 14:01:57.677581 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:57.677559    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7711-76c080"
Sep 15 14:01:57.951316 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:57.951268    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7711-76c080"]
Sep 15 14:01:58.646811 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:58.646780    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7711-76c080" event={"ID":"6b7acb7d-ef11-4296-b66a-d104c5d6b104","Type":"ContainerStarted","Data":"91f3c0033b2cdd1ed944616b3dd858cbb9c83b75bff4048d88625ae6d20e9564"}
Sep 15 14:01:58.647306 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:58.646827    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7711-76c080" event={"ID":"6b7acb7d-ef11-4296-b66a-d104c5d6b104","Type":"ContainerStarted","Data":"84a77ce22965cf7d3b3e10abd4f8d2946a73016d4e37cd19b62cc451886a1470"}
Sep 15 14:01:58.647306 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:58.646835    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7711-b5650c" podUID="6dede009-4f7c-44da-81e7-36ed4c7abac2" containerName="test-curl-7711-b5650c" containerID="cri-o://83be93f6ae01d9038d7c58df39d081b556d1b0a81b03117712f65be204165e8c" gracePeriod=2
Sep 15 14:01:58.663918 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:58.663872    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7711-76c080" podStartSLOduration=1.663857927 podStartE2EDuration="1.663857927s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 14:01:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 14:01:58.660939867 +0000 UTC m=+1405.420066153" watchObservedRunningTime="2026-09-15 14:01:58.663857927 +0000 UTC m=+1405.422984242"
Sep 15 14:01:59.243637 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:59.243585    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7711-76c080"]
Sep 15 14:01:59.247433 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:59.247396    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7711-76c080"]
Sep 15 14:01:59.362884 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:59.362807    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7711-8fc994"]
Sep 15 14:01:59.363260 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:59.363247    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b7acb7d-ef11-4296-b66a-d104c5d6b104" containerName="test-curl-7711-76c080"
Sep 15 14:01:59.363318 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:59.363262    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b7acb7d-ef11-4296-b66a-d104c5d6b104" containerName="test-curl-7711-76c080"
Sep 15 14:01:59.363353 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:59.363321    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b7acb7d-ef11-4296-b66a-d104c5d6b104" containerName="test-curl-7711-76c080"
Sep 15 14:01:59.365310 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:59.365293    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7711-8fc994"
Sep 15 14:01:59.370961 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:59.370937    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7711-8fc994"]
Sep 15 14:01:59.506114 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:59.506076    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmh5w\" (UniqueName: \"kubernetes.io/projected/23b4c507-475e-4db0-9b5f-91718f027ecb-kube-api-access-tmh5w\") pod \"test-curl-7711-8fc994\" (UID: \"23b4c507-475e-4db0-9b5f-91718f027ecb\") " pod="opendatahub/test-curl-7711-8fc994"
Sep 15 14:01:59.607021 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:59.606987    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmh5w\" (UniqueName: \"kubernetes.io/projected/23b4c507-475e-4db0-9b5f-91718f027ecb-kube-api-access-tmh5w\") pod \"test-curl-7711-8fc994\" (UID: \"23b4c507-475e-4db0-9b5f-91718f027ecb\") " pod="opendatahub/test-curl-7711-8fc994"
Sep 15 14:01:59.616149 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:59.616053    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmh5w\" (UniqueName: \"kubernetes.io/projected/23b4c507-475e-4db0-9b5f-91718f027ecb-kube-api-access-tmh5w\") pod \"test-curl-7711-8fc994\" (UID: \"23b4c507-475e-4db0-9b5f-91718f027ecb\") " pod="opendatahub/test-curl-7711-8fc994"
Sep 15 14:01:59.658762 ip-10-0-128-41 kubenswrapper[2578]: E0915 14:01:59.658732    2578 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7711-76c080" container="test-curl-7711-76c080"
Sep 15 14:01:59.676152 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:59.676110    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7711-8fc994"
Sep 15 14:01:59.949274 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:01:59.949243    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7711-8fc994"]
Sep 15 14:01:59.950979 ip-10-0-128-41 kubenswrapper[2578]: W0915 14:01:59.950955    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod23b4c507_475e_4db0_9b5f_91718f027ecb.slice/crio-4ff45df70d69b373ab49467ba10963de4a38bab7686d649c8a2770b4181fcf77 WatchSource:0}: Error finding container 4ff45df70d69b373ab49467ba10963de4a38bab7686d649c8a2770b4181fcf77: Status 404 returned error can't find the container with id 4ff45df70d69b373ab49467ba10963de4a38bab7686d649c8a2770b4181fcf77
Sep 15 14:02:00.667191 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:00.667162    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7711-8fc994" event={"ID":"23b4c507-475e-4db0-9b5f-91718f027ecb","Type":"ContainerStarted","Data":"d0683ba312b0d33f9f1f9b81e7d7183254724380e87afe4771ca6e1ac3e79ff1"}
Sep 15 14:02:00.667551 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:00.667205    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7711-8fc994" event={"ID":"23b4c507-475e-4db0-9b5f-91718f027ecb","Type":"ContainerStarted","Data":"4ff45df70d69b373ab49467ba10963de4a38bab7686d649c8a2770b4181fcf77"}
Sep 15 14:02:00.667551 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:00.667358    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7711-76c080" podUID="6b7acb7d-ef11-4296-b66a-d104c5d6b104" containerName="test-curl-7711-76c080" containerID="cri-o://91f3c0033b2cdd1ed944616b3dd858cbb9c83b75bff4048d88625ae6d20e9564" gracePeriod=2
Sep 15 14:02:00.682204 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:00.682167    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7711-8fc994" podStartSLOduration=1.682152516 podStartE2EDuration="1.682152516s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 14:01:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 14:02:00.680774278 +0000 UTC m=+1407.439900564" watchObservedRunningTime="2026-09-15 14:02:00.682152516 +0000 UTC m=+1407.441278827"
Sep 15 14:02:00.820833 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:00.820807    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7711-b5650c"
Sep 15 14:02:01.021406 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:01.021316    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lmqkr\" (UniqueName: \"kubernetes.io/projected/6dede009-4f7c-44da-81e7-36ed4c7abac2-kube-api-access-lmqkr\") pod \"6dede009-4f7c-44da-81e7-36ed4c7abac2\" (UID: \"6dede009-4f7c-44da-81e7-36ed4c7abac2\") "
Sep 15 14:02:01.023507 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:01.023484    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6dede009-4f7c-44da-81e7-36ed4c7abac2-kube-api-access-lmqkr" (OuterVolumeSpecName: "kube-api-access-lmqkr") pod "6dede009-4f7c-44da-81e7-36ed4c7abac2" (UID: "6dede009-4f7c-44da-81e7-36ed4c7abac2"). InnerVolumeSpecName "kube-api-access-lmqkr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 14:02:01.122204 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:01.122174    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lmqkr\" (UniqueName: \"kubernetes.io/projected/6dede009-4f7c-44da-81e7-36ed4c7abac2-kube-api-access-lmqkr\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:02:01.258082 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:01.258052    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7711-8fc994"]
Sep 15 14:02:01.262086 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:01.262060    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7711-8fc994"]
Sep 15 14:02:01.371505 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:01.371476    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7711-3ea356"]
Sep 15 14:02:01.371888 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:01.371874    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23b4c507-475e-4db0-9b5f-91718f027ecb" containerName="test-curl-7711-8fc994"
Sep 15 14:02:01.371932 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:01.371890    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="23b4c507-475e-4db0-9b5f-91718f027ecb" containerName="test-curl-7711-8fc994"
Sep 15 14:02:01.371982 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:01.371974    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="23b4c507-475e-4db0-9b5f-91718f027ecb" containerName="test-curl-7711-8fc994"
Sep 15 14:02:01.374215 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:01.374198    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7711-3ea356"
Sep 15 14:02:01.381035 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:01.381008    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7711-3ea356"]
Sep 15 14:02:01.424379 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:01.424351    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwd6w\" (UniqueName: \"kubernetes.io/projected/75eb893f-642e-4b14-ac2a-97f435fc651b-kube-api-access-fwd6w\") pod \"test-curl-7711-3ea356\" (UID: \"75eb893f-642e-4b14-ac2a-97f435fc651b\") " pod="opendatahub/test-curl-7711-3ea356"
Sep 15 14:02:01.525564 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:01.525533    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwd6w\" (UniqueName: \"kubernetes.io/projected/75eb893f-642e-4b14-ac2a-97f435fc651b-kube-api-access-fwd6w\") pod \"test-curl-7711-3ea356\" (UID: \"75eb893f-642e-4b14-ac2a-97f435fc651b\") " pod="opendatahub/test-curl-7711-3ea356"
Sep 15 14:02:01.535760 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:01.535739    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwd6w\" (UniqueName: \"kubernetes.io/projected/75eb893f-642e-4b14-ac2a-97f435fc651b-kube-api-access-fwd6w\") pod \"test-curl-7711-3ea356\" (UID: \"75eb893f-642e-4b14-ac2a-97f435fc651b\") " pod="opendatahub/test-curl-7711-3ea356"
Sep 15 14:02:01.674751 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:01.674666    2578 generic.go:356] "Generic (PLEG): container finished" podID="6dede009-4f7c-44da-81e7-36ed4c7abac2" containerID="83be93f6ae01d9038d7c58df39d081b556d1b0a81b03117712f65be204165e8c" exitCode=137
Sep 15 14:02:01.674751 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:01.674708    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7711-b5650c"
Sep 15 14:02:01.675214 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:01.674779    2578 scope.go:117] "RemoveContainer" containerID="83be93f6ae01d9038d7c58df39d081b556d1b0a81b03117712f65be204165e8c"
Sep 15 14:02:01.675214 ip-10-0-128-41 kubenswrapper[2578]: E0915 14:02:01.675077    2578 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7711-8fc994" container="test-curl-7711-8fc994"
Sep 15 14:02:01.684305 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:01.684288    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7711-3ea356"
Sep 15 14:02:01.684517 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:01.684498    2578 scope.go:117] "RemoveContainer" containerID="83be93f6ae01d9038d7c58df39d081b556d1b0a81b03117712f65be204165e8c"
Sep 15 14:02:01.684788 ip-10-0-128-41 kubenswrapper[2578]: E0915 14:02:01.684770    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83be93f6ae01d9038d7c58df39d081b556d1b0a81b03117712f65be204165e8c\": container with ID starting with 83be93f6ae01d9038d7c58df39d081b556d1b0a81b03117712f65be204165e8c not found: ID does not exist" containerID="83be93f6ae01d9038d7c58df39d081b556d1b0a81b03117712f65be204165e8c"
Sep 15 14:02:01.684840 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:01.684798    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83be93f6ae01d9038d7c58df39d081b556d1b0a81b03117712f65be204165e8c"} err="failed to get container status \"83be93f6ae01d9038d7c58df39d081b556d1b0a81b03117712f65be204165e8c\": rpc error: code = NotFound desc = could not find container \"83be93f6ae01d9038d7c58df39d081b556d1b0a81b03117712f65be204165e8c\": container with ID starting with 83be93f6ae01d9038d7c58df39d081b556d1b0a81b03117712f65be204165e8c not found: ID does not exist"
Sep 15 14:02:01.685715 ip-10-0-128-41 kubenswrapper[2578]: E0915 14:02:01.685695    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7711-b5650c\" is forbidden: User \"system:node:ip-10-0-128-41.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-128-41.ec2.internal' and this object" podUID="6dede009-4f7c-44da-81e7-36ed4c7abac2" pod="opendatahub/test-curl-7711-b5650c"
Sep 15 14:02:01.761179 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:01.761144    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6dede009-4f7c-44da-81e7-36ed4c7abac2" path="/var/lib/kubelet/pods/6dede009-4f7c-44da-81e7-36ed4c7abac2/volumes"
Sep 15 14:02:01.953732 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:01.953707    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7711-3ea356"]
Sep 15 14:02:01.955299 ip-10-0-128-41 kubenswrapper[2578]: W0915 14:02:01.955269    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod75eb893f_642e_4b14_ac2a_97f435fc651b.slice/crio-96e653c8640273bd2970e7227078da07c7ea4813d3afee9fffe900aa584b3348 WatchSource:0}: Error finding container 96e653c8640273bd2970e7227078da07c7ea4813d3afee9fffe900aa584b3348: Status 404 returned error can't find the container with id 96e653c8640273bd2970e7227078da07c7ea4813d3afee9fffe900aa584b3348
Sep 15 14:02:02.683189 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:02.683160    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7711-3ea356" event={"ID":"75eb893f-642e-4b14-ac2a-97f435fc651b","Type":"ContainerStarted","Data":"153032be6a38b2093f342294e76173b957cfaea4bf30e2eed6429b0d2f35425f"}
Sep 15 14:02:02.683556 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:02.683208    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7711-3ea356" event={"ID":"75eb893f-642e-4b14-ac2a-97f435fc651b","Type":"ContainerStarted","Data":"96e653c8640273bd2970e7227078da07c7ea4813d3afee9fffe900aa584b3348"}
Sep 15 14:02:02.684379 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:02.684354    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7711-8fc994" podUID="23b4c507-475e-4db0-9b5f-91718f027ecb" containerName="test-curl-7711-8fc994" containerID="cri-o://d0683ba312b0d33f9f1f9b81e7d7183254724380e87afe4771ca6e1ac3e79ff1" gracePeriod=2
Sep 15 14:02:02.703919 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:02.703869    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7711-3ea356" podStartSLOduration=1.703849551 podStartE2EDuration="1.703849551s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 14:02:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 14:02:02.700955249 +0000 UTC m=+1409.460081535" watchObservedRunningTime="2026-09-15 14:02:02.703849551 +0000 UTC m=+1409.462975836"
Sep 15 14:02:02.816538 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:02.816511    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7711-76c080"
Sep 15 14:02:02.835957 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:02.835937    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vgvqw\" (UniqueName: \"kubernetes.io/projected/6b7acb7d-ef11-4296-b66a-d104c5d6b104-kube-api-access-vgvqw\") pod \"6b7acb7d-ef11-4296-b66a-d104c5d6b104\" (UID: \"6b7acb7d-ef11-4296-b66a-d104c5d6b104\") "
Sep 15 14:02:02.838222 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:02.838188    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b7acb7d-ef11-4296-b66a-d104c5d6b104-kube-api-access-vgvqw" (OuterVolumeSpecName: "kube-api-access-vgvqw") pod "6b7acb7d-ef11-4296-b66a-d104c5d6b104" (UID: "6b7acb7d-ef11-4296-b66a-d104c5d6b104"). InnerVolumeSpecName "kube-api-access-vgvqw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 14:02:02.937318 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:02.937235    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vgvqw\" (UniqueName: \"kubernetes.io/projected/6b7acb7d-ef11-4296-b66a-d104c5d6b104-kube-api-access-vgvqw\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:02:03.271338 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:03.271255    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7711-3ea356"]
Sep 15 14:02:03.274614 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:03.274586    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7711-3ea356"]
Sep 15 14:02:03.698844 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:03.698807    2578 generic.go:356] "Generic (PLEG): container finished" podID="6b7acb7d-ef11-4296-b66a-d104c5d6b104" containerID="91f3c0033b2cdd1ed944616b3dd858cbb9c83b75bff4048d88625ae6d20e9564" exitCode=137
Sep 15 14:02:03.699330 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:03.698863    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7711-76c080"
Sep 15 14:02:03.699330 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:03.698903    2578 scope.go:117] "RemoveContainer" containerID="91f3c0033b2cdd1ed944616b3dd858cbb9c83b75bff4048d88625ae6d20e9564"
Sep 15 14:02:03.699470 ip-10-0-128-41 kubenswrapper[2578]: E0915 14:02:03.699330    2578 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7711-3ea356" container="test-curl-7711-3ea356"
Sep 15 14:02:03.708307 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:03.708288    2578 scope.go:117] "RemoveContainer" containerID="91f3c0033b2cdd1ed944616b3dd858cbb9c83b75bff4048d88625ae6d20e9564"
Sep 15 14:02:03.708585 ip-10-0-128-41 kubenswrapper[2578]: E0915 14:02:03.708566    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91f3c0033b2cdd1ed944616b3dd858cbb9c83b75bff4048d88625ae6d20e9564\": container with ID starting with 91f3c0033b2cdd1ed944616b3dd858cbb9c83b75bff4048d88625ae6d20e9564 not found: ID does not exist" containerID="91f3c0033b2cdd1ed944616b3dd858cbb9c83b75bff4048d88625ae6d20e9564"
Sep 15 14:02:03.708639 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:03.708593    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91f3c0033b2cdd1ed944616b3dd858cbb9c83b75bff4048d88625ae6d20e9564"} err="failed to get container status \"91f3c0033b2cdd1ed944616b3dd858cbb9c83b75bff4048d88625ae6d20e9564\": rpc error: code = NotFound desc = could not find container \"91f3c0033b2cdd1ed944616b3dd858cbb9c83b75bff4048d88625ae6d20e9564\": container with ID starting with 91f3c0033b2cdd1ed944616b3dd858cbb9c83b75bff4048d88625ae6d20e9564 not found: ID does not exist"
Sep 15 14:02:03.709257 ip-10-0-128-41 kubenswrapper[2578]: E0915 14:02:03.709234    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7711-76c080\" is forbidden: User \"system:node:ip-10-0-128-41.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-128-41.ec2.internal' and this object" podUID="6b7acb7d-ef11-4296-b66a-d104c5d6b104" pod="opendatahub/test-curl-7711-76c080"
Sep 15 14:02:03.756771 ip-10-0-128-41 kubenswrapper[2578]: E0915 14:02:03.756737    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7711-76c080\" is forbidden: User \"system:node:ip-10-0-128-41.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-128-41.ec2.internal' and this object" podUID="6b7acb7d-ef11-4296-b66a-d104c5d6b104" pod="opendatahub/test-curl-7711-76c080"
Sep 15 14:02:03.758964 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:03.758939    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b7acb7d-ef11-4296-b66a-d104c5d6b104" path="/var/lib/kubelet/pods/6b7acb7d-ef11-4296-b66a-d104c5d6b104/volumes"
Sep 15 14:02:04.089733 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:04.089703    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-5842bc8c-openshift-default-5f95546cbd-jv67x"]
Sep 15 14:02:04.090146 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:04.090119    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75eb893f-642e-4b14-ac2a-97f435fc651b" containerName="test-curl-7711-3ea356"
Sep 15 14:02:04.090195 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:04.090147    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="75eb893f-642e-4b14-ac2a-97f435fc651b" containerName="test-curl-7711-3ea356"
Sep 15 14:02:04.090233 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:04.090216    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="75eb893f-642e-4b14-ac2a-97f435fc651b" containerName="test-curl-7711-3ea356"
Sep 15 14:02:04.093307 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:04.093287    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5842bc8c-openshift-default-5f95546cbd-jv67x"
Sep 15 14:02:04.095534 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:04.095515    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-5842bc8c-openshift-default-dockercfg-j5kzw\""
Sep 15 14:02:04.105989 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:04.105928    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-5842bc8c-openshift-default-5f95546cbd-jv67x"]
Sep 15 14:02:04.146532 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:04.146502    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dc735386-fdae-445d-8e52-d57a6a897fd4-istio-envoy\") pod \"e2e-mt-5842bc8c-openshift-default-5f95546cbd-jv67x\" (UID: \"dc735386-fdae-445d-8e52-d57a6a897fd4\") " pod="openshift-ingress/e2e-mt-5842bc8c-openshift-default-5f95546cbd-jv67x"
Sep 15 14:02:04.146532 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:04.146533    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dc735386-fdae-445d-8e52-d57a6a897fd4-istio-data\") pod \"e2e-mt-5842bc8c-openshift-default-5f95546cbd-jv67x\" (UID: \"dc735386-fdae-445d-8e52-d57a6a897fd4\") " pod="openshift-ingress/e2e-mt-5842bc8c-openshift-default-5f95546cbd-jv67x"
Sep 15 14:02:04.146728 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:04.146553    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc735386-fdae-445d-8e52-d57a6a897fd4-workload-socket\") pod \"e2e-mt-5842bc8c-openshift-default-5f95546cbd-jv67x\" (UID: \"dc735386-fdae-445d-8e52-d57a6a897fd4\") " pod="openshift-ingress/e2e-mt-5842bc8c-openshift-default-5f95546cbd-jv67x"
Sep 15 14:02:04.146728 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:04.146617    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc735386-fdae-445d-8e52-d57a6a897fd4-workload-certs\") pod \"e2e-mt-5842bc8c-openshift-default-5f95546cbd-jv67x\" (UID: \"dc735386-fdae-445d-8e52-d57a6a897fd4\") " pod="openshift-ingress/e2e-mt-5842bc8c-openshift-default-5f95546cbd-jv67x"
Sep 15 14:02:04.146728 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:04.146657    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dc735386-fdae-445d-8e52-d57a6a897fd4-istiod-ca-cert\") pod \"e2e-mt-5842bc8c-openshift-default-5f95546cbd-jv67x\" (UID: \"dc735386-fdae-445d-8e52-d57a6a897fd4\") " pod="openshift-ingress/e2e-mt-5842bc8c-openshift-default-5f95546cbd-jv67x"
Sep 15 14:02:04.146728 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:04.146694    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpfvj\" (UniqueName: \"kubernetes.io/projected/dc735386-fdae-445d-8e52-d57a6a897fd4-kube-api-access-zpfvj\") pod \"e2e-mt-5842bc8c-openshift-default-5f95546cbd-jv67x\" (UID: \"dc735386-fdae-445d-8e52-d57a6a897fd4\") " pod="openshift-ingress/e2e-mt-5842bc8c-openshift-default-5f95546cbd-jv67x"
Sep 15 14:02:04.146728 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:04.146727    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dc735386-fdae-445d-8e52-d57a6a897fd4-istio-podinfo\") pod \"e2e-mt-5842bc8c-openshift-default-5f95546cbd-jv67x\" (UID: \"dc735386-fdae-445d-8e52-d57a6a897fd4\") " pod="openshift-ingress/e2e-mt-5842bc8c-openshift-default-5f95546cbd-jv67x"
Sep 15 14:02:04.146885 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:04.146771    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc735386-fdae-445d-8e52-d57a6a897fd4-credential-socket\") pod \"e2e-mt-5842bc8c-openshift-default-5f95546cbd-jv67x\" (UID: \"dc735386-fdae-445d-8e52-d57a6a897fd4\") " pod="openshift-ingress/e2e-mt-5842bc8c-openshift-default-5f95546cbd-jv67x"
Sep 15 14:02:04.146885 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:04.146785    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dc735386-fdae-445d-8e52-d57a6a897fd4-istio-token\") pod \"e2e-mt-5842bc8c-openshift-default-5f95546cbd-jv67x\" (UID: \"dc735386-fdae-445d-8e52-d57a6a897fd4\") " pod="openshift-ingress/e2e-mt-5842bc8c-openshift-default-5f95546cbd-jv67x"
Sep 15 14:02:04.247700 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:04.247663    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc735386-fdae-445d-8e52-d57a6a897fd4-workload-certs\") pod \"e2e-mt-5842bc8c-openshift-default-5f95546cbd-jv67x\" (UID: \"dc735386-fdae-445d-8e52-d57a6a897fd4\") " pod="openshift-ingress/e2e-mt-5842bc8c-openshift-default-5f95546cbd-jv67x"
Sep 15 14:02:04.247876 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:04.247724    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dc735386-fdae-445d-8e52-d57a6a897fd4-istiod-ca-cert\") pod \"e2e-mt-5842bc8c-openshift-default-5f95546cbd-jv67x\" (UID: \"dc735386-fdae-445d-8e52-d57a6a897fd4\") " pod="openshift-ingress/e2e-mt-5842bc8c-openshift-default-5f95546cbd-jv67x"
Sep 15 14:02:04.247876 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:04.247775    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpfvj\" (UniqueName: \"kubernetes.io/projected/dc735386-fdae-445d-8e52-d57a6a897fd4-kube-api-access-zpfvj\") pod \"e2e-mt-5842bc8c-openshift-default-5f95546cbd-jv67x\" (UID: \"dc735386-fdae-445d-8e52-d57a6a897fd4\") " pod="openshift-ingress/e2e-mt-5842bc8c-openshift-default-5f95546cbd-jv67x"
Sep 15 14:02:04.247876 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:04.247810    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dc735386-fdae-445d-8e52-d57a6a897fd4-istio-podinfo\") pod \"e2e-mt-5842bc8c-openshift-default-5f95546cbd-jv67x\" (UID: \"dc735386-fdae-445d-8e52-d57a6a897fd4\") " pod="openshift-ingress/e2e-mt-5842bc8c-openshift-default-5f95546cbd-jv67x"
Sep 15 14:02:04.247876 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:04.247870    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc735386-fdae-445d-8e52-d57a6a897fd4-credential-socket\") pod \"e2e-mt-5842bc8c-openshift-default-5f95546cbd-jv67x\" (UID: \"dc735386-fdae-445d-8e52-d57a6a897fd4\") " pod="openshift-ingress/e2e-mt-5842bc8c-openshift-default-5f95546cbd-jv67x"
Sep 15 14:02:04.248094 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:04.247893    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dc735386-fdae-445d-8e52-d57a6a897fd4-istio-token\") pod \"e2e-mt-5842bc8c-openshift-default-5f95546cbd-jv67x\" (UID: \"dc735386-fdae-445d-8e52-d57a6a897fd4\") " pod="openshift-ingress/e2e-mt-5842bc8c-openshift-default-5f95546cbd-jv67x"
Sep 15 14:02:04.248094 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:04.247967    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dc735386-fdae-445d-8e52-d57a6a897fd4-istio-envoy\") pod \"e2e-mt-5842bc8c-openshift-default-5f95546cbd-jv67x\" (UID: \"dc735386-fdae-445d-8e52-d57a6a897fd4\") " pod="openshift-ingress/e2e-mt-5842bc8c-openshift-default-5f95546cbd-jv67x"
Sep 15 14:02:04.248094 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:04.247994    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dc735386-fdae-445d-8e52-d57a6a897fd4-istio-data\") pod \"e2e-mt-5842bc8c-openshift-default-5f95546cbd-jv67x\" (UID: \"dc735386-fdae-445d-8e52-d57a6a897fd4\") " pod="openshift-ingress/e2e-mt-5842bc8c-openshift-default-5f95546cbd-jv67x"
Sep 15 14:02:04.248094 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:04.248022    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc735386-fdae-445d-8e52-d57a6a897fd4-workload-socket\") pod \"e2e-mt-5842bc8c-openshift-default-5f95546cbd-jv67x\" (UID: \"dc735386-fdae-445d-8e52-d57a6a897fd4\") " pod="openshift-ingress/e2e-mt-5842bc8c-openshift-default-5f95546cbd-jv67x"
Sep 15 14:02:04.248323 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:04.248161    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc735386-fdae-445d-8e52-d57a6a897fd4-workload-certs\") pod \"e2e-mt-5842bc8c-openshift-default-5f95546cbd-jv67x\" (UID: \"dc735386-fdae-445d-8e52-d57a6a897fd4\") " pod="openshift-ingress/e2e-mt-5842bc8c-openshift-default-5f95546cbd-jv67x"
Sep 15 14:02:04.248377 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:04.248326    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc735386-fdae-445d-8e52-d57a6a897fd4-credential-socket\") pod \"e2e-mt-5842bc8c-openshift-default-5f95546cbd-jv67x\" (UID: \"dc735386-fdae-445d-8e52-d57a6a897fd4\") " pod="openshift-ingress/e2e-mt-5842bc8c-openshift-default-5f95546cbd-jv67x"
Sep 15 14:02:04.248425 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:04.248401    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc735386-fdae-445d-8e52-d57a6a897fd4-workload-socket\") pod \"e2e-mt-5842bc8c-openshift-default-5f95546cbd-jv67x\" (UID: \"dc735386-fdae-445d-8e52-d57a6a897fd4\") " pod="openshift-ingress/e2e-mt-5842bc8c-openshift-default-5f95546cbd-jv67x"
Sep 15 14:02:04.248551 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:04.248528    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dc735386-fdae-445d-8e52-d57a6a897fd4-istio-data\") pod \"e2e-mt-5842bc8c-openshift-default-5f95546cbd-jv67x\" (UID: \"dc735386-fdae-445d-8e52-d57a6a897fd4\") " pod="openshift-ingress/e2e-mt-5842bc8c-openshift-default-5f95546cbd-jv67x"
Sep 15 14:02:04.248790 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:04.248643    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dc735386-fdae-445d-8e52-d57a6a897fd4-istiod-ca-cert\") pod \"e2e-mt-5842bc8c-openshift-default-5f95546cbd-jv67x\" (UID: \"dc735386-fdae-445d-8e52-d57a6a897fd4\") " pod="openshift-ingress/e2e-mt-5842bc8c-openshift-default-5f95546cbd-jv67x"
Sep 15 14:02:04.250447 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:04.250428    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dc735386-fdae-445d-8e52-d57a6a897fd4-istio-envoy\") pod \"e2e-mt-5842bc8c-openshift-default-5f95546cbd-jv67x\" (UID: \"dc735386-fdae-445d-8e52-d57a6a897fd4\") " pod="openshift-ingress/e2e-mt-5842bc8c-openshift-default-5f95546cbd-jv67x"
Sep 15 14:02:04.250538 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:04.250448    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dc735386-fdae-445d-8e52-d57a6a897fd4-istio-podinfo\") pod \"e2e-mt-5842bc8c-openshift-default-5f95546cbd-jv67x\" (UID: \"dc735386-fdae-445d-8e52-d57a6a897fd4\") " pod="openshift-ingress/e2e-mt-5842bc8c-openshift-default-5f95546cbd-jv67x"
Sep 15 14:02:04.258287 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:04.258262    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dc735386-fdae-445d-8e52-d57a6a897fd4-istio-token\") pod \"e2e-mt-5842bc8c-openshift-default-5f95546cbd-jv67x\" (UID: \"dc735386-fdae-445d-8e52-d57a6a897fd4\") " pod="openshift-ingress/e2e-mt-5842bc8c-openshift-default-5f95546cbd-jv67x"
Sep 15 14:02:04.258555 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:04.258535    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpfvj\" (UniqueName: \"kubernetes.io/projected/dc735386-fdae-445d-8e52-d57a6a897fd4-kube-api-access-zpfvj\") pod \"e2e-mt-5842bc8c-openshift-default-5f95546cbd-jv67x\" (UID: \"dc735386-fdae-445d-8e52-d57a6a897fd4\") " pod="openshift-ingress/e2e-mt-5842bc8c-openshift-default-5f95546cbd-jv67x"
Sep 15 14:02:04.404914 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:04.404823    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5842bc8c-openshift-default-5f95546cbd-jv67x"
Sep 15 14:02:04.687348 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:04.687320    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-5842bc8c-openshift-default-5f95546cbd-jv67x"]
Sep 15 14:02:04.688932 ip-10-0-128-41 kubenswrapper[2578]: W0915 14:02:04.688901    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc735386_fdae_445d_8e52_d57a6a897fd4.slice/crio-a2a862fb490e7d094c4f764a569b5190c563672c683d0caff768ca2e3b712334 WatchSource:0}: Error finding container a2a862fb490e7d094c4f764a569b5190c563672c683d0caff768ca2e3b712334: Status 404 returned error can't find the container with id a2a862fb490e7d094c4f764a569b5190c563672c683d0caff768ca2e3b712334
Sep 15 14:02:04.692006 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:04.691962    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 15 14:02:04.692094 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:04.692051    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 15 14:02:04.692151 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:04.692091    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 15 14:02:04.710960 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:04.710935    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5842bc8c-openshift-default-5f95546cbd-jv67x" event={"ID":"dc735386-fdae-445d-8e52-d57a6a897fd4","Type":"ContainerStarted","Data":"a2a862fb490e7d094c4f764a569b5190c563672c683d0caff768ca2e3b712334"}
Sep 15 14:02:04.712085 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:04.712060    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7711-3ea356" podUID="75eb893f-642e-4b14-ac2a-97f435fc651b" containerName="test-curl-7711-3ea356" containerID="cri-o://153032be6a38b2093f342294e76173b957cfaea4bf30e2eed6429b0d2f35425f" gracePeriod=2
Sep 15 14:02:04.812193 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:04.812169    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7711-8fc994"
Sep 15 14:02:04.854297 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:04.854252    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tmh5w\" (UniqueName: \"kubernetes.io/projected/23b4c507-475e-4db0-9b5f-91718f027ecb-kube-api-access-tmh5w\") pod \"23b4c507-475e-4db0-9b5f-91718f027ecb\" (UID: \"23b4c507-475e-4db0-9b5f-91718f027ecb\") "
Sep 15 14:02:04.856498 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:04.856469    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23b4c507-475e-4db0-9b5f-91718f027ecb-kube-api-access-tmh5w" (OuterVolumeSpecName: "kube-api-access-tmh5w") pod "23b4c507-475e-4db0-9b5f-91718f027ecb" (UID: "23b4c507-475e-4db0-9b5f-91718f027ecb"). InnerVolumeSpecName "kube-api-access-tmh5w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 14:02:04.956091 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:04.956014    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tmh5w\" (UniqueName: \"kubernetes.io/projected/23b4c507-475e-4db0-9b5f-91718f027ecb-kube-api-access-tmh5w\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:02:05.719804 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:05.719760    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5842bc8c-openshift-default-5f95546cbd-jv67x" event={"ID":"dc735386-fdae-445d-8e52-d57a6a897fd4","Type":"ContainerStarted","Data":"00e15ad6103a4ace0538570c73b0bbda2b17e3b2f0aaecd08007b3abaf0ab397"}
Sep 15 14:02:05.721058 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:05.721030    2578 generic.go:356] "Generic (PLEG): container finished" podID="23b4c507-475e-4db0-9b5f-91718f027ecb" containerID="d0683ba312b0d33f9f1f9b81e7d7183254724380e87afe4771ca6e1ac3e79ff1" exitCode=137
Sep 15 14:02:05.721189 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:05.721069    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7711-8fc994"
Sep 15 14:02:05.721189 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:05.721150    2578 scope.go:117] "RemoveContainer" containerID="d0683ba312b0d33f9f1f9b81e7d7183254724380e87afe4771ca6e1ac3e79ff1"
Sep 15 14:02:05.730860 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:05.730840    2578 scope.go:117] "RemoveContainer" containerID="d0683ba312b0d33f9f1f9b81e7d7183254724380e87afe4771ca6e1ac3e79ff1"
Sep 15 14:02:05.731111 ip-10-0-128-41 kubenswrapper[2578]: E0915 14:02:05.731093    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0683ba312b0d33f9f1f9b81e7d7183254724380e87afe4771ca6e1ac3e79ff1\": container with ID starting with d0683ba312b0d33f9f1f9b81e7d7183254724380e87afe4771ca6e1ac3e79ff1 not found: ID does not exist" containerID="d0683ba312b0d33f9f1f9b81e7d7183254724380e87afe4771ca6e1ac3e79ff1"
Sep 15 14:02:05.731209 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:05.731119    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0683ba312b0d33f9f1f9b81e7d7183254724380e87afe4771ca6e1ac3e79ff1"} err="failed to get container status \"d0683ba312b0d33f9f1f9b81e7d7183254724380e87afe4771ca6e1ac3e79ff1\": rpc error: code = NotFound desc = could not find container \"d0683ba312b0d33f9f1f9b81e7d7183254724380e87afe4771ca6e1ac3e79ff1\": container with ID starting with d0683ba312b0d33f9f1f9b81e7d7183254724380e87afe4771ca6e1ac3e79ff1 not found: ID does not exist"
Sep 15 14:02:05.742967 ip-10-0-128-41 kubenswrapper[2578]: E0915 14:02:05.742942    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7711-8fc994\" is forbidden: User \"system:node:ip-10-0-128-41.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-128-41.ec2.internal' and this object" podUID="23b4c507-475e-4db0-9b5f-91718f027ecb" pod="opendatahub/test-curl-7711-8fc994"
Sep 15 14:02:05.742967 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:05.742938    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-5842bc8c-openshift-default-5f95546cbd-jv67x" podStartSLOduration=1.7429233549999998 podStartE2EDuration="1.742923355s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 14:02:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 14:02:05.740587532 +0000 UTC m=+1412.499713817" watchObservedRunningTime="2026-09-15 14:02:05.742923355 +0000 UTC m=+1412.502049642"
Sep 15 14:02:05.758785 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:05.758762    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23b4c507-475e-4db0-9b5f-91718f027ecb" path="/var/lib/kubelet/pods/23b4c507-475e-4db0-9b5f-91718f027ecb/volumes"
Sep 15 14:02:06.405301 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:06.405267    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-5842bc8c-openshift-default-5f95546cbd-jv67x"
Sep 15 14:02:06.410806 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:06.410781    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-5842bc8c-openshift-default-5f95546cbd-jv67x"
Sep 15 14:02:06.728721 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:06.728695    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-5842bc8c-openshift-default-5f95546cbd-jv67x"
Sep 15 14:02:06.729755 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:06.729738    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-5842bc8c-openshift-default-5f95546cbd-jv67x"
Sep 15 14:02:06.897869 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:06.897845    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7711-3ea356"
Sep 15 14:02:06.979459 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:06.979382    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fwd6w\" (UniqueName: \"kubernetes.io/projected/75eb893f-642e-4b14-ac2a-97f435fc651b-kube-api-access-fwd6w\") pod \"75eb893f-642e-4b14-ac2a-97f435fc651b\" (UID: \"75eb893f-642e-4b14-ac2a-97f435fc651b\") "
Sep 15 14:02:06.981524 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:06.981499    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75eb893f-642e-4b14-ac2a-97f435fc651b-kube-api-access-fwd6w" (OuterVolumeSpecName: "kube-api-access-fwd6w") pod "75eb893f-642e-4b14-ac2a-97f435fc651b" (UID: "75eb893f-642e-4b14-ac2a-97f435fc651b"). InnerVolumeSpecName "kube-api-access-fwd6w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 14:02:07.080370 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:07.080328    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fwd6w\" (UniqueName: \"kubernetes.io/projected/75eb893f-642e-4b14-ac2a-97f435fc651b-kube-api-access-fwd6w\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:02:07.742873 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:07.742841    2578 generic.go:356] "Generic (PLEG): container finished" podID="75eb893f-642e-4b14-ac2a-97f435fc651b" containerID="153032be6a38b2093f342294e76173b957cfaea4bf30e2eed6429b0d2f35425f" exitCode=137
Sep 15 14:02:07.743365 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:07.742898    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7711-3ea356"
Sep 15 14:02:07.743365 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:07.742947    2578 scope.go:117] "RemoveContainer" containerID="153032be6a38b2093f342294e76173b957cfaea4bf30e2eed6429b0d2f35425f"
Sep 15 14:02:07.752819 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:07.752650    2578 scope.go:117] "RemoveContainer" containerID="153032be6a38b2093f342294e76173b957cfaea4bf30e2eed6429b0d2f35425f"
Sep 15 14:02:07.753009 ip-10-0-128-41 kubenswrapper[2578]: E0915 14:02:07.752980    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"153032be6a38b2093f342294e76173b957cfaea4bf30e2eed6429b0d2f35425f\": container with ID starting with 153032be6a38b2093f342294e76173b957cfaea4bf30e2eed6429b0d2f35425f not found: ID does not exist" containerID="153032be6a38b2093f342294e76173b957cfaea4bf30e2eed6429b0d2f35425f"
Sep 15 14:02:07.753079 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:07.753021    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"153032be6a38b2093f342294e76173b957cfaea4bf30e2eed6429b0d2f35425f"} err="failed to get container status \"153032be6a38b2093f342294e76173b957cfaea4bf30e2eed6429b0d2f35425f\": rpc error: code = NotFound desc = could not find container \"153032be6a38b2093f342294e76173b957cfaea4bf30e2eed6429b0d2f35425f\": container with ID starting with 153032be6a38b2093f342294e76173b957cfaea4bf30e2eed6429b0d2f35425f not found: ID does not exist"
Sep 15 14:02:07.753687 ip-10-0-128-41 kubenswrapper[2578]: E0915 14:02:07.753661    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7711-3ea356\" is forbidden: User \"system:node:ip-10-0-128-41.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-128-41.ec2.internal' and this object" podUID="75eb893f-642e-4b14-ac2a-97f435fc651b" pod="opendatahub/test-curl-7711-3ea356"
Sep 15 14:02:07.757908 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:07.757882    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75eb893f-642e-4b14-ac2a-97f435fc651b" path="/var/lib/kubelet/pods/75eb893f-642e-4b14-ac2a-97f435fc651b/volumes"
Sep 15 14:02:12.520255 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:12.520224    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-5842bc8c-56d56f769-sj65g"]
Sep 15 14:02:12.524180 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:12.524157    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-5842bc8c-56d56f769-sj65g"
Sep 15 14:02:12.526934 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:12.526904    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-5842bc8c\""
Sep 15 14:02:12.527107 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:12.526966    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-5842bc8c-dockercfg-57jv2\""
Sep 15 14:02:12.534585 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:12.534562    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-5842bc8c-56d56f769-sj65g"]
Sep 15 14:02:12.638762 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:12.638730    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfz7s\" (UniqueName: \"kubernetes.io/projected/9a821092-6e14-43e2-b542-429692eb4c0e-kube-api-access-lfz7s\") pod \"payload-processing-e2e-mt-5842bc8c-56d56f769-sj65g\" (UID: \"9a821092-6e14-43e2-b542-429692eb4c0e\") " pod="openshift-ingress/payload-processing-e2e-mt-5842bc8c-56d56f769-sj65g"
Sep 15 14:02:12.638926 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:12.638831    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9a821092-6e14-43e2-b542-429692eb4c0e-plugins-config-volume\") pod \"payload-processing-e2e-mt-5842bc8c-56d56f769-sj65g\" (UID: \"9a821092-6e14-43e2-b542-429692eb4c0e\") " pod="openshift-ingress/payload-processing-e2e-mt-5842bc8c-56d56f769-sj65g"
Sep 15 14:02:12.740167 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:12.740089    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfz7s\" (UniqueName: \"kubernetes.io/projected/9a821092-6e14-43e2-b542-429692eb4c0e-kube-api-access-lfz7s\") pod \"payload-processing-e2e-mt-5842bc8c-56d56f769-sj65g\" (UID: \"9a821092-6e14-43e2-b542-429692eb4c0e\") " pod="openshift-ingress/payload-processing-e2e-mt-5842bc8c-56d56f769-sj65g"
Sep 15 14:02:12.740336 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:12.740300    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9a821092-6e14-43e2-b542-429692eb4c0e-plugins-config-volume\") pod \"payload-processing-e2e-mt-5842bc8c-56d56f769-sj65g\" (UID: \"9a821092-6e14-43e2-b542-429692eb4c0e\") " pod="openshift-ingress/payload-processing-e2e-mt-5842bc8c-56d56f769-sj65g"
Sep 15 14:02:12.741432 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:12.741398    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9a821092-6e14-43e2-b542-429692eb4c0e-plugins-config-volume\") pod \"payload-processing-e2e-mt-5842bc8c-56d56f769-sj65g\" (UID: \"9a821092-6e14-43e2-b542-429692eb4c0e\") " pod="openshift-ingress/payload-processing-e2e-mt-5842bc8c-56d56f769-sj65g"
Sep 15 14:02:12.749881 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:12.749842    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfz7s\" (UniqueName: \"kubernetes.io/projected/9a821092-6e14-43e2-b542-429692eb4c0e-kube-api-access-lfz7s\") pod \"payload-processing-e2e-mt-5842bc8c-56d56f769-sj65g\" (UID: \"9a821092-6e14-43e2-b542-429692eb4c0e\") " pod="openshift-ingress/payload-processing-e2e-mt-5842bc8c-56d56f769-sj65g"
Sep 15 14:02:12.837818 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:12.837791    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-5842bc8c-56d56f769-sj65g"
Sep 15 14:02:13.112850 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:13.112824    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-5842bc8c-56d56f769-sj65g"]
Sep 15 14:02:13.114208 ip-10-0-128-41 kubenswrapper[2578]: W0915 14:02:13.114181    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a821092_6e14_43e2_b542_429692eb4c0e.slice/crio-6acef6aaae3959e305210fa05869417602bf0cb96ca8694d76059f1ab4a0f54e WatchSource:0}: Error finding container 6acef6aaae3959e305210fa05869417602bf0cb96ca8694d76059f1ab4a0f54e: Status 404 returned error can't find the container with id 6acef6aaae3959e305210fa05869417602bf0cb96ca8694d76059f1ab4a0f54e
Sep 15 14:02:13.783724 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:13.783686    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-5842bc8c-56d56f769-sj65g" event={"ID":"9a821092-6e14-43e2-b542-429692eb4c0e","Type":"ContainerStarted","Data":"3efd96ef32ad30938fe299b82c5e913385e5f7a36443f9bd855296dddf8a026d"}
Sep 15 14:02:13.784089 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:13.783755    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-5842bc8c-56d56f769-sj65g"
Sep 15 14:02:13.784089 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:13.783778    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-5842bc8c-56d56f769-sj65g" event={"ID":"9a821092-6e14-43e2-b542-429692eb4c0e","Type":"ContainerStarted","Data":"6acef6aaae3959e305210fa05869417602bf0cb96ca8694d76059f1ab4a0f54e"}
Sep 15 14:02:13.803224 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:13.803175    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-5842bc8c-56d56f769-sj65g" podStartSLOduration=1.803160656 podStartE2EDuration="1.803160656s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 14:02:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 14:02:13.801035738 +0000 UTC m=+1420.560162024" watchObservedRunningTime="2026-09-15 14:02:13.803160656 +0000 UTC m=+1420.562286941"
Sep 15 14:02:24.792309 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:24.792216    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-5842bc8c-56d56f769-sj65g"
Sep 15 14:02:43.984815 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:43.984735    2578 generic.go:356] "Generic (PLEG): container finished" podID="dc735386-fdae-445d-8e52-d57a6a897fd4" containerID="00e15ad6103a4ace0538570c73b0bbda2b17e3b2f0aaecd08007b3abaf0ab397" exitCode=0
Sep 15 14:02:43.985230 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:43.984809    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5842bc8c-openshift-default-5f95546cbd-jv67x" event={"ID":"dc735386-fdae-445d-8e52-d57a6a897fd4","Type":"ContainerDied","Data":"00e15ad6103a4ace0538570c73b0bbda2b17e3b2f0aaecd08007b3abaf0ab397"}
Sep 15 14:02:43.985289 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:43.985273    2578 scope.go:117] "RemoveContainer" containerID="00e15ad6103a4ace0538570c73b0bbda2b17e3b2f0aaecd08007b3abaf0ab397"
Sep 15 14:02:43.986484 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:43.986454    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 15 14:02:43.986583 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:43.986523    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 15 14:02:43.986583 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:43.986557    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 15 14:02:44.993823 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:44.993790    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5842bc8c-openshift-default-5f95546cbd-jv67x" event={"ID":"dc735386-fdae-445d-8e52-d57a6a897fd4","Type":"ContainerStarted","Data":"b733d83ff0eae0837f1d0f4f7c83f6a8046c2d6ac9da9a2af7d735dd03895f2b"}
Sep 15 14:02:45.405330 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:45.405291    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-5842bc8c-openshift-default-5f95546cbd-jv67x"
Sep 15 14:02:45.405590 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:45.405568    2578 patch_prober.go:28] interesting pod/e2e-mt-5842bc8c-openshift-default-5f95546cbd-jv67x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.98:15021/healthz/ready\": dial tcp 10.133.0.98:15021: connect: connection refused" start-of-body=
Sep 15 14:02:45.405680 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:45.405659    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5842bc8c-openshift-default-5f95546cbd-jv67x" podUID="dc735386-fdae-445d-8e52-d57a6a897fd4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.98:15021/healthz/ready\": dial tcp 10.133.0.98:15021: connect: connection refused"
Sep 15 14:02:46.405400 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:46.405365    2578 patch_prober.go:28] interesting pod/e2e-mt-5842bc8c-openshift-default-5f95546cbd-jv67x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.98:15021/healthz/ready\": dial tcp 10.133.0.98:15021: connect: connection refused" start-of-body=
Sep 15 14:02:46.405827 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:46.405430    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5842bc8c-openshift-default-5f95546cbd-jv67x" podUID="dc735386-fdae-445d-8e52-d57a6a897fd4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.98:15021/healthz/ready\": dial tcp 10.133.0.98:15021: connect: connection refused"
Sep 15 14:02:47.405786 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:47.405748    2578 patch_prober.go:28] interesting pod/e2e-mt-5842bc8c-openshift-default-5f95546cbd-jv67x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.98:15021/healthz/ready\": dial tcp 10.133.0.98:15021: connect: connection refused" start-of-body=
Sep 15 14:02:47.406202 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:47.405809    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5842bc8c-openshift-default-5f95546cbd-jv67x" podUID="dc735386-fdae-445d-8e52-d57a6a897fd4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.98:15021/healthz/ready\": dial tcp 10.133.0.98:15021: connect: connection refused"
Sep 15 14:02:48.405699 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:48.405660    2578 patch_prober.go:28] interesting pod/e2e-mt-5842bc8c-openshift-default-5f95546cbd-jv67x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.98:15021/healthz/ready\": dial tcp 10.133.0.98:15021: connect: connection refused" start-of-body=
Sep 15 14:02:48.405880 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:48.405721    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5842bc8c-openshift-default-5f95546cbd-jv67x" podUID="dc735386-fdae-445d-8e52-d57a6a897fd4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.98:15021/healthz/ready\": dial tcp 10.133.0.98:15021: connect: connection refused"
Sep 15 14:02:49.405279 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:49.405239    2578 patch_prober.go:28] interesting pod/e2e-mt-5842bc8c-openshift-default-5f95546cbd-jv67x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.98:15021/healthz/ready\": dial tcp 10.133.0.98:15021: connect: connection refused" start-of-body=
Sep 15 14:02:49.405484 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:49.405321    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5842bc8c-openshift-default-5f95546cbd-jv67x" podUID="dc735386-fdae-445d-8e52-d57a6a897fd4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.98:15021/healthz/ready\": dial tcp 10.133.0.98:15021: connect: connection refused"
Sep 15 14:02:50.409817 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:50.409787    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-5842bc8c-openshift-default-5f95546cbd-jv67x"
Sep 15 14:02:50.410249 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:50.410231    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-5842bc8c-openshift-default-5f95546cbd-jv67x"
Sep 15 14:02:50.410926 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:02:50.410903    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-5842bc8c-openshift-default-5f95546cbd-jv67x"
Sep 15 14:03:30.500460 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:03:30.500425    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2aa332-hrng5"]
Sep 15 14:03:30.503174 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:03:30.503157    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2aa332-hrng5"
Sep 15 14:03:30.505514 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:03:30.505492    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 15 14:03:30.505647 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:03:30.505496    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 14:03:30.505647 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:03:30.505539    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qzmkv\""
Sep 15 14:03:30.512239 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:03:30.512220    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2aa332-hrng5"]
Sep 15 14:03:30.645549 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:03:30.645514    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f36a54d0-d85d-4ee5-a0a3-842820ca1b34-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-2aa332-hrng5\" (UID: \"f36a54d0-d85d-4ee5-a0a3-842820ca1b34\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2aa332-hrng5"
Sep 15 14:03:30.645724 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:03:30.645574    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnrk4\" (UniqueName: \"kubernetes.io/projected/f36a54d0-d85d-4ee5-a0a3-842820ca1b34-kube-api-access-jnrk4\") pod \"maas-api-revoke-keys-e2e-inf-b-2aa332-hrng5\" (UID: \"f36a54d0-d85d-4ee5-a0a3-842820ca1b34\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2aa332-hrng5"
Sep 15 14:03:30.747199 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:03:30.747158    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f36a54d0-d85d-4ee5-a0a3-842820ca1b34-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-2aa332-hrng5\" (UID: \"f36a54d0-d85d-4ee5-a0a3-842820ca1b34\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2aa332-hrng5"
Sep 15 14:03:30.747373 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:03:30.747258    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnrk4\" (UniqueName: \"kubernetes.io/projected/f36a54d0-d85d-4ee5-a0a3-842820ca1b34-kube-api-access-jnrk4\") pod \"maas-api-revoke-keys-e2e-inf-b-2aa332-hrng5\" (UID: \"f36a54d0-d85d-4ee5-a0a3-842820ca1b34\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2aa332-hrng5"
Sep 15 14:03:30.747816 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:03:30.747793    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f36a54d0-d85d-4ee5-a0a3-842820ca1b34-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-2aa332-hrng5\" (UID: \"f36a54d0-d85d-4ee5-a0a3-842820ca1b34\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2aa332-hrng5"
Sep 15 14:03:30.756947 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:03:30.756883    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnrk4\" (UniqueName: \"kubernetes.io/projected/f36a54d0-d85d-4ee5-a0a3-842820ca1b34-kube-api-access-jnrk4\") pod \"maas-api-revoke-keys-e2e-inf-b-2aa332-hrng5\" (UID: \"f36a54d0-d85d-4ee5-a0a3-842820ca1b34\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2aa332-hrng5"
Sep 15 14:03:30.815724 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:03:30.815695    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2aa332-hrng5"
Sep 15 14:03:31.089484 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:03:31.089452    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2aa332-hrng5"]
Sep 15 14:03:31.090615 ip-10-0-128-41 kubenswrapper[2578]: W0915 14:03:31.090582    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf36a54d0_d85d_4ee5_a0a3_842820ca1b34.slice/crio-64ee6e5a48ab8ca24b3890f536166cc42f94a2efa60ffb62f88ec363832481eb WatchSource:0}: Error finding container 64ee6e5a48ab8ca24b3890f536166cc42f94a2efa60ffb62f88ec363832481eb: Status 404 returned error can't find the container with id 64ee6e5a48ab8ca24b3890f536166cc42f94a2efa60ffb62f88ec363832481eb
Sep 15 14:03:31.292545 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:03:31.292515    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2aa332-hrng5" event={"ID":"f36a54d0-d85d-4ee5-a0a3-842820ca1b34","Type":"ContainerStarted","Data":"64ee6e5a48ab8ca24b3890f536166cc42f94a2efa60ffb62f88ec363832481eb"}
Sep 15 14:03:32.302585 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:03:32.302551    2578 generic.go:356] "Generic (PLEG): container finished" podID="f36a54d0-d85d-4ee5-a0a3-842820ca1b34" containerID="71d7749fe15a66b6bd810edad5b130f675773346d73a6c1ce69551c97fcf8e25" exitCode=0
Sep 15 14:03:32.302996 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:03:32.302640    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2aa332-hrng5" event={"ID":"f36a54d0-d85d-4ee5-a0a3-842820ca1b34","Type":"ContainerDied","Data":"71d7749fe15a66b6bd810edad5b130f675773346d73a6c1ce69551c97fcf8e25"}
Sep 15 14:03:33.436752 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:03:33.436729    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2aa332-hrng5"
Sep 15 14:03:33.580738 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:03:33.580645    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jnrk4\" (UniqueName: \"kubernetes.io/projected/f36a54d0-d85d-4ee5-a0a3-842820ca1b34-kube-api-access-jnrk4\") pod \"f36a54d0-d85d-4ee5-a0a3-842820ca1b34\" (UID: \"f36a54d0-d85d-4ee5-a0a3-842820ca1b34\") "
Sep 15 14:03:33.580905 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:03:33.580738    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f36a54d0-d85d-4ee5-a0a3-842820ca1b34-maas-api-service-ca\") pod \"f36a54d0-d85d-4ee5-a0a3-842820ca1b34\" (UID: \"f36a54d0-d85d-4ee5-a0a3-842820ca1b34\") "
Sep 15 14:03:33.581112 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:03:33.581090    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f36a54d0-d85d-4ee5-a0a3-842820ca1b34-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f36a54d0-d85d-4ee5-a0a3-842820ca1b34" (UID: "f36a54d0-d85d-4ee5-a0a3-842820ca1b34"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 14:03:33.582897 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:03:33.582872    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f36a54d0-d85d-4ee5-a0a3-842820ca1b34-kube-api-access-jnrk4" (OuterVolumeSpecName: "kube-api-access-jnrk4") pod "f36a54d0-d85d-4ee5-a0a3-842820ca1b34" (UID: "f36a54d0-d85d-4ee5-a0a3-842820ca1b34"). InnerVolumeSpecName "kube-api-access-jnrk4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 14:03:33.682348 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:03:33.682318    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jnrk4\" (UniqueName: \"kubernetes.io/projected/f36a54d0-d85d-4ee5-a0a3-842820ca1b34-kube-api-access-jnrk4\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:03:33.682348 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:03:33.682345    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f36a54d0-d85d-4ee5-a0a3-842820ca1b34-maas-api-service-ca\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:03:34.070031 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:03:34.069995    2578 scope.go:117] "RemoveContainer" containerID="3e70393e916fa97afbfa62f9ac2048d62b9410d7e177ccd7361dcf4163694f58"
Sep 15 14:03:34.316660 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:03:34.316633    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2aa332-hrng5"
Sep 15 14:03:34.316838 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:03:34.316631    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2aa332-hrng5" event={"ID":"f36a54d0-d85d-4ee5-a0a3-842820ca1b34","Type":"ContainerDied","Data":"64ee6e5a48ab8ca24b3890f536166cc42f94a2efa60ffb62f88ec363832481eb"}
Sep 15 14:03:34.316838 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:03:34.316761    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="64ee6e5a48ab8ca24b3890f536166cc42f94a2efa60ffb62f88ec363832481eb"
Sep 15 14:04:03.045884 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:04:03.045757    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-4441a1-d88sj"]
Sep 15 14:04:03.048528 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:04:03.048504    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-4441a1-d88sj"]
Sep 15 14:04:03.758881 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:04:03.758846    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef036711-aa65-49d2-88b1-6b092d274eff" path="/var/lib/kubelet/pods/ef036711-aa65-49d2-88b1-6b092d274eff/volumes"
Sep 15 14:05:10.004808 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:05:10.004771    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-1293e7-7vbxw"]
Sep 15 14:05:10.005318 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:05:10.005224    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f36a54d0-d85d-4ee5-a0a3-842820ca1b34" containerName="revoke-keys"
Sep 15 14:05:10.005318 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:05:10.005236    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f36a54d0-d85d-4ee5-a0a3-842820ca1b34" containerName="revoke-keys"
Sep 15 14:05:10.005318 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:05:10.005303    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f36a54d0-d85d-4ee5-a0a3-842820ca1b34" containerName="revoke-keys"
Sep 15 14:05:10.008422 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:05:10.008405    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-1293e7-7vbxw"
Sep 15 14:05:10.011136 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:05:10.011103    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 14:05:10.011886 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:05:10.011861    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qzmkv\""
Sep 15 14:05:10.011886 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:05:10.011860    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 15 14:05:10.029763 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:05:10.029738    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-1293e7-7vbxw"]
Sep 15 14:05:10.037559 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:05:10.037532    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c44b4baa-4289-434e-b7f6-415790f98d2b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-1293e7-7vbxw\" (UID: \"c44b4baa-4289-434e-b7f6-415790f98d2b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-1293e7-7vbxw"
Sep 15 14:05:10.037685 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:05:10.037661    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b25tc\" (UniqueName: \"kubernetes.io/projected/c44b4baa-4289-434e-b7f6-415790f98d2b-kube-api-access-b25tc\") pod \"maas-api-revoke-keys-e2e-worker-w0-1293e7-7vbxw\" (UID: \"c44b4baa-4289-434e-b7f6-415790f98d2b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-1293e7-7vbxw"
Sep 15 14:05:10.138895 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:05:10.138856    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b25tc\" (UniqueName: \"kubernetes.io/projected/c44b4baa-4289-434e-b7f6-415790f98d2b-kube-api-access-b25tc\") pod \"maas-api-revoke-keys-e2e-worker-w0-1293e7-7vbxw\" (UID: \"c44b4baa-4289-434e-b7f6-415790f98d2b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-1293e7-7vbxw"
Sep 15 14:05:10.139104 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:05:10.138951    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c44b4baa-4289-434e-b7f6-415790f98d2b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-1293e7-7vbxw\" (UID: \"c44b4baa-4289-434e-b7f6-415790f98d2b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-1293e7-7vbxw"
Sep 15 14:05:10.139562 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:05:10.139543    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c44b4baa-4289-434e-b7f6-415790f98d2b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-1293e7-7vbxw\" (UID: \"c44b4baa-4289-434e-b7f6-415790f98d2b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-1293e7-7vbxw"
Sep 15 14:05:10.149661 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:05:10.149639    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b25tc\" (UniqueName: \"kubernetes.io/projected/c44b4baa-4289-434e-b7f6-415790f98d2b-kube-api-access-b25tc\") pod \"maas-api-revoke-keys-e2e-worker-w0-1293e7-7vbxw\" (UID: \"c44b4baa-4289-434e-b7f6-415790f98d2b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-1293e7-7vbxw"
Sep 15 14:05:10.319169 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:05:10.319094    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-1293e7-7vbxw"
Sep 15 14:05:10.595554 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:05:10.595528    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-1293e7-7vbxw"]
Sep 15 14:05:10.596788 ip-10-0-128-41 kubenswrapper[2578]: W0915 14:05:10.596754    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc44b4baa_4289_434e_b7f6_415790f98d2b.slice/crio-d3019f842454f2203f5f1d5ad885f178fd556248d6a073b98925fb03749843a0 WatchSource:0}: Error finding container d3019f842454f2203f5f1d5ad885f178fd556248d6a073b98925fb03749843a0: Status 404 returned error can't find the container with id d3019f842454f2203f5f1d5ad885f178fd556248d6a073b98925fb03749843a0
Sep 15 14:05:10.933237 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:05:10.933144    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-1293e7-7vbxw" event={"ID":"c44b4baa-4289-434e-b7f6-415790f98d2b","Type":"ContainerStarted","Data":"6f1d1d88a835112faec7485905bdc2cfeced62b495119a46e5efd997b4d2c7ba"}
Sep 15 14:05:10.933237 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:05:10.933195    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-1293e7-7vbxw" event={"ID":"c44b4baa-4289-434e-b7f6-415790f98d2b","Type":"ContainerStarted","Data":"d3019f842454f2203f5f1d5ad885f178fd556248d6a073b98925fb03749843a0"}
Sep 15 14:05:10.953220 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:05:10.953175    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-1293e7-7vbxw" podStartSLOduration=1.953161543 podStartE2EDuration="1.953161543s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 14:05:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 14:05:10.951263685 +0000 UTC m=+1597.710389971" watchObservedRunningTime="2026-09-15 14:05:10.953161543 +0000 UTC m=+1597.712287829"
Sep 15 14:05:11.941416 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:05:11.941378    2578 generic.go:356] "Generic (PLEG): container finished" podID="c44b4baa-4289-434e-b7f6-415790f98d2b" containerID="6f1d1d88a835112faec7485905bdc2cfeced62b495119a46e5efd997b4d2c7ba" exitCode=0
Sep 15 14:05:11.941826 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:05:11.941447    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-1293e7-7vbxw" event={"ID":"c44b4baa-4289-434e-b7f6-415790f98d2b","Type":"ContainerDied","Data":"6f1d1d88a835112faec7485905bdc2cfeced62b495119a46e5efd997b4d2c7ba"}
Sep 15 14:05:13.078553 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:05:13.078530    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-1293e7-7vbxw"
Sep 15 14:05:13.172947 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:05:13.172914    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c44b4baa-4289-434e-b7f6-415790f98d2b-maas-api-service-ca\") pod \"c44b4baa-4289-434e-b7f6-415790f98d2b\" (UID: \"c44b4baa-4289-434e-b7f6-415790f98d2b\") "
Sep 15 14:05:13.173114 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:05:13.172966    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b25tc\" (UniqueName: \"kubernetes.io/projected/c44b4baa-4289-434e-b7f6-415790f98d2b-kube-api-access-b25tc\") pod \"c44b4baa-4289-434e-b7f6-415790f98d2b\" (UID: \"c44b4baa-4289-434e-b7f6-415790f98d2b\") "
Sep 15 14:05:13.173357 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:05:13.173329    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c44b4baa-4289-434e-b7f6-415790f98d2b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c44b4baa-4289-434e-b7f6-415790f98d2b" (UID: "c44b4baa-4289-434e-b7f6-415790f98d2b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 14:05:13.175190 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:05:13.175164    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c44b4baa-4289-434e-b7f6-415790f98d2b-kube-api-access-b25tc" (OuterVolumeSpecName: "kube-api-access-b25tc") pod "c44b4baa-4289-434e-b7f6-415790f98d2b" (UID: "c44b4baa-4289-434e-b7f6-415790f98d2b"). InnerVolumeSpecName "kube-api-access-b25tc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 14:05:13.273925 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:05:13.273846    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c44b4baa-4289-434e-b7f6-415790f98d2b-maas-api-service-ca\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:05:13.273925 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:05:13.273872    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b25tc\" (UniqueName: \"kubernetes.io/projected/c44b4baa-4289-434e-b7f6-415790f98d2b-kube-api-access-b25tc\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:05:13.954537 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:05:13.954505    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-1293e7-7vbxw"
Sep 15 14:05:13.954691 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:05:13.954553    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-1293e7-7vbxw" event={"ID":"c44b4baa-4289-434e-b7f6-415790f98d2b","Type":"ContainerDied","Data":"d3019f842454f2203f5f1d5ad885f178fd556248d6a073b98925fb03749843a0"}
Sep 15 14:05:13.954691 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:05:13.954612    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d3019f842454f2203f5f1d5ad885f178fd556248d6a073b98925fb03749843a0"
Sep 15 14:05:34.102015 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:05:34.101938    2578 scope.go:117] "RemoveContainer" containerID="d983611c23952682df8e70fdad25c7782b7e3becff0ed9cf1a8573c525731dfb"
Sep 15 14:06:19.079114 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:06:19.079082    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5842bc8c-mtv9z"]
Sep 15 14:06:19.079582 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:06:19.079506    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c44b4baa-4289-434e-b7f6-415790f98d2b" containerName="revoke-keys"
Sep 15 14:06:19.079582 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:06:19.079518    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c44b4baa-4289-434e-b7f6-415790f98d2b" containerName="revoke-keys"
Sep 15 14:06:19.079659 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:06:19.079595    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c44b4baa-4289-434e-b7f6-415790f98d2b" containerName="revoke-keys"
Sep 15 14:06:19.082731 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:06:19.082714    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5842bc8c-mtv9z"
Sep 15 14:06:19.087271 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:06:19.087242    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 14:06:19.087766 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:06:19.087751    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 15 14:06:19.088198 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:06:19.088177    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qzmkv\""
Sep 15 14:06:19.099736 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:06:19.099711    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5842bc8c-mtv9z"]
Sep 15 14:06:19.234755 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:06:19.234723    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n26vq\" (UniqueName: \"kubernetes.io/projected/b16b17aa-16fd-40f2-8127-049d74a0aca2-kube-api-access-n26vq\") pod \"maas-api-revoke-keys-e2e-mt-5842bc8c-mtv9z\" (UID: \"b16b17aa-16fd-40f2-8127-049d74a0aca2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5842bc8c-mtv9z"
Sep 15 14:06:19.234923 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:06:19.234764    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b16b17aa-16fd-40f2-8127-049d74a0aca2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-5842bc8c-mtv9z\" (UID: \"b16b17aa-16fd-40f2-8127-049d74a0aca2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5842bc8c-mtv9z"
Sep 15 14:06:19.335828 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:06:19.335742    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n26vq\" (UniqueName: \"kubernetes.io/projected/b16b17aa-16fd-40f2-8127-049d74a0aca2-kube-api-access-n26vq\") pod \"maas-api-revoke-keys-e2e-mt-5842bc8c-mtv9z\" (UID: \"b16b17aa-16fd-40f2-8127-049d74a0aca2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5842bc8c-mtv9z"
Sep 15 14:06:19.335828 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:06:19.335788    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b16b17aa-16fd-40f2-8127-049d74a0aca2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-5842bc8c-mtv9z\" (UID: \"b16b17aa-16fd-40f2-8127-049d74a0aca2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5842bc8c-mtv9z"
Sep 15 14:06:19.336429 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:06:19.336411    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b16b17aa-16fd-40f2-8127-049d74a0aca2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-5842bc8c-mtv9z\" (UID: \"b16b17aa-16fd-40f2-8127-049d74a0aca2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5842bc8c-mtv9z"
Sep 15 14:06:19.346464 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:06:19.346442    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n26vq\" (UniqueName: \"kubernetes.io/projected/b16b17aa-16fd-40f2-8127-049d74a0aca2-kube-api-access-n26vq\") pod \"maas-api-revoke-keys-e2e-mt-5842bc8c-mtv9z\" (UID: \"b16b17aa-16fd-40f2-8127-049d74a0aca2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5842bc8c-mtv9z"
Sep 15 14:06:19.392818 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:06:19.392778    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5842bc8c-mtv9z"
Sep 15 14:06:19.668908 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:06:19.668882    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5842bc8c-mtv9z"]
Sep 15 14:06:19.670768 ip-10-0-128-41 kubenswrapper[2578]: W0915 14:06:19.670743    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb16b17aa_16fd_40f2_8127_049d74a0aca2.slice/crio-92ad9f225f634de98ffa5551b0c4f6c281dd6dcdcf025d396f5743a37ee666f8 WatchSource:0}: Error finding container 92ad9f225f634de98ffa5551b0c4f6c281dd6dcdcf025d396f5743a37ee666f8: Status 404 returned error can't find the container with id 92ad9f225f634de98ffa5551b0c4f6c281dd6dcdcf025d396f5743a37ee666f8
Sep 15 14:06:20.362986 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:06:20.362946    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5842bc8c-mtv9z" event={"ID":"b16b17aa-16fd-40f2-8127-049d74a0aca2","Type":"ContainerStarted","Data":"6769905fdebb555d5de0cec7f1f919b52cc9018cf11cbd68a6948d4d0549765c"}
Sep 15 14:06:20.363454 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:06:20.363009    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5842bc8c-mtv9z" event={"ID":"b16b17aa-16fd-40f2-8127-049d74a0aca2","Type":"ContainerStarted","Data":"92ad9f225f634de98ffa5551b0c4f6c281dd6dcdcf025d396f5743a37ee666f8"}
Sep 15 14:06:20.382413 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:06:20.382367    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5842bc8c-mtv9z" podStartSLOduration=1.382346859 podStartE2EDuration="1.382346859s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 14:06:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 14:06:20.380477832 +0000 UTC m=+1667.139604119" watchObservedRunningTime="2026-09-15 14:06:20.382346859 +0000 UTC m=+1667.141473145"
Sep 15 14:06:21.370303 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:06:21.370265    2578 generic.go:356] "Generic (PLEG): container finished" podID="b16b17aa-16fd-40f2-8127-049d74a0aca2" containerID="6769905fdebb555d5de0cec7f1f919b52cc9018cf11cbd68a6948d4d0549765c" exitCode=0
Sep 15 14:06:21.370682 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:06:21.370320    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5842bc8c-mtv9z" event={"ID":"b16b17aa-16fd-40f2-8127-049d74a0aca2","Type":"ContainerDied","Data":"6769905fdebb555d5de0cec7f1f919b52cc9018cf11cbd68a6948d4d0549765c"}
Sep 15 14:06:22.511242 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:06:22.511216    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5842bc8c-mtv9z"
Sep 15 14:06:22.672300 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:06:22.672210    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b16b17aa-16fd-40f2-8127-049d74a0aca2-maas-api-service-ca\") pod \"b16b17aa-16fd-40f2-8127-049d74a0aca2\" (UID: \"b16b17aa-16fd-40f2-8127-049d74a0aca2\") "
Sep 15 14:06:22.672300 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:06:22.672256    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n26vq\" (UniqueName: \"kubernetes.io/projected/b16b17aa-16fd-40f2-8127-049d74a0aca2-kube-api-access-n26vq\") pod \"b16b17aa-16fd-40f2-8127-049d74a0aca2\" (UID: \"b16b17aa-16fd-40f2-8127-049d74a0aca2\") "
Sep 15 14:06:22.672541 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:06:22.672518    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b16b17aa-16fd-40f2-8127-049d74a0aca2-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b16b17aa-16fd-40f2-8127-049d74a0aca2" (UID: "b16b17aa-16fd-40f2-8127-049d74a0aca2"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 14:06:22.672660 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:06:22.672640    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b16b17aa-16fd-40f2-8127-049d74a0aca2-maas-api-service-ca\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:06:22.674489 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:06:22.674465    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b16b17aa-16fd-40f2-8127-049d74a0aca2-kube-api-access-n26vq" (OuterVolumeSpecName: "kube-api-access-n26vq") pod "b16b17aa-16fd-40f2-8127-049d74a0aca2" (UID: "b16b17aa-16fd-40f2-8127-049d74a0aca2"). InnerVolumeSpecName "kube-api-access-n26vq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 14:06:22.773652 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:06:22.773621    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n26vq\" (UniqueName: \"kubernetes.io/projected/b16b17aa-16fd-40f2-8127-049d74a0aca2-kube-api-access-n26vq\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:06:23.383531 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:06:23.383502    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5842bc8c-mtv9z"
Sep 15 14:06:23.383708 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:06:23.383505    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5842bc8c-mtv9z" event={"ID":"b16b17aa-16fd-40f2-8127-049d74a0aca2","Type":"ContainerDied","Data":"92ad9f225f634de98ffa5551b0c4f6c281dd6dcdcf025d396f5743a37ee666f8"}
Sep 15 14:06:23.383708 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:06:23.383622    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="92ad9f225f634de98ffa5551b0c4f6c281dd6dcdcf025d396f5743a37ee666f8"
Sep 15 14:06:34.125577 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:06:34.125543    2578 scope.go:117] "RemoveContainer" containerID="4bd804373b72ca5285e3b062275be166173871e6035564a8d71999650200054d"
Sep 15 14:06:34.134875 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:06:34.134856    2578 scope.go:117] "RemoveContainer" containerID="53635739e4ed51aa32d89c2d44f2ce02094eb5871f4682569d78afadfa6e7259"
Sep 15 14:06:34.930602 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:06:34.930570    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-5842bc8c-56d56f769-sj65g"]
Sep 15 14:06:34.931094 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:06:34.931059    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-5842bc8c-56d56f769-sj65g" podUID="9a821092-6e14-43e2-b542-429692eb4c0e" containerName="payload-processing" containerID="cri-o://3efd96ef32ad30938fe299b82c5e913385e5f7a36443f9bd855296dddf8a026d" gracePeriod=30
Sep 15 14:06:35.187923 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:06:35.187832    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5842bc8c-mtv9z"]
Sep 15 14:06:35.191079 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:06:35.190874    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5842bc8c-mtv9z"]
Sep 15 14:06:35.212517 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:06:35.212486    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-5842bc8c-56d56f769-sj65g"
Sep 15 14:06:35.304997 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:06:35.304963    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lfz7s\" (UniqueName: \"kubernetes.io/projected/9a821092-6e14-43e2-b542-429692eb4c0e-kube-api-access-lfz7s\") pod \"9a821092-6e14-43e2-b542-429692eb4c0e\" (UID: \"9a821092-6e14-43e2-b542-429692eb4c0e\") "
Sep 15 14:06:35.305224 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:06:35.305043    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9a821092-6e14-43e2-b542-429692eb4c0e-plugins-config-volume\") pod \"9a821092-6e14-43e2-b542-429692eb4c0e\" (UID: \"9a821092-6e14-43e2-b542-429692eb4c0e\") "
Sep 15 14:06:35.305484 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:06:35.305460    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a821092-6e14-43e2-b542-429692eb4c0e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9a821092-6e14-43e2-b542-429692eb4c0e" (UID: "9a821092-6e14-43e2-b542-429692eb4c0e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 14:06:35.307345 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:06:35.307318    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a821092-6e14-43e2-b542-429692eb4c0e-kube-api-access-lfz7s" (OuterVolumeSpecName: "kube-api-access-lfz7s") pod "9a821092-6e14-43e2-b542-429692eb4c0e" (UID: "9a821092-6e14-43e2-b542-429692eb4c0e"). InnerVolumeSpecName "kube-api-access-lfz7s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 14:06:35.405992 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:06:35.405963    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lfz7s\" (UniqueName: \"kubernetes.io/projected/9a821092-6e14-43e2-b542-429692eb4c0e-kube-api-access-lfz7s\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:06:35.405992 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:06:35.405990    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9a821092-6e14-43e2-b542-429692eb4c0e-plugins-config-volume\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:06:35.460354 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:06:35.460267    2578 generic.go:356] "Generic (PLEG): container finished" podID="9a821092-6e14-43e2-b542-429692eb4c0e" containerID="3efd96ef32ad30938fe299b82c5e913385e5f7a36443f9bd855296dddf8a026d" exitCode=0
Sep 15 14:06:35.460354 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:06:35.460311    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-5842bc8c-56d56f769-sj65g"
Sep 15 14:06:35.460586 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:06:35.460358    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-5842bc8c-56d56f769-sj65g" event={"ID":"9a821092-6e14-43e2-b542-429692eb4c0e","Type":"ContainerDied","Data":"3efd96ef32ad30938fe299b82c5e913385e5f7a36443f9bd855296dddf8a026d"}
Sep 15 14:06:35.460586 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:06:35.460418    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-5842bc8c-56d56f769-sj65g" event={"ID":"9a821092-6e14-43e2-b542-429692eb4c0e","Type":"ContainerDied","Data":"6acef6aaae3959e305210fa05869417602bf0cb96ca8694d76059f1ab4a0f54e"}
Sep 15 14:06:35.460586 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:06:35.460447    2578 scope.go:117] "RemoveContainer" containerID="3efd96ef32ad30938fe299b82c5e913385e5f7a36443f9bd855296dddf8a026d"
Sep 15 14:06:35.470076 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:06:35.470060    2578 scope.go:117] "RemoveContainer" containerID="3efd96ef32ad30938fe299b82c5e913385e5f7a36443f9bd855296dddf8a026d"
Sep 15 14:06:35.470383 ip-10-0-128-41 kubenswrapper[2578]: E0915 14:06:35.470364    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3efd96ef32ad30938fe299b82c5e913385e5f7a36443f9bd855296dddf8a026d\": container with ID starting with 3efd96ef32ad30938fe299b82c5e913385e5f7a36443f9bd855296dddf8a026d not found: ID does not exist" containerID="3efd96ef32ad30938fe299b82c5e913385e5f7a36443f9bd855296dddf8a026d"
Sep 15 14:06:35.470453 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:06:35.470391    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3efd96ef32ad30938fe299b82c5e913385e5f7a36443f9bd855296dddf8a026d"} err="failed to get container status \"3efd96ef32ad30938fe299b82c5e913385e5f7a36443f9bd855296dddf8a026d\": rpc error: code = NotFound desc = could not find container \"3efd96ef32ad30938fe299b82c5e913385e5f7a36443f9bd855296dddf8a026d\": container with ID starting with 3efd96ef32ad30938fe299b82c5e913385e5f7a36443f9bd855296dddf8a026d not found: ID does not exist"
Sep 15 14:06:35.482792 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:06:35.482770    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-5842bc8c-56d56f769-sj65g"]
Sep 15 14:06:35.490210 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:06:35.490189    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-5842bc8c-56d56f769-sj65g"]
Sep 15 14:06:35.759154 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:06:35.759044    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a821092-6e14-43e2-b542-429692eb4c0e" path="/var/lib/kubelet/pods/9a821092-6e14-43e2-b542-429692eb4c0e/volumes"
Sep 15 14:06:35.759562 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:06:35.759540    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b16b17aa-16fd-40f2-8127-049d74a0aca2" path="/var/lib/kubelet/pods/b16b17aa-16fd-40f2-8127-049d74a0aca2/volumes"
Sep 15 14:07:24.097979 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:07:24.097943    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-5842bc8c-openshift-default-5f95546cbd-jv67x"]
Sep 15 14:07:24.098466 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:07:24.098253    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-5842bc8c-openshift-default-5f95546cbd-jv67x" podUID="dc735386-fdae-445d-8e52-d57a6a897fd4" containerName="istio-proxy" containerID="cri-o://b733d83ff0eae0837f1d0f4f7c83f6a8046c2d6ac9da9a2af7d735dd03895f2b" gracePeriod=30
Sep 15 14:07:29.350693 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:07:29.350666    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5842bc8c-openshift-default-5f95546cbd-jv67x"
Sep 15 14:07:29.357068 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:07:29.357046    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc735386-fdae-445d-8e52-d57a6a897fd4-workload-socket\") pod \"dc735386-fdae-445d-8e52-d57a6a897fd4\" (UID: \"dc735386-fdae-445d-8e52-d57a6a897fd4\") "
Sep 15 14:07:29.357211 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:07:29.357081    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zpfvj\" (UniqueName: \"kubernetes.io/projected/dc735386-fdae-445d-8e52-d57a6a897fd4-kube-api-access-zpfvj\") pod \"dc735386-fdae-445d-8e52-d57a6a897fd4\" (UID: \"dc735386-fdae-445d-8e52-d57a6a897fd4\") "
Sep 15 14:07:29.357211 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:07:29.357118    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dc735386-fdae-445d-8e52-d57a6a897fd4-istio-envoy\") pod \"dc735386-fdae-445d-8e52-d57a6a897fd4\" (UID: \"dc735386-fdae-445d-8e52-d57a6a897fd4\") "
Sep 15 14:07:29.357211 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:07:29.357171    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dc735386-fdae-445d-8e52-d57a6a897fd4-istio-podinfo\") pod \"dc735386-fdae-445d-8e52-d57a6a897fd4\" (UID: \"dc735386-fdae-445d-8e52-d57a6a897fd4\") "
Sep 15 14:07:29.357381 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:07:29.357227    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc735386-fdae-445d-8e52-d57a6a897fd4-credential-socket\") pod \"dc735386-fdae-445d-8e52-d57a6a897fd4\" (UID: \"dc735386-fdae-445d-8e52-d57a6a897fd4\") "
Sep 15 14:07:29.357381 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:07:29.357287    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dc735386-fdae-445d-8e52-d57a6a897fd4-istio-token\") pod \"dc735386-fdae-445d-8e52-d57a6a897fd4\" (UID: \"dc735386-fdae-445d-8e52-d57a6a897fd4\") "
Sep 15 14:07:29.357381 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:07:29.357299    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc735386-fdae-445d-8e52-d57a6a897fd4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "dc735386-fdae-445d-8e52-d57a6a897fd4" (UID: "dc735386-fdae-445d-8e52-d57a6a897fd4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 14:07:29.357381 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:07:29.357324    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc735386-fdae-445d-8e52-d57a6a897fd4-workload-certs\") pod \"dc735386-fdae-445d-8e52-d57a6a897fd4\" (UID: \"dc735386-fdae-445d-8e52-d57a6a897fd4\") "
Sep 15 14:07:29.357381 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:07:29.357378    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dc735386-fdae-445d-8e52-d57a6a897fd4-istio-data\") pod \"dc735386-fdae-445d-8e52-d57a6a897fd4\" (UID: \"dc735386-fdae-445d-8e52-d57a6a897fd4\") "
Sep 15 14:07:29.357684 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:07:29.357414    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dc735386-fdae-445d-8e52-d57a6a897fd4-istiod-ca-cert\") pod \"dc735386-fdae-445d-8e52-d57a6a897fd4\" (UID: \"dc735386-fdae-445d-8e52-d57a6a897fd4\") "
Sep 15 14:07:29.357684 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:07:29.357555    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc735386-fdae-445d-8e52-d57a6a897fd4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "dc735386-fdae-445d-8e52-d57a6a897fd4" (UID: "dc735386-fdae-445d-8e52-d57a6a897fd4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 14:07:29.357684 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:07:29.357650    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc735386-fdae-445d-8e52-d57a6a897fd4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "dc735386-fdae-445d-8e52-d57a6a897fd4" (UID: "dc735386-fdae-445d-8e52-d57a6a897fd4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 14:07:29.357837 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:07:29.357690    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc735386-fdae-445d-8e52-d57a6a897fd4-istio-data" (OuterVolumeSpecName: "istio-data") pod "dc735386-fdae-445d-8e52-d57a6a897fd4" (UID: "dc735386-fdae-445d-8e52-d57a6a897fd4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 14:07:29.357895 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:07:29.357855    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc735386-fdae-445d-8e52-d57a6a897fd4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "dc735386-fdae-445d-8e52-d57a6a897fd4" (UID: "dc735386-fdae-445d-8e52-d57a6a897fd4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 14:07:29.357949 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:07:29.357931    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc735386-fdae-445d-8e52-d57a6a897fd4-credential-socket\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:07:29.357990 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:07:29.357957    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc735386-fdae-445d-8e52-d57a6a897fd4-workload-certs\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:07:29.357990 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:07:29.357972    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dc735386-fdae-445d-8e52-d57a6a897fd4-istio-data\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:07:29.357990 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:07:29.357985    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc735386-fdae-445d-8e52-d57a6a897fd4-workload-socket\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:07:29.359618 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:07:29.359588    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc735386-fdae-445d-8e52-d57a6a897fd4-istio-token" (OuterVolumeSpecName: "istio-token") pod "dc735386-fdae-445d-8e52-d57a6a897fd4" (UID: "dc735386-fdae-445d-8e52-d57a6a897fd4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 14:07:29.359789 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:07:29.359772    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc735386-fdae-445d-8e52-d57a6a897fd4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "dc735386-fdae-445d-8e52-d57a6a897fd4" (UID: "dc735386-fdae-445d-8e52-d57a6a897fd4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 14:07:29.359921 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:07:29.359907    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/dc735386-fdae-445d-8e52-d57a6a897fd4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "dc735386-fdae-445d-8e52-d57a6a897fd4" (UID: "dc735386-fdae-445d-8e52-d57a6a897fd4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 14:07:29.360024 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:07:29.360006    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc735386-fdae-445d-8e52-d57a6a897fd4-kube-api-access-zpfvj" (OuterVolumeSpecName: "kube-api-access-zpfvj") pod "dc735386-fdae-445d-8e52-d57a6a897fd4" (UID: "dc735386-fdae-445d-8e52-d57a6a897fd4"). InnerVolumeSpecName "kube-api-access-zpfvj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 14:07:29.459036 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:07:29.459004    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dc735386-fdae-445d-8e52-d57a6a897fd4-istio-token\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:07:29.459036 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:07:29.459030    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dc735386-fdae-445d-8e52-d57a6a897fd4-istiod-ca-cert\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:07:29.459036 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:07:29.459038    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zpfvj\" (UniqueName: \"kubernetes.io/projected/dc735386-fdae-445d-8e52-d57a6a897fd4-kube-api-access-zpfvj\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:07:29.459036 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:07:29.459046    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dc735386-fdae-445d-8e52-d57a6a897fd4-istio-envoy\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:07:29.459325 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:07:29.459059    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dc735386-fdae-445d-8e52-d57a6a897fd4-istio-podinfo\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:07:29.792076 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:07:29.792036    2578 generic.go:356] "Generic (PLEG): container finished" podID="dc735386-fdae-445d-8e52-d57a6a897fd4" containerID="b733d83ff0eae0837f1d0f4f7c83f6a8046c2d6ac9da9a2af7d735dd03895f2b" exitCode=0
Sep 15 14:07:29.792289 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:07:29.792087    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5842bc8c-openshift-default-5f95546cbd-jv67x"
Sep 15 14:07:29.792289 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:07:29.792136    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5842bc8c-openshift-default-5f95546cbd-jv67x" event={"ID":"dc735386-fdae-445d-8e52-d57a6a897fd4","Type":"ContainerDied","Data":"b733d83ff0eae0837f1d0f4f7c83f6a8046c2d6ac9da9a2af7d735dd03895f2b"}
Sep 15 14:07:29.792289 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:07:29.792203    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5842bc8c-openshift-default-5f95546cbd-jv67x" event={"ID":"dc735386-fdae-445d-8e52-d57a6a897fd4","Type":"ContainerDied","Data":"a2a862fb490e7d094c4f764a569b5190c563672c683d0caff768ca2e3b712334"}
Sep 15 14:07:29.792289 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:07:29.792234    2578 scope.go:117] "RemoveContainer" containerID="b733d83ff0eae0837f1d0f4f7c83f6a8046c2d6ac9da9a2af7d735dd03895f2b"
Sep 15 14:07:29.801783 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:07:29.801765    2578 scope.go:117] "RemoveContainer" containerID="00e15ad6103a4ace0538570c73b0bbda2b17e3b2f0aaecd08007b3abaf0ab397"
Sep 15 14:07:29.811045 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:07:29.811017    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-5842bc8c-openshift-default-5f95546cbd-jv67x"]
Sep 15 14:07:29.811277 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:07:29.811261    2578 scope.go:117] "RemoveContainer" containerID="b733d83ff0eae0837f1d0f4f7c83f6a8046c2d6ac9da9a2af7d735dd03895f2b"
Sep 15 14:07:29.811548 ip-10-0-128-41 kubenswrapper[2578]: E0915 14:07:29.811528    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b733d83ff0eae0837f1d0f4f7c83f6a8046c2d6ac9da9a2af7d735dd03895f2b\": container with ID starting with b733d83ff0eae0837f1d0f4f7c83f6a8046c2d6ac9da9a2af7d735dd03895f2b not found: ID does not exist" containerID="b733d83ff0eae0837f1d0f4f7c83f6a8046c2d6ac9da9a2af7d735dd03895f2b"
Sep 15 14:07:29.811591 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:07:29.811556    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b733d83ff0eae0837f1d0f4f7c83f6a8046c2d6ac9da9a2af7d735dd03895f2b"} err="failed to get container status \"b733d83ff0eae0837f1d0f4f7c83f6a8046c2d6ac9da9a2af7d735dd03895f2b\": rpc error: code = NotFound desc = could not find container \"b733d83ff0eae0837f1d0f4f7c83f6a8046c2d6ac9da9a2af7d735dd03895f2b\": container with ID starting with b733d83ff0eae0837f1d0f4f7c83f6a8046c2d6ac9da9a2af7d735dd03895f2b not found: ID does not exist"
Sep 15 14:07:29.811591 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:07:29.811573    2578 scope.go:117] "RemoveContainer" containerID="00e15ad6103a4ace0538570c73b0bbda2b17e3b2f0aaecd08007b3abaf0ab397"
Sep 15 14:07:29.811828 ip-10-0-128-41 kubenswrapper[2578]: E0915 14:07:29.811810    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00e15ad6103a4ace0538570c73b0bbda2b17e3b2f0aaecd08007b3abaf0ab397\": container with ID starting with 00e15ad6103a4ace0538570c73b0bbda2b17e3b2f0aaecd08007b3abaf0ab397 not found: ID does not exist" containerID="00e15ad6103a4ace0538570c73b0bbda2b17e3b2f0aaecd08007b3abaf0ab397"
Sep 15 14:07:29.811871 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:07:29.811833    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00e15ad6103a4ace0538570c73b0bbda2b17e3b2f0aaecd08007b3abaf0ab397"} err="failed to get container status \"00e15ad6103a4ace0538570c73b0bbda2b17e3b2f0aaecd08007b3abaf0ab397\": rpc error: code = NotFound desc = could not find container \"00e15ad6103a4ace0538570c73b0bbda2b17e3b2f0aaecd08007b3abaf0ab397\": container with ID starting with 00e15ad6103a4ace0538570c73b0bbda2b17e3b2f0aaecd08007b3abaf0ab397 not found: ID does not exist"
Sep 15 14:07:29.818190 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:07:29.818171    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-5842bc8c-openshift-default-5f95546cbd-jv67x"]
Sep 15 14:07:31.758341 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:07:31.758312    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc735386-fdae-445d-8e52-d57a6a897fd4" path="/var/lib/kubelet/pods/dc735386-fdae-445d-8e52-d57a6a897fd4/volumes"
Sep 15 14:08:01.051405 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:01.051366    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-2aa332-openshift-default-b94f494dd-x48k9"]
Sep 15 14:08:01.053929 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:01.051616    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-2aa332-openshift-default-b94f494dd-x48k9" podUID="5d43fec5-9d61-43bf-a663-a1341b804332" containerName="istio-proxy" containerID="cri-o://9c364ab606b7861e0ab3b529f118cdf3034a59e46df126e10022a925b4b4bbb1" gracePeriod=30
Sep 15 14:08:02.602581 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:02.602541    2578 patch_prober.go:28] interesting pod/e2e-inf-b-2aa332-openshift-default-b94f494dd-x48k9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 15 14:08:02.602976 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:02.602609    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-2aa332-openshift-default-b94f494dd-x48k9" podUID="5d43fec5-9d61-43bf-a663-a1341b804332" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 15 14:08:06.089495 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:06.089457    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-66261e-ddtrx"]
Sep 15 14:08:06.089876 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:06.089862    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b16b17aa-16fd-40f2-8127-049d74a0aca2" containerName="revoke-keys"
Sep 15 14:08:06.089876 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:06.089876    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b16b17aa-16fd-40f2-8127-049d74a0aca2" containerName="revoke-keys"
Sep 15 14:08:06.089970 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:06.089886    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a821092-6e14-43e2-b542-429692eb4c0e" containerName="payload-processing"
Sep 15 14:08:06.089970 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:06.089892    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a821092-6e14-43e2-b542-429692eb4c0e" containerName="payload-processing"
Sep 15 14:08:06.089970 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:06.089899    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc735386-fdae-445d-8e52-d57a6a897fd4" containerName="istio-proxy"
Sep 15 14:08:06.089970 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:06.089906    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc735386-fdae-445d-8e52-d57a6a897fd4" containerName="istio-proxy"
Sep 15 14:08:06.089970 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:06.089920    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc735386-fdae-445d-8e52-d57a6a897fd4" containerName="istio-proxy"
Sep 15 14:08:06.089970 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:06.089927    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc735386-fdae-445d-8e52-d57a6a897fd4" containerName="istio-proxy"
Sep 15 14:08:06.090181 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:06.090003    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="b16b17aa-16fd-40f2-8127-049d74a0aca2" containerName="revoke-keys"
Sep 15 14:08:06.090181 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:06.090012    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a821092-6e14-43e2-b542-429692eb4c0e" containerName="payload-processing"
Sep 15 14:08:06.090181 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:06.090019    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc735386-fdae-445d-8e52-d57a6a897fd4" containerName="istio-proxy"
Sep 15 14:08:06.090181 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:06.090026    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc735386-fdae-445d-8e52-d57a6a897fd4" containerName="istio-proxy"
Sep 15 14:08:06.093198 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:06.093176    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-66261e-ddtrx"
Sep 15 14:08:06.095812 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:06.095793    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 14:08:06.096535 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:06.096519    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 15 14:08:06.096592 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:06.096527    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qzmkv\""
Sep 15 14:08:06.101013 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:06.100989    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-66261e-ddtrx"]
Sep 15 14:08:06.135683 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:06.135657    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5g52\" (UniqueName: \"kubernetes.io/projected/e7697dd9-f922-45b8-83be-1b06dae787b1-kube-api-access-b5g52\") pod \"maas-api-revoke-keys-e2e-worker-w4-66261e-ddtrx\" (UID: \"e7697dd9-f922-45b8-83be-1b06dae787b1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-66261e-ddtrx"
Sep 15 14:08:06.135832 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:06.135701    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e7697dd9-f922-45b8-83be-1b06dae787b1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w4-66261e-ddtrx\" (UID: \"e7697dd9-f922-45b8-83be-1b06dae787b1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-66261e-ddtrx"
Sep 15 14:08:06.236799 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:06.236764    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e7697dd9-f922-45b8-83be-1b06dae787b1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w4-66261e-ddtrx\" (UID: \"e7697dd9-f922-45b8-83be-1b06dae787b1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-66261e-ddtrx"
Sep 15 14:08:06.236979 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:06.236911    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5g52\" (UniqueName: \"kubernetes.io/projected/e7697dd9-f922-45b8-83be-1b06dae787b1-kube-api-access-b5g52\") pod \"maas-api-revoke-keys-e2e-worker-w4-66261e-ddtrx\" (UID: \"e7697dd9-f922-45b8-83be-1b06dae787b1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-66261e-ddtrx"
Sep 15 14:08:06.237457 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:06.237427    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e7697dd9-f922-45b8-83be-1b06dae787b1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w4-66261e-ddtrx\" (UID: \"e7697dd9-f922-45b8-83be-1b06dae787b1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-66261e-ddtrx"
Sep 15 14:08:06.246830 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:06.246798    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5g52\" (UniqueName: \"kubernetes.io/projected/e7697dd9-f922-45b8-83be-1b06dae787b1-kube-api-access-b5g52\") pod \"maas-api-revoke-keys-e2e-worker-w4-66261e-ddtrx\" (UID: \"e7697dd9-f922-45b8-83be-1b06dae787b1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-66261e-ddtrx"
Sep 15 14:08:06.310820 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:06.310794    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-2aa332-openshift-default-b94f494dd-x48k9"
Sep 15 14:08:06.338112 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:06.338055    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-snsvj\" (UniqueName: \"kubernetes.io/projected/5d43fec5-9d61-43bf-a663-a1341b804332-kube-api-access-snsvj\") pod \"5d43fec5-9d61-43bf-a663-a1341b804332\" (UID: \"5d43fec5-9d61-43bf-a663-a1341b804332\") "
Sep 15 14:08:06.338112 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:06.338097    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d43fec5-9d61-43bf-a663-a1341b804332-workload-socket\") pod \"5d43fec5-9d61-43bf-a663-a1341b804332\" (UID: \"5d43fec5-9d61-43bf-a663-a1341b804332\") "
Sep 15 14:08:06.338323 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:06.338137    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5d43fec5-9d61-43bf-a663-a1341b804332-istio-data\") pod \"5d43fec5-9d61-43bf-a663-a1341b804332\" (UID: \"5d43fec5-9d61-43bf-a663-a1341b804332\") "
Sep 15 14:08:06.338323 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:06.338277    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5d43fec5-9d61-43bf-a663-a1341b804332-istio-envoy\") pod \"5d43fec5-9d61-43bf-a663-a1341b804332\" (UID: \"5d43fec5-9d61-43bf-a663-a1341b804332\") "
Sep 15 14:08:06.338417 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:06.338329    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5d43fec5-9d61-43bf-a663-a1341b804332-istio-podinfo\") pod \"5d43fec5-9d61-43bf-a663-a1341b804332\" (UID: \"5d43fec5-9d61-43bf-a663-a1341b804332\") "
Sep 15 14:08:06.338474 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:06.338415    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d43fec5-9d61-43bf-a663-a1341b804332-istio-data" (OuterVolumeSpecName: "istio-data") pod "5d43fec5-9d61-43bf-a663-a1341b804332" (UID: "5d43fec5-9d61-43bf-a663-a1341b804332"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 14:08:06.338474 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:06.338432    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d43fec5-9d61-43bf-a663-a1341b804332-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5d43fec5-9d61-43bf-a663-a1341b804332" (UID: "5d43fec5-9d61-43bf-a663-a1341b804332"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 14:08:06.338474 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:06.338456    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d43fec5-9d61-43bf-a663-a1341b804332-credential-socket\") pod \"5d43fec5-9d61-43bf-a663-a1341b804332\" (UID: \"5d43fec5-9d61-43bf-a663-a1341b804332\") "
Sep 15 14:08:06.338638 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:06.338488    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d43fec5-9d61-43bf-a663-a1341b804332-workload-certs\") pod \"5d43fec5-9d61-43bf-a663-a1341b804332\" (UID: \"5d43fec5-9d61-43bf-a663-a1341b804332\") "
Sep 15 14:08:06.338638 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:06.338519    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5d43fec5-9d61-43bf-a663-a1341b804332-istiod-ca-cert\") pod \"5d43fec5-9d61-43bf-a663-a1341b804332\" (UID: \"5d43fec5-9d61-43bf-a663-a1341b804332\") "
Sep 15 14:08:06.338638 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:06.338542    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d43fec5-9d61-43bf-a663-a1341b804332-istio-token\") pod \"5d43fec5-9d61-43bf-a663-a1341b804332\" (UID: \"5d43fec5-9d61-43bf-a663-a1341b804332\") "
Sep 15 14:08:06.338807 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:06.338653    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d43fec5-9d61-43bf-a663-a1341b804332-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5d43fec5-9d61-43bf-a663-a1341b804332" (UID: "5d43fec5-9d61-43bf-a663-a1341b804332"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 14:08:06.338807 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:06.338743    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d43fec5-9d61-43bf-a663-a1341b804332-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5d43fec5-9d61-43bf-a663-a1341b804332" (UID: "5d43fec5-9d61-43bf-a663-a1341b804332"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 14:08:06.338941 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:06.338914    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5d43fec5-9d61-43bf-a663-a1341b804332-istio-data\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:08:06.339188 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:06.338941    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d43fec5-9d61-43bf-a663-a1341b804332-credential-socket\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:08:06.339188 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:06.338955    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d43fec5-9d61-43bf-a663-a1341b804332-workload-certs\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:08:06.339188 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:06.338970    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d43fec5-9d61-43bf-a663-a1341b804332-workload-socket\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:08:06.339188 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:06.339147    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d43fec5-9d61-43bf-a663-a1341b804332-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5d43fec5-9d61-43bf-a663-a1341b804332" (UID: "5d43fec5-9d61-43bf-a663-a1341b804332"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 14:08:06.340480 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:06.340459    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d43fec5-9d61-43bf-a663-a1341b804332-kube-api-access-snsvj" (OuterVolumeSpecName: "kube-api-access-snsvj") pod "5d43fec5-9d61-43bf-a663-a1341b804332" (UID: "5d43fec5-9d61-43bf-a663-a1341b804332"). InnerVolumeSpecName "kube-api-access-snsvj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 14:08:06.340585 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:06.340564    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d43fec5-9d61-43bf-a663-a1341b804332-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5d43fec5-9d61-43bf-a663-a1341b804332" (UID: "5d43fec5-9d61-43bf-a663-a1341b804332"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 14:08:06.340639 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:06.340618    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5d43fec5-9d61-43bf-a663-a1341b804332-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5d43fec5-9d61-43bf-a663-a1341b804332" (UID: "5d43fec5-9d61-43bf-a663-a1341b804332"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 14:08:06.341289 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:06.341268    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d43fec5-9d61-43bf-a663-a1341b804332-istio-token" (OuterVolumeSpecName: "istio-token") pod "5d43fec5-9d61-43bf-a663-a1341b804332" (UID: "5d43fec5-9d61-43bf-a663-a1341b804332"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 14:08:06.440019 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:06.439988    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5d43fec5-9d61-43bf-a663-a1341b804332-istiod-ca-cert\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:08:06.440019 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:06.440012    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d43fec5-9d61-43bf-a663-a1341b804332-istio-token\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:08:06.440019 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:06.440021    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-snsvj\" (UniqueName: \"kubernetes.io/projected/5d43fec5-9d61-43bf-a663-a1341b804332-kube-api-access-snsvj\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:08:06.440269 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:06.440030    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5d43fec5-9d61-43bf-a663-a1341b804332-istio-envoy\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:08:06.440269 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:06.440041    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5d43fec5-9d61-43bf-a663-a1341b804332-istio-podinfo\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:08:06.456817 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:06.456789    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-66261e-ddtrx"
Sep 15 14:08:06.732666 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:06.732639    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-66261e-ddtrx"]
Sep 15 14:08:06.733276 ip-10-0-128-41 kubenswrapper[2578]: W0915 14:08:06.733254    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7697dd9_f922_45b8_83be_1b06dae787b1.slice/crio-88148f6e668686ed2302eaa7a4ff6f51c31f42a6daf2c26305cd427a51e06a38 WatchSource:0}: Error finding container 88148f6e668686ed2302eaa7a4ff6f51c31f42a6daf2c26305cd427a51e06a38: Status 404 returned error can't find the container with id 88148f6e668686ed2302eaa7a4ff6f51c31f42a6daf2c26305cd427a51e06a38
Sep 15 14:08:07.022213 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:07.022174    2578 generic.go:356] "Generic (PLEG): container finished" podID="5d43fec5-9d61-43bf-a663-a1341b804332" containerID="9c364ab606b7861e0ab3b529f118cdf3034a59e46df126e10022a925b4b4bbb1" exitCode=0
Sep 15 14:08:07.022369 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:07.022241    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-2aa332-openshift-default-b94f494dd-x48k9"
Sep 15 14:08:07.022369 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:07.022250    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-2aa332-openshift-default-b94f494dd-x48k9" event={"ID":"5d43fec5-9d61-43bf-a663-a1341b804332","Type":"ContainerDied","Data":"9c364ab606b7861e0ab3b529f118cdf3034a59e46df126e10022a925b4b4bbb1"}
Sep 15 14:08:07.022369 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:07.022317    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-2aa332-openshift-default-b94f494dd-x48k9" event={"ID":"5d43fec5-9d61-43bf-a663-a1341b804332","Type":"ContainerDied","Data":"33d081a592e119a3ea40d80020988f673166984f9a6a4d5fb428e66ed32638a2"}
Sep 15 14:08:07.022369 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:07.022348    2578 scope.go:117] "RemoveContainer" containerID="9c364ab606b7861e0ab3b529f118cdf3034a59e46df126e10022a925b4b4bbb1"
Sep 15 14:08:07.024260 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:07.024238    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-66261e-ddtrx" event={"ID":"e7697dd9-f922-45b8-83be-1b06dae787b1","Type":"ContainerStarted","Data":"57b8935d09d025f486efae5cce5eb27e1de3886c3c4d20d88b1624514f589504"}
Sep 15 14:08:07.024393 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:07.024287    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-66261e-ddtrx" event={"ID":"e7697dd9-f922-45b8-83be-1b06dae787b1","Type":"ContainerStarted","Data":"88148f6e668686ed2302eaa7a4ff6f51c31f42a6daf2c26305cd427a51e06a38"}
Sep 15 14:08:07.032256 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:07.032240    2578 scope.go:117] "RemoveContainer" containerID="aa4cab93d82837f55caaf08fe4dea6d1acc657fbc7512f26283009bdf78cf10c"
Sep 15 14:08:07.041312 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:07.041031    2578 scope.go:117] "RemoveContainer" containerID="9c364ab606b7861e0ab3b529f118cdf3034a59e46df126e10022a925b4b4bbb1"
Sep 15 14:08:07.041411 ip-10-0-128-41 kubenswrapper[2578]: E0915 14:08:07.041358    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c364ab606b7861e0ab3b529f118cdf3034a59e46df126e10022a925b4b4bbb1\": container with ID starting with 9c364ab606b7861e0ab3b529f118cdf3034a59e46df126e10022a925b4b4bbb1 not found: ID does not exist" containerID="9c364ab606b7861e0ab3b529f118cdf3034a59e46df126e10022a925b4b4bbb1"
Sep 15 14:08:07.041411 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:07.041385    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c364ab606b7861e0ab3b529f118cdf3034a59e46df126e10022a925b4b4bbb1"} err="failed to get container status \"9c364ab606b7861e0ab3b529f118cdf3034a59e46df126e10022a925b4b4bbb1\": rpc error: code = NotFound desc = could not find container \"9c364ab606b7861e0ab3b529f118cdf3034a59e46df126e10022a925b4b4bbb1\": container with ID starting with 9c364ab606b7861e0ab3b529f118cdf3034a59e46df126e10022a925b4b4bbb1 not found: ID does not exist"
Sep 15 14:08:07.041411 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:07.041408    2578 scope.go:117] "RemoveContainer" containerID="aa4cab93d82837f55caaf08fe4dea6d1acc657fbc7512f26283009bdf78cf10c"
Sep 15 14:08:07.041681 ip-10-0-128-41 kubenswrapper[2578]: E0915 14:08:07.041666    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa4cab93d82837f55caaf08fe4dea6d1acc657fbc7512f26283009bdf78cf10c\": container with ID starting with aa4cab93d82837f55caaf08fe4dea6d1acc657fbc7512f26283009bdf78cf10c not found: ID does not exist" containerID="aa4cab93d82837f55caaf08fe4dea6d1acc657fbc7512f26283009bdf78cf10c"
Sep 15 14:08:07.041728 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:07.041685    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa4cab93d82837f55caaf08fe4dea6d1acc657fbc7512f26283009bdf78cf10c"} err="failed to get container status \"aa4cab93d82837f55caaf08fe4dea6d1acc657fbc7512f26283009bdf78cf10c\": rpc error: code = NotFound desc = could not find container \"aa4cab93d82837f55caaf08fe4dea6d1acc657fbc7512f26283009bdf78cf10c\": container with ID starting with aa4cab93d82837f55caaf08fe4dea6d1acc657fbc7512f26283009bdf78cf10c not found: ID does not exist"
Sep 15 14:08:07.043047 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:07.043009    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-66261e-ddtrx" podStartSLOduration=1.042995755 podStartE2EDuration="1.042995755s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 14:08:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 14:08:07.040598219 +0000 UTC m=+1773.799724506" watchObservedRunningTime="2026-09-15 14:08:07.042995755 +0000 UTC m=+1773.802122040"
Sep 15 14:08:07.054857 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:07.054831    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-2aa332-openshift-default-b94f494dd-x48k9"]
Sep 15 14:08:07.057467 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:07.057447    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-2aa332-openshift-default-b94f494dd-x48k9"]
Sep 15 14:08:07.764156 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:07.759525    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d43fec5-9d61-43bf-a663-a1341b804332" path="/var/lib/kubelet/pods/5d43fec5-9d61-43bf-a663-a1341b804332/volumes"
Sep 15 14:08:08.032031 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:08.032002    2578 generic.go:356] "Generic (PLEG): container finished" podID="e7697dd9-f922-45b8-83be-1b06dae787b1" containerID="57b8935d09d025f486efae5cce5eb27e1de3886c3c4d20d88b1624514f589504" exitCode=0
Sep 15 14:08:08.032236 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:08.032083    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-66261e-ddtrx" event={"ID":"e7697dd9-f922-45b8-83be-1b06dae787b1","Type":"ContainerDied","Data":"57b8935d09d025f486efae5cce5eb27e1de3886c3c4d20d88b1624514f589504"}
Sep 15 14:08:08.963652 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:08.963613    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-a090a0-6b87cd4745-ckgzh"]
Sep 15 14:08:08.964090 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:08.964032    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d43fec5-9d61-43bf-a663-a1341b804332" containerName="istio-proxy"
Sep 15 14:08:08.964090 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:08.964044    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d43fec5-9d61-43bf-a663-a1341b804332" containerName="istio-proxy"
Sep 15 14:08:08.964205 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:08.964151    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d43fec5-9d61-43bf-a663-a1341b804332" containerName="istio-proxy"
Sep 15 14:08:08.964205 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:08.964161    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d43fec5-9d61-43bf-a663-a1341b804332" containerName="istio-proxy"
Sep 15 14:08:08.967411 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:08.967396    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-a090a0-6b87cd4745-ckgzh"
Sep 15 14:08:08.969798 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:08.969776    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w3-a090a0\""
Sep 15 14:08:08.969907 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:08.969844    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w3-a090a0-dockercfg-b6646\""
Sep 15 14:08:08.980235 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:08.980211    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-a090a0-6b87cd4745-ckgzh"]
Sep 15 14:08:09.064841 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:09.064575    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ea660976-e44a-4417-a711-1a9ec206ebf5-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-a090a0-6b87cd4745-ckgzh\" (UID: \"ea660976-e44a-4417-a711-1a9ec206ebf5\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-a090a0-6b87cd4745-ckgzh"
Sep 15 14:08:09.064841 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:09.064675    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kk6k\" (UniqueName: \"kubernetes.io/projected/ea660976-e44a-4417-a711-1a9ec206ebf5-kube-api-access-6kk6k\") pod \"payload-processing-e2e-shared-a-w3-a090a0-6b87cd4745-ckgzh\" (UID: \"ea660976-e44a-4417-a711-1a9ec206ebf5\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-a090a0-6b87cd4745-ckgzh"
Sep 15 14:08:09.165449 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:09.165414    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ea660976-e44a-4417-a711-1a9ec206ebf5-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-a090a0-6b87cd4745-ckgzh\" (UID: \"ea660976-e44a-4417-a711-1a9ec206ebf5\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-a090a0-6b87cd4745-ckgzh"
Sep 15 14:08:09.165558 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:09.165507    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kk6k\" (UniqueName: \"kubernetes.io/projected/ea660976-e44a-4417-a711-1a9ec206ebf5-kube-api-access-6kk6k\") pod \"payload-processing-e2e-shared-a-w3-a090a0-6b87cd4745-ckgzh\" (UID: \"ea660976-e44a-4417-a711-1a9ec206ebf5\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-a090a0-6b87cd4745-ckgzh"
Sep 15 14:08:09.166088 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:09.166071    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ea660976-e44a-4417-a711-1a9ec206ebf5-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-a090a0-6b87cd4745-ckgzh\" (UID: \"ea660976-e44a-4417-a711-1a9ec206ebf5\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-a090a0-6b87cd4745-ckgzh"
Sep 15 14:08:09.174399 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:09.174376    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kk6k\" (UniqueName: \"kubernetes.io/projected/ea660976-e44a-4417-a711-1a9ec206ebf5-kube-api-access-6kk6k\") pod \"payload-processing-e2e-shared-a-w3-a090a0-6b87cd4745-ckgzh\" (UID: \"ea660976-e44a-4417-a711-1a9ec206ebf5\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-a090a0-6b87cd4745-ckgzh"
Sep 15 14:08:09.192638 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:09.192617    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-66261e-ddtrx"
Sep 15 14:08:09.266190 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:09.266076    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b5g52\" (UniqueName: \"kubernetes.io/projected/e7697dd9-f922-45b8-83be-1b06dae787b1-kube-api-access-b5g52\") pod \"e7697dd9-f922-45b8-83be-1b06dae787b1\" (UID: \"e7697dd9-f922-45b8-83be-1b06dae787b1\") "
Sep 15 14:08:09.266369 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:09.266194    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e7697dd9-f922-45b8-83be-1b06dae787b1-maas-api-service-ca\") pod \"e7697dd9-f922-45b8-83be-1b06dae787b1\" (UID: \"e7697dd9-f922-45b8-83be-1b06dae787b1\") "
Sep 15 14:08:09.266526 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:09.266502    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e7697dd9-f922-45b8-83be-1b06dae787b1-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e7697dd9-f922-45b8-83be-1b06dae787b1" (UID: "e7697dd9-f922-45b8-83be-1b06dae787b1"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 14:08:09.268349 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:09.268327    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7697dd9-f922-45b8-83be-1b06dae787b1-kube-api-access-b5g52" (OuterVolumeSpecName: "kube-api-access-b5g52") pod "e7697dd9-f922-45b8-83be-1b06dae787b1" (UID: "e7697dd9-f922-45b8-83be-1b06dae787b1"). InnerVolumeSpecName "kube-api-access-b5g52". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 14:08:09.278155 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:09.278135    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-a090a0-6b87cd4745-ckgzh"
Sep 15 14:08:09.366947 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:09.366910    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e7697dd9-f922-45b8-83be-1b06dae787b1-maas-api-service-ca\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:08:09.366947 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:09.366940    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b5g52\" (UniqueName: \"kubernetes.io/projected/e7697dd9-f922-45b8-83be-1b06dae787b1-kube-api-access-b5g52\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:08:09.552601 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:09.552577    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-a090a0-6b87cd4745-ckgzh"]
Sep 15 14:08:09.553257 ip-10-0-128-41 kubenswrapper[2578]: W0915 14:08:09.553236    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea660976_e44a_4417_a711_1a9ec206ebf5.slice/crio-d057ba9d88f4c988be1b62c50005796e42bc789657200484a30418038bc82843 WatchSource:0}: Error finding container d057ba9d88f4c988be1b62c50005796e42bc789657200484a30418038bc82843: Status 404 returned error can't find the container with id d057ba9d88f4c988be1b62c50005796e42bc789657200484a30418038bc82843
Sep 15 14:08:10.049709 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:10.049682    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-66261e-ddtrx"
Sep 15 14:08:10.049709 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:10.049694    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-66261e-ddtrx" event={"ID":"e7697dd9-f922-45b8-83be-1b06dae787b1","Type":"ContainerDied","Data":"88148f6e668686ed2302eaa7a4ff6f51c31f42a6daf2c26305cd427a51e06a38"}
Sep 15 14:08:10.050260 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:10.049737    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="88148f6e668686ed2302eaa7a4ff6f51c31f42a6daf2c26305cd427a51e06a38"
Sep 15 14:08:10.051509 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:10.051483    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-a090a0-6b87cd4745-ckgzh" event={"ID":"ea660976-e44a-4417-a711-1a9ec206ebf5","Type":"ContainerStarted","Data":"06d9abfd20b0d1630a0caafb6e43fcf2c49ec198130492bf9182cdd2eedcd8c4"}
Sep 15 14:08:10.051906 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:10.051527    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-a090a0-6b87cd4745-ckgzh" event={"ID":"ea660976-e44a-4417-a711-1a9ec206ebf5","Type":"ContainerStarted","Data":"d057ba9d88f4c988be1b62c50005796e42bc789657200484a30418038bc82843"}
Sep 15 14:08:10.051906 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:10.051617    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-a090a0-6b87cd4745-ckgzh"
Sep 15 14:08:10.069516 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:10.069477    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-a090a0-6b87cd4745-ckgzh" podStartSLOduration=2.069464795 podStartE2EDuration="2.069464795s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 14:08:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 14:08:10.067599912 +0000 UTC m=+1776.826726197" watchObservedRunningTime="2026-09-15 14:08:10.069464795 +0000 UTC m=+1776.828591079"
Sep 15 14:08:10.956320 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:10.956285    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-66261e/distinct-2-w4-66261e-kserve-5cd847d7db-vc5dv"]
Sep 15 14:08:10.967145 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:10.965042    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-66261e/distinct-w4-66261e-kserve-5bd55f855c-kqbr2"]
Sep 15 14:08:21.060186 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:21.060151    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-a090a0-6b87cd4745-ckgzh"
Sep 15 14:08:25.979751 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:25.979647    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-66261e/distinct-2-w4-66261e-kserve-5cd847d7db-vc5dv" podUID="59dae33f-5c20-4387-9578-b5a6152b88d8" containerName="main" containerID="cri-o://0bdeb65f9329844be69929258ac6f9c7b68b19c5f597150582236b0bc1a326e6" gracePeriod=45
Sep 15 14:08:25.992768 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:25.992680    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-66261e/distinct-w4-66261e-kserve-5bd55f855c-kqbr2" podUID="d83045a5-62ec-4400-a4b7-154331b6abf1" containerName="main" containerID="cri-o://22f90491ba0c8b7ae12d5bb52f776b9b26e36cc7646c228695fef2ca8743098a" gracePeriod=45
Sep 15 14:08:26.154629 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:26.154596    2578 generic.go:356] "Generic (PLEG): container finished" podID="d83045a5-62ec-4400-a4b7-154331b6abf1" containerID="22f90491ba0c8b7ae12d5bb52f776b9b26e36cc7646c228695fef2ca8743098a" exitCode=0
Sep 15 14:08:26.154877 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:26.154829    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-66261e/distinct-w4-66261e-kserve-5bd55f855c-kqbr2" event={"ID":"d83045a5-62ec-4400-a4b7-154331b6abf1","Type":"ContainerDied","Data":"22f90491ba0c8b7ae12d5bb52f776b9b26e36cc7646c228695fef2ca8743098a"}
Sep 15 14:08:26.156692 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:26.156669    2578 generic.go:356] "Generic (PLEG): container finished" podID="59dae33f-5c20-4387-9578-b5a6152b88d8" containerID="0bdeb65f9329844be69929258ac6f9c7b68b19c5f597150582236b0bc1a326e6" exitCode=0
Sep 15 14:08:26.156807 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:26.156724    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-66261e/distinct-2-w4-66261e-kserve-5cd847d7db-vc5dv" event={"ID":"59dae33f-5c20-4387-9578-b5a6152b88d8","Type":"ContainerDied","Data":"0bdeb65f9329844be69929258ac6f9c7b68b19c5f597150582236b0bc1a326e6"}
Sep 15 14:08:26.242585 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:26.242515    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-66261e/distinct-2-w4-66261e-kserve-5cd847d7db-vc5dv"
Sep 15 14:08:26.279758 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:26.279723    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-66261e/distinct-w4-66261e-kserve-5bd55f855c-kqbr2"
Sep 15 14:08:26.342176 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:26.342117    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/59dae33f-5c20-4387-9578-b5a6152b88d8-tmp-dir\") pod \"59dae33f-5c20-4387-9578-b5a6152b88d8\" (UID: \"59dae33f-5c20-4387-9578-b5a6152b88d8\") "
Sep 15 14:08:26.342356 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:26.342196    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/59dae33f-5c20-4387-9578-b5a6152b88d8-model-cache\") pod \"59dae33f-5c20-4387-9578-b5a6152b88d8\" (UID: \"59dae33f-5c20-4387-9578-b5a6152b88d8\") "
Sep 15 14:08:26.342356 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:26.342237    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ztv54\" (UniqueName: \"kubernetes.io/projected/59dae33f-5c20-4387-9578-b5a6152b88d8-kube-api-access-ztv54\") pod \"59dae33f-5c20-4387-9578-b5a6152b88d8\" (UID: \"59dae33f-5c20-4387-9578-b5a6152b88d8\") "
Sep 15 14:08:26.342356 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:26.342297    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/59dae33f-5c20-4387-9578-b5a6152b88d8-home\") pod \"59dae33f-5c20-4387-9578-b5a6152b88d8\" (UID: \"59dae33f-5c20-4387-9578-b5a6152b88d8\") "
Sep 15 14:08:26.342519 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:26.342358    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/59dae33f-5c20-4387-9578-b5a6152b88d8-dshm\") pod \"59dae33f-5c20-4387-9578-b5a6152b88d8\" (UID: \"59dae33f-5c20-4387-9578-b5a6152b88d8\") "
Sep 15 14:08:26.342519 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:26.342384    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/59dae33f-5c20-4387-9578-b5a6152b88d8-tls-certs\") pod \"59dae33f-5c20-4387-9578-b5a6152b88d8\" (UID: \"59dae33f-5c20-4387-9578-b5a6152b88d8\") "
Sep 15 14:08:26.347645 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:26.347609    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/59dae33f-5c20-4387-9578-b5a6152b88d8-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "59dae33f-5c20-4387-9578-b5a6152b88d8" (UID: "59dae33f-5c20-4387-9578-b5a6152b88d8"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 14:08:26.347849 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:26.347827    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59dae33f-5c20-4387-9578-b5a6152b88d8-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "59dae33f-5c20-4387-9578-b5a6152b88d8" (UID: "59dae33f-5c20-4387-9578-b5a6152b88d8"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 14:08:26.348023 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:26.348003    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59dae33f-5c20-4387-9578-b5a6152b88d8-model-cache" (OuterVolumeSpecName: "model-cache") pod "59dae33f-5c20-4387-9578-b5a6152b88d8" (UID: "59dae33f-5c20-4387-9578-b5a6152b88d8"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 14:08:26.348663 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:26.348614    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59dae33f-5c20-4387-9578-b5a6152b88d8-home" (OuterVolumeSpecName: "home") pod "59dae33f-5c20-4387-9578-b5a6152b88d8" (UID: "59dae33f-5c20-4387-9578-b5a6152b88d8"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 14:08:26.354941 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:26.351527    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59dae33f-5c20-4387-9578-b5a6152b88d8-kube-api-access-ztv54" (OuterVolumeSpecName: "kube-api-access-ztv54") pod "59dae33f-5c20-4387-9578-b5a6152b88d8" (UID: "59dae33f-5c20-4387-9578-b5a6152b88d8"). InnerVolumeSpecName "kube-api-access-ztv54". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 14:08:26.355723 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:26.355692    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59dae33f-5c20-4387-9578-b5a6152b88d8-dshm" (OuterVolumeSpecName: "dshm") pod "59dae33f-5c20-4387-9578-b5a6152b88d8" (UID: "59dae33f-5c20-4387-9578-b5a6152b88d8"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 14:08:26.445049 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:26.445015    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d83045a5-62ec-4400-a4b7-154331b6abf1-home\") pod \"d83045a5-62ec-4400-a4b7-154331b6abf1\" (UID: \"d83045a5-62ec-4400-a4b7-154331b6abf1\") "
Sep 15 14:08:26.445049 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:26.445055    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hzqbr\" (UniqueName: \"kubernetes.io/projected/d83045a5-62ec-4400-a4b7-154331b6abf1-kube-api-access-hzqbr\") pod \"d83045a5-62ec-4400-a4b7-154331b6abf1\" (UID: \"d83045a5-62ec-4400-a4b7-154331b6abf1\") "
Sep 15 14:08:26.445311 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:26.445152    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d83045a5-62ec-4400-a4b7-154331b6abf1-tmp-dir\") pod \"d83045a5-62ec-4400-a4b7-154331b6abf1\" (UID: \"d83045a5-62ec-4400-a4b7-154331b6abf1\") "
Sep 15 14:08:26.445311 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:26.445195    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d83045a5-62ec-4400-a4b7-154331b6abf1-model-cache\") pod \"d83045a5-62ec-4400-a4b7-154331b6abf1\" (UID: \"d83045a5-62ec-4400-a4b7-154331b6abf1\") "
Sep 15 14:08:26.445311 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:26.445224    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d83045a5-62ec-4400-a4b7-154331b6abf1-tls-certs\") pod \"d83045a5-62ec-4400-a4b7-154331b6abf1\" (UID: \"d83045a5-62ec-4400-a4b7-154331b6abf1\") "
Sep 15 14:08:26.445311 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:26.445249    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d83045a5-62ec-4400-a4b7-154331b6abf1-dshm\") pod \"d83045a5-62ec-4400-a4b7-154331b6abf1\" (UID: \"d83045a5-62ec-4400-a4b7-154331b6abf1\") "
Sep 15 14:08:26.445572 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:26.445357    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d83045a5-62ec-4400-a4b7-154331b6abf1-home" (OuterVolumeSpecName: "home") pod "d83045a5-62ec-4400-a4b7-154331b6abf1" (UID: "d83045a5-62ec-4400-a4b7-154331b6abf1"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 14:08:26.445572 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:26.445370    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d83045a5-62ec-4400-a4b7-154331b6abf1-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d83045a5-62ec-4400-a4b7-154331b6abf1" (UID: "d83045a5-62ec-4400-a4b7-154331b6abf1"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 14:08:26.445572 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:26.445512    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d83045a5-62ec-4400-a4b7-154331b6abf1-model-cache" (OuterVolumeSpecName: "model-cache") pod "d83045a5-62ec-4400-a4b7-154331b6abf1" (UID: "d83045a5-62ec-4400-a4b7-154331b6abf1"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 14:08:26.445724 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:26.445700    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/59dae33f-5c20-4387-9578-b5a6152b88d8-tmp-dir\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:08:26.445724 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:26.445719    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/59dae33f-5c20-4387-9578-b5a6152b88d8-model-cache\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:08:26.445881 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:26.445736    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ztv54\" (UniqueName: \"kubernetes.io/projected/59dae33f-5c20-4387-9578-b5a6152b88d8-kube-api-access-ztv54\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:08:26.445881 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:26.445751    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d83045a5-62ec-4400-a4b7-154331b6abf1-home\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:08:26.445881 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:26.445764    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/59dae33f-5c20-4387-9578-b5a6152b88d8-home\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:08:26.445881 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:26.445776    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/59dae33f-5c20-4387-9578-b5a6152b88d8-dshm\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:08:26.445881 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:26.445786    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/59dae33f-5c20-4387-9578-b5a6152b88d8-tls-certs\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:08:26.445881 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:26.445798    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d83045a5-62ec-4400-a4b7-154331b6abf1-tmp-dir\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:08:26.445881 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:26.445809    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d83045a5-62ec-4400-a4b7-154331b6abf1-model-cache\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:08:26.447460 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:26.447441    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d83045a5-62ec-4400-a4b7-154331b6abf1-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d83045a5-62ec-4400-a4b7-154331b6abf1" (UID: "d83045a5-62ec-4400-a4b7-154331b6abf1"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 14:08:26.447885 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:26.447866    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d83045a5-62ec-4400-a4b7-154331b6abf1-dshm" (OuterVolumeSpecName: "dshm") pod "d83045a5-62ec-4400-a4b7-154331b6abf1" (UID: "d83045a5-62ec-4400-a4b7-154331b6abf1"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 14:08:26.447939 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:26.447864    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d83045a5-62ec-4400-a4b7-154331b6abf1-kube-api-access-hzqbr" (OuterVolumeSpecName: "kube-api-access-hzqbr") pod "d83045a5-62ec-4400-a4b7-154331b6abf1" (UID: "d83045a5-62ec-4400-a4b7-154331b6abf1"). InnerVolumeSpecName "kube-api-access-hzqbr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 14:08:26.547046 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:26.547013    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d83045a5-62ec-4400-a4b7-154331b6abf1-tls-certs\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:08:26.547046 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:26.547042    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d83045a5-62ec-4400-a4b7-154331b6abf1-dshm\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:08:26.547046 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:26.547053    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hzqbr\" (UniqueName: \"kubernetes.io/projected/d83045a5-62ec-4400-a4b7-154331b6abf1-kube-api-access-hzqbr\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:08:27.164495 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:27.164459    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-66261e/distinct-2-w4-66261e-kserve-5cd847d7db-vc5dv"
Sep 15 14:08:27.164495 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:27.164477    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-66261e/distinct-2-w4-66261e-kserve-5cd847d7db-vc5dv" event={"ID":"59dae33f-5c20-4387-9578-b5a6152b88d8","Type":"ContainerDied","Data":"f5c23c7a682c3ec2a63923274cbcfaef22785b80939786e5cb5734b89b220797"}
Sep 15 14:08:27.165038 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:27.164544    2578 scope.go:117] "RemoveContainer" containerID="0bdeb65f9329844be69929258ac6f9c7b68b19c5f597150582236b0bc1a326e6"
Sep 15 14:08:27.166077 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:27.166059    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-66261e/distinct-w4-66261e-kserve-5bd55f855c-kqbr2"
Sep 15 14:08:27.166195 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:27.166076    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-66261e/distinct-w4-66261e-kserve-5bd55f855c-kqbr2" event={"ID":"d83045a5-62ec-4400-a4b7-154331b6abf1","Type":"ContainerDied","Data":"2470048ec1bef7a7fe6cc17441a4528b060ec6d9032384360ff6501f078ab0d8"}
Sep 15 14:08:27.175741 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:27.175725    2578 scope.go:117] "RemoveContainer" containerID="22f90491ba0c8b7ae12d5bb52f776b9b26e36cc7646c228695fef2ca8743098a"
Sep 15 14:08:27.187835 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:27.187809    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-66261e/distinct-2-w4-66261e-kserve-5cd847d7db-vc5dv"]
Sep 15 14:08:27.191140 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:27.191106    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-66261e/distinct-2-w4-66261e-kserve-5cd847d7db-vc5dv"]
Sep 15 14:08:27.201910 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:27.201887    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-66261e/distinct-w4-66261e-kserve-5bd55f855c-kqbr2"]
Sep 15 14:08:27.204339 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:27.204321    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-66261e/distinct-w4-66261e-kserve-5bd55f855c-kqbr2"]
Sep 15 14:08:27.758710 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:27.758677    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="59dae33f-5c20-4387-9578-b5a6152b88d8" path="/var/lib/kubelet/pods/59dae33f-5c20-4387-9578-b5a6152b88d8/volumes"
Sep 15 14:08:27.759092 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:27.759077    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d83045a5-62ec-4400-a4b7-154331b6abf1" path="/var/lib/kubelet/pods/d83045a5-62ec-4400-a4b7-154331b6abf1/volumes"
Sep 15 14:08:34.035447 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:34.035412    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2aa332-hrng5"]
Sep 15 14:08:34.038040 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:34.038017    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2aa332-hrng5"]
Sep 15 14:08:35.758989 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:35.758954    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f36a54d0-d85d-4ee5-a0a3-842820ca1b34" path="/var/lib/kubelet/pods/f36a54d0-d85d-4ee5-a0a3-842820ca1b34/volumes"
Sep 15 14:08:43.138241 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:43.138203    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-d418fd-5b7847d9f-vdqwp"]
Sep 15 14:08:43.138640 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:43.138627    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7697dd9-f922-45b8-83be-1b06dae787b1" containerName="revoke-keys"
Sep 15 14:08:43.138688 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:43.138642    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7697dd9-f922-45b8-83be-1b06dae787b1" containerName="revoke-keys"
Sep 15 14:08:43.138688 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:43.138651    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d43fec5-9d61-43bf-a663-a1341b804332" containerName="istio-proxy"
Sep 15 14:08:43.138688 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:43.138656    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d43fec5-9d61-43bf-a663-a1341b804332" containerName="istio-proxy"
Sep 15 14:08:43.138688 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:43.138668    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d83045a5-62ec-4400-a4b7-154331b6abf1" containerName="main"
Sep 15 14:08:43.138688 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:43.138674    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d83045a5-62ec-4400-a4b7-154331b6abf1" containerName="main"
Sep 15 14:08:43.138688 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:43.138686    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59dae33f-5c20-4387-9578-b5a6152b88d8" containerName="main"
Sep 15 14:08:43.138869 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:43.138692    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="59dae33f-5c20-4387-9578-b5a6152b88d8" containerName="main"
Sep 15 14:08:43.138869 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:43.138774    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7697dd9-f922-45b8-83be-1b06dae787b1" containerName="revoke-keys"
Sep 15 14:08:43.138869 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:43.138783    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="d83045a5-62ec-4400-a4b7-154331b6abf1" containerName="main"
Sep 15 14:08:43.138869 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:43.138791    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="59dae33f-5c20-4387-9578-b5a6152b88d8" containerName="main"
Sep 15 14:08:43.142904 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:43.142883    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-d418fd-5b7847d9f-vdqwp"
Sep 15 14:08:43.145397 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:43.145375    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w3-d418fd-dockercfg-d2ztv\""
Sep 15 14:08:43.145516 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:43.145427    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w3-d418fd\""
Sep 15 14:08:43.156454 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:43.156427    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-d418fd-5b7847d9f-vdqwp"]
Sep 15 14:08:43.186954 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:43.186925    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-d418fd-6774d98678-87fgz"]
Sep 15 14:08:43.190383 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:43.190367    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-d418fd-6774d98678-87fgz"
Sep 15 14:08:43.201336 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:43.201307    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-d418fd-6774d98678-87fgz"]
Sep 15 14:08:43.203615 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:43.203590    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6f9f8be5-896d-447b-9a8f-7643cdc485c8-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-d418fd-5b7847d9f-vdqwp\" (UID: \"6f9f8be5-896d-447b-9a8f-7643cdc485c8\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-d418fd-5b7847d9f-vdqwp"
Sep 15 14:08:43.203716 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:43.203662    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvtr6\" (UniqueName: \"kubernetes.io/projected/6f9f8be5-896d-447b-9a8f-7643cdc485c8-kube-api-access-pvtr6\") pod \"payload-processing-e2e-shared-b-w3-d418fd-5b7847d9f-vdqwp\" (UID: \"6f9f8be5-896d-447b-9a8f-7643cdc485c8\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-d418fd-5b7847d9f-vdqwp"
Sep 15 14:08:43.304583 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:43.304553    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sm5jv\" (UniqueName: \"kubernetes.io/projected/76303c83-e12a-441b-b368-99a72c8bff7c-kube-api-access-sm5jv\") pod \"payload-pre-processing-e2e-shared-b-w3-d418fd-6774d98678-87fgz\" (UID: \"76303c83-e12a-441b-b368-99a72c8bff7c\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-d418fd-6774d98678-87fgz"
Sep 15 14:08:43.304583 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:43.304589    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/76303c83-e12a-441b-b368-99a72c8bff7c-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-d418fd-6774d98678-87fgz\" (UID: \"76303c83-e12a-441b-b368-99a72c8bff7c\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-d418fd-6774d98678-87fgz"
Sep 15 14:08:43.304838 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:43.304659    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6f9f8be5-896d-447b-9a8f-7643cdc485c8-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-d418fd-5b7847d9f-vdqwp\" (UID: \"6f9f8be5-896d-447b-9a8f-7643cdc485c8\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-d418fd-5b7847d9f-vdqwp"
Sep 15 14:08:43.304838 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:43.304721    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvtr6\" (UniqueName: \"kubernetes.io/projected/6f9f8be5-896d-447b-9a8f-7643cdc485c8-kube-api-access-pvtr6\") pod \"payload-processing-e2e-shared-b-w3-d418fd-5b7847d9f-vdqwp\" (UID: \"6f9f8be5-896d-447b-9a8f-7643cdc485c8\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-d418fd-5b7847d9f-vdqwp"
Sep 15 14:08:43.305465 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:43.305435    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6f9f8be5-896d-447b-9a8f-7643cdc485c8-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-d418fd-5b7847d9f-vdqwp\" (UID: \"6f9f8be5-896d-447b-9a8f-7643cdc485c8\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-d418fd-5b7847d9f-vdqwp"
Sep 15 14:08:43.313213 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:43.313183    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvtr6\" (UniqueName: \"kubernetes.io/projected/6f9f8be5-896d-447b-9a8f-7643cdc485c8-kube-api-access-pvtr6\") pod \"payload-processing-e2e-shared-b-w3-d418fd-5b7847d9f-vdqwp\" (UID: \"6f9f8be5-896d-447b-9a8f-7643cdc485c8\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-d418fd-5b7847d9f-vdqwp"
Sep 15 14:08:43.405819 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:43.405727    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sm5jv\" (UniqueName: \"kubernetes.io/projected/76303c83-e12a-441b-b368-99a72c8bff7c-kube-api-access-sm5jv\") pod \"payload-pre-processing-e2e-shared-b-w3-d418fd-6774d98678-87fgz\" (UID: \"76303c83-e12a-441b-b368-99a72c8bff7c\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-d418fd-6774d98678-87fgz"
Sep 15 14:08:43.405819 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:43.405772    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/76303c83-e12a-441b-b368-99a72c8bff7c-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-d418fd-6774d98678-87fgz\" (UID: \"76303c83-e12a-441b-b368-99a72c8bff7c\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-d418fd-6774d98678-87fgz"
Sep 15 14:08:43.406429 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:43.406410    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/76303c83-e12a-441b-b368-99a72c8bff7c-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-d418fd-6774d98678-87fgz\" (UID: \"76303c83-e12a-441b-b368-99a72c8bff7c\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-d418fd-6774d98678-87fgz"
Sep 15 14:08:43.417438 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:43.417417    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sm5jv\" (UniqueName: \"kubernetes.io/projected/76303c83-e12a-441b-b368-99a72c8bff7c-kube-api-access-sm5jv\") pod \"payload-pre-processing-e2e-shared-b-w3-d418fd-6774d98678-87fgz\" (UID: \"76303c83-e12a-441b-b368-99a72c8bff7c\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-d418fd-6774d98678-87fgz"
Sep 15 14:08:43.452979 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:43.452948    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-d418fd-5b7847d9f-vdqwp"
Sep 15 14:08:43.500081 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:43.500051    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-d418fd-6774d98678-87fgz"
Sep 15 14:08:43.726948 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:43.726923    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-d418fd-5b7847d9f-vdqwp"]
Sep 15 14:08:43.727492 ip-10-0-128-41 kubenswrapper[2578]: W0915 14:08:43.727471    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f9f8be5_896d_447b_9a8f_7643cdc485c8.slice/crio-8971ed9e45e085a0fab8966852a787a6d3471e084b5bb3a656bc5cc3b53c321e WatchSource:0}: Error finding container 8971ed9e45e085a0fab8966852a787a6d3471e084b5bb3a656bc5cc3b53c321e: Status 404 returned error can't find the container with id 8971ed9e45e085a0fab8966852a787a6d3471e084b5bb3a656bc5cc3b53c321e
Sep 15 14:08:43.790614 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:43.790589    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-d418fd-6774d98678-87fgz"]
Sep 15 14:08:43.792162 ip-10-0-128-41 kubenswrapper[2578]: W0915 14:08:43.792140    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76303c83_e12a_441b_b368_99a72c8bff7c.slice/crio-25928e62f6c8b32ee973b5dfd133a349e10db043ff9de1767390d341d122e3e8 WatchSource:0}: Error finding container 25928e62f6c8b32ee973b5dfd133a349e10db043ff9de1767390d341d122e3e8: Status 404 returned error can't find the container with id 25928e62f6c8b32ee973b5dfd133a349e10db043ff9de1767390d341d122e3e8
Sep 15 14:08:44.273116 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:44.273076    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-d418fd-6774d98678-87fgz" event={"ID":"76303c83-e12a-441b-b368-99a72c8bff7c","Type":"ContainerStarted","Data":"bb47ec2ae2f561e12b1440b86760f0988d8fd3b88f5fd44b3cae7cebd7d6690a"}
Sep 15 14:08:44.273619 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:44.273168    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-d418fd-6774d98678-87fgz" event={"ID":"76303c83-e12a-441b-b368-99a72c8bff7c","Type":"ContainerStarted","Data":"25928e62f6c8b32ee973b5dfd133a349e10db043ff9de1767390d341d122e3e8"}
Sep 15 14:08:44.273619 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:44.273199    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-d418fd-6774d98678-87fgz"
Sep 15 14:08:44.274979 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:44.274952    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-d418fd-5b7847d9f-vdqwp" event={"ID":"6f9f8be5-896d-447b-9a8f-7643cdc485c8","Type":"ContainerStarted","Data":"12a4a5d459f690a72371f79d9f4728fb0e7dd23fd63b37c4e10ac3e44addcccd"}
Sep 15 14:08:44.275118 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:44.275002    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-d418fd-5b7847d9f-vdqwp"
Sep 15 14:08:44.275118 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:44.275027    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-d418fd-5b7847d9f-vdqwp" event={"ID":"6f9f8be5-896d-447b-9a8f-7643cdc485c8","Type":"ContainerStarted","Data":"8971ed9e45e085a0fab8966852a787a6d3471e084b5bb3a656bc5cc3b53c321e"}
Sep 15 14:08:44.290680 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:44.290631    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-d418fd-6774d98678-87fgz" podStartSLOduration=1.290615106 podStartE2EDuration="1.290615106s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 14:08:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 14:08:44.29050093 +0000 UTC m=+1811.049627216" watchObservedRunningTime="2026-09-15 14:08:44.290615106 +0000 UTC m=+1811.049741394"
Sep 15 14:08:44.308558 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:44.308512    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-d418fd-5b7847d9f-vdqwp" podStartSLOduration=1.308497525 podStartE2EDuration="1.308497525s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 14:08:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 14:08:44.308010026 +0000 UTC m=+1811.067136315" watchObservedRunningTime="2026-09-15 14:08:44.308497525 +0000 UTC m=+1811.067623812"
Sep 15 14:08:55.282749 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:55.282716    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-d418fd-6774d98678-87fgz"
Sep 15 14:08:55.283344 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:08:55.283069    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-d418fd-5b7847d9f-vdqwp"
Sep 15 14:09:34.205378 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:09:34.205341    2578 scope.go:117] "RemoveContainer" containerID="71d7749fe15a66b6bd810edad5b130f675773346d73a6c1ce69551c97fcf8e25"
Sep 15 14:10:10.542741 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:10:10.542658    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-1293e7-openshift-default-567dbc6586-qk4jn"]
Sep 15 14:10:10.543356 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:10:10.542931    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-1293e7-openshift-default-567dbc6586-qk4jn" podUID="b8e97cfd-1e47-4397-9cfc-179f6cf158b4" containerName="istio-proxy" containerID="cri-o://aac16bed7a959d2ed5f3f8d132f4b43c54b7e8d121fff698407321aa4fdc769e" gracePeriod=30
Sep 15 14:10:14.029222 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:10:14.029187    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-1293e7-7vbxw"]
Sep 15 14:10:14.032879 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:10:14.032852    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-1293e7-7vbxw"]
Sep 15 14:10:15.758422 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:10:15.758389    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c44b4baa-4289-434e-b7f6-415790f98d2b" path="/var/lib/kubelet/pods/c44b4baa-4289-434e-b7f6-415790f98d2b/volumes"
Sep 15 14:10:15.800877 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:10:15.800852    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-1293e7-openshift-default-567dbc6586-qk4jn"
Sep 15 14:10:15.828686 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:10:15.828620    2578 generic.go:356] "Generic (PLEG): container finished" podID="b8e97cfd-1e47-4397-9cfc-179f6cf158b4" containerID="aac16bed7a959d2ed5f3f8d132f4b43c54b7e8d121fff698407321aa4fdc769e" exitCode=0
Sep 15 14:10:15.828686 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:10:15.828674    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-1293e7-openshift-default-567dbc6586-qk4jn"
Sep 15 14:10:15.828855 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:10:15.828695    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-1293e7-openshift-default-567dbc6586-qk4jn" event={"ID":"b8e97cfd-1e47-4397-9cfc-179f6cf158b4","Type":"ContainerDied","Data":"aac16bed7a959d2ed5f3f8d132f4b43c54b7e8d121fff698407321aa4fdc769e"}
Sep 15 14:10:15.828855 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:10:15.828737    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-1293e7-openshift-default-567dbc6586-qk4jn" event={"ID":"b8e97cfd-1e47-4397-9cfc-179f6cf158b4","Type":"ContainerDied","Data":"e347001360884cf3e7a036343c55f29fd709f8fc9e1bf33a031524349fbecb20"}
Sep 15 14:10:15.828855 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:10:15.828758    2578 scope.go:117] "RemoveContainer" containerID="aac16bed7a959d2ed5f3f8d132f4b43c54b7e8d121fff698407321aa4fdc769e"
Sep 15 14:10:15.840482 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:10:15.840465    2578 scope.go:117] "RemoveContainer" containerID="0c03e306be1606962d321e6f41d45b0fdce44cd93106409c29b76c0cf8aefb77"
Sep 15 14:10:15.850991 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:10:15.850970    2578 scope.go:117] "RemoveContainer" containerID="aac16bed7a959d2ed5f3f8d132f4b43c54b7e8d121fff698407321aa4fdc769e"
Sep 15 14:10:15.851328 ip-10-0-128-41 kubenswrapper[2578]: E0915 14:10:15.851307    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aac16bed7a959d2ed5f3f8d132f4b43c54b7e8d121fff698407321aa4fdc769e\": container with ID starting with aac16bed7a959d2ed5f3f8d132f4b43c54b7e8d121fff698407321aa4fdc769e not found: ID does not exist" containerID="aac16bed7a959d2ed5f3f8d132f4b43c54b7e8d121fff698407321aa4fdc769e"
Sep 15 14:10:15.851444 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:10:15.851334    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aac16bed7a959d2ed5f3f8d132f4b43c54b7e8d121fff698407321aa4fdc769e"} err="failed to get container status \"aac16bed7a959d2ed5f3f8d132f4b43c54b7e8d121fff698407321aa4fdc769e\": rpc error: code = NotFound desc = could not find container \"aac16bed7a959d2ed5f3f8d132f4b43c54b7e8d121fff698407321aa4fdc769e\": container with ID starting with aac16bed7a959d2ed5f3f8d132f4b43c54b7e8d121fff698407321aa4fdc769e not found: ID does not exist"
Sep 15 14:10:15.851444 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:10:15.851350    2578 scope.go:117] "RemoveContainer" containerID="0c03e306be1606962d321e6f41d45b0fdce44cd93106409c29b76c0cf8aefb77"
Sep 15 14:10:15.851645 ip-10-0-128-41 kubenswrapper[2578]: E0915 14:10:15.851627    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c03e306be1606962d321e6f41d45b0fdce44cd93106409c29b76c0cf8aefb77\": container with ID starting with 0c03e306be1606962d321e6f41d45b0fdce44cd93106409c29b76c0cf8aefb77 not found: ID does not exist" containerID="0c03e306be1606962d321e6f41d45b0fdce44cd93106409c29b76c0cf8aefb77"
Sep 15 14:10:15.851711 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:10:15.851650    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c03e306be1606962d321e6f41d45b0fdce44cd93106409c29b76c0cf8aefb77"} err="failed to get container status \"0c03e306be1606962d321e6f41d45b0fdce44cd93106409c29b76c0cf8aefb77\": rpc error: code = NotFound desc = could not find container \"0c03e306be1606962d321e6f41d45b0fdce44cd93106409c29b76c0cf8aefb77\": container with ID starting with 0c03e306be1606962d321e6f41d45b0fdce44cd93106409c29b76c0cf8aefb77 not found: ID does not exist"
Sep 15 14:10:15.928004 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:10:15.927973    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8e97cfd-1e47-4397-9cfc-179f6cf158b4-istio-data\") pod \"b8e97cfd-1e47-4397-9cfc-179f6cf158b4\" (UID: \"b8e97cfd-1e47-4397-9cfc-179f6cf158b4\") "
Sep 15 14:10:15.928004 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:10:15.928009    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8e97cfd-1e47-4397-9cfc-179f6cf158b4-workload-certs\") pod \"b8e97cfd-1e47-4397-9cfc-179f6cf158b4\" (UID: \"b8e97cfd-1e47-4397-9cfc-179f6cf158b4\") "
Sep 15 14:10:15.928261 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:10:15.928041    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8e97cfd-1e47-4397-9cfc-179f6cf158b4-workload-socket\") pod \"b8e97cfd-1e47-4397-9cfc-179f6cf158b4\" (UID: \"b8e97cfd-1e47-4397-9cfc-179f6cf158b4\") "
Sep 15 14:10:15.928261 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:10:15.928101    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8e97cfd-1e47-4397-9cfc-179f6cf158b4-istiod-ca-cert\") pod \"b8e97cfd-1e47-4397-9cfc-179f6cf158b4\" (UID: \"b8e97cfd-1e47-4397-9cfc-179f6cf158b4\") "
Sep 15 14:10:15.928261 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:10:15.928190    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8e97cfd-1e47-4397-9cfc-179f6cf158b4-credential-socket\") pod \"b8e97cfd-1e47-4397-9cfc-179f6cf158b4\" (UID: \"b8e97cfd-1e47-4397-9cfc-179f6cf158b4\") "
Sep 15 14:10:15.928261 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:10:15.928220    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-slg2n\" (UniqueName: \"kubernetes.io/projected/b8e97cfd-1e47-4397-9cfc-179f6cf158b4-kube-api-access-slg2n\") pod \"b8e97cfd-1e47-4397-9cfc-179f6cf158b4\" (UID: \"b8e97cfd-1e47-4397-9cfc-179f6cf158b4\") "
Sep 15 14:10:15.928479 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:10:15.928276    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8e97cfd-1e47-4397-9cfc-179f6cf158b4-istio-podinfo\") pod \"b8e97cfd-1e47-4397-9cfc-179f6cf158b4\" (UID: \"b8e97cfd-1e47-4397-9cfc-179f6cf158b4\") "
Sep 15 14:10:15.928479 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:10:15.928314    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8e97cfd-1e47-4397-9cfc-179f6cf158b4-istio-envoy\") pod \"b8e97cfd-1e47-4397-9cfc-179f6cf158b4\" (UID: \"b8e97cfd-1e47-4397-9cfc-179f6cf158b4\") "
Sep 15 14:10:15.928479 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:10:15.928330    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8e97cfd-1e47-4397-9cfc-179f6cf158b4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b8e97cfd-1e47-4397-9cfc-179f6cf158b4" (UID: "b8e97cfd-1e47-4397-9cfc-179f6cf158b4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 14:10:15.928479 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:10:15.928341    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8e97cfd-1e47-4397-9cfc-179f6cf158b4-istio-data" (OuterVolumeSpecName: "istio-data") pod "b8e97cfd-1e47-4397-9cfc-179f6cf158b4" (UID: "b8e97cfd-1e47-4397-9cfc-179f6cf158b4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 14:10:15.928479 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:10:15.928356    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8e97cfd-1e47-4397-9cfc-179f6cf158b4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b8e97cfd-1e47-4397-9cfc-179f6cf158b4" (UID: "b8e97cfd-1e47-4397-9cfc-179f6cf158b4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 14:10:15.928479 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:10:15.928402    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8e97cfd-1e47-4397-9cfc-179f6cf158b4-istio-token\") pod \"b8e97cfd-1e47-4397-9cfc-179f6cf158b4\" (UID: \"b8e97cfd-1e47-4397-9cfc-179f6cf158b4\") "
Sep 15 14:10:15.928479 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:10:15.928455    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8e97cfd-1e47-4397-9cfc-179f6cf158b4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b8e97cfd-1e47-4397-9cfc-179f6cf158b4" (UID: "b8e97cfd-1e47-4397-9cfc-179f6cf158b4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 14:10:15.928830 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:10:15.928556    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b8e97cfd-1e47-4397-9cfc-179f6cf158b4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b8e97cfd-1e47-4397-9cfc-179f6cf158b4" (UID: "b8e97cfd-1e47-4397-9cfc-179f6cf158b4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 14:10:15.928830 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:10:15.928770    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8e97cfd-1e47-4397-9cfc-179f6cf158b4-istio-data\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:10:15.928830 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:10:15.928789    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8e97cfd-1e47-4397-9cfc-179f6cf158b4-workload-certs\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:10:15.928830 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:10:15.928803    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8e97cfd-1e47-4397-9cfc-179f6cf158b4-workload-socket\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:10:15.928830 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:10:15.928816    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8e97cfd-1e47-4397-9cfc-179f6cf158b4-istiod-ca-cert\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:10:15.928830 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:10:15.928829    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8e97cfd-1e47-4397-9cfc-179f6cf158b4-credential-socket\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:10:15.931310 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:10:15.931279    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8e97cfd-1e47-4397-9cfc-179f6cf158b4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b8e97cfd-1e47-4397-9cfc-179f6cf158b4" (UID: "b8e97cfd-1e47-4397-9cfc-179f6cf158b4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 14:10:15.931310 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:10:15.931300    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8e97cfd-1e47-4397-9cfc-179f6cf158b4-istio-token" (OuterVolumeSpecName: "istio-token") pod "b8e97cfd-1e47-4397-9cfc-179f6cf158b4" (UID: "b8e97cfd-1e47-4397-9cfc-179f6cf158b4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 14:10:15.931659 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:10:15.931336    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b8e97cfd-1e47-4397-9cfc-179f6cf158b4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b8e97cfd-1e47-4397-9cfc-179f6cf158b4" (UID: "b8e97cfd-1e47-4397-9cfc-179f6cf158b4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 14:10:15.931659 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:10:15.931342    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8e97cfd-1e47-4397-9cfc-179f6cf158b4-kube-api-access-slg2n" (OuterVolumeSpecName: "kube-api-access-slg2n") pod "b8e97cfd-1e47-4397-9cfc-179f6cf158b4" (UID: "b8e97cfd-1e47-4397-9cfc-179f6cf158b4"). InnerVolumeSpecName "kube-api-access-slg2n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 14:10:16.030265 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:10:16.030234    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-slg2n\" (UniqueName: \"kubernetes.io/projected/b8e97cfd-1e47-4397-9cfc-179f6cf158b4-kube-api-access-slg2n\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:10:16.030265 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:10:16.030264    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8e97cfd-1e47-4397-9cfc-179f6cf158b4-istio-podinfo\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:10:16.030265 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:10:16.030273    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8e97cfd-1e47-4397-9cfc-179f6cf158b4-istio-envoy\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:10:16.030548 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:10:16.030283    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8e97cfd-1e47-4397-9cfc-179f6cf158b4-istio-token\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:10:16.152952 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:10:16.152922    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-1293e7-openshift-default-567dbc6586-qk4jn"]
Sep 15 14:10:16.157092 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:10:16.157067    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-1293e7-openshift-default-567dbc6586-qk4jn"]
Sep 15 14:10:17.758516 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:10:17.758479    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b8e97cfd-1e47-4397-9cfc-179f6cf158b4" path="/var/lib/kubelet/pods/b8e97cfd-1e47-4397-9cfc-179f6cf158b4/volumes"
Sep 15 14:11:34.242393 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:11:34.242315    2578 scope.go:117] "RemoveContainer" containerID="6f1d1d88a835112faec7485905bdc2cfeced62b495119a46e5efd997b4d2c7ba"
Sep 15 14:12:34.264353 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:12:34.264318    2578 scope.go:117] "RemoveContainer" containerID="6769905fdebb555d5de0cec7f1f919b52cc9018cf11cbd68a6948d4d0549765c"
Sep 15 14:13:06.685466 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:06.685428    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-66261e-openshift-default-86bd889684-6v7ph"]
Sep 15 14:13:06.687866 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:06.685672    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-66261e-openshift-default-86bd889684-6v7ph" podUID="a46634e7-1982-4116-a42e-2075f7d3cd72" containerName="istio-proxy" containerID="cri-o://ce4d105fff7a28e1557941cbb7a7e1109df1586a69b94d809cc26bcda035d471" gracePeriod=30
Sep 15 14:13:10.020890 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:10.020851    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-66261e-ddtrx"]
Sep 15 14:13:10.024072 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:10.024050    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-66261e-ddtrx"]
Sep 15 14:13:11.758324 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:11.758295    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e7697dd9-f922-45b8-83be-1b06dae787b1" path="/var/lib/kubelet/pods/e7697dd9-f922-45b8-83be-1b06dae787b1/volumes"
Sep 15 14:13:11.868701 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:11.868675    2578 generic.go:356] "Generic (PLEG): container finished" podID="a46634e7-1982-4116-a42e-2075f7d3cd72" containerID="ce4d105fff7a28e1557941cbb7a7e1109df1586a69b94d809cc26bcda035d471" exitCode=0
Sep 15 14:13:11.868842 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:11.868712    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-66261e-openshift-default-86bd889684-6v7ph" event={"ID":"a46634e7-1982-4116-a42e-2075f7d3cd72","Type":"ContainerDied","Data":"ce4d105fff7a28e1557941cbb7a7e1109df1586a69b94d809cc26bcda035d471"}
Sep 15 14:13:11.868842 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:11.868791    2578 scope.go:117] "RemoveContainer" containerID="ee4d55fb0ecd9bf838123efb3d9d3d60c022a5d86226dc964280f8cce76e78bb"
Sep 15 14:13:11.946651 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:11.946626    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-66261e-openshift-default-86bd889684-6v7ph"
Sep 15 14:13:12.021555 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:12.021477    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a46634e7-1982-4116-a42e-2075f7d3cd72-istio-podinfo\") pod \"a46634e7-1982-4116-a42e-2075f7d3cd72\" (UID: \"a46634e7-1982-4116-a42e-2075f7d3cd72\") "
Sep 15 14:13:12.021555 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:12.021527    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a46634e7-1982-4116-a42e-2075f7d3cd72-istio-token\") pod \"a46634e7-1982-4116-a42e-2075f7d3cd72\" (UID: \"a46634e7-1982-4116-a42e-2075f7d3cd72\") "
Sep 15 14:13:12.021771 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:12.021559    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a46634e7-1982-4116-a42e-2075f7d3cd72-credential-socket\") pod \"a46634e7-1982-4116-a42e-2075f7d3cd72\" (UID: \"a46634e7-1982-4116-a42e-2075f7d3cd72\") "
Sep 15 14:13:12.021771 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:12.021594    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a46634e7-1982-4116-a42e-2075f7d3cd72-istio-envoy\") pod \"a46634e7-1982-4116-a42e-2075f7d3cd72\" (UID: \"a46634e7-1982-4116-a42e-2075f7d3cd72\") "
Sep 15 14:13:12.021771 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:12.021616    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a46634e7-1982-4116-a42e-2075f7d3cd72-istiod-ca-cert\") pod \"a46634e7-1982-4116-a42e-2075f7d3cd72\" (UID: \"a46634e7-1982-4116-a42e-2075f7d3cd72\") "
Sep 15 14:13:12.021771 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:12.021632    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a46634e7-1982-4116-a42e-2075f7d3cd72-workload-socket\") pod \"a46634e7-1982-4116-a42e-2075f7d3cd72\" (UID: \"a46634e7-1982-4116-a42e-2075f7d3cd72\") "
Sep 15 14:13:12.021771 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:12.021678    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lp5mq\" (UniqueName: \"kubernetes.io/projected/a46634e7-1982-4116-a42e-2075f7d3cd72-kube-api-access-lp5mq\") pod \"a46634e7-1982-4116-a42e-2075f7d3cd72\" (UID: \"a46634e7-1982-4116-a42e-2075f7d3cd72\") "
Sep 15 14:13:12.021771 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:12.021737    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a46634e7-1982-4116-a42e-2075f7d3cd72-workload-certs\") pod \"a46634e7-1982-4116-a42e-2075f7d3cd72\" (UID: \"a46634e7-1982-4116-a42e-2075f7d3cd72\") "
Sep 15 14:13:12.021771 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:12.021767    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a46634e7-1982-4116-a42e-2075f7d3cd72-istio-data\") pod \"a46634e7-1982-4116-a42e-2075f7d3cd72\" (UID: \"a46634e7-1982-4116-a42e-2075f7d3cd72\") "
Sep 15 14:13:12.022177 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:12.021921    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a46634e7-1982-4116-a42e-2075f7d3cd72-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a46634e7-1982-4116-a42e-2075f7d3cd72" (UID: "a46634e7-1982-4116-a42e-2075f7d3cd72"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 14:13:12.022177 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:12.021933    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a46634e7-1982-4116-a42e-2075f7d3cd72-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a46634e7-1982-4116-a42e-2075f7d3cd72" (UID: "a46634e7-1982-4116-a42e-2075f7d3cd72"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 14:13:12.022177 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:12.022004    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a46634e7-1982-4116-a42e-2075f7d3cd72-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a46634e7-1982-4116-a42e-2075f7d3cd72" (UID: "a46634e7-1982-4116-a42e-2075f7d3cd72"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 14:13:12.022177 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:12.022119    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a46634e7-1982-4116-a42e-2075f7d3cd72-istio-data" (OuterVolumeSpecName: "istio-data") pod "a46634e7-1982-4116-a42e-2075f7d3cd72" (UID: "a46634e7-1982-4116-a42e-2075f7d3cd72"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 14:13:12.022177 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:12.022174    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a46634e7-1982-4116-a42e-2075f7d3cd72-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a46634e7-1982-4116-a42e-2075f7d3cd72" (UID: "a46634e7-1982-4116-a42e-2075f7d3cd72"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 14:13:12.022688 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:12.022235    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a46634e7-1982-4116-a42e-2075f7d3cd72-istio-data\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:13:12.022688 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:12.022258    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a46634e7-1982-4116-a42e-2075f7d3cd72-credential-socket\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:13:12.022688 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:12.022323    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a46634e7-1982-4116-a42e-2075f7d3cd72-istiod-ca-cert\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:13:12.022688 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:12.022432    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a46634e7-1982-4116-a42e-2075f7d3cd72-workload-socket\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:13:12.023946 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:12.023918    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a46634e7-1982-4116-a42e-2075f7d3cd72-istio-token" (OuterVolumeSpecName: "istio-token") pod "a46634e7-1982-4116-a42e-2075f7d3cd72" (UID: "a46634e7-1982-4116-a42e-2075f7d3cd72"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 14:13:12.023946 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:12.023931    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a46634e7-1982-4116-a42e-2075f7d3cd72-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a46634e7-1982-4116-a42e-2075f7d3cd72" (UID: "a46634e7-1982-4116-a42e-2075f7d3cd72"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 14:13:12.024074 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:12.023967    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a46634e7-1982-4116-a42e-2075f7d3cd72-kube-api-access-lp5mq" (OuterVolumeSpecName: "kube-api-access-lp5mq") pod "a46634e7-1982-4116-a42e-2075f7d3cd72" (UID: "a46634e7-1982-4116-a42e-2075f7d3cd72"). InnerVolumeSpecName "kube-api-access-lp5mq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 14:13:12.024113 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:12.024104    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a46634e7-1982-4116-a42e-2075f7d3cd72-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a46634e7-1982-4116-a42e-2075f7d3cd72" (UID: "a46634e7-1982-4116-a42e-2075f7d3cd72"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 14:13:12.123922 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:12.123883    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lp5mq\" (UniqueName: \"kubernetes.io/projected/a46634e7-1982-4116-a42e-2075f7d3cd72-kube-api-access-lp5mq\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:13:12.123922 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:12.123919    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a46634e7-1982-4116-a42e-2075f7d3cd72-workload-certs\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:13:12.123922 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:12.123931    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a46634e7-1982-4116-a42e-2075f7d3cd72-istio-podinfo\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:13:12.124190 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:12.123939    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a46634e7-1982-4116-a42e-2075f7d3cd72-istio-token\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:13:12.124190 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:12.123948    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a46634e7-1982-4116-a42e-2075f7d3cd72-istio-envoy\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:13:12.877040 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:12.877013    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-66261e-openshift-default-86bd889684-6v7ph"
Sep 15 14:13:12.877537 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:12.877070    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-66261e-openshift-default-86bd889684-6v7ph" event={"ID":"a46634e7-1982-4116-a42e-2075f7d3cd72","Type":"ContainerDied","Data":"b6fcf05c9f2db5c373bbea9006e3cc2b672a9c6db588e80a429753cb3805bb82"}
Sep 15 14:13:12.877537 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:12.877158    2578 scope.go:117] "RemoveContainer" containerID="ce4d105fff7a28e1557941cbb7a7e1109df1586a69b94d809cc26bcda035d471"
Sep 15 14:13:12.899604 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:12.899574    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-66261e-openshift-default-86bd889684-6v7ph"]
Sep 15 14:13:12.904608 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:12.904584    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-66261e-openshift-default-86bd889684-6v7ph"]
Sep 15 14:13:13.758225 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:13.758192    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a46634e7-1982-4116-a42e-2075f7d3cd72" path="/var/lib/kubelet/pods/a46634e7-1982-4116-a42e-2075f7d3cd72/volumes"
Sep 15 14:13:18.028208 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:18.028175    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-746f54-openshift-default-8466df476d-s9rqw"]
Sep 15 14:13:18.028577 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:18.028556    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a46634e7-1982-4116-a42e-2075f7d3cd72" containerName="istio-proxy"
Sep 15 14:13:18.028577 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:18.028567    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a46634e7-1982-4116-a42e-2075f7d3cd72" containerName="istio-proxy"
Sep 15 14:13:18.028650 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:18.028579    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8e97cfd-1e47-4397-9cfc-179f6cf158b4" containerName="istio-proxy"
Sep 15 14:13:18.028650 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:18.028585    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8e97cfd-1e47-4397-9cfc-179f6cf158b4" containerName="istio-proxy"
Sep 15 14:13:18.028714 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:18.028654    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8e97cfd-1e47-4397-9cfc-179f6cf158b4" containerName="istio-proxy"
Sep 15 14:13:18.028714 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:18.028662    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a46634e7-1982-4116-a42e-2075f7d3cd72" containerName="istio-proxy"
Sep 15 14:13:18.028714 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:18.028668    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8e97cfd-1e47-4397-9cfc-179f6cf158b4" containerName="istio-proxy"
Sep 15 14:13:18.028714 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:18.028680    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a46634e7-1982-4116-a42e-2075f7d3cd72" containerName="istio-proxy"
Sep 15 14:13:18.033013 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:18.032997    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-746f54-openshift-default-8466df476d-s9rqw"
Sep 15 14:13:18.036238 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:18.036220    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-746f54-openshift-default-dockercfg-j9xdq\""
Sep 15 14:13:18.048236 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:18.048207    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-746f54-openshift-default-8466df476d-s9rqw"]
Sep 15 14:13:18.078785 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:18.078760    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a18a0de3-d5c6-4a37-93dc-8362087285b7-istio-data\") pod \"e2e-api-a-746f54-openshift-default-8466df476d-s9rqw\" (UID: \"a18a0de3-d5c6-4a37-93dc-8362087285b7\") " pod="openshift-ingress/e2e-api-a-746f54-openshift-default-8466df476d-s9rqw"
Sep 15 14:13:18.078934 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:18.078789    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a18a0de3-d5c6-4a37-93dc-8362087285b7-istio-token\") pod \"e2e-api-a-746f54-openshift-default-8466df476d-s9rqw\" (UID: \"a18a0de3-d5c6-4a37-93dc-8362087285b7\") " pod="openshift-ingress/e2e-api-a-746f54-openshift-default-8466df476d-s9rqw"
Sep 15 14:13:18.078934 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:18.078816    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a18a0de3-d5c6-4a37-93dc-8362087285b7-workload-socket\") pod \"e2e-api-a-746f54-openshift-default-8466df476d-s9rqw\" (UID: \"a18a0de3-d5c6-4a37-93dc-8362087285b7\") " pod="openshift-ingress/e2e-api-a-746f54-openshift-default-8466df476d-s9rqw"
Sep 15 14:13:18.078934 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:18.078838    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a18a0de3-d5c6-4a37-93dc-8362087285b7-workload-certs\") pod \"e2e-api-a-746f54-openshift-default-8466df476d-s9rqw\" (UID: \"a18a0de3-d5c6-4a37-93dc-8362087285b7\") " pod="openshift-ingress/e2e-api-a-746f54-openshift-default-8466df476d-s9rqw"
Sep 15 14:13:18.078934 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:18.078901    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a18a0de3-d5c6-4a37-93dc-8362087285b7-istio-envoy\") pod \"e2e-api-a-746f54-openshift-default-8466df476d-s9rqw\" (UID: \"a18a0de3-d5c6-4a37-93dc-8362087285b7\") " pod="openshift-ingress/e2e-api-a-746f54-openshift-default-8466df476d-s9rqw"
Sep 15 14:13:18.079239 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:18.078942    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a18a0de3-d5c6-4a37-93dc-8362087285b7-istiod-ca-cert\") pod \"e2e-api-a-746f54-openshift-default-8466df476d-s9rqw\" (UID: \"a18a0de3-d5c6-4a37-93dc-8362087285b7\") " pod="openshift-ingress/e2e-api-a-746f54-openshift-default-8466df476d-s9rqw"
Sep 15 14:13:18.079239 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:18.078994    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a18a0de3-d5c6-4a37-93dc-8362087285b7-credential-socket\") pod \"e2e-api-a-746f54-openshift-default-8466df476d-s9rqw\" (UID: \"a18a0de3-d5c6-4a37-93dc-8362087285b7\") " pod="openshift-ingress/e2e-api-a-746f54-openshift-default-8466df476d-s9rqw"
Sep 15 14:13:18.079239 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:18.079018    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75pvj\" (UniqueName: \"kubernetes.io/projected/a18a0de3-d5c6-4a37-93dc-8362087285b7-kube-api-access-75pvj\") pod \"e2e-api-a-746f54-openshift-default-8466df476d-s9rqw\" (UID: \"a18a0de3-d5c6-4a37-93dc-8362087285b7\") " pod="openshift-ingress/e2e-api-a-746f54-openshift-default-8466df476d-s9rqw"
Sep 15 14:13:18.079239 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:18.079101    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a18a0de3-d5c6-4a37-93dc-8362087285b7-istio-podinfo\") pod \"e2e-api-a-746f54-openshift-default-8466df476d-s9rqw\" (UID: \"a18a0de3-d5c6-4a37-93dc-8362087285b7\") " pod="openshift-ingress/e2e-api-a-746f54-openshift-default-8466df476d-s9rqw"
Sep 15 14:13:18.180470 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:18.180436    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a18a0de3-d5c6-4a37-93dc-8362087285b7-istio-data\") pod \"e2e-api-a-746f54-openshift-default-8466df476d-s9rqw\" (UID: \"a18a0de3-d5c6-4a37-93dc-8362087285b7\") " pod="openshift-ingress/e2e-api-a-746f54-openshift-default-8466df476d-s9rqw"
Sep 15 14:13:18.180470 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:18.180475    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a18a0de3-d5c6-4a37-93dc-8362087285b7-istio-token\") pod \"e2e-api-a-746f54-openshift-default-8466df476d-s9rqw\" (UID: \"a18a0de3-d5c6-4a37-93dc-8362087285b7\") " pod="openshift-ingress/e2e-api-a-746f54-openshift-default-8466df476d-s9rqw"
Sep 15 14:13:18.180714 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:18.180497    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a18a0de3-d5c6-4a37-93dc-8362087285b7-workload-socket\") pod \"e2e-api-a-746f54-openshift-default-8466df476d-s9rqw\" (UID: \"a18a0de3-d5c6-4a37-93dc-8362087285b7\") " pod="openshift-ingress/e2e-api-a-746f54-openshift-default-8466df476d-s9rqw"
Sep 15 14:13:18.180714 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:18.180514    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a18a0de3-d5c6-4a37-93dc-8362087285b7-workload-certs\") pod \"e2e-api-a-746f54-openshift-default-8466df476d-s9rqw\" (UID: \"a18a0de3-d5c6-4a37-93dc-8362087285b7\") " pod="openshift-ingress/e2e-api-a-746f54-openshift-default-8466df476d-s9rqw"
Sep 15 14:13:18.180714 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:18.180536    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a18a0de3-d5c6-4a37-93dc-8362087285b7-istio-envoy\") pod \"e2e-api-a-746f54-openshift-default-8466df476d-s9rqw\" (UID: \"a18a0de3-d5c6-4a37-93dc-8362087285b7\") " pod="openshift-ingress/e2e-api-a-746f54-openshift-default-8466df476d-s9rqw"
Sep 15 14:13:18.180714 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:18.180617    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a18a0de3-d5c6-4a37-93dc-8362087285b7-istiod-ca-cert\") pod \"e2e-api-a-746f54-openshift-default-8466df476d-s9rqw\" (UID: \"a18a0de3-d5c6-4a37-93dc-8362087285b7\") " pod="openshift-ingress/e2e-api-a-746f54-openshift-default-8466df476d-s9rqw"
Sep 15 14:13:18.180714 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:18.180689    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a18a0de3-d5c6-4a37-93dc-8362087285b7-credential-socket\") pod \"e2e-api-a-746f54-openshift-default-8466df476d-s9rqw\" (UID: \"a18a0de3-d5c6-4a37-93dc-8362087285b7\") " pod="openshift-ingress/e2e-api-a-746f54-openshift-default-8466df476d-s9rqw"
Sep 15 14:13:18.180982 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:18.180725    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75pvj\" (UniqueName: \"kubernetes.io/projected/a18a0de3-d5c6-4a37-93dc-8362087285b7-kube-api-access-75pvj\") pod \"e2e-api-a-746f54-openshift-default-8466df476d-s9rqw\" (UID: \"a18a0de3-d5c6-4a37-93dc-8362087285b7\") " pod="openshift-ingress/e2e-api-a-746f54-openshift-default-8466df476d-s9rqw"
Sep 15 14:13:18.180982 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:18.180821    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a18a0de3-d5c6-4a37-93dc-8362087285b7-istio-podinfo\") pod \"e2e-api-a-746f54-openshift-default-8466df476d-s9rqw\" (UID: \"a18a0de3-d5c6-4a37-93dc-8362087285b7\") " pod="openshift-ingress/e2e-api-a-746f54-openshift-default-8466df476d-s9rqw"
Sep 15 14:13:18.180982 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:18.180883    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a18a0de3-d5c6-4a37-93dc-8362087285b7-istio-data\") pod \"e2e-api-a-746f54-openshift-default-8466df476d-s9rqw\" (UID: \"a18a0de3-d5c6-4a37-93dc-8362087285b7\") " pod="openshift-ingress/e2e-api-a-746f54-openshift-default-8466df476d-s9rqw"
Sep 15 14:13:18.180982 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:18.180950    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a18a0de3-d5c6-4a37-93dc-8362087285b7-workload-socket\") pod \"e2e-api-a-746f54-openshift-default-8466df476d-s9rqw\" (UID: \"a18a0de3-d5c6-4a37-93dc-8362087285b7\") " pod="openshift-ingress/e2e-api-a-746f54-openshift-default-8466df476d-s9rqw"
Sep 15 14:13:18.181236 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:18.180990    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a18a0de3-d5c6-4a37-93dc-8362087285b7-workload-certs\") pod \"e2e-api-a-746f54-openshift-default-8466df476d-s9rqw\" (UID: \"a18a0de3-d5c6-4a37-93dc-8362087285b7\") " pod="openshift-ingress/e2e-api-a-746f54-openshift-default-8466df476d-s9rqw"
Sep 15 14:13:18.181236 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:18.181080    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a18a0de3-d5c6-4a37-93dc-8362087285b7-credential-socket\") pod \"e2e-api-a-746f54-openshift-default-8466df476d-s9rqw\" (UID: \"a18a0de3-d5c6-4a37-93dc-8362087285b7\") " pod="openshift-ingress/e2e-api-a-746f54-openshift-default-8466df476d-s9rqw"
Sep 15 14:13:18.181460 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:18.181429    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a18a0de3-d5c6-4a37-93dc-8362087285b7-istiod-ca-cert\") pod \"e2e-api-a-746f54-openshift-default-8466df476d-s9rqw\" (UID: \"a18a0de3-d5c6-4a37-93dc-8362087285b7\") " pod="openshift-ingress/e2e-api-a-746f54-openshift-default-8466df476d-s9rqw"
Sep 15 14:13:18.182906 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:18.182888    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a18a0de3-d5c6-4a37-93dc-8362087285b7-istio-envoy\") pod \"e2e-api-a-746f54-openshift-default-8466df476d-s9rqw\" (UID: \"a18a0de3-d5c6-4a37-93dc-8362087285b7\") " pod="openshift-ingress/e2e-api-a-746f54-openshift-default-8466df476d-s9rqw"
Sep 15 14:13:18.183281 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:18.183265    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a18a0de3-d5c6-4a37-93dc-8362087285b7-istio-podinfo\") pod \"e2e-api-a-746f54-openshift-default-8466df476d-s9rqw\" (UID: \"a18a0de3-d5c6-4a37-93dc-8362087285b7\") " pod="openshift-ingress/e2e-api-a-746f54-openshift-default-8466df476d-s9rqw"
Sep 15 14:13:18.191704 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:18.191683    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-75pvj\" (UniqueName: \"kubernetes.io/projected/a18a0de3-d5c6-4a37-93dc-8362087285b7-kube-api-access-75pvj\") pod \"e2e-api-a-746f54-openshift-default-8466df476d-s9rqw\" (UID: \"a18a0de3-d5c6-4a37-93dc-8362087285b7\") " pod="openshift-ingress/e2e-api-a-746f54-openshift-default-8466df476d-s9rqw"
Sep 15 14:13:18.191787 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:18.191734    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a18a0de3-d5c6-4a37-93dc-8362087285b7-istio-token\") pod \"e2e-api-a-746f54-openshift-default-8466df476d-s9rqw\" (UID: \"a18a0de3-d5c6-4a37-93dc-8362087285b7\") " pod="openshift-ingress/e2e-api-a-746f54-openshift-default-8466df476d-s9rqw"
Sep 15 14:13:18.345007 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:18.344913    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-746f54-openshift-default-8466df476d-s9rqw"
Sep 15 14:13:18.626605 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:18.626566    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-746f54-openshift-default-8466df476d-s9rqw"]
Sep 15 14:13:18.628377 ip-10-0-128-41 kubenswrapper[2578]: W0915 14:13:18.628353    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda18a0de3_d5c6_4a37_93dc_8362087285b7.slice/crio-0441b31392c1aa4c9c9135570d97f4469816b8b65e00186a39120c64ae7b9fc8 WatchSource:0}: Error finding container 0441b31392c1aa4c9c9135570d97f4469816b8b65e00186a39120c64ae7b9fc8: Status 404 returned error can't find the container with id 0441b31392c1aa4c9c9135570d97f4469816b8b65e00186a39120c64ae7b9fc8
Sep 15 14:13:18.630708 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:18.630678    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 15 14:13:18.630783 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:18.630742    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 15 14:13:18.630783 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:18.630771    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 15 14:13:18.913954 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:18.913853    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-746f54-openshift-default-8466df476d-s9rqw" event={"ID":"a18a0de3-d5c6-4a37-93dc-8362087285b7","Type":"ContainerStarted","Data":"cdfba6ab1b2055d6b41521f3965f5a1dcb92e800d12511b25aac03e4215b62af"}
Sep 15 14:13:18.913954 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:18.913929    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-746f54-openshift-default-8466df476d-s9rqw" event={"ID":"a18a0de3-d5c6-4a37-93dc-8362087285b7","Type":"ContainerStarted","Data":"0441b31392c1aa4c9c9135570d97f4469816b8b65e00186a39120c64ae7b9fc8"}
Sep 15 14:13:18.935528 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:18.935484    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-746f54-openshift-default-8466df476d-s9rqw" podStartSLOduration=0.93546838 podStartE2EDuration="935.46838ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 14:13:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 14:13:18.93370571 +0000 UTC m=+2085.692832008" watchObservedRunningTime="2026-09-15 14:13:18.93546838 +0000 UTC m=+2085.694594665"
Sep 15 14:13:19.345322 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:19.345286    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-746f54-openshift-default-8466df476d-s9rqw"
Sep 15 14:13:19.350659 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:19.350632    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-746f54-openshift-default-8466df476d-s9rqw"
Sep 15 14:13:19.921287 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:19.921258    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-746f54-openshift-default-8466df476d-s9rqw"
Sep 15 14:13:19.922300 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:19.922281    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-746f54-openshift-default-8466df476d-s9rqw"
Sep 15 14:13:26.078978 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:26.078946    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-746f54-78b844b659-gfl6b"]
Sep 15 14:13:26.079390 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:26.079375    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a46634e7-1982-4116-a42e-2075f7d3cd72" containerName="istio-proxy"
Sep 15 14:13:26.079435 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:26.079391    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a46634e7-1982-4116-a42e-2075f7d3cd72" containerName="istio-proxy"
Sep 15 14:13:26.079435 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:26.079403    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8e97cfd-1e47-4397-9cfc-179f6cf158b4" containerName="istio-proxy"
Sep 15 14:13:26.079435 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:26.079409    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8e97cfd-1e47-4397-9cfc-179f6cf158b4" containerName="istio-proxy"
Sep 15 14:13:26.082819 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:26.082797    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-746f54-78b844b659-gfl6b"
Sep 15 14:13:26.085361 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:26.085342    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-746f54-dockercfg-tjhrt\""
Sep 15 14:13:26.085531 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:26.085513    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-746f54\""
Sep 15 14:13:26.093102 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:26.093083    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-746f54-78b844b659-gfl6b"]
Sep 15 14:13:26.134821 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:26.134783    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-746f54-f9b7c67f4-dx28h"]
Sep 15 14:13:26.138380 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:26.138363    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-746f54-f9b7c67f4-dx28h"
Sep 15 14:13:26.150915 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:26.150893    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-746f54-f9b7c67f4-dx28h"]
Sep 15 14:13:26.156391 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:26.156369    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/76943adf-43f8-4eba-8746-f977c9cacf6e-plugins-config-volume\") pod \"payload-processing-e2e-api-a-746f54-78b844b659-gfl6b\" (UID: \"76943adf-43f8-4eba-8746-f977c9cacf6e\") " pod="openshift-ingress/payload-processing-e2e-api-a-746f54-78b844b659-gfl6b"
Sep 15 14:13:26.156520 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:26.156505    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mqc7\" (UniqueName: \"kubernetes.io/projected/76943adf-43f8-4eba-8746-f977c9cacf6e-kube-api-access-2mqc7\") pod \"payload-processing-e2e-api-a-746f54-78b844b659-gfl6b\" (UID: \"76943adf-43f8-4eba-8746-f977c9cacf6e\") " pod="openshift-ingress/payload-processing-e2e-api-a-746f54-78b844b659-gfl6b"
Sep 15 14:13:26.256954 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:26.256919    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b8e58998-d4f4-46a1-9bfe-af94a5071a8d-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-746f54-f9b7c67f4-dx28h\" (UID: \"b8e58998-d4f4-46a1-9bfe-af94a5071a8d\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-746f54-f9b7c67f4-dx28h"
Sep 15 14:13:26.257141 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:26.257029    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mqc7\" (UniqueName: \"kubernetes.io/projected/76943adf-43f8-4eba-8746-f977c9cacf6e-kube-api-access-2mqc7\") pod \"payload-processing-e2e-api-a-746f54-78b844b659-gfl6b\" (UID: \"76943adf-43f8-4eba-8746-f977c9cacf6e\") " pod="openshift-ingress/payload-processing-e2e-api-a-746f54-78b844b659-gfl6b"
Sep 15 14:13:26.257141 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:26.257065    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/76943adf-43f8-4eba-8746-f977c9cacf6e-plugins-config-volume\") pod \"payload-processing-e2e-api-a-746f54-78b844b659-gfl6b\" (UID: \"76943adf-43f8-4eba-8746-f977c9cacf6e\") " pod="openshift-ingress/payload-processing-e2e-api-a-746f54-78b844b659-gfl6b"
Sep 15 14:13:26.257302 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:26.257283    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcs77\" (UniqueName: \"kubernetes.io/projected/b8e58998-d4f4-46a1-9bfe-af94a5071a8d-kube-api-access-tcs77\") pod \"payload-pre-processing-e2e-api-a-746f54-f9b7c67f4-dx28h\" (UID: \"b8e58998-d4f4-46a1-9bfe-af94a5071a8d\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-746f54-f9b7c67f4-dx28h"
Sep 15 14:13:26.257809 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:26.257792    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/76943adf-43f8-4eba-8746-f977c9cacf6e-plugins-config-volume\") pod \"payload-processing-e2e-api-a-746f54-78b844b659-gfl6b\" (UID: \"76943adf-43f8-4eba-8746-f977c9cacf6e\") " pod="openshift-ingress/payload-processing-e2e-api-a-746f54-78b844b659-gfl6b"
Sep 15 14:13:26.265771 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:26.265737    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mqc7\" (UniqueName: \"kubernetes.io/projected/76943adf-43f8-4eba-8746-f977c9cacf6e-kube-api-access-2mqc7\") pod \"payload-processing-e2e-api-a-746f54-78b844b659-gfl6b\" (UID: \"76943adf-43f8-4eba-8746-f977c9cacf6e\") " pod="openshift-ingress/payload-processing-e2e-api-a-746f54-78b844b659-gfl6b"
Sep 15 14:13:26.358402 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:26.358320    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcs77\" (UniqueName: \"kubernetes.io/projected/b8e58998-d4f4-46a1-9bfe-af94a5071a8d-kube-api-access-tcs77\") pod \"payload-pre-processing-e2e-api-a-746f54-f9b7c67f4-dx28h\" (UID: \"b8e58998-d4f4-46a1-9bfe-af94a5071a8d\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-746f54-f9b7c67f4-dx28h"
Sep 15 14:13:26.358402 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:26.358363    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b8e58998-d4f4-46a1-9bfe-af94a5071a8d-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-746f54-f9b7c67f4-dx28h\" (UID: \"b8e58998-d4f4-46a1-9bfe-af94a5071a8d\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-746f54-f9b7c67f4-dx28h"
Sep 15 14:13:26.359049 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:26.359031    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b8e58998-d4f4-46a1-9bfe-af94a5071a8d-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-746f54-f9b7c67f4-dx28h\" (UID: \"b8e58998-d4f4-46a1-9bfe-af94a5071a8d\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-746f54-f9b7c67f4-dx28h"
Sep 15 14:13:26.366630 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:26.366590    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcs77\" (UniqueName: \"kubernetes.io/projected/b8e58998-d4f4-46a1-9bfe-af94a5071a8d-kube-api-access-tcs77\") pod \"payload-pre-processing-e2e-api-a-746f54-f9b7c67f4-dx28h\" (UID: \"b8e58998-d4f4-46a1-9bfe-af94a5071a8d\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-746f54-f9b7c67f4-dx28h"
Sep 15 14:13:26.394760 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:26.394737    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-746f54-78b844b659-gfl6b"
Sep 15 14:13:26.448362 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:26.448334    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-746f54-f9b7c67f4-dx28h"
Sep 15 14:13:26.671599 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:26.671570    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-746f54-78b844b659-gfl6b"]
Sep 15 14:13:26.672547 ip-10-0-128-41 kubenswrapper[2578]: W0915 14:13:26.672521    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76943adf_43f8_4eba_8746_f977c9cacf6e.slice/crio-4d4accb1e10000bb9ccd08d715a3cf1ff0093d41cb7d557aed388e4adc095f19 WatchSource:0}: Error finding container 4d4accb1e10000bb9ccd08d715a3cf1ff0093d41cb7d557aed388e4adc095f19: Status 404 returned error can't find the container with id 4d4accb1e10000bb9ccd08d715a3cf1ff0093d41cb7d557aed388e4adc095f19
Sep 15 14:13:26.742880 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:26.742852    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-746f54-f9b7c67f4-dx28h"]
Sep 15 14:13:26.743239 ip-10-0-128-41 kubenswrapper[2578]: W0915 14:13:26.743216    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8e58998_d4f4_46a1_9bfe_af94a5071a8d.slice/crio-0a712cd16d4cd1071c6555a165558c495d22eaf53cc6e59d24d81bdca9825218 WatchSource:0}: Error finding container 0a712cd16d4cd1071c6555a165558c495d22eaf53cc6e59d24d81bdca9825218: Status 404 returned error can't find the container with id 0a712cd16d4cd1071c6555a165558c495d22eaf53cc6e59d24d81bdca9825218
Sep 15 14:13:26.968054 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:26.967958    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-746f54-78b844b659-gfl6b" event={"ID":"76943adf-43f8-4eba-8746-f977c9cacf6e","Type":"ContainerStarted","Data":"00bebd896b38c0003e50b36a5d64cbeacf273e2b15878ff7111d27cc3154891f"}
Sep 15 14:13:26.968239 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:26.968160    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-746f54-78b844b659-gfl6b"
Sep 15 14:13:26.968239 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:26.968200    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-746f54-78b844b659-gfl6b" event={"ID":"76943adf-43f8-4eba-8746-f977c9cacf6e","Type":"ContainerStarted","Data":"4d4accb1e10000bb9ccd08d715a3cf1ff0093d41cb7d557aed388e4adc095f19"}
Sep 15 14:13:26.969682 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:26.969659    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-746f54-f9b7c67f4-dx28h" event={"ID":"b8e58998-d4f4-46a1-9bfe-af94a5071a8d","Type":"ContainerStarted","Data":"3b770f5f471a4d009dc1ec1321003b11315e1f993adafa3218d5eaac1c231e8e"}
Sep 15 14:13:26.969682 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:26.969695    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-746f54-f9b7c67f4-dx28h" event={"ID":"b8e58998-d4f4-46a1-9bfe-af94a5071a8d","Type":"ContainerStarted","Data":"0a712cd16d4cd1071c6555a165558c495d22eaf53cc6e59d24d81bdca9825218"}
Sep 15 14:13:26.969852 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:26.969725    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-746f54-f9b7c67f4-dx28h"
Sep 15 14:13:26.989233 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:26.989189    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-746f54-78b844b659-gfl6b" podStartSLOduration=0.989175082 podStartE2EDuration="989.175082ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 14:13:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 14:13:26.9853386 +0000 UTC m=+2093.744464907" watchObservedRunningTime="2026-09-15 14:13:26.989175082 +0000 UTC m=+2093.748301368"
Sep 15 14:13:27.005533 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:27.005485    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-746f54-f9b7c67f4-dx28h" podStartSLOduration=1.005467857 podStartE2EDuration="1.005467857s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 14:13:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 14:13:27.001733567 +0000 UTC m=+2093.760859855" watchObservedRunningTime="2026-09-15 14:13:27.005467857 +0000 UTC m=+2093.764594144"
Sep 15 14:13:37.981484 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:37.981426    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-746f54-78b844b659-gfl6b"
Sep 15 14:13:37.983289 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:37.983267    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-746f54-f9b7c67f4-dx28h"
Sep 15 14:13:41.491883 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:41.491848    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-e50cdb-openshift-default-6c4c7d6cf6-fpf2d"]
Sep 15 14:13:41.495252 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:41.495236    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-e50cdb-openshift-default-6c4c7d6cf6-fpf2d"
Sep 15 14:13:41.501106 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:41.501080    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-e50cdb-openshift-default-dockercfg-h2mzx\""
Sep 15 14:13:41.509666 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:41.509640    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-e50cdb-openshift-default-6c4c7d6cf6-fpf2d"]
Sep 15 14:13:41.627889 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:41.627850    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9afc43e8-1aeb-415c-a911-4b688f58ffc3-credential-socket\") pod \"e2e-api-b-e50cdb-openshift-default-6c4c7d6cf6-fpf2d\" (UID: \"9afc43e8-1aeb-415c-a911-4b688f58ffc3\") " pod="openshift-ingress/e2e-api-b-e50cdb-openshift-default-6c4c7d6cf6-fpf2d"
Sep 15 14:13:41.628067 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:41.627906    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9afc43e8-1aeb-415c-a911-4b688f58ffc3-istio-data\") pod \"e2e-api-b-e50cdb-openshift-default-6c4c7d6cf6-fpf2d\" (UID: \"9afc43e8-1aeb-415c-a911-4b688f58ffc3\") " pod="openshift-ingress/e2e-api-b-e50cdb-openshift-default-6c4c7d6cf6-fpf2d"
Sep 15 14:13:41.628067 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:41.627973    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9afc43e8-1aeb-415c-a911-4b688f58ffc3-istio-podinfo\") pod \"e2e-api-b-e50cdb-openshift-default-6c4c7d6cf6-fpf2d\" (UID: \"9afc43e8-1aeb-415c-a911-4b688f58ffc3\") " pod="openshift-ingress/e2e-api-b-e50cdb-openshift-default-6c4c7d6cf6-fpf2d"
Sep 15 14:13:41.628067 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:41.628049    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9afc43e8-1aeb-415c-a911-4b688f58ffc3-istio-token\") pod \"e2e-api-b-e50cdb-openshift-default-6c4c7d6cf6-fpf2d\" (UID: \"9afc43e8-1aeb-415c-a911-4b688f58ffc3\") " pod="openshift-ingress/e2e-api-b-e50cdb-openshift-default-6c4c7d6cf6-fpf2d"
Sep 15 14:13:41.628228 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:41.628077    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9afc43e8-1aeb-415c-a911-4b688f58ffc3-workload-socket\") pod \"e2e-api-b-e50cdb-openshift-default-6c4c7d6cf6-fpf2d\" (UID: \"9afc43e8-1aeb-415c-a911-4b688f58ffc3\") " pod="openshift-ingress/e2e-api-b-e50cdb-openshift-default-6c4c7d6cf6-fpf2d"
Sep 15 14:13:41.628228 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:41.628113    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9afc43e8-1aeb-415c-a911-4b688f58ffc3-workload-certs\") pod \"e2e-api-b-e50cdb-openshift-default-6c4c7d6cf6-fpf2d\" (UID: \"9afc43e8-1aeb-415c-a911-4b688f58ffc3\") " pod="openshift-ingress/e2e-api-b-e50cdb-openshift-default-6c4c7d6cf6-fpf2d"
Sep 15 14:13:41.628228 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:41.628147    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7lsm\" (UniqueName: \"kubernetes.io/projected/9afc43e8-1aeb-415c-a911-4b688f58ffc3-kube-api-access-t7lsm\") pod \"e2e-api-b-e50cdb-openshift-default-6c4c7d6cf6-fpf2d\" (UID: \"9afc43e8-1aeb-415c-a911-4b688f58ffc3\") " pod="openshift-ingress/e2e-api-b-e50cdb-openshift-default-6c4c7d6cf6-fpf2d"
Sep 15 14:13:41.628228 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:41.628207    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9afc43e8-1aeb-415c-a911-4b688f58ffc3-istiod-ca-cert\") pod \"e2e-api-b-e50cdb-openshift-default-6c4c7d6cf6-fpf2d\" (UID: \"9afc43e8-1aeb-415c-a911-4b688f58ffc3\") " pod="openshift-ingress/e2e-api-b-e50cdb-openshift-default-6c4c7d6cf6-fpf2d"
Sep 15 14:13:41.628381 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:41.628247    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9afc43e8-1aeb-415c-a911-4b688f58ffc3-istio-envoy\") pod \"e2e-api-b-e50cdb-openshift-default-6c4c7d6cf6-fpf2d\" (UID: \"9afc43e8-1aeb-415c-a911-4b688f58ffc3\") " pod="openshift-ingress/e2e-api-b-e50cdb-openshift-default-6c4c7d6cf6-fpf2d"
Sep 15 14:13:41.729260 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:41.729220    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9afc43e8-1aeb-415c-a911-4b688f58ffc3-workload-certs\") pod \"e2e-api-b-e50cdb-openshift-default-6c4c7d6cf6-fpf2d\" (UID: \"9afc43e8-1aeb-415c-a911-4b688f58ffc3\") " pod="openshift-ingress/e2e-api-b-e50cdb-openshift-default-6c4c7d6cf6-fpf2d"
Sep 15 14:13:41.729260 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:41.729264    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7lsm\" (UniqueName: \"kubernetes.io/projected/9afc43e8-1aeb-415c-a911-4b688f58ffc3-kube-api-access-t7lsm\") pod \"e2e-api-b-e50cdb-openshift-default-6c4c7d6cf6-fpf2d\" (UID: \"9afc43e8-1aeb-415c-a911-4b688f58ffc3\") " pod="openshift-ingress/e2e-api-b-e50cdb-openshift-default-6c4c7d6cf6-fpf2d"
Sep 15 14:13:41.729535 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:41.729287    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9afc43e8-1aeb-415c-a911-4b688f58ffc3-istiod-ca-cert\") pod \"e2e-api-b-e50cdb-openshift-default-6c4c7d6cf6-fpf2d\" (UID: \"9afc43e8-1aeb-415c-a911-4b688f58ffc3\") " pod="openshift-ingress/e2e-api-b-e50cdb-openshift-default-6c4c7d6cf6-fpf2d"
Sep 15 14:13:41.729535 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:41.729309    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9afc43e8-1aeb-415c-a911-4b688f58ffc3-istio-envoy\") pod \"e2e-api-b-e50cdb-openshift-default-6c4c7d6cf6-fpf2d\" (UID: \"9afc43e8-1aeb-415c-a911-4b688f58ffc3\") " pod="openshift-ingress/e2e-api-b-e50cdb-openshift-default-6c4c7d6cf6-fpf2d"
Sep 15 14:13:41.729535 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:41.729435    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9afc43e8-1aeb-415c-a911-4b688f58ffc3-credential-socket\") pod \"e2e-api-b-e50cdb-openshift-default-6c4c7d6cf6-fpf2d\" (UID: \"9afc43e8-1aeb-415c-a911-4b688f58ffc3\") " pod="openshift-ingress/e2e-api-b-e50cdb-openshift-default-6c4c7d6cf6-fpf2d"
Sep 15 14:13:41.729535 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:41.729520    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9afc43e8-1aeb-415c-a911-4b688f58ffc3-istio-data\") pod \"e2e-api-b-e50cdb-openshift-default-6c4c7d6cf6-fpf2d\" (UID: \"9afc43e8-1aeb-415c-a911-4b688f58ffc3\") " pod="openshift-ingress/e2e-api-b-e50cdb-openshift-default-6c4c7d6cf6-fpf2d"
Sep 15 14:13:41.729773 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:41.729557    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9afc43e8-1aeb-415c-a911-4b688f58ffc3-istio-podinfo\") pod \"e2e-api-b-e50cdb-openshift-default-6c4c7d6cf6-fpf2d\" (UID: \"9afc43e8-1aeb-415c-a911-4b688f58ffc3\") " pod="openshift-ingress/e2e-api-b-e50cdb-openshift-default-6c4c7d6cf6-fpf2d"
Sep 15 14:13:41.729773 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:41.729609    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9afc43e8-1aeb-415c-a911-4b688f58ffc3-istio-token\") pod \"e2e-api-b-e50cdb-openshift-default-6c4c7d6cf6-fpf2d\" (UID: \"9afc43e8-1aeb-415c-a911-4b688f58ffc3\") " pod="openshift-ingress/e2e-api-b-e50cdb-openshift-default-6c4c7d6cf6-fpf2d"
Sep 15 14:13:41.729773 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:41.729635    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9afc43e8-1aeb-415c-a911-4b688f58ffc3-workload-socket\") pod \"e2e-api-b-e50cdb-openshift-default-6c4c7d6cf6-fpf2d\" (UID: \"9afc43e8-1aeb-415c-a911-4b688f58ffc3\") " pod="openshift-ingress/e2e-api-b-e50cdb-openshift-default-6c4c7d6cf6-fpf2d"
Sep 15 14:13:41.729773 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:41.729739    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9afc43e8-1aeb-415c-a911-4b688f58ffc3-workload-certs\") pod \"e2e-api-b-e50cdb-openshift-default-6c4c7d6cf6-fpf2d\" (UID: \"9afc43e8-1aeb-415c-a911-4b688f58ffc3\") " pod="openshift-ingress/e2e-api-b-e50cdb-openshift-default-6c4c7d6cf6-fpf2d"
Sep 15 14:13:41.729993 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:41.729973    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9afc43e8-1aeb-415c-a911-4b688f58ffc3-istio-data\") pod \"e2e-api-b-e50cdb-openshift-default-6c4c7d6cf6-fpf2d\" (UID: \"9afc43e8-1aeb-415c-a911-4b688f58ffc3\") " pod="openshift-ingress/e2e-api-b-e50cdb-openshift-default-6c4c7d6cf6-fpf2d"
Sep 15 14:13:41.730192 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:41.730159    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9afc43e8-1aeb-415c-a911-4b688f58ffc3-credential-socket\") pod \"e2e-api-b-e50cdb-openshift-default-6c4c7d6cf6-fpf2d\" (UID: \"9afc43e8-1aeb-415c-a911-4b688f58ffc3\") " pod="openshift-ingress/e2e-api-b-e50cdb-openshift-default-6c4c7d6cf6-fpf2d"
Sep 15 14:13:41.730414 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:41.730313    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9afc43e8-1aeb-415c-a911-4b688f58ffc3-workload-socket\") pod \"e2e-api-b-e50cdb-openshift-default-6c4c7d6cf6-fpf2d\" (UID: \"9afc43e8-1aeb-415c-a911-4b688f58ffc3\") " pod="openshift-ingress/e2e-api-b-e50cdb-openshift-default-6c4c7d6cf6-fpf2d"
Sep 15 14:13:41.730414 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:41.730409    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9afc43e8-1aeb-415c-a911-4b688f58ffc3-istiod-ca-cert\") pod \"e2e-api-b-e50cdb-openshift-default-6c4c7d6cf6-fpf2d\" (UID: \"9afc43e8-1aeb-415c-a911-4b688f58ffc3\") " pod="openshift-ingress/e2e-api-b-e50cdb-openshift-default-6c4c7d6cf6-fpf2d"
Sep 15 14:13:41.732286 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:41.732265    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9afc43e8-1aeb-415c-a911-4b688f58ffc3-istio-envoy\") pod \"e2e-api-b-e50cdb-openshift-default-6c4c7d6cf6-fpf2d\" (UID: \"9afc43e8-1aeb-415c-a911-4b688f58ffc3\") " pod="openshift-ingress/e2e-api-b-e50cdb-openshift-default-6c4c7d6cf6-fpf2d"
Sep 15 14:13:41.732372 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:41.732300    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9afc43e8-1aeb-415c-a911-4b688f58ffc3-istio-podinfo\") pod \"e2e-api-b-e50cdb-openshift-default-6c4c7d6cf6-fpf2d\" (UID: \"9afc43e8-1aeb-415c-a911-4b688f58ffc3\") " pod="openshift-ingress/e2e-api-b-e50cdb-openshift-default-6c4c7d6cf6-fpf2d"
Sep 15 14:13:41.736966 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:41.736941    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9afc43e8-1aeb-415c-a911-4b688f58ffc3-istio-token\") pod \"e2e-api-b-e50cdb-openshift-default-6c4c7d6cf6-fpf2d\" (UID: \"9afc43e8-1aeb-415c-a911-4b688f58ffc3\") " pod="openshift-ingress/e2e-api-b-e50cdb-openshift-default-6c4c7d6cf6-fpf2d"
Sep 15 14:13:41.737069 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:41.737052    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7lsm\" (UniqueName: \"kubernetes.io/projected/9afc43e8-1aeb-415c-a911-4b688f58ffc3-kube-api-access-t7lsm\") pod \"e2e-api-b-e50cdb-openshift-default-6c4c7d6cf6-fpf2d\" (UID: \"9afc43e8-1aeb-415c-a911-4b688f58ffc3\") " pod="openshift-ingress/e2e-api-b-e50cdb-openshift-default-6c4c7d6cf6-fpf2d"
Sep 15 14:13:41.805886 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:41.805844    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-e50cdb-openshift-default-6c4c7d6cf6-fpf2d"
Sep 15 14:13:42.096839 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:42.096808    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-e50cdb-openshift-default-6c4c7d6cf6-fpf2d"]
Sep 15 14:13:42.098020 ip-10-0-128-41 kubenswrapper[2578]: W0915 14:13:42.097994    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9afc43e8_1aeb_415c_a911_4b688f58ffc3.slice/crio-cad15fea821de98d7265e881ba7a773a0cd30754daf0057a09e642248942551f WatchSource:0}: Error finding container cad15fea821de98d7265e881ba7a773a0cd30754daf0057a09e642248942551f: Status 404 returned error can't find the container with id cad15fea821de98d7265e881ba7a773a0cd30754daf0057a09e642248942551f
Sep 15 14:13:42.103497 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:42.103454    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 15 14:13:42.103607 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:42.103540    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 15 14:13:42.103607 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:42.103568    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 15 14:13:43.069529 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:43.069494    2578 generic.go:356] "Generic (PLEG): container finished" podID="a18a0de3-d5c6-4a37-93dc-8362087285b7" containerID="cdfba6ab1b2055d6b41521f3965f5a1dcb92e800d12511b25aac03e4215b62af" exitCode=0
Sep 15 14:13:43.070033 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:43.069569    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-746f54-openshift-default-8466df476d-s9rqw" event={"ID":"a18a0de3-d5c6-4a37-93dc-8362087285b7","Type":"ContainerDied","Data":"cdfba6ab1b2055d6b41521f3965f5a1dcb92e800d12511b25aac03e4215b62af"}
Sep 15 14:13:43.070095 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:43.070065    2578 scope.go:117] "RemoveContainer" containerID="cdfba6ab1b2055d6b41521f3965f5a1dcb92e800d12511b25aac03e4215b62af"
Sep 15 14:13:43.071484 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:43.071454    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 15 14:13:43.071600 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:43.071461    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-e50cdb-openshift-default-6c4c7d6cf6-fpf2d" event={"ID":"9afc43e8-1aeb-415c-a911-4b688f58ffc3","Type":"ContainerStarted","Data":"7a2849246d1734630724b71838a1885019a0bbdceb4d4b710b9fe1f0ebcb0d87"}
Sep 15 14:13:43.071600 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:43.071590    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-e50cdb-openshift-default-6c4c7d6cf6-fpf2d" event={"ID":"9afc43e8-1aeb-415c-a911-4b688f58ffc3","Type":"ContainerStarted","Data":"cad15fea821de98d7265e881ba7a773a0cd30754daf0057a09e642248942551f"}
Sep 15 14:13:43.071689 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:43.071547    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 15 14:13:43.071689 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:43.071676    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 15 14:13:43.120462 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:43.120416    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-e50cdb-openshift-default-6c4c7d6cf6-fpf2d" podStartSLOduration=2.120398933 podStartE2EDuration="2.120398933s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 14:13:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 14:13:43.11670125 +0000 UTC m=+2109.875827569" watchObservedRunningTime="2026-09-15 14:13:43.120398933 +0000 UTC m=+2109.879525218"
Sep 15 14:13:43.806371 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:43.806334    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-e50cdb-openshift-default-6c4c7d6cf6-fpf2d"
Sep 15 14:13:43.811891 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:43.811866    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-e50cdb-openshift-default-6c4c7d6cf6-fpf2d"
Sep 15 14:13:44.086328 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:44.086230    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-746f54-openshift-default-8466df476d-s9rqw" event={"ID":"a18a0de3-d5c6-4a37-93dc-8362087285b7","Type":"ContainerStarted","Data":"9a68e496898ccd846454cf8bb39ff2f880bf4b6e998a8f92a520bb9c3a80c07a"}
Sep 15 14:13:44.086816 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:44.086617    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-e50cdb-openshift-default-6c4c7d6cf6-fpf2d"
Sep 15 14:13:44.087558 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:44.087533    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-e50cdb-openshift-default-6c4c7d6cf6-fpf2d"
Sep 15 14:13:44.345167 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:44.345047    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-746f54-openshift-default-8466df476d-s9rqw"
Sep 15 14:13:44.345345 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:44.345323    2578 patch_prober.go:28] interesting pod/e2e-api-a-746f54-openshift-default-8466df476d-s9rqw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.107:15021/healthz/ready\": dial tcp 10.133.0.107:15021: connect: connection refused" start-of-body=
Sep 15 14:13:44.345403 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:44.345374    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-746f54-openshift-default-8466df476d-s9rqw" podUID="a18a0de3-d5c6-4a37-93dc-8362087285b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.107:15021/healthz/ready\": dial tcp 10.133.0.107:15021: connect: connection refused"
Sep 15 14:13:45.346043 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:45.346008    2578 patch_prober.go:28] interesting pod/e2e-api-a-746f54-openshift-default-8466df476d-s9rqw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.107:15021/healthz/ready\": dial tcp 10.133.0.107:15021: connect: connection refused" start-of-body=
Sep 15 14:13:45.346449 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:45.346089    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-746f54-openshift-default-8466df476d-s9rqw" podUID="a18a0de3-d5c6-4a37-93dc-8362087285b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.107:15021/healthz/ready\": dial tcp 10.133.0.107:15021: connect: connection refused"
Sep 15 14:13:46.345865 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:46.345823    2578 patch_prober.go:28] interesting pod/e2e-api-a-746f54-openshift-default-8466df476d-s9rqw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.107:15021/healthz/ready\": dial tcp 10.133.0.107:15021: connect: connection refused" start-of-body=
Sep 15 14:13:46.346073 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:46.345885    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-746f54-openshift-default-8466df476d-s9rqw" podUID="a18a0de3-d5c6-4a37-93dc-8362087285b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.107:15021/healthz/ready\": dial tcp 10.133.0.107:15021: connect: connection refused"
Sep 15 14:13:47.345961 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:47.345925    2578 patch_prober.go:28] interesting pod/e2e-api-a-746f54-openshift-default-8466df476d-s9rqw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.107:15021/healthz/ready\": dial tcp 10.133.0.107:15021: connect: connection refused" start-of-body=
Sep 15 14:13:47.346173 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:47.345978    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-746f54-openshift-default-8466df476d-s9rqw" podUID="a18a0de3-d5c6-4a37-93dc-8362087285b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.107:15021/healthz/ready\": dial tcp 10.133.0.107:15021: connect: connection refused"
Sep 15 14:13:48.345881 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:48.345836    2578 patch_prober.go:28] interesting pod/e2e-api-a-746f54-openshift-default-8466df476d-s9rqw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.107:15021/healthz/ready\": dial tcp 10.133.0.107:15021: connect: connection refused" start-of-body=
Sep 15 14:13:48.346074 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:48.345902    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-746f54-openshift-default-8466df476d-s9rqw" podUID="a18a0de3-d5c6-4a37-93dc-8362087285b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.107:15021/healthz/ready\": dial tcp 10.133.0.107:15021: connect: connection refused"
Sep 15 14:13:49.352365 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:49.352332    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-746f54-openshift-default-8466df476d-s9rqw"
Sep 15 14:13:49.352843 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:49.352744    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-746f54-openshift-default-8466df476d-s9rqw"
Sep 15 14:13:49.354119 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:49.354097    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-746f54-openshift-default-8466df476d-s9rqw"
Sep 15 14:13:49.883379 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:49.883345    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-e50cdb-6b58cb9994-25n6j"]
Sep 15 14:13:49.886178 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:49.886155    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-e50cdb-6b58cb9994-25n6j"
Sep 15 14:13:49.888417 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:49.888396    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-e50cdb\""
Sep 15 14:13:49.888520 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:49.888499    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-e50cdb-dockercfg-xss6t\""
Sep 15 14:13:49.902110 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:49.902088    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-e50cdb-6b58cb9994-25n6j"]
Sep 15 14:13:49.914241 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:49.914219    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vxjn\" (UniqueName: \"kubernetes.io/projected/a0c93185-7ba8-4938-ba68-51b1cd756d77-kube-api-access-6vxjn\") pod \"payload-pre-processing-e2e-api-b-e50cdb-6b58cb9994-25n6j\" (UID: \"a0c93185-7ba8-4938-ba68-51b1cd756d77\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-e50cdb-6b58cb9994-25n6j"
Sep 15 14:13:49.914337 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:49.914327    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a0c93185-7ba8-4938-ba68-51b1cd756d77-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-e50cdb-6b58cb9994-25n6j\" (UID: \"a0c93185-7ba8-4938-ba68-51b1cd756d77\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-e50cdb-6b58cb9994-25n6j"
Sep 15 14:13:50.015571 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:50.015477    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a0c93185-7ba8-4938-ba68-51b1cd756d77-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-e50cdb-6b58cb9994-25n6j\" (UID: \"a0c93185-7ba8-4938-ba68-51b1cd756d77\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-e50cdb-6b58cb9994-25n6j"
Sep 15 14:13:50.015571 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:50.015551    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vxjn\" (UniqueName: \"kubernetes.io/projected/a0c93185-7ba8-4938-ba68-51b1cd756d77-kube-api-access-6vxjn\") pod \"payload-pre-processing-e2e-api-b-e50cdb-6b58cb9994-25n6j\" (UID: \"a0c93185-7ba8-4938-ba68-51b1cd756d77\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-e50cdb-6b58cb9994-25n6j"
Sep 15 14:13:50.016467 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:50.016429    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a0c93185-7ba8-4938-ba68-51b1cd756d77-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-e50cdb-6b58cb9994-25n6j\" (UID: \"a0c93185-7ba8-4938-ba68-51b1cd756d77\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-e50cdb-6b58cb9994-25n6j"
Sep 15 14:13:50.024517 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:50.024494    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vxjn\" (UniqueName: \"kubernetes.io/projected/a0c93185-7ba8-4938-ba68-51b1cd756d77-kube-api-access-6vxjn\") pod \"payload-pre-processing-e2e-api-b-e50cdb-6b58cb9994-25n6j\" (UID: \"a0c93185-7ba8-4938-ba68-51b1cd756d77\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-e50cdb-6b58cb9994-25n6j"
Sep 15 14:13:50.197046 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:50.196960    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-e50cdb-6b58cb9994-25n6j"
Sep 15 14:13:50.474714 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:50.474688    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-e50cdb-6b58cb9994-25n6j"]
Sep 15 14:13:50.476810 ip-10-0-128-41 kubenswrapper[2578]: W0915 14:13:50.476778    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0c93185_7ba8_4938_ba68_51b1cd756d77.slice/crio-250675a58c0492c691173482773475f0ed8a8e9b5d507a716a95d56ab5d7f6ad WatchSource:0}: Error finding container 250675a58c0492c691173482773475f0ed8a8e9b5d507a716a95d56ab5d7f6ad: Status 404 returned error can't find the container with id 250675a58c0492c691173482773475f0ed8a8e9b5d507a716a95d56ab5d7f6ad
Sep 15 14:13:51.128800 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:51.128763    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-e50cdb-6b58cb9994-25n6j" event={"ID":"a0c93185-7ba8-4938-ba68-51b1cd756d77","Type":"ContainerStarted","Data":"7f3b814f116fb8dd613b0287347d7a633e69b234a34cef3271f68b97ffa5b9e2"}
Sep 15 14:13:51.129238 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:51.128819    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-e50cdb-6b58cb9994-25n6j" event={"ID":"a0c93185-7ba8-4938-ba68-51b1cd756d77","Type":"ContainerStarted","Data":"250675a58c0492c691173482773475f0ed8a8e9b5d507a716a95d56ab5d7f6ad"}
Sep 15 14:13:51.129238 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:51.128852    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-e50cdb-6b58cb9994-25n6j"
Sep 15 14:13:51.146389 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:13:51.146337    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-e50cdb-6b58cb9994-25n6j" podStartSLOduration=2.146318517 podStartE2EDuration="2.146318517s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 14:13:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 14:13:51.145708489 +0000 UTC m=+2117.904834786" watchObservedRunningTime="2026-09-15 14:13:51.146318517 +0000 UTC m=+2117.905444804"
Sep 15 14:14:02.137325 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:02.137291    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-e50cdb-6b58cb9994-25n6j"
Sep 15 14:14:07.241995 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:07.241904    2578 generic.go:356] "Generic (PLEG): container finished" podID="9afc43e8-1aeb-415c-a911-4b688f58ffc3" containerID="7a2849246d1734630724b71838a1885019a0bbdceb4d4b710b9fe1f0ebcb0d87" exitCode=0
Sep 15 14:14:07.241995 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:07.241977    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-e50cdb-openshift-default-6c4c7d6cf6-fpf2d" event={"ID":"9afc43e8-1aeb-415c-a911-4b688f58ffc3","Type":"ContainerDied","Data":"7a2849246d1734630724b71838a1885019a0bbdceb4d4b710b9fe1f0ebcb0d87"}
Sep 15 14:14:07.242459 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:07.242420    2578 scope.go:117] "RemoveContainer" containerID="7a2849246d1734630724b71838a1885019a0bbdceb4d4b710b9fe1f0ebcb0d87"
Sep 15 14:14:07.243552 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:07.243526    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 15 14:14:07.243621 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:07.243587    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 15 14:14:07.243621 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:07.243615    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 15 14:14:08.250158 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:08.250108    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-e50cdb-openshift-default-6c4c7d6cf6-fpf2d" event={"ID":"9afc43e8-1aeb-415c-a911-4b688f58ffc3","Type":"ContainerStarted","Data":"45599cf2e1bbd43703a4be571cd4e056dd755d91fc06124a929f14daa1675baa"}
Sep 15 14:14:08.806970 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:08.806932    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-e50cdb-openshift-default-6c4c7d6cf6-fpf2d"
Sep 15 14:14:08.807207 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:08.807171    2578 patch_prober.go:28] interesting pod/e2e-api-b-e50cdb-openshift-default-6c4c7d6cf6-fpf2d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.110:15021/healthz/ready\": dial tcp 10.133.0.110:15021: connect: connection refused" start-of-body=
Sep 15 14:14:08.807270 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:08.807236    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-e50cdb-openshift-default-6c4c7d6cf6-fpf2d" podUID="9afc43e8-1aeb-415c-a911-4b688f58ffc3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.110:15021/healthz/ready\": dial tcp 10.133.0.110:15021: connect: connection refused"
Sep 15 14:14:09.806617 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:09.806578    2578 patch_prober.go:28] interesting pod/e2e-api-b-e50cdb-openshift-default-6c4c7d6cf6-fpf2d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.110:15021/healthz/ready\": dial tcp 10.133.0.110:15021: connect: connection refused" start-of-body=
Sep 15 14:14:09.807015 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:09.806639    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-e50cdb-openshift-default-6c4c7d6cf6-fpf2d" podUID="9afc43e8-1aeb-415c-a911-4b688f58ffc3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.110:15021/healthz/ready\": dial tcp 10.133.0.110:15021: connect: connection refused"
Sep 15 14:14:10.807229 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:10.807192    2578 patch_prober.go:28] interesting pod/e2e-api-b-e50cdb-openshift-default-6c4c7d6cf6-fpf2d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.110:15021/healthz/ready\": dial tcp 10.133.0.110:15021: connect: connection refused" start-of-body=
Sep 15 14:14:10.807628 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:10.807245    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-e50cdb-openshift-default-6c4c7d6cf6-fpf2d" podUID="9afc43e8-1aeb-415c-a911-4b688f58ffc3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.110:15021/healthz/ready\": dial tcp 10.133.0.110:15021: connect: connection refused"
Sep 15 14:14:11.807253 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:11.807213    2578 patch_prober.go:28] interesting pod/e2e-api-b-e50cdb-openshift-default-6c4c7d6cf6-fpf2d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.110:15021/healthz/ready\": dial tcp 10.133.0.110:15021: connect: connection refused" start-of-body=
Sep 15 14:14:11.807654 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:11.807294    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-e50cdb-openshift-default-6c4c7d6cf6-fpf2d" podUID="9afc43e8-1aeb-415c-a911-4b688f58ffc3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.110:15021/healthz/ready\": dial tcp 10.133.0.110:15021: connect: connection refused"
Sep 15 14:14:12.806822 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:12.806780    2578 patch_prober.go:28] interesting pod/e2e-api-b-e50cdb-openshift-default-6c4c7d6cf6-fpf2d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.110:15021/healthz/ready\": dial tcp 10.133.0.110:15021: connect: connection refused" start-of-body=
Sep 15 14:14:12.807006 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:12.806854    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-e50cdb-openshift-default-6c4c7d6cf6-fpf2d" podUID="9afc43e8-1aeb-415c-a911-4b688f58ffc3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.110:15021/healthz/ready\": dial tcp 10.133.0.110:15021: connect: connection refused"
Sep 15 14:14:13.811143 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:13.811104    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-e50cdb-openshift-default-6c4c7d6cf6-fpf2d"
Sep 15 14:14:13.811552 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:13.811532    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-e50cdb-openshift-default-6c4c7d6cf6-fpf2d"
Sep 15 14:14:13.812212 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:13.812193    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-e50cdb-openshift-default-6c4c7d6cf6-fpf2d"
Sep 15 14:14:17.962408 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:17.962371    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-746f54-vq5kd"]
Sep 15 14:14:17.965451 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:17.965418    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-746f54-vq5kd"
Sep 15 14:14:17.967572 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:17.967554    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qzmkv\""
Sep 15 14:14:17.968226 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:17.968209    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 15 14:14:17.968319 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:17.968239    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 14:14:17.974024 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:17.974002    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-746f54-vq5kd"]
Sep 15 14:14:18.093570 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:18.093536    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/20211472-8e29-4908-bbcc-eada6205d3fa-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-746f54-vq5kd\" (UID: \"20211472-8e29-4908-bbcc-eada6205d3fa\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-746f54-vq5kd"
Sep 15 14:14:18.093570 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:18.093573    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znrlm\" (UniqueName: \"kubernetes.io/projected/20211472-8e29-4908-bbcc-eada6205d3fa-kube-api-access-znrlm\") pod \"maas-api-revoke-keys-e2e-api-a-746f54-vq5kd\" (UID: \"20211472-8e29-4908-bbcc-eada6205d3fa\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-746f54-vq5kd"
Sep 15 14:14:18.194642 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:18.194599    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/20211472-8e29-4908-bbcc-eada6205d3fa-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-746f54-vq5kd\" (UID: \"20211472-8e29-4908-bbcc-eada6205d3fa\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-746f54-vq5kd"
Sep 15 14:14:18.194642 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:18.194647    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znrlm\" (UniqueName: \"kubernetes.io/projected/20211472-8e29-4908-bbcc-eada6205d3fa-kube-api-access-znrlm\") pod \"maas-api-revoke-keys-e2e-api-a-746f54-vq5kd\" (UID: \"20211472-8e29-4908-bbcc-eada6205d3fa\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-746f54-vq5kd"
Sep 15 14:14:18.195293 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:18.195272    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/20211472-8e29-4908-bbcc-eada6205d3fa-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-746f54-vq5kd\" (UID: \"20211472-8e29-4908-bbcc-eada6205d3fa\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-746f54-vq5kd"
Sep 15 14:14:18.203578 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:18.203553    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-znrlm\" (UniqueName: \"kubernetes.io/projected/20211472-8e29-4908-bbcc-eada6205d3fa-kube-api-access-znrlm\") pod \"maas-api-revoke-keys-e2e-api-a-746f54-vq5kd\" (UID: \"20211472-8e29-4908-bbcc-eada6205d3fa\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-746f54-vq5kd"
Sep 15 14:14:18.277736 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:18.277707    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-746f54-vq5kd"
Sep 15 14:14:18.552865 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:18.552838    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-746f54-vq5kd"]
Sep 15 14:14:18.553884 ip-10-0-128-41 kubenswrapper[2578]: W0915 14:14:18.553855    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20211472_8e29_4908_bbcc_eada6205d3fa.slice/crio-23895679ea5450d0952d04fa532d1d68b3dc54e49c5043ddd138c66540f7099b WatchSource:0}: Error finding container 23895679ea5450d0952d04fa532d1d68b3dc54e49c5043ddd138c66540f7099b: Status 404 returned error can't find the container with id 23895679ea5450d0952d04fa532d1d68b3dc54e49c5043ddd138c66540f7099b
Sep 15 14:14:19.332104 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:19.332074    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-746f54-vq5kd" event={"ID":"20211472-8e29-4908-bbcc-eada6205d3fa","Type":"ContainerStarted","Data":"6b68040f9a522a899471f97f7ae5a3b8515a78fd8ded9ec60d6a54e39e36911f"}
Sep 15 14:14:19.332524 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:19.332120    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-746f54-vq5kd" event={"ID":"20211472-8e29-4908-bbcc-eada6205d3fa","Type":"ContainerStarted","Data":"23895679ea5450d0952d04fa532d1d68b3dc54e49c5043ddd138c66540f7099b"}
Sep 15 14:14:19.351317 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:19.351267    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-746f54-vq5kd" podStartSLOduration=2.351252795 podStartE2EDuration="2.351252795s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 14:14:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 14:14:19.347684782 +0000 UTC m=+2146.106811070" watchObservedRunningTime="2026-09-15 14:14:19.351252795 +0000 UTC m=+2146.110379112"
Sep 15 14:14:20.339455 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:20.339423    2578 generic.go:356] "Generic (PLEG): container finished" podID="20211472-8e29-4908-bbcc-eada6205d3fa" containerID="6b68040f9a522a899471f97f7ae5a3b8515a78fd8ded9ec60d6a54e39e36911f" exitCode=0
Sep 15 14:14:20.339839 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:20.339502    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-746f54-vq5kd" event={"ID":"20211472-8e29-4908-bbcc-eada6205d3fa","Type":"ContainerDied","Data":"6b68040f9a522a899471f97f7ae5a3b8515a78fd8ded9ec60d6a54e39e36911f"}
Sep 15 14:14:21.476508 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:21.476485    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-746f54-vq5kd"
Sep 15 14:14:21.630949 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:21.630863    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/20211472-8e29-4908-bbcc-eada6205d3fa-maas-api-service-ca\") pod \"20211472-8e29-4908-bbcc-eada6205d3fa\" (UID: \"20211472-8e29-4908-bbcc-eada6205d3fa\") "
Sep 15 14:14:21.630949 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:21.630937    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-znrlm\" (UniqueName: \"kubernetes.io/projected/20211472-8e29-4908-bbcc-eada6205d3fa-kube-api-access-znrlm\") pod \"20211472-8e29-4908-bbcc-eada6205d3fa\" (UID: \"20211472-8e29-4908-bbcc-eada6205d3fa\") "
Sep 15 14:14:21.631299 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:21.631280    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/20211472-8e29-4908-bbcc-eada6205d3fa-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "20211472-8e29-4908-bbcc-eada6205d3fa" (UID: "20211472-8e29-4908-bbcc-eada6205d3fa"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 14:14:21.633176 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:21.633143    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20211472-8e29-4908-bbcc-eada6205d3fa-kube-api-access-znrlm" (OuterVolumeSpecName: "kube-api-access-znrlm") pod "20211472-8e29-4908-bbcc-eada6205d3fa" (UID: "20211472-8e29-4908-bbcc-eada6205d3fa"). InnerVolumeSpecName "kube-api-access-znrlm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 14:14:21.732148 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:21.732089    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/20211472-8e29-4908-bbcc-eada6205d3fa-maas-api-service-ca\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:14:21.732148 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:21.732118    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-znrlm\" (UniqueName: \"kubernetes.io/projected/20211472-8e29-4908-bbcc-eada6205d3fa-kube-api-access-znrlm\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:14:22.352352 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:22.352320    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-746f54-vq5kd"
Sep 15 14:14:22.352563 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:22.352358    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-746f54-vq5kd" event={"ID":"20211472-8e29-4908-bbcc-eada6205d3fa","Type":"ContainerDied","Data":"23895679ea5450d0952d04fa532d1d68b3dc54e49c5043ddd138c66540f7099b"}
Sep 15 14:14:22.352563 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:22.352439    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="23895679ea5450d0952d04fa532d1d68b3dc54e49c5043ddd138c66540f7099b"
Sep 15 14:14:33.577828 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:33.577727    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-746f54-78b844b659-gfl6b"]
Sep 15 14:14:33.578309 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:33.578023    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-746f54-78b844b659-gfl6b" podUID="76943adf-43f8-4eba-8746-f977c9cacf6e" containerName="payload-processing" containerID="cri-o://00bebd896b38c0003e50b36a5d64cbeacf273e2b15878ff7111d27cc3154891f" gracePeriod=30
Sep 15 14:14:33.584605 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:33.584574    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-746f54-f9b7c67f4-dx28h"]
Sep 15 14:14:33.584880 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:33.584805    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-746f54-f9b7c67f4-dx28h" podUID="b8e58998-d4f4-46a1-9bfe-af94a5071a8d" containerName="payload-pre-processing" containerID="cri-o://3b770f5f471a4d009dc1ec1321003b11315e1f993adafa3218d5eaac1c231e8e" gracePeriod=30
Sep 15 14:14:33.801284 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:33.801201    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-746f54-vq5kd"]
Sep 15 14:14:33.804873 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:33.804843    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-746f54-vq5kd"]
Sep 15 14:14:33.857618 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:33.857592    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-746f54-78b844b659-gfl6b"
Sep 15 14:14:33.882970 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:33.882944    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-746f54-f9b7c67f4-dx28h"
Sep 15 14:14:33.949654 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:33.949606    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2mqc7\" (UniqueName: \"kubernetes.io/projected/76943adf-43f8-4eba-8746-f977c9cacf6e-kube-api-access-2mqc7\") pod \"76943adf-43f8-4eba-8746-f977c9cacf6e\" (UID: \"76943adf-43f8-4eba-8746-f977c9cacf6e\") "
Sep 15 14:14:33.949854 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:33.949723    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b8e58998-d4f4-46a1-9bfe-af94a5071a8d-plugins-config-volume\") pod \"b8e58998-d4f4-46a1-9bfe-af94a5071a8d\" (UID: \"b8e58998-d4f4-46a1-9bfe-af94a5071a8d\") "
Sep 15 14:14:33.949854 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:33.949755    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tcs77\" (UniqueName: \"kubernetes.io/projected/b8e58998-d4f4-46a1-9bfe-af94a5071a8d-kube-api-access-tcs77\") pod \"b8e58998-d4f4-46a1-9bfe-af94a5071a8d\" (UID: \"b8e58998-d4f4-46a1-9bfe-af94a5071a8d\") "
Sep 15 14:14:33.949994 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:33.949854    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/76943adf-43f8-4eba-8746-f977c9cacf6e-plugins-config-volume\") pod \"76943adf-43f8-4eba-8746-f977c9cacf6e\" (UID: \"76943adf-43f8-4eba-8746-f977c9cacf6e\") "
Sep 15 14:14:33.950583 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:33.950210    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b8e58998-d4f4-46a1-9bfe-af94a5071a8d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b8e58998-d4f4-46a1-9bfe-af94a5071a8d" (UID: "b8e58998-d4f4-46a1-9bfe-af94a5071a8d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 14:14:33.950583 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:33.950543    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/76943adf-43f8-4eba-8746-f977c9cacf6e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "76943adf-43f8-4eba-8746-f977c9cacf6e" (UID: "76943adf-43f8-4eba-8746-f977c9cacf6e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 14:14:33.952606 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:33.952579    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76943adf-43f8-4eba-8746-f977c9cacf6e-kube-api-access-2mqc7" (OuterVolumeSpecName: "kube-api-access-2mqc7") pod "76943adf-43f8-4eba-8746-f977c9cacf6e" (UID: "76943adf-43f8-4eba-8746-f977c9cacf6e"). InnerVolumeSpecName "kube-api-access-2mqc7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 14:14:33.952713 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:33.952671    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8e58998-d4f4-46a1-9bfe-af94a5071a8d-kube-api-access-tcs77" (OuterVolumeSpecName: "kube-api-access-tcs77") pod "b8e58998-d4f4-46a1-9bfe-af94a5071a8d" (UID: "b8e58998-d4f4-46a1-9bfe-af94a5071a8d"). InnerVolumeSpecName "kube-api-access-tcs77". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 14:14:34.051488 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:34.051453    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b8e58998-d4f4-46a1-9bfe-af94a5071a8d-plugins-config-volume\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:14:34.051488 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:34.051482    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tcs77\" (UniqueName: \"kubernetes.io/projected/b8e58998-d4f4-46a1-9bfe-af94a5071a8d-kube-api-access-tcs77\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:14:34.051488 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:34.051491    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/76943adf-43f8-4eba-8746-f977c9cacf6e-plugins-config-volume\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:14:34.051724 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:34.051500    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2mqc7\" (UniqueName: \"kubernetes.io/projected/76943adf-43f8-4eba-8746-f977c9cacf6e-kube-api-access-2mqc7\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:14:34.304321 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:34.304285    2578 scope.go:117] "RemoveContainer" containerID="57b8935d09d025f486efae5cce5eb27e1de3886c3c4d20d88b1624514f589504"
Sep 15 14:14:34.427312 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:34.427275    2578 generic.go:356] "Generic (PLEG): container finished" podID="b8e58998-d4f4-46a1-9bfe-af94a5071a8d" containerID="3b770f5f471a4d009dc1ec1321003b11315e1f993adafa3218d5eaac1c231e8e" exitCode=0
Sep 15 14:14:34.427545 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:34.427345    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-746f54-f9b7c67f4-dx28h"
Sep 15 14:14:34.427545 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:34.427358    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-746f54-f9b7c67f4-dx28h" event={"ID":"b8e58998-d4f4-46a1-9bfe-af94a5071a8d","Type":"ContainerDied","Data":"3b770f5f471a4d009dc1ec1321003b11315e1f993adafa3218d5eaac1c231e8e"}
Sep 15 14:14:34.427545 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:34.427415    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-746f54-f9b7c67f4-dx28h" event={"ID":"b8e58998-d4f4-46a1-9bfe-af94a5071a8d","Type":"ContainerDied","Data":"0a712cd16d4cd1071c6555a165558c495d22eaf53cc6e59d24d81bdca9825218"}
Sep 15 14:14:34.427545 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:34.427484    2578 scope.go:117] "RemoveContainer" containerID="3b770f5f471a4d009dc1ec1321003b11315e1f993adafa3218d5eaac1c231e8e"
Sep 15 14:14:34.429173 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:34.429097    2578 generic.go:356] "Generic (PLEG): container finished" podID="76943adf-43f8-4eba-8746-f977c9cacf6e" containerID="00bebd896b38c0003e50b36a5d64cbeacf273e2b15878ff7111d27cc3154891f" exitCode=0
Sep 15 14:14:34.429173 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:34.429163    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-746f54-78b844b659-gfl6b"
Sep 15 14:14:34.429173 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:34.429163    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-746f54-78b844b659-gfl6b" event={"ID":"76943adf-43f8-4eba-8746-f977c9cacf6e","Type":"ContainerDied","Data":"00bebd896b38c0003e50b36a5d64cbeacf273e2b15878ff7111d27cc3154891f"}
Sep 15 14:14:34.429173 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:34.429206    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-746f54-78b844b659-gfl6b" event={"ID":"76943adf-43f8-4eba-8746-f977c9cacf6e","Type":"ContainerDied","Data":"4d4accb1e10000bb9ccd08d715a3cf1ff0093d41cb7d557aed388e4adc095f19"}
Sep 15 14:14:34.438682 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:34.438663    2578 scope.go:117] "RemoveContainer" containerID="3b770f5f471a4d009dc1ec1321003b11315e1f993adafa3218d5eaac1c231e8e"
Sep 15 14:14:34.439000 ip-10-0-128-41 kubenswrapper[2578]: E0915 14:14:34.438969    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b770f5f471a4d009dc1ec1321003b11315e1f993adafa3218d5eaac1c231e8e\": container with ID starting with 3b770f5f471a4d009dc1ec1321003b11315e1f993adafa3218d5eaac1c231e8e not found: ID does not exist" containerID="3b770f5f471a4d009dc1ec1321003b11315e1f993adafa3218d5eaac1c231e8e"
Sep 15 14:14:34.439104 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:34.439006    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b770f5f471a4d009dc1ec1321003b11315e1f993adafa3218d5eaac1c231e8e"} err="failed to get container status \"3b770f5f471a4d009dc1ec1321003b11315e1f993adafa3218d5eaac1c231e8e\": rpc error: code = NotFound desc = could not find container \"3b770f5f471a4d009dc1ec1321003b11315e1f993adafa3218d5eaac1c231e8e\": container with ID starting with 3b770f5f471a4d009dc1ec1321003b11315e1f993adafa3218d5eaac1c231e8e not found: ID does not exist"
Sep 15 14:14:34.439104 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:34.439024    2578 scope.go:117] "RemoveContainer" containerID="00bebd896b38c0003e50b36a5d64cbeacf273e2b15878ff7111d27cc3154891f"
Sep 15 14:14:34.447467 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:34.447454    2578 scope.go:117] "RemoveContainer" containerID="00bebd896b38c0003e50b36a5d64cbeacf273e2b15878ff7111d27cc3154891f"
Sep 15 14:14:34.447731 ip-10-0-128-41 kubenswrapper[2578]: E0915 14:14:34.447711    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00bebd896b38c0003e50b36a5d64cbeacf273e2b15878ff7111d27cc3154891f\": container with ID starting with 00bebd896b38c0003e50b36a5d64cbeacf273e2b15878ff7111d27cc3154891f not found: ID does not exist" containerID="00bebd896b38c0003e50b36a5d64cbeacf273e2b15878ff7111d27cc3154891f"
Sep 15 14:14:34.447783 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:34.447739    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00bebd896b38c0003e50b36a5d64cbeacf273e2b15878ff7111d27cc3154891f"} err="failed to get container status \"00bebd896b38c0003e50b36a5d64cbeacf273e2b15878ff7111d27cc3154891f\": rpc error: code = NotFound desc = could not find container \"00bebd896b38c0003e50b36a5d64cbeacf273e2b15878ff7111d27cc3154891f\": container with ID starting with 00bebd896b38c0003e50b36a5d64cbeacf273e2b15878ff7111d27cc3154891f not found: ID does not exist"
Sep 15 14:14:34.454044 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:34.454017    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-746f54-f9b7c67f4-dx28h"]
Sep 15 14:14:34.456932 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:34.456908    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-746f54-f9b7c67f4-dx28h"]
Sep 15 14:14:34.469931 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:34.469910    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-746f54-78b844b659-gfl6b"]
Sep 15 14:14:34.473009 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:34.472988    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-746f54-78b844b659-gfl6b"]
Sep 15 14:14:35.758371 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:35.758340    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="20211472-8e29-4908-bbcc-eada6205d3fa" path="/var/lib/kubelet/pods/20211472-8e29-4908-bbcc-eada6205d3fa/volumes"
Sep 15 14:14:35.758816 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:35.758735    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="76943adf-43f8-4eba-8746-f977c9cacf6e" path="/var/lib/kubelet/pods/76943adf-43f8-4eba-8746-f977c9cacf6e/volumes"
Sep 15 14:14:35.759051 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:35.759038    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b8e58998-d4f4-46a1-9bfe-af94a5071a8d" path="/var/lib/kubelet/pods/b8e58998-d4f4-46a1-9bfe-af94a5071a8d/volumes"
Sep 15 14:14:40.673876 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:40.673838    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-746f54-openshift-default-8466df476d-s9rqw"]
Sep 15 14:14:40.674389 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:40.674090    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-746f54-openshift-default-8466df476d-s9rqw" podUID="a18a0de3-d5c6-4a37-93dc-8362087285b7" containerName="istio-proxy" containerID="cri-o://9a68e496898ccd846454cf8bb39ff2f880bf4b6e998a8f92a520bb9c3a80c07a" gracePeriod=30
Sep 15 14:14:41.024788 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:41.024708    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e50cdb-rnv7w"]
Sep 15 14:14:41.025201 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:41.025186    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20211472-8e29-4908-bbcc-eada6205d3fa" containerName="revoke-keys"
Sep 15 14:14:41.025252 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:41.025203    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="20211472-8e29-4908-bbcc-eada6205d3fa" containerName="revoke-keys"
Sep 15 14:14:41.025252 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:41.025211    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8e58998-d4f4-46a1-9bfe-af94a5071a8d" containerName="payload-pre-processing"
Sep 15 14:14:41.025252 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:41.025217    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8e58998-d4f4-46a1-9bfe-af94a5071a8d" containerName="payload-pre-processing"
Sep 15 14:14:41.025252 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:41.025227    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76943adf-43f8-4eba-8746-f977c9cacf6e" containerName="payload-processing"
Sep 15 14:14:41.025252 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:41.025233    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="76943adf-43f8-4eba-8746-f977c9cacf6e" containerName="payload-processing"
Sep 15 14:14:41.025416 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:41.025304    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="76943adf-43f8-4eba-8746-f977c9cacf6e" containerName="payload-processing"
Sep 15 14:14:41.025416 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:41.025315    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8e58998-d4f4-46a1-9bfe-af94a5071a8d" containerName="payload-pre-processing"
Sep 15 14:14:41.025416 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:41.025321    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="20211472-8e29-4908-bbcc-eada6205d3fa" containerName="revoke-keys"
Sep 15 14:14:41.027749 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:41.027732    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e50cdb-rnv7w"
Sep 15 14:14:41.030166 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:41.030112    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 15 14:14:41.030302 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:41.030214    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 14:14:41.030302 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:41.030223    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qzmkv\""
Sep 15 14:14:41.037590 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:41.037565    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e50cdb-rnv7w"]
Sep 15 14:14:41.116060 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:41.116024    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/497240eb-59bd-4a88-91d3-3b5688ba2d6a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-e50cdb-rnv7w\" (UID: \"497240eb-59bd-4a88-91d3-3b5688ba2d6a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e50cdb-rnv7w"
Sep 15 14:14:41.116060 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:41.116064    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6qlw\" (UniqueName: \"kubernetes.io/projected/497240eb-59bd-4a88-91d3-3b5688ba2d6a-kube-api-access-k6qlw\") pod \"maas-api-revoke-keys-e2e-api-b-e50cdb-rnv7w\" (UID: \"497240eb-59bd-4a88-91d3-3b5688ba2d6a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e50cdb-rnv7w"
Sep 15 14:14:41.216707 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:41.216668    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/497240eb-59bd-4a88-91d3-3b5688ba2d6a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-e50cdb-rnv7w\" (UID: \"497240eb-59bd-4a88-91d3-3b5688ba2d6a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e50cdb-rnv7w"
Sep 15 14:14:41.216892 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:41.216714    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6qlw\" (UniqueName: \"kubernetes.io/projected/497240eb-59bd-4a88-91d3-3b5688ba2d6a-kube-api-access-k6qlw\") pod \"maas-api-revoke-keys-e2e-api-b-e50cdb-rnv7w\" (UID: \"497240eb-59bd-4a88-91d3-3b5688ba2d6a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e50cdb-rnv7w"
Sep 15 14:14:41.217366 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:41.217346    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/497240eb-59bd-4a88-91d3-3b5688ba2d6a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-e50cdb-rnv7w\" (UID: \"497240eb-59bd-4a88-91d3-3b5688ba2d6a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e50cdb-rnv7w"
Sep 15 14:14:41.225246 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:41.225226    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6qlw\" (UniqueName: \"kubernetes.io/projected/497240eb-59bd-4a88-91d3-3b5688ba2d6a-kube-api-access-k6qlw\") pod \"maas-api-revoke-keys-e2e-api-b-e50cdb-rnv7w\" (UID: \"497240eb-59bd-4a88-91d3-3b5688ba2d6a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e50cdb-rnv7w"
Sep 15 14:14:41.340410 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:41.340332    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e50cdb-rnv7w"
Sep 15 14:14:41.627053 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:41.627025    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e50cdb-rnv7w"]
Sep 15 14:14:41.629227 ip-10-0-128-41 kubenswrapper[2578]: W0915 14:14:41.629190    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod497240eb_59bd_4a88_91d3_3b5688ba2d6a.slice/crio-3cd4d3de4d9aca5589c1644f86d99962fd627b473d6fca00de109abf4460d35d WatchSource:0}: Error finding container 3cd4d3de4d9aca5589c1644f86d99962fd627b473d6fca00de109abf4460d35d: Status 404 returned error can't find the container with id 3cd4d3de4d9aca5589c1644f86d99962fd627b473d6fca00de109abf4460d35d
Sep 15 14:14:42.488725 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:42.488698    2578 generic.go:356] "Generic (PLEG): container finished" podID="497240eb-59bd-4a88-91d3-3b5688ba2d6a" containerID="1ab9e6b4103b2224820c04edce692362a74a6e498eaed7aeb06ab45674adcbe7" exitCode=0
Sep 15 14:14:42.489073 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:42.488791    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e50cdb-rnv7w" event={"ID":"497240eb-59bd-4a88-91d3-3b5688ba2d6a","Type":"ContainerDied","Data":"1ab9e6b4103b2224820c04edce692362a74a6e498eaed7aeb06ab45674adcbe7"}
Sep 15 14:14:42.489073 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:42.488846    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e50cdb-rnv7w" event={"ID":"497240eb-59bd-4a88-91d3-3b5688ba2d6a","Type":"ContainerStarted","Data":"3cd4d3de4d9aca5589c1644f86d99962fd627b473d6fca00de109abf4460d35d"}
Sep 15 14:14:43.634275 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:43.634252    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e50cdb-rnv7w"
Sep 15 14:14:43.742951 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:43.742920    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/497240eb-59bd-4a88-91d3-3b5688ba2d6a-maas-api-service-ca\") pod \"497240eb-59bd-4a88-91d3-3b5688ba2d6a\" (UID: \"497240eb-59bd-4a88-91d3-3b5688ba2d6a\") "
Sep 15 14:14:43.742951 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:43.742965    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k6qlw\" (UniqueName: \"kubernetes.io/projected/497240eb-59bd-4a88-91d3-3b5688ba2d6a-kube-api-access-k6qlw\") pod \"497240eb-59bd-4a88-91d3-3b5688ba2d6a\" (UID: \"497240eb-59bd-4a88-91d3-3b5688ba2d6a\") "
Sep 15 14:14:43.743328 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:43.743304    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/497240eb-59bd-4a88-91d3-3b5688ba2d6a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "497240eb-59bd-4a88-91d3-3b5688ba2d6a" (UID: "497240eb-59bd-4a88-91d3-3b5688ba2d6a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 14:14:43.743397 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:43.743385    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/497240eb-59bd-4a88-91d3-3b5688ba2d6a-maas-api-service-ca\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:14:43.745264 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:43.745221    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/497240eb-59bd-4a88-91d3-3b5688ba2d6a-kube-api-access-k6qlw" (OuterVolumeSpecName: "kube-api-access-k6qlw") pod "497240eb-59bd-4a88-91d3-3b5688ba2d6a" (UID: "497240eb-59bd-4a88-91d3-3b5688ba2d6a"). InnerVolumeSpecName "kube-api-access-k6qlw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 14:14:43.844229 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:43.844196    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k6qlw\" (UniqueName: \"kubernetes.io/projected/497240eb-59bd-4a88-91d3-3b5688ba2d6a-kube-api-access-k6qlw\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:14:44.502359 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:44.502328    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e50cdb-rnv7w"
Sep 15 14:14:44.502359 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:44.502349    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e50cdb-rnv7w" event={"ID":"497240eb-59bd-4a88-91d3-3b5688ba2d6a","Type":"ContainerDied","Data":"3cd4d3de4d9aca5589c1644f86d99962fd627b473d6fca00de109abf4460d35d"}
Sep 15 14:14:44.502588 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:44.502396    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3cd4d3de4d9aca5589c1644f86d99962fd627b473d6fca00de109abf4460d35d"
Sep 15 14:14:45.925408 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:45.925386    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-746f54-openshift-default-8466df476d-s9rqw"
Sep 15 14:14:46.066270 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:46.066235    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a18a0de3-d5c6-4a37-93dc-8362087285b7-istio-data\") pod \"a18a0de3-d5c6-4a37-93dc-8362087285b7\" (UID: \"a18a0de3-d5c6-4a37-93dc-8362087285b7\") "
Sep 15 14:14:46.066270 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:46.066270    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a18a0de3-d5c6-4a37-93dc-8362087285b7-istio-token\") pod \"a18a0de3-d5c6-4a37-93dc-8362087285b7\" (UID: \"a18a0de3-d5c6-4a37-93dc-8362087285b7\") "
Sep 15 14:14:46.066524 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:46.066291    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a18a0de3-d5c6-4a37-93dc-8362087285b7-istio-podinfo\") pod \"a18a0de3-d5c6-4a37-93dc-8362087285b7\" (UID: \"a18a0de3-d5c6-4a37-93dc-8362087285b7\") "
Sep 15 14:14:46.066524 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:46.066332    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a18a0de3-d5c6-4a37-93dc-8362087285b7-istio-envoy\") pod \"a18a0de3-d5c6-4a37-93dc-8362087285b7\" (UID: \"a18a0de3-d5c6-4a37-93dc-8362087285b7\") "
Sep 15 14:14:46.066524 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:46.066447    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-75pvj\" (UniqueName: \"kubernetes.io/projected/a18a0de3-d5c6-4a37-93dc-8362087285b7-kube-api-access-75pvj\") pod \"a18a0de3-d5c6-4a37-93dc-8362087285b7\" (UID: \"a18a0de3-d5c6-4a37-93dc-8362087285b7\") "
Sep 15 14:14:46.066524 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:46.066503    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a18a0de3-d5c6-4a37-93dc-8362087285b7-workload-certs\") pod \"a18a0de3-d5c6-4a37-93dc-8362087285b7\" (UID: \"a18a0de3-d5c6-4a37-93dc-8362087285b7\") "
Sep 15 14:14:46.066725 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:46.066529    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a18a0de3-d5c6-4a37-93dc-8362087285b7-workload-socket\") pod \"a18a0de3-d5c6-4a37-93dc-8362087285b7\" (UID: \"a18a0de3-d5c6-4a37-93dc-8362087285b7\") "
Sep 15 14:14:46.066725 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:46.066564    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a18a0de3-d5c6-4a37-93dc-8362087285b7-istio-data" (OuterVolumeSpecName: "istio-data") pod "a18a0de3-d5c6-4a37-93dc-8362087285b7" (UID: "a18a0de3-d5c6-4a37-93dc-8362087285b7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 14:14:46.066725 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:46.066598    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a18a0de3-d5c6-4a37-93dc-8362087285b7-istiod-ca-cert\") pod \"a18a0de3-d5c6-4a37-93dc-8362087285b7\" (UID: \"a18a0de3-d5c6-4a37-93dc-8362087285b7\") "
Sep 15 14:14:46.066725 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:46.066641    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a18a0de3-d5c6-4a37-93dc-8362087285b7-credential-socket\") pod \"a18a0de3-d5c6-4a37-93dc-8362087285b7\" (UID: \"a18a0de3-d5c6-4a37-93dc-8362087285b7\") "
Sep 15 14:14:46.066933 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:46.066780    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a18a0de3-d5c6-4a37-93dc-8362087285b7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a18a0de3-d5c6-4a37-93dc-8362087285b7" (UID: "a18a0de3-d5c6-4a37-93dc-8362087285b7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 14:14:46.066986 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:46.066928    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a18a0de3-d5c6-4a37-93dc-8362087285b7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a18a0de3-d5c6-4a37-93dc-8362087285b7" (UID: "a18a0de3-d5c6-4a37-93dc-8362087285b7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 14:14:46.067196 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:46.067144    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a18a0de3-d5c6-4a37-93dc-8362087285b7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a18a0de3-d5c6-4a37-93dc-8362087285b7" (UID: "a18a0de3-d5c6-4a37-93dc-8362087285b7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 14:14:46.067410 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:46.067319    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a18a0de3-d5c6-4a37-93dc-8362087285b7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a18a0de3-d5c6-4a37-93dc-8362087285b7" (UID: "a18a0de3-d5c6-4a37-93dc-8362087285b7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 14:14:46.067410 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:46.067276    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a18a0de3-d5c6-4a37-93dc-8362087285b7-istio-data\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:14:46.067526 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:46.067433    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a18a0de3-d5c6-4a37-93dc-8362087285b7-workload-certs\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:14:46.067526 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:46.067448    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a18a0de3-d5c6-4a37-93dc-8362087285b7-istiod-ca-cert\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:14:46.068820 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:46.068798    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a18a0de3-d5c6-4a37-93dc-8362087285b7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a18a0de3-d5c6-4a37-93dc-8362087285b7" (UID: "a18a0de3-d5c6-4a37-93dc-8362087285b7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 14:14:46.068909 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:46.068837    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a18a0de3-d5c6-4a37-93dc-8362087285b7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a18a0de3-d5c6-4a37-93dc-8362087285b7" (UID: "a18a0de3-d5c6-4a37-93dc-8362087285b7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 14:14:46.069209 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:46.069184    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a18a0de3-d5c6-4a37-93dc-8362087285b7-kube-api-access-75pvj" (OuterVolumeSpecName: "kube-api-access-75pvj") pod "a18a0de3-d5c6-4a37-93dc-8362087285b7" (UID: "a18a0de3-d5c6-4a37-93dc-8362087285b7"). InnerVolumeSpecName "kube-api-access-75pvj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 14:14:46.069261 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:46.069192    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a18a0de3-d5c6-4a37-93dc-8362087285b7-istio-token" (OuterVolumeSpecName: "istio-token") pod "a18a0de3-d5c6-4a37-93dc-8362087285b7" (UID: "a18a0de3-d5c6-4a37-93dc-8362087285b7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 14:14:46.168327 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:46.168287    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a18a0de3-d5c6-4a37-93dc-8362087285b7-istio-envoy\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:14:46.168327 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:46.168318    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-75pvj\" (UniqueName: \"kubernetes.io/projected/a18a0de3-d5c6-4a37-93dc-8362087285b7-kube-api-access-75pvj\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:14:46.168327 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:46.168329    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a18a0de3-d5c6-4a37-93dc-8362087285b7-workload-socket\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:14:46.168565 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:46.168337    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a18a0de3-d5c6-4a37-93dc-8362087285b7-credential-socket\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:14:46.168565 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:46.168346    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a18a0de3-d5c6-4a37-93dc-8362087285b7-istio-token\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:14:46.168565 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:46.168356    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a18a0de3-d5c6-4a37-93dc-8362087285b7-istio-podinfo\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:14:46.517401 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:46.517313    2578 generic.go:356] "Generic (PLEG): container finished" podID="a18a0de3-d5c6-4a37-93dc-8362087285b7" containerID="9a68e496898ccd846454cf8bb39ff2f880bf4b6e998a8f92a520bb9c3a80c07a" exitCode=0
Sep 15 14:14:46.517401 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:46.517361    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-746f54-openshift-default-8466df476d-s9rqw"
Sep 15 14:14:46.517401 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:46.517363    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-746f54-openshift-default-8466df476d-s9rqw" event={"ID":"a18a0de3-d5c6-4a37-93dc-8362087285b7","Type":"ContainerDied","Data":"9a68e496898ccd846454cf8bb39ff2f880bf4b6e998a8f92a520bb9c3a80c07a"}
Sep 15 14:14:46.517628 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:46.517417    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-746f54-openshift-default-8466df476d-s9rqw" event={"ID":"a18a0de3-d5c6-4a37-93dc-8362087285b7","Type":"ContainerDied","Data":"0441b31392c1aa4c9c9135570d97f4469816b8b65e00186a39120c64ae7b9fc8"}
Sep 15 14:14:46.517628 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:46.517448    2578 scope.go:117] "RemoveContainer" containerID="9a68e496898ccd846454cf8bb39ff2f880bf4b6e998a8f92a520bb9c3a80c07a"
Sep 15 14:14:46.528321 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:46.528300    2578 scope.go:117] "RemoveContainer" containerID="cdfba6ab1b2055d6b41521f3965f5a1dcb92e800d12511b25aac03e4215b62af"
Sep 15 14:14:46.537305 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:46.537284    2578 scope.go:117] "RemoveContainer" containerID="9a68e496898ccd846454cf8bb39ff2f880bf4b6e998a8f92a520bb9c3a80c07a"
Sep 15 14:14:46.537606 ip-10-0-128-41 kubenswrapper[2578]: E0915 14:14:46.537569    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a68e496898ccd846454cf8bb39ff2f880bf4b6e998a8f92a520bb9c3a80c07a\": container with ID starting with 9a68e496898ccd846454cf8bb39ff2f880bf4b6e998a8f92a520bb9c3a80c07a not found: ID does not exist" containerID="9a68e496898ccd846454cf8bb39ff2f880bf4b6e998a8f92a520bb9c3a80c07a"
Sep 15 14:14:46.537681 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:46.537615    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a68e496898ccd846454cf8bb39ff2f880bf4b6e998a8f92a520bb9c3a80c07a"} err="failed to get container status \"9a68e496898ccd846454cf8bb39ff2f880bf4b6e998a8f92a520bb9c3a80c07a\": rpc error: code = NotFound desc = could not find container \"9a68e496898ccd846454cf8bb39ff2f880bf4b6e998a8f92a520bb9c3a80c07a\": container with ID starting with 9a68e496898ccd846454cf8bb39ff2f880bf4b6e998a8f92a520bb9c3a80c07a not found: ID does not exist"
Sep 15 14:14:46.537681 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:46.537632    2578 scope.go:117] "RemoveContainer" containerID="cdfba6ab1b2055d6b41521f3965f5a1dcb92e800d12511b25aac03e4215b62af"
Sep 15 14:14:46.537898 ip-10-0-128-41 kubenswrapper[2578]: E0915 14:14:46.537880    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cdfba6ab1b2055d6b41521f3965f5a1dcb92e800d12511b25aac03e4215b62af\": container with ID starting with cdfba6ab1b2055d6b41521f3965f5a1dcb92e800d12511b25aac03e4215b62af not found: ID does not exist" containerID="cdfba6ab1b2055d6b41521f3965f5a1dcb92e800d12511b25aac03e4215b62af"
Sep 15 14:14:46.537956 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:46.537904    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cdfba6ab1b2055d6b41521f3965f5a1dcb92e800d12511b25aac03e4215b62af"} err="failed to get container status \"cdfba6ab1b2055d6b41521f3965f5a1dcb92e800d12511b25aac03e4215b62af\": rpc error: code = NotFound desc = could not find container \"cdfba6ab1b2055d6b41521f3965f5a1dcb92e800d12511b25aac03e4215b62af\": container with ID starting with cdfba6ab1b2055d6b41521f3965f5a1dcb92e800d12511b25aac03e4215b62af not found: ID does not exist"
Sep 15 14:14:46.540650 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:46.540626    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-746f54-openshift-default-8466df476d-s9rqw"]
Sep 15 14:14:46.543286 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:46.543265    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-746f54-openshift-default-8466df476d-s9rqw"]
Sep 15 14:14:47.758594 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:47.758562    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a18a0de3-d5c6-4a37-93dc-8362087285b7" path="/var/lib/kubelet/pods/a18a0de3-d5c6-4a37-93dc-8362087285b7/volumes"
Sep 15 14:14:56.758224 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:56.758188    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-e50cdb-6b58cb9994-25n6j"]
Sep 15 14:14:56.758922 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:56.758889    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-e50cdb-6b58cb9994-25n6j" podUID="a0c93185-7ba8-4938-ba68-51b1cd756d77" containerName="payload-pre-processing" containerID="cri-o://7f3b814f116fb8dd613b0287347d7a633e69b234a34cef3271f68b97ffa5b9e2" gracePeriod=30
Sep 15 14:14:56.994135 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:56.994092    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e50cdb-rnv7w"]
Sep 15 14:14:57.002886 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:57.002862    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e50cdb-rnv7w"]
Sep 15 14:14:57.013879 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:57.013828    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-e50cdb-6b58cb9994-25n6j"
Sep 15 14:14:57.176748 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:57.176717    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6vxjn\" (UniqueName: \"kubernetes.io/projected/a0c93185-7ba8-4938-ba68-51b1cd756d77-kube-api-access-6vxjn\") pod \"a0c93185-7ba8-4938-ba68-51b1cd756d77\" (UID: \"a0c93185-7ba8-4938-ba68-51b1cd756d77\") "
Sep 15 14:14:57.176950 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:57.176809    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a0c93185-7ba8-4938-ba68-51b1cd756d77-plugins-config-volume\") pod \"a0c93185-7ba8-4938-ba68-51b1cd756d77\" (UID: \"a0c93185-7ba8-4938-ba68-51b1cd756d77\") "
Sep 15 14:14:57.177229 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:57.177200    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a0c93185-7ba8-4938-ba68-51b1cd756d77-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a0c93185-7ba8-4938-ba68-51b1cd756d77" (UID: "a0c93185-7ba8-4938-ba68-51b1cd756d77"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 14:14:57.179004 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:57.178985    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0c93185-7ba8-4938-ba68-51b1cd756d77-kube-api-access-6vxjn" (OuterVolumeSpecName: "kube-api-access-6vxjn") pod "a0c93185-7ba8-4938-ba68-51b1cd756d77" (UID: "a0c93185-7ba8-4938-ba68-51b1cd756d77"). InnerVolumeSpecName "kube-api-access-6vxjn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 14:14:57.278034 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:57.278006    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a0c93185-7ba8-4938-ba68-51b1cd756d77-plugins-config-volume\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:14:57.278034 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:57.278035    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6vxjn\" (UniqueName: \"kubernetes.io/projected/a0c93185-7ba8-4938-ba68-51b1cd756d77-kube-api-access-6vxjn\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:14:57.584172 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:57.584054    2578 generic.go:356] "Generic (PLEG): container finished" podID="a0c93185-7ba8-4938-ba68-51b1cd756d77" containerID="7f3b814f116fb8dd613b0287347d7a633e69b234a34cef3271f68b97ffa5b9e2" exitCode=0
Sep 15 14:14:57.584172 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:57.584116    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-e50cdb-6b58cb9994-25n6j"
Sep 15 14:14:57.584172 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:57.584159    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-e50cdb-6b58cb9994-25n6j" event={"ID":"a0c93185-7ba8-4938-ba68-51b1cd756d77","Type":"ContainerDied","Data":"7f3b814f116fb8dd613b0287347d7a633e69b234a34cef3271f68b97ffa5b9e2"}
Sep 15 14:14:57.584449 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:57.584213    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-e50cdb-6b58cb9994-25n6j" event={"ID":"a0c93185-7ba8-4938-ba68-51b1cd756d77","Type":"ContainerDied","Data":"250675a58c0492c691173482773475f0ed8a8e9b5d507a716a95d56ab5d7f6ad"}
Sep 15 14:14:57.584449 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:57.584236    2578 scope.go:117] "RemoveContainer" containerID="7f3b814f116fb8dd613b0287347d7a633e69b234a34cef3271f68b97ffa5b9e2"
Sep 15 14:14:57.593804 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:57.593785    2578 scope.go:117] "RemoveContainer" containerID="7f3b814f116fb8dd613b0287347d7a633e69b234a34cef3271f68b97ffa5b9e2"
Sep 15 14:14:57.594065 ip-10-0-128-41 kubenswrapper[2578]: E0915 14:14:57.594044    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f3b814f116fb8dd613b0287347d7a633e69b234a34cef3271f68b97ffa5b9e2\": container with ID starting with 7f3b814f116fb8dd613b0287347d7a633e69b234a34cef3271f68b97ffa5b9e2 not found: ID does not exist" containerID="7f3b814f116fb8dd613b0287347d7a633e69b234a34cef3271f68b97ffa5b9e2"
Sep 15 14:14:57.594153 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:57.594076    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f3b814f116fb8dd613b0287347d7a633e69b234a34cef3271f68b97ffa5b9e2"} err="failed to get container status \"7f3b814f116fb8dd613b0287347d7a633e69b234a34cef3271f68b97ffa5b9e2\": rpc error: code = NotFound desc = could not find container \"7f3b814f116fb8dd613b0287347d7a633e69b234a34cef3271f68b97ffa5b9e2\": container with ID starting with 7f3b814f116fb8dd613b0287347d7a633e69b234a34cef3271f68b97ffa5b9e2 not found: ID does not exist"
Sep 15 14:14:57.609709 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:57.609685    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-e50cdb-6b58cb9994-25n6j"]
Sep 15 14:14:57.619433 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:57.619413    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-e50cdb-6b58cb9994-25n6j"]
Sep 15 14:14:57.758469 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:57.758436    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="497240eb-59bd-4a88-91d3-3b5688ba2d6a" path="/var/lib/kubelet/pods/497240eb-59bd-4a88-91d3-3b5688ba2d6a/volumes"
Sep 15 14:14:57.758855 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:14:57.758809    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a0c93185-7ba8-4938-ba68-51b1cd756d77" path="/var/lib/kubelet/pods/a0c93185-7ba8-4938-ba68-51b1cd756d77/volumes"
Sep 15 14:15:00.222305 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:00.222272    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-4bb7b3-29824695-g2wt2"]
Sep 15 14:15:00.223612 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:00.223587    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0c93185-7ba8-4938-ba68-51b1cd756d77" containerName="payload-pre-processing"
Sep 15 14:15:00.223763 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:00.223751    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0c93185-7ba8-4938-ba68-51b1cd756d77" containerName="payload-pre-processing"
Sep 15 14:15:00.223876 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:00.223867    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a18a0de3-d5c6-4a37-93dc-8362087285b7" containerName="istio-proxy"
Sep 15 14:15:00.223950 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:00.223942    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a18a0de3-d5c6-4a37-93dc-8362087285b7" containerName="istio-proxy"
Sep 15 14:15:00.224024 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:00.224015    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a18a0de3-d5c6-4a37-93dc-8362087285b7" containerName="istio-proxy"
Sep 15 14:15:00.224098 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:00.224090    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a18a0de3-d5c6-4a37-93dc-8362087285b7" containerName="istio-proxy"
Sep 15 14:15:00.224218 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:00.224208    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="497240eb-59bd-4a88-91d3-3b5688ba2d6a" containerName="revoke-keys"
Sep 15 14:15:00.224294 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:00.224285    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="497240eb-59bd-4a88-91d3-3b5688ba2d6a" containerName="revoke-keys"
Sep 15 14:15:00.224475 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:00.224465    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a18a0de3-d5c6-4a37-93dc-8362087285b7" containerName="istio-proxy"
Sep 15 14:15:00.224554 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:00.224545    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a18a0de3-d5c6-4a37-93dc-8362087285b7" containerName="istio-proxy"
Sep 15 14:15:00.224626 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:00.224618    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a0c93185-7ba8-4938-ba68-51b1cd756d77" containerName="payload-pre-processing"
Sep 15 14:15:00.224699 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:00.224691    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="497240eb-59bd-4a88-91d3-3b5688ba2d6a" containerName="revoke-keys"
Sep 15 14:15:00.233442 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:00.233411    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-583e9a-29824695-vr9xx"]
Sep 15 14:15:00.235321 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:00.233679    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-4bb7b3-29824695-g2wt2"
Sep 15 14:15:00.243495 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:00.243020    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 14:15:00.243495 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:00.243268    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qzmkv\""
Sep 15 14:15:00.246252 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:00.246227    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-d418fd-29824695-2qwp8"]
Sep 15 14:15:00.246461 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:00.246438    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-583e9a-29824695-vr9xx"
Sep 15 14:15:00.246733 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:00.246709    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 15 14:15:00.258008 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:00.257966    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-a090a0-29824695-fhkh4"]
Sep 15 14:15:00.258374 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:00.258054    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-d418fd-29824695-2qwp8"
Sep 15 14:15:00.261913 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:00.261890    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-66261e-29824695-n48jq"]
Sep 15 14:15:00.262240 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:00.262220    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-a090a0-29824695-fhkh4"
Sep 15 14:15:00.264671 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:00.264649    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-4bb7b3-29824695-g2wt2"]
Sep 15 14:15:00.264791 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:00.264689    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-583e9a-29824695-vr9xx"]
Sep 15 14:15:00.264791 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:00.264770    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-66261e-29824695-n48jq"
Sep 15 14:15:00.265403 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:00.265382    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-66261e-29824695-n48jq"]
Sep 15 14:15:00.269198 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:00.269176    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-a090a0-29824695-fhkh4"]
Sep 15 14:15:00.271636 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:00.271615    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-2aa332-29824695-qf6cc"]
Sep 15 14:15:00.274026 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:00.274010    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-2aa332-29824695-qf6cc"
Sep 15 14:15:00.282561 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:00.282434    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-d418fd-29824695-2qwp8"]
Sep 15 14:15:00.287801 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:00.287765    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-2aa332-29824695-qf6cc"]
Sep 15 14:15:00.410546 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:00.410507    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ngjf\" (UniqueName: \"kubernetes.io/projected/cc908b90-c185-4e0b-9b5d-489c881a472d-kube-api-access-2ngjf\") pod \"maas-api-key-cleanup-e2e-inf-b-2aa332-29824695-qf6cc\" (UID: \"cc908b90-c185-4e0b-9b5d-489c881a472d\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-2aa332-29824695-qf6cc"
Sep 15 14:15:00.410732 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:00.410553    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ztfk\" (UniqueName: \"kubernetes.io/projected/54576938-62ab-42da-b7df-e1d0a2126667-kube-api-access-6ztfk\") pod \"maas-api-key-cleanup-e2e-shared-a-w3-a090a0-29824695-fhkh4\" (UID: \"54576938-62ab-42da-b7df-e1d0a2126667\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-a090a0-29824695-fhkh4"
Sep 15 14:15:00.410732 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:00.410599    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7cxrj\" (UniqueName: \"kubernetes.io/projected/5bf64b0b-19c7-4892-9408-edd6d9d16b03-kube-api-access-7cxrj\") pod \"maas-api-key-cleanup-e2e-shared-a-w2-583e9a-29824695-vr9xx\" (UID: \"5bf64b0b-19c7-4892-9408-edd6d9d16b03\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-583e9a-29824695-vr9xx"
Sep 15 14:15:00.410732 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:00.410627    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4kcj\" (UniqueName: \"kubernetes.io/projected/482187c1-8b54-4748-96e7-2ae76a7a913e-kube-api-access-n4kcj\") pod \"maas-api-key-cleanup-e2e-shared-b-w2-4bb7b3-29824695-g2wt2\" (UID: \"482187c1-8b54-4748-96e7-2ae76a7a913e\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-4bb7b3-29824695-g2wt2"
Sep 15 14:15:00.410732 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:00.410696    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvtzf\" (UniqueName: \"kubernetes.io/projected/8ac73ffc-507f-4caf-9a81-14c5853978a3-kube-api-access-kvtzf\") pod \"maas-api-key-cleanup-e2e-worker-w4-66261e-29824695-n48jq\" (UID: \"8ac73ffc-507f-4caf-9a81-14c5853978a3\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-66261e-29824695-n48jq"
Sep 15 14:15:00.410732 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:00.410725    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7sbvb\" (UniqueName: \"kubernetes.io/projected/dbaac8ec-8147-4983-9c92-63efb4f1cd6f-kube-api-access-7sbvb\") pod \"maas-api-key-cleanup-e2e-shared-b-w3-d418fd-29824695-2qwp8\" (UID: \"dbaac8ec-8147-4983-9c92-63efb4f1cd6f\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-d418fd-29824695-2qwp8"
Sep 15 14:15:00.511293 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:00.511194    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ngjf\" (UniqueName: \"kubernetes.io/projected/cc908b90-c185-4e0b-9b5d-489c881a472d-kube-api-access-2ngjf\") pod \"maas-api-key-cleanup-e2e-inf-b-2aa332-29824695-qf6cc\" (UID: \"cc908b90-c185-4e0b-9b5d-489c881a472d\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-2aa332-29824695-qf6cc"
Sep 15 14:15:00.511293 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:00.511232    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ztfk\" (UniqueName: \"kubernetes.io/projected/54576938-62ab-42da-b7df-e1d0a2126667-kube-api-access-6ztfk\") pod \"maas-api-key-cleanup-e2e-shared-a-w3-a090a0-29824695-fhkh4\" (UID: \"54576938-62ab-42da-b7df-e1d0a2126667\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-a090a0-29824695-fhkh4"
Sep 15 14:15:00.511541 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:00.511403    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cxrj\" (UniqueName: \"kubernetes.io/projected/5bf64b0b-19c7-4892-9408-edd6d9d16b03-kube-api-access-7cxrj\") pod \"maas-api-key-cleanup-e2e-shared-a-w2-583e9a-29824695-vr9xx\" (UID: \"5bf64b0b-19c7-4892-9408-edd6d9d16b03\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-583e9a-29824695-vr9xx"
Sep 15 14:15:00.511541 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:00.511449    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4kcj\" (UniqueName: \"kubernetes.io/projected/482187c1-8b54-4748-96e7-2ae76a7a913e-kube-api-access-n4kcj\") pod \"maas-api-key-cleanup-e2e-shared-b-w2-4bb7b3-29824695-g2wt2\" (UID: \"482187c1-8b54-4748-96e7-2ae76a7a913e\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-4bb7b3-29824695-g2wt2"
Sep 15 14:15:00.511541 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:00.511536    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvtzf\" (UniqueName: \"kubernetes.io/projected/8ac73ffc-507f-4caf-9a81-14c5853978a3-kube-api-access-kvtzf\") pod \"maas-api-key-cleanup-e2e-worker-w4-66261e-29824695-n48jq\" (UID: \"8ac73ffc-507f-4caf-9a81-14c5853978a3\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-66261e-29824695-n48jq"
Sep 15 14:15:00.511719 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:00.511576    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7sbvb\" (UniqueName: \"kubernetes.io/projected/dbaac8ec-8147-4983-9c92-63efb4f1cd6f-kube-api-access-7sbvb\") pod \"maas-api-key-cleanup-e2e-shared-b-w3-d418fd-29824695-2qwp8\" (UID: \"dbaac8ec-8147-4983-9c92-63efb4f1cd6f\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-d418fd-29824695-2qwp8"
Sep 15 14:15:00.520799 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:00.520771    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7cxrj\" (UniqueName: \"kubernetes.io/projected/5bf64b0b-19c7-4892-9408-edd6d9d16b03-kube-api-access-7cxrj\") pod \"maas-api-key-cleanup-e2e-shared-a-w2-583e9a-29824695-vr9xx\" (UID: \"5bf64b0b-19c7-4892-9408-edd6d9d16b03\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-583e9a-29824695-vr9xx"
Sep 15 14:15:00.521393 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:00.521243    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ztfk\" (UniqueName: \"kubernetes.io/projected/54576938-62ab-42da-b7df-e1d0a2126667-kube-api-access-6ztfk\") pod \"maas-api-key-cleanup-e2e-shared-a-w3-a090a0-29824695-fhkh4\" (UID: \"54576938-62ab-42da-b7df-e1d0a2126667\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-a090a0-29824695-fhkh4"
Sep 15 14:15:00.521393 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:00.521332    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvtzf\" (UniqueName: \"kubernetes.io/projected/8ac73ffc-507f-4caf-9a81-14c5853978a3-kube-api-access-kvtzf\") pod \"maas-api-key-cleanup-e2e-worker-w4-66261e-29824695-n48jq\" (UID: \"8ac73ffc-507f-4caf-9a81-14c5853978a3\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-66261e-29824695-n48jq"
Sep 15 14:15:00.521559 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:00.521397    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ngjf\" (UniqueName: \"kubernetes.io/projected/cc908b90-c185-4e0b-9b5d-489c881a472d-kube-api-access-2ngjf\") pod \"maas-api-key-cleanup-e2e-inf-b-2aa332-29824695-qf6cc\" (UID: \"cc908b90-c185-4e0b-9b5d-489c881a472d\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-2aa332-29824695-qf6cc"
Sep 15 14:15:00.521600 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:00.521575    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4kcj\" (UniqueName: \"kubernetes.io/projected/482187c1-8b54-4748-96e7-2ae76a7a913e-kube-api-access-n4kcj\") pod \"maas-api-key-cleanup-e2e-shared-b-w2-4bb7b3-29824695-g2wt2\" (UID: \"482187c1-8b54-4748-96e7-2ae76a7a913e\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-4bb7b3-29824695-g2wt2"
Sep 15 14:15:00.521767 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:00.521744    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7sbvb\" (UniqueName: \"kubernetes.io/projected/dbaac8ec-8147-4983-9c92-63efb4f1cd6f-kube-api-access-7sbvb\") pod \"maas-api-key-cleanup-e2e-shared-b-w3-d418fd-29824695-2qwp8\" (UID: \"dbaac8ec-8147-4983-9c92-63efb4f1cd6f\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-d418fd-29824695-2qwp8"
Sep 15 14:15:00.561632 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:00.561606    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-4bb7b3-29824695-g2wt2"
Sep 15 14:15:00.572158 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:00.572137    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-583e9a-29824695-vr9xx"
Sep 15 14:15:00.580530 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:00.580507    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-d418fd-29824695-2qwp8"
Sep 15 14:15:00.593750 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:00.593724    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-a090a0-29824695-fhkh4"
Sep 15 14:15:00.602544 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:00.602491    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-66261e-29824695-n48jq"
Sep 15 14:15:00.609421 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:00.609235    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-2aa332-29824695-qf6cc"
Sep 15 14:15:00.847092 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:00.847067    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-4bb7b3-29824695-g2wt2"]
Sep 15 14:15:00.848708 ip-10-0-128-41 kubenswrapper[2578]: W0915 14:15:00.848683    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod482187c1_8b54_4748_96e7_2ae76a7a913e.slice/crio-f4f5a1049d07c0dcbf5b739351745fa0b77f378a214d6441fece492a8321f828 WatchSource:0}: Error finding container f4f5a1049d07c0dcbf5b739351745fa0b77f378a214d6441fece492a8321f828: Status 404 returned error can't find the container with id f4f5a1049d07c0dcbf5b739351745fa0b77f378a214d6441fece492a8321f828
Sep 15 14:15:00.869455 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:00.869426    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-583e9a-29824695-vr9xx"]
Sep 15 14:15:00.870497 ip-10-0-128-41 kubenswrapper[2578]: W0915 14:15:00.870476    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bf64b0b_19c7_4892_9408_edd6d9d16b03.slice/crio-c0c2cbedc4a8d9949e12db271ab57cbf18a6950287bc67959a29615c423a3ae9 WatchSource:0}: Error finding container c0c2cbedc4a8d9949e12db271ab57cbf18a6950287bc67959a29615c423a3ae9: Status 404 returned error can't find the container with id c0c2cbedc4a8d9949e12db271ab57cbf18a6950287bc67959a29615c423a3ae9
Sep 15 14:15:00.882820 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:00.882798    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-d418fd-29824695-2qwp8"]
Sep 15 14:15:00.884533 ip-10-0-128-41 kubenswrapper[2578]: W0915 14:15:00.884507    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbaac8ec_8147_4983_9c92_63efb4f1cd6f.slice/crio-6c1c6ffb0887b7a2090339dc70dd0cae32177805914b0a58b9ad15683721eb53 WatchSource:0}: Error finding container 6c1c6ffb0887b7a2090339dc70dd0cae32177805914b0a58b9ad15683721eb53: Status 404 returned error can't find the container with id 6c1c6ffb0887b7a2090339dc70dd0cae32177805914b0a58b9ad15683721eb53
Sep 15 14:15:00.905243 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:00.905220    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-a090a0-29824695-fhkh4"]
Sep 15 14:15:00.905488 ip-10-0-128-41 kubenswrapper[2578]: W0915 14:15:00.905465    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54576938_62ab_42da_b7df_e1d0a2126667.slice/crio-ef3c27589b3ea2bedb98408b8892738752a47cac6d5b3bc01a1a540630b90ffe WatchSource:0}: Error finding container ef3c27589b3ea2bedb98408b8892738752a47cac6d5b3bc01a1a540630b90ffe: Status 404 returned error can't find the container with id ef3c27589b3ea2bedb98408b8892738752a47cac6d5b3bc01a1a540630b90ffe
Sep 15 14:15:00.945010 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:00.944988    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-2aa332-29824695-qf6cc"]
Sep 15 14:15:00.947531 ip-10-0-128-41 kubenswrapper[2578]: W0915 14:15:00.947505    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ac73ffc_507f_4caf_9a81_14c5853978a3.slice/crio-79a7406ff07d17dfe22e8d9cbf038eac78b2ae2c7d49e5f79a41d48cee0272b1 WatchSource:0}: Error finding container 79a7406ff07d17dfe22e8d9cbf038eac78b2ae2c7d49e5f79a41d48cee0272b1: Status 404 returned error can't find the container with id 79a7406ff07d17dfe22e8d9cbf038eac78b2ae2c7d49e5f79a41d48cee0272b1
Sep 15 14:15:00.948369 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:00.948346    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-66261e-29824695-n48jq"]
Sep 15 14:15:00.948472 ip-10-0-128-41 kubenswrapper[2578]: W0915 14:15:00.948383    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc908b90_c185_4e0b_9b5d_489c881a472d.slice/crio-0aede742a1b8886b892d75044d4f52f4bf612559630e8164b6895402632f642c WatchSource:0}: Error finding container 0aede742a1b8886b892d75044d4f52f4bf612559630e8164b6895402632f642c: Status 404 returned error can't find the container with id 0aede742a1b8886b892d75044d4f52f4bf612559630e8164b6895402632f642c
Sep 15 14:15:01.623586 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:01.623548    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-66261e-29824695-n48jq" event={"ID":"8ac73ffc-507f-4caf-9a81-14c5853978a3","Type":"ContainerStarted","Data":"37571656806a006653615e9c9e8d32e0f2aa157b6b17a962af3b3860a49ab672"}
Sep 15 14:15:01.624044 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:01.623638    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-66261e-29824695-n48jq" event={"ID":"8ac73ffc-507f-4caf-9a81-14c5853978a3","Type":"ContainerStarted","Data":"79a7406ff07d17dfe22e8d9cbf038eac78b2ae2c7d49e5f79a41d48cee0272b1"}
Sep 15 14:15:01.625418 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:01.625386    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-4bb7b3-29824695-g2wt2" event={"ID":"482187c1-8b54-4748-96e7-2ae76a7a913e","Type":"ContainerStarted","Data":"14d4802cbc5f24e4ff80dfb79ab037ac1c0712d128b8fb970abad690b0408937"}
Sep 15 14:15:01.625544 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:01.625445    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-4bb7b3-29824695-g2wt2" event={"ID":"482187c1-8b54-4748-96e7-2ae76a7a913e","Type":"ContainerStarted","Data":"f4f5a1049d07c0dcbf5b739351745fa0b77f378a214d6441fece492a8321f828"}
Sep 15 14:15:01.627216 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:01.627195    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-583e9a-29824695-vr9xx" event={"ID":"5bf64b0b-19c7-4892-9408-edd6d9d16b03","Type":"ContainerStarted","Data":"84d0797ff28fda652f4a8a622fa5159f718d3c917c4d538e5512bcb424d78721"}
Sep 15 14:15:01.627333 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:01.627256    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-583e9a-29824695-vr9xx" event={"ID":"5bf64b0b-19c7-4892-9408-edd6d9d16b03","Type":"ContainerStarted","Data":"c0c2cbedc4a8d9949e12db271ab57cbf18a6950287bc67959a29615c423a3ae9"}
Sep 15 14:15:01.628919 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:01.628895    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-a090a0-29824695-fhkh4" event={"ID":"54576938-62ab-42da-b7df-e1d0a2126667","Type":"ContainerStarted","Data":"818aff19cbb81879a16a32714aadfd6577b3162f02691db8bd277100440788df"}
Sep 15 14:15:01.629019 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:01.628942    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-a090a0-29824695-fhkh4" event={"ID":"54576938-62ab-42da-b7df-e1d0a2126667","Type":"ContainerStarted","Data":"ef3c27589b3ea2bedb98408b8892738752a47cac6d5b3bc01a1a540630b90ffe"}
Sep 15 14:15:01.630462 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:01.630443    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-d418fd-29824695-2qwp8" event={"ID":"dbaac8ec-8147-4983-9c92-63efb4f1cd6f","Type":"ContainerStarted","Data":"ced2f9dbce3cdbb9010ee4a56390636c2c719cdd276b9197fdd95387c806793b"}
Sep 15 14:15:01.630560 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:01.630477    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-d418fd-29824695-2qwp8" event={"ID":"dbaac8ec-8147-4983-9c92-63efb4f1cd6f","Type":"ContainerStarted","Data":"6c1c6ffb0887b7a2090339dc70dd0cae32177805914b0a58b9ad15683721eb53"}
Sep 15 14:15:01.631883 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:01.631865    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-2aa332-29824695-qf6cc" event={"ID":"cc908b90-c185-4e0b-9b5d-489c881a472d","Type":"ContainerStarted","Data":"dc2e28a440251ffde0167bf06e3c7342b93623e12d1436d86de751435cb6a877"}
Sep 15 14:15:01.631954 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:01.631898    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-2aa332-29824695-qf6cc" event={"ID":"cc908b90-c185-4e0b-9b5d-489c881a472d","Type":"ContainerStarted","Data":"0aede742a1b8886b892d75044d4f52f4bf612559630e8164b6895402632f642c"}
Sep 15 14:15:01.642777 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:01.642738    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-66261e-29824695-n48jq" podStartSLOduration=1.642726368 podStartE2EDuration="1.642726368s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 14:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 14:15:01.639579921 +0000 UTC m=+2188.398706208" watchObservedRunningTime="2026-09-15 14:15:01.642726368 +0000 UTC m=+2188.401852687"
Sep 15 14:15:01.656574 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:01.656521    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-583e9a-29824695-vr9xx" podStartSLOduration=1.656507832 podStartE2EDuration="1.656507832s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 14:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 14:15:01.65360476 +0000 UTC m=+2188.412731046" watchObservedRunningTime="2026-09-15 14:15:01.656507832 +0000 UTC m=+2188.415634108"
Sep 15 14:15:01.668291 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:01.668243    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-a090a0-29824695-fhkh4" podStartSLOduration=1.668226029 podStartE2EDuration="1.668226029s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 14:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 14:15:01.667491796 +0000 UTC m=+2188.426618082" watchObservedRunningTime="2026-09-15 14:15:01.668226029 +0000 UTC m=+2188.427352314"
Sep 15 14:15:01.683248 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:01.683207    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-4bb7b3-29824695-g2wt2" podStartSLOduration=1.683196599 podStartE2EDuration="1.683196599s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 14:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 14:15:01.682373859 +0000 UTC m=+2188.441500145" watchObservedRunningTime="2026-09-15 14:15:01.683196599 +0000 UTC m=+2188.442322902"
Sep 15 14:15:01.698108 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:01.698061    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-d418fd-29824695-2qwp8" podStartSLOduration=1.698045075 podStartE2EDuration="1.698045075s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 14:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 14:15:01.697101205 +0000 UTC m=+2188.456227490" watchObservedRunningTime="2026-09-15 14:15:01.698045075 +0000 UTC m=+2188.457171362"
Sep 15 14:15:01.714931 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:01.714889    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-2aa332-29824695-qf6cc" podStartSLOduration=1.714876407 podStartE2EDuration="1.714876407s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 14:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 14:15:01.713937271 +0000 UTC m=+2188.473063557" watchObservedRunningTime="2026-09-15 14:15:01.714876407 +0000 UTC m=+2188.474002694"
Sep 15 14:15:02.641844 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:02.641808    2578 generic.go:356] "Generic (PLEG): container finished" podID="cc908b90-c185-4e0b-9b5d-489c881a472d" containerID="dc2e28a440251ffde0167bf06e3c7342b93623e12d1436d86de751435cb6a877" exitCode=0
Sep 15 14:15:02.642264 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:02.641904    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-2aa332-29824695-qf6cc" event={"ID":"cc908b90-c185-4e0b-9b5d-489c881a472d","Type":"ContainerDied","Data":"dc2e28a440251ffde0167bf06e3c7342b93623e12d1436d86de751435cb6a877"}
Sep 15 14:15:02.643552 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:02.643530    2578 generic.go:356] "Generic (PLEG): container finished" podID="8ac73ffc-507f-4caf-9a81-14c5853978a3" containerID="37571656806a006653615e9c9e8d32e0f2aa157b6b17a962af3b3860a49ab672" exitCode=0
Sep 15 14:15:02.643668 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:02.643584    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-66261e-29824695-n48jq" event={"ID":"8ac73ffc-507f-4caf-9a81-14c5853978a3","Type":"ContainerDied","Data":"37571656806a006653615e9c9e8d32e0f2aa157b6b17a962af3b3860a49ab672"}
Sep 15 14:15:02.645240 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:02.645219    2578 generic.go:356] "Generic (PLEG): container finished" podID="482187c1-8b54-4748-96e7-2ae76a7a913e" containerID="14d4802cbc5f24e4ff80dfb79ab037ac1c0712d128b8fb970abad690b0408937" exitCode=0
Sep 15 14:15:02.645352 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:02.645302    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-4bb7b3-29824695-g2wt2" event={"ID":"482187c1-8b54-4748-96e7-2ae76a7a913e","Type":"ContainerDied","Data":"14d4802cbc5f24e4ff80dfb79ab037ac1c0712d128b8fb970abad690b0408937"}
Sep 15 14:15:02.646715 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:02.646692    2578 generic.go:356] "Generic (PLEG): container finished" podID="5bf64b0b-19c7-4892-9408-edd6d9d16b03" containerID="84d0797ff28fda652f4a8a622fa5159f718d3c917c4d538e5512bcb424d78721" exitCode=0
Sep 15 14:15:02.646800 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:02.646760    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-583e9a-29824695-vr9xx" event={"ID":"5bf64b0b-19c7-4892-9408-edd6d9d16b03","Type":"ContainerDied","Data":"84d0797ff28fda652f4a8a622fa5159f718d3c917c4d538e5512bcb424d78721"}
Sep 15 14:15:02.648174 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:02.648156    2578 generic.go:356] "Generic (PLEG): container finished" podID="54576938-62ab-42da-b7df-e1d0a2126667" containerID="818aff19cbb81879a16a32714aadfd6577b3162f02691db8bd277100440788df" exitCode=0
Sep 15 14:15:02.648256 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:02.648183    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-a090a0-29824695-fhkh4" event={"ID":"54576938-62ab-42da-b7df-e1d0a2126667","Type":"ContainerDied","Data":"818aff19cbb81879a16a32714aadfd6577b3162f02691db8bd277100440788df"}
Sep 15 14:15:02.649803 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:02.649784    2578 generic.go:356] "Generic (PLEG): container finished" podID="dbaac8ec-8147-4983-9c92-63efb4f1cd6f" containerID="ced2f9dbce3cdbb9010ee4a56390636c2c719cdd276b9197fdd95387c806793b" exitCode=0
Sep 15 14:15:02.649890 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:02.649808    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-d418fd-29824695-2qwp8" event={"ID":"dbaac8ec-8147-4983-9c92-63efb4f1cd6f","Type":"ContainerDied","Data":"ced2f9dbce3cdbb9010ee4a56390636c2c719cdd276b9197fdd95387c806793b"}
Sep 15 14:15:03.595641 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:03.595602    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-e50cdb-openshift-default-6c4c7d6cf6-fpf2d"]
Sep 15 14:15:03.595934 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:03.595901    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-e50cdb-openshift-default-6c4c7d6cf6-fpf2d" podUID="9afc43e8-1aeb-415c-a911-4b688f58ffc3" containerName="istio-proxy" containerID="cri-o://45599cf2e1bbd43703a4be571cd4e056dd755d91fc06124a929f14daa1675baa" gracePeriod=30
Sep 15 14:15:03.849456 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:03.849373    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-a090a0-29824695-fhkh4"
Sep 15 14:15:03.942088 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:03.942067    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6ztfk\" (UniqueName: \"kubernetes.io/projected/54576938-62ab-42da-b7df-e1d0a2126667-kube-api-access-6ztfk\") pod \"54576938-62ab-42da-b7df-e1d0a2126667\" (UID: \"54576938-62ab-42da-b7df-e1d0a2126667\") "
Sep 15 14:15:03.944431 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:03.944399    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54576938-62ab-42da-b7df-e1d0a2126667-kube-api-access-6ztfk" (OuterVolumeSpecName: "kube-api-access-6ztfk") pod "54576938-62ab-42da-b7df-e1d0a2126667" (UID: "54576938-62ab-42da-b7df-e1d0a2126667"). InnerVolumeSpecName "kube-api-access-6ztfk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 14:15:03.947765 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:03.947742    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-66261e-29824695-n48jq"
Sep 15 14:15:03.950753 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:03.950732    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-583e9a-29824695-vr9xx"
Sep 15 14:15:03.954660 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:03.954643    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-2aa332-29824695-qf6cc"
Sep 15 14:15:03.958095 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:03.958077    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-d418fd-29824695-2qwp8"
Sep 15 14:15:03.961359 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:03.961343    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-4bb7b3-29824695-g2wt2"
Sep 15 14:15:04.043288 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:04.043258    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n4kcj\" (UniqueName: \"kubernetes.io/projected/482187c1-8b54-4748-96e7-2ae76a7a913e-kube-api-access-n4kcj\") pod \"482187c1-8b54-4748-96e7-2ae76a7a913e\" (UID: \"482187c1-8b54-4748-96e7-2ae76a7a913e\") "
Sep 15 14:15:04.043453 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:04.043355    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7sbvb\" (UniqueName: \"kubernetes.io/projected/dbaac8ec-8147-4983-9c92-63efb4f1cd6f-kube-api-access-7sbvb\") pod \"dbaac8ec-8147-4983-9c92-63efb4f1cd6f\" (UID: \"dbaac8ec-8147-4983-9c92-63efb4f1cd6f\") "
Sep 15 14:15:04.043453 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:04.043379    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7cxrj\" (UniqueName: \"kubernetes.io/projected/5bf64b0b-19c7-4892-9408-edd6d9d16b03-kube-api-access-7cxrj\") pod \"5bf64b0b-19c7-4892-9408-edd6d9d16b03\" (UID: \"5bf64b0b-19c7-4892-9408-edd6d9d16b03\") "
Sep 15 14:15:04.043453 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:04.043416    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2ngjf\" (UniqueName: \"kubernetes.io/projected/cc908b90-c185-4e0b-9b5d-489c881a472d-kube-api-access-2ngjf\") pod \"cc908b90-c185-4e0b-9b5d-489c881a472d\" (UID: \"cc908b90-c185-4e0b-9b5d-489c881a472d\") "
Sep 15 14:15:04.043453 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:04.043445    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kvtzf\" (UniqueName: \"kubernetes.io/projected/8ac73ffc-507f-4caf-9a81-14c5853978a3-kube-api-access-kvtzf\") pod \"8ac73ffc-507f-4caf-9a81-14c5853978a3\" (UID: \"8ac73ffc-507f-4caf-9a81-14c5853978a3\") "
Sep 15 14:15:04.043790 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:04.043763    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6ztfk\" (UniqueName: \"kubernetes.io/projected/54576938-62ab-42da-b7df-e1d0a2126667-kube-api-access-6ztfk\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:15:04.045826 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:04.045786    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc908b90-c185-4e0b-9b5d-489c881a472d-kube-api-access-2ngjf" (OuterVolumeSpecName: "kube-api-access-2ngjf") pod "cc908b90-c185-4e0b-9b5d-489c881a472d" (UID: "cc908b90-c185-4e0b-9b5d-489c881a472d"). InnerVolumeSpecName "kube-api-access-2ngjf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 14:15:04.045958 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:04.045823    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5bf64b0b-19c7-4892-9408-edd6d9d16b03-kube-api-access-7cxrj" (OuterVolumeSpecName: "kube-api-access-7cxrj") pod "5bf64b0b-19c7-4892-9408-edd6d9d16b03" (UID: "5bf64b0b-19c7-4892-9408-edd6d9d16b03"). InnerVolumeSpecName "kube-api-access-7cxrj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 14:15:04.045958 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:04.045933    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dbaac8ec-8147-4983-9c92-63efb4f1cd6f-kube-api-access-7sbvb" (OuterVolumeSpecName: "kube-api-access-7sbvb") pod "dbaac8ec-8147-4983-9c92-63efb4f1cd6f" (UID: "dbaac8ec-8147-4983-9c92-63efb4f1cd6f"). InnerVolumeSpecName "kube-api-access-7sbvb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 14:15:04.046199 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:04.046179    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/482187c1-8b54-4748-96e7-2ae76a7a913e-kube-api-access-n4kcj" (OuterVolumeSpecName: "kube-api-access-n4kcj") pod "482187c1-8b54-4748-96e7-2ae76a7a913e" (UID: "482187c1-8b54-4748-96e7-2ae76a7a913e"). InnerVolumeSpecName "kube-api-access-n4kcj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 14:15:04.046262 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:04.046193    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ac73ffc-507f-4caf-9a81-14c5853978a3-kube-api-access-kvtzf" (OuterVolumeSpecName: "kube-api-access-kvtzf") pod "8ac73ffc-507f-4caf-9a81-14c5853978a3" (UID: "8ac73ffc-507f-4caf-9a81-14c5853978a3"). InnerVolumeSpecName "kube-api-access-kvtzf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 14:15:04.144736 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:04.144633    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7sbvb\" (UniqueName: \"kubernetes.io/projected/dbaac8ec-8147-4983-9c92-63efb4f1cd6f-kube-api-access-7sbvb\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:15:04.144736 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:04.144676    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7cxrj\" (UniqueName: \"kubernetes.io/projected/5bf64b0b-19c7-4892-9408-edd6d9d16b03-kube-api-access-7cxrj\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:15:04.144736 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:04.144685    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2ngjf\" (UniqueName: \"kubernetes.io/projected/cc908b90-c185-4e0b-9b5d-489c881a472d-kube-api-access-2ngjf\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:15:04.144736 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:04.144693    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kvtzf\" (UniqueName: \"kubernetes.io/projected/8ac73ffc-507f-4caf-9a81-14c5853978a3-kube-api-access-kvtzf\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:15:04.144736 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:04.144701    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n4kcj\" (UniqueName: \"kubernetes.io/projected/482187c1-8b54-4748-96e7-2ae76a7a913e-kube-api-access-n4kcj\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:15:04.663401 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:04.663361    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-d418fd-29824695-2qwp8"
Sep 15 14:15:04.663401 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:04.663381    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-d418fd-29824695-2qwp8" event={"ID":"dbaac8ec-8147-4983-9c92-63efb4f1cd6f","Type":"ContainerDied","Data":"6c1c6ffb0887b7a2090339dc70dd0cae32177805914b0a58b9ad15683721eb53"}
Sep 15 14:15:04.663671 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:04.663464    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6c1c6ffb0887b7a2090339dc70dd0cae32177805914b0a58b9ad15683721eb53"
Sep 15 14:15:04.664801 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:04.664778    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-2aa332-29824695-qf6cc"
Sep 15 14:15:04.664801 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:04.664783    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-2aa332-29824695-qf6cc" event={"ID":"cc908b90-c185-4e0b-9b5d-489c881a472d","Type":"ContainerDied","Data":"0aede742a1b8886b892d75044d4f52f4bf612559630e8164b6895402632f642c"}
Sep 15 14:15:04.665010 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:04.664823    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0aede742a1b8886b892d75044d4f52f4bf612559630e8164b6895402632f642c"
Sep 15 14:15:04.666372 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:04.666346    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-66261e-29824695-n48jq"
Sep 15 14:15:04.666494 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:04.666355    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-66261e-29824695-n48jq" event={"ID":"8ac73ffc-507f-4caf-9a81-14c5853978a3","Type":"ContainerDied","Data":"79a7406ff07d17dfe22e8d9cbf038eac78b2ae2c7d49e5f79a41d48cee0272b1"}
Sep 15 14:15:04.666494 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:04.666473    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="79a7406ff07d17dfe22e8d9cbf038eac78b2ae2c7d49e5f79a41d48cee0272b1"
Sep 15 14:15:04.667775 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:04.667758    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-4bb7b3-29824695-g2wt2"
Sep 15 14:15:04.667775 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:04.667765    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-4bb7b3-29824695-g2wt2" event={"ID":"482187c1-8b54-4748-96e7-2ae76a7a913e","Type":"ContainerDied","Data":"f4f5a1049d07c0dcbf5b739351745fa0b77f378a214d6441fece492a8321f828"}
Sep 15 14:15:04.667945 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:04.667807    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f4f5a1049d07c0dcbf5b739351745fa0b77f378a214d6441fece492a8321f828"
Sep 15 14:15:04.669252 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:04.669236    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-583e9a-29824695-vr9xx"
Sep 15 14:15:04.669482 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:04.669246    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-583e9a-29824695-vr9xx" event={"ID":"5bf64b0b-19c7-4892-9408-edd6d9d16b03","Type":"ContainerDied","Data":"c0c2cbedc4a8d9949e12db271ab57cbf18a6950287bc67959a29615c423a3ae9"}
Sep 15 14:15:04.669558 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:04.669518    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c0c2cbedc4a8d9949e12db271ab57cbf18a6950287bc67959a29615c423a3ae9"
Sep 15 14:15:04.670750 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:04.670716    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-a090a0-29824695-fhkh4" event={"ID":"54576938-62ab-42da-b7df-e1d0a2126667","Type":"ContainerDied","Data":"ef3c27589b3ea2bedb98408b8892738752a47cac6d5b3bc01a1a540630b90ffe"}
Sep 15 14:15:04.670858 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:04.670756    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ef3c27589b3ea2bedb98408b8892738752a47cac6d5b3bc01a1a540630b90ffe"
Sep 15 14:15:04.670858 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:04.670732    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-a090a0-29824695-fhkh4"
Sep 15 14:15:08.847262 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:08.847237    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-e50cdb-openshift-default-6c4c7d6cf6-fpf2d"
Sep 15 14:15:08.884846 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:08.884756    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9afc43e8-1aeb-415c-a911-4b688f58ffc3-istio-envoy\") pod \"9afc43e8-1aeb-415c-a911-4b688f58ffc3\" (UID: \"9afc43e8-1aeb-415c-a911-4b688f58ffc3\") "
Sep 15 14:15:08.884846 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:08.884790    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9afc43e8-1aeb-415c-a911-4b688f58ffc3-istio-data\") pod \"9afc43e8-1aeb-415c-a911-4b688f58ffc3\" (UID: \"9afc43e8-1aeb-415c-a911-4b688f58ffc3\") "
Sep 15 14:15:08.884846 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:08.884816    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9afc43e8-1aeb-415c-a911-4b688f58ffc3-istio-token\") pod \"9afc43e8-1aeb-415c-a911-4b688f58ffc3\" (UID: \"9afc43e8-1aeb-415c-a911-4b688f58ffc3\") "
Sep 15 14:15:08.884846 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:08.884842    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9afc43e8-1aeb-415c-a911-4b688f58ffc3-istio-podinfo\") pod \"9afc43e8-1aeb-415c-a911-4b688f58ffc3\" (UID: \"9afc43e8-1aeb-415c-a911-4b688f58ffc3\") "
Sep 15 14:15:08.885219 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:08.884874    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9afc43e8-1aeb-415c-a911-4b688f58ffc3-workload-socket\") pod \"9afc43e8-1aeb-415c-a911-4b688f58ffc3\" (UID: \"9afc43e8-1aeb-415c-a911-4b688f58ffc3\") "
Sep 15 14:15:08.885219 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:08.884948    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9afc43e8-1aeb-415c-a911-4b688f58ffc3-istiod-ca-cert\") pod \"9afc43e8-1aeb-415c-a911-4b688f58ffc3\" (UID: \"9afc43e8-1aeb-415c-a911-4b688f58ffc3\") "
Sep 15 14:15:08.885219 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:08.884979    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9afc43e8-1aeb-415c-a911-4b688f58ffc3-workload-certs\") pod \"9afc43e8-1aeb-415c-a911-4b688f58ffc3\" (UID: \"9afc43e8-1aeb-415c-a911-4b688f58ffc3\") "
Sep 15 14:15:08.885219 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:08.885020    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9afc43e8-1aeb-415c-a911-4b688f58ffc3-credential-socket\") pod \"9afc43e8-1aeb-415c-a911-4b688f58ffc3\" (UID: \"9afc43e8-1aeb-415c-a911-4b688f58ffc3\") "
Sep 15 14:15:08.885219 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:08.885103    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t7lsm\" (UniqueName: \"kubernetes.io/projected/9afc43e8-1aeb-415c-a911-4b688f58ffc3-kube-api-access-t7lsm\") pod \"9afc43e8-1aeb-415c-a911-4b688f58ffc3\" (UID: \"9afc43e8-1aeb-415c-a911-4b688f58ffc3\") "
Sep 15 14:15:08.885219 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:08.885109    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9afc43e8-1aeb-415c-a911-4b688f58ffc3-istio-data" (OuterVolumeSpecName: "istio-data") pod "9afc43e8-1aeb-415c-a911-4b688f58ffc3" (UID: "9afc43e8-1aeb-415c-a911-4b688f58ffc3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 14:15:08.885562 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:08.885317    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9afc43e8-1aeb-415c-a911-4b688f58ffc3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9afc43e8-1aeb-415c-a911-4b688f58ffc3" (UID: "9afc43e8-1aeb-415c-a911-4b688f58ffc3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 14:15:08.885562 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:08.885415    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9afc43e8-1aeb-415c-a911-4b688f58ffc3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9afc43e8-1aeb-415c-a911-4b688f58ffc3" (UID: "9afc43e8-1aeb-415c-a911-4b688f58ffc3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 14:15:08.885562 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:08.885466    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9afc43e8-1aeb-415c-a911-4b688f58ffc3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9afc43e8-1aeb-415c-a911-4b688f58ffc3" (UID: "9afc43e8-1aeb-415c-a911-4b688f58ffc3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 14:15:08.885562 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:08.885549    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9afc43e8-1aeb-415c-a911-4b688f58ffc3-credential-socket\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:15:08.885777 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:08.885570    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9afc43e8-1aeb-415c-a911-4b688f58ffc3-istio-data\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:15:08.885777 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:08.885587    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9afc43e8-1aeb-415c-a911-4b688f58ffc3-workload-socket\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:15:08.885777 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:08.885599    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9afc43e8-1aeb-415c-a911-4b688f58ffc3-workload-certs\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:15:08.885948 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:08.885800    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9afc43e8-1aeb-415c-a911-4b688f58ffc3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9afc43e8-1aeb-415c-a911-4b688f58ffc3" (UID: "9afc43e8-1aeb-415c-a911-4b688f58ffc3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 14:15:08.887340 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:08.887305    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9afc43e8-1aeb-415c-a911-4b688f58ffc3-istio-token" (OuterVolumeSpecName: "istio-token") pod "9afc43e8-1aeb-415c-a911-4b688f58ffc3" (UID: "9afc43e8-1aeb-415c-a911-4b688f58ffc3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 14:15:08.887541 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:08.887520    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9afc43e8-1aeb-415c-a911-4b688f58ffc3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9afc43e8-1aeb-415c-a911-4b688f58ffc3" (UID: "9afc43e8-1aeb-415c-a911-4b688f58ffc3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 14:15:08.887999 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:08.887976    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9afc43e8-1aeb-415c-a911-4b688f58ffc3-kube-api-access-t7lsm" (OuterVolumeSpecName: "kube-api-access-t7lsm") pod "9afc43e8-1aeb-415c-a911-4b688f58ffc3" (UID: "9afc43e8-1aeb-415c-a911-4b688f58ffc3"). InnerVolumeSpecName "kube-api-access-t7lsm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 14:15:08.887999 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:08.887981    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9afc43e8-1aeb-415c-a911-4b688f58ffc3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9afc43e8-1aeb-415c-a911-4b688f58ffc3" (UID: "9afc43e8-1aeb-415c-a911-4b688f58ffc3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 14:15:08.986981 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:08.986940    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9afc43e8-1aeb-415c-a911-4b688f58ffc3-istiod-ca-cert\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:15:08.986981 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:08.986973    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t7lsm\" (UniqueName: \"kubernetes.io/projected/9afc43e8-1aeb-415c-a911-4b688f58ffc3-kube-api-access-t7lsm\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:15:08.986981 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:08.986985    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9afc43e8-1aeb-415c-a911-4b688f58ffc3-istio-envoy\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:15:08.987256 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:08.986994    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9afc43e8-1aeb-415c-a911-4b688f58ffc3-istio-token\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:15:08.987256 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:08.987004    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9afc43e8-1aeb-415c-a911-4b688f58ffc3-istio-podinfo\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:15:09.710306 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:09.710263    2578 generic.go:356] "Generic (PLEG): container finished" podID="9afc43e8-1aeb-415c-a911-4b688f58ffc3" containerID="45599cf2e1bbd43703a4be571cd4e056dd755d91fc06124a929f14daa1675baa" exitCode=0
Sep 15 14:15:09.710473 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:09.710315    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-e50cdb-openshift-default-6c4c7d6cf6-fpf2d"
Sep 15 14:15:09.710473 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:09.710342    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-e50cdb-openshift-default-6c4c7d6cf6-fpf2d" event={"ID":"9afc43e8-1aeb-415c-a911-4b688f58ffc3","Type":"ContainerDied","Data":"45599cf2e1bbd43703a4be571cd4e056dd755d91fc06124a929f14daa1675baa"}
Sep 15 14:15:09.710473 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:09.710397    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-e50cdb-openshift-default-6c4c7d6cf6-fpf2d" event={"ID":"9afc43e8-1aeb-415c-a911-4b688f58ffc3","Type":"ContainerDied","Data":"cad15fea821de98d7265e881ba7a773a0cd30754daf0057a09e642248942551f"}
Sep 15 14:15:09.710473 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:09.710419    2578 scope.go:117] "RemoveContainer" containerID="45599cf2e1bbd43703a4be571cd4e056dd755d91fc06124a929f14daa1675baa"
Sep 15 14:15:09.720737 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:09.720715    2578 scope.go:117] "RemoveContainer" containerID="7a2849246d1734630724b71838a1885019a0bbdceb4d4b710b9fe1f0ebcb0d87"
Sep 15 14:15:09.729300 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:09.729280    2578 scope.go:117] "RemoveContainer" containerID="45599cf2e1bbd43703a4be571cd4e056dd755d91fc06124a929f14daa1675baa"
Sep 15 14:15:09.729589 ip-10-0-128-41 kubenswrapper[2578]: E0915 14:15:09.729571    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45599cf2e1bbd43703a4be571cd4e056dd755d91fc06124a929f14daa1675baa\": container with ID starting with 45599cf2e1bbd43703a4be571cd4e056dd755d91fc06124a929f14daa1675baa not found: ID does not exist" containerID="45599cf2e1bbd43703a4be571cd4e056dd755d91fc06124a929f14daa1675baa"
Sep 15 14:15:09.729670 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:09.729601    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45599cf2e1bbd43703a4be571cd4e056dd755d91fc06124a929f14daa1675baa"} err="failed to get container status \"45599cf2e1bbd43703a4be571cd4e056dd755d91fc06124a929f14daa1675baa\": rpc error: code = NotFound desc = could not find container \"45599cf2e1bbd43703a4be571cd4e056dd755d91fc06124a929f14daa1675baa\": container with ID starting with 45599cf2e1bbd43703a4be571cd4e056dd755d91fc06124a929f14daa1675baa not found: ID does not exist"
Sep 15 14:15:09.729670 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:09.729624    2578 scope.go:117] "RemoveContainer" containerID="7a2849246d1734630724b71838a1885019a0bbdceb4d4b710b9fe1f0ebcb0d87"
Sep 15 14:15:09.729991 ip-10-0-128-41 kubenswrapper[2578]: E0915 14:15:09.729948    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a2849246d1734630724b71838a1885019a0bbdceb4d4b710b9fe1f0ebcb0d87\": container with ID starting with 7a2849246d1734630724b71838a1885019a0bbdceb4d4b710b9fe1f0ebcb0d87 not found: ID does not exist" containerID="7a2849246d1734630724b71838a1885019a0bbdceb4d4b710b9fe1f0ebcb0d87"
Sep 15 14:15:09.729991 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:09.729982    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a2849246d1734630724b71838a1885019a0bbdceb4d4b710b9fe1f0ebcb0d87"} err="failed to get container status \"7a2849246d1734630724b71838a1885019a0bbdceb4d4b710b9fe1f0ebcb0d87\": rpc error: code = NotFound desc = could not find container \"7a2849246d1734630724b71838a1885019a0bbdceb4d4b710b9fe1f0ebcb0d87\": container with ID starting with 7a2849246d1734630724b71838a1885019a0bbdceb4d4b710b9fe1f0ebcb0d87 not found: ID does not exist"
Sep 15 14:15:09.733334 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:09.733310    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-e50cdb-openshift-default-6c4c7d6cf6-fpf2d"]
Sep 15 14:15:09.736965 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:09.736945    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-e50cdb-openshift-default-6c4c7d6cf6-fpf2d"]
Sep 15 14:15:09.758517 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:09.758490    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9afc43e8-1aeb-415c-a911-4b688f58ffc3" path="/var/lib/kubelet/pods/9afc43e8-1aeb-415c-a911-4b688f58ffc3/volumes"
Sep 15 14:15:15.371413 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:15.371371    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-583e9a-29824695-vr9xx"]
Sep 15 14:15:15.374612 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:15.374587    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-583e9a-29824695-vr9xx"]
Sep 15 14:15:15.395614 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:15.395586    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-583e9a-7854fbc79-vx72w"]
Sep 15 14:15:15.395864 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:15.395833    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-583e9a-7854fbc79-vx72w" podUID="a0904f8e-14aa-41ea-9574-82d95df0a62d" containerName="payload-processing" containerID="cri-o://4f1aa739761606b64b34ab26d9f80cd55d54d0875297233ea342c2bb7693b988" gracePeriod=30
Sep 15 14:15:15.403409 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:15.403248    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-583e9a-798555686-8vmrc"]
Sep 15 14:15:15.403840 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:15.403478    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-583e9a-798555686-8vmrc" podUID="b5653541-7ead-45de-830a-5b29b2989925" containerName="payload-pre-processing" containerID="cri-o://f342edd1c04d15d4c5d63c04c0f30408fec08bf2825fbeba80aef31613f67da6" gracePeriod=30
Sep 15 14:15:15.688324 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:15.688298    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-583e9a-7854fbc79-vx72w"
Sep 15 14:15:15.691352 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:15.691335    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-583e9a-798555686-8vmrc"
Sep 15 14:15:15.758252 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:15.758219    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rbpqp\" (UniqueName: \"kubernetes.io/projected/a0904f8e-14aa-41ea-9574-82d95df0a62d-kube-api-access-rbpqp\") pod \"a0904f8e-14aa-41ea-9574-82d95df0a62d\" (UID: \"a0904f8e-14aa-41ea-9574-82d95df0a62d\") "
Sep 15 14:15:15.758462 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:15.758314    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a0904f8e-14aa-41ea-9574-82d95df0a62d-plugins-config-volume\") pod \"a0904f8e-14aa-41ea-9574-82d95df0a62d\" (UID: \"a0904f8e-14aa-41ea-9574-82d95df0a62d\") "
Sep 15 14:15:15.758462 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:15.758368    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b5653541-7ead-45de-830a-5b29b2989925-plugins-config-volume\") pod \"b5653541-7ead-45de-830a-5b29b2989925\" (UID: \"b5653541-7ead-45de-830a-5b29b2989925\") "
Sep 15 14:15:15.758584 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:15.758496    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-594cj\" (UniqueName: \"kubernetes.io/projected/b5653541-7ead-45de-830a-5b29b2989925-kube-api-access-594cj\") pod \"b5653541-7ead-45de-830a-5b29b2989925\" (UID: \"b5653541-7ead-45de-830a-5b29b2989925\") "
Sep 15 14:15:15.759440 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:15.759211    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5653541-7ead-45de-830a-5b29b2989925-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b5653541-7ead-45de-830a-5b29b2989925" (UID: "b5653541-7ead-45de-830a-5b29b2989925"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 14:15:15.759440 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:15.759403    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a0904f8e-14aa-41ea-9574-82d95df0a62d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a0904f8e-14aa-41ea-9574-82d95df0a62d" (UID: "a0904f8e-14aa-41ea-9574-82d95df0a62d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 14:15:15.760528 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:15.760069    2578 generic.go:356] "Generic (PLEG): container finished" podID="a0904f8e-14aa-41ea-9574-82d95df0a62d" containerID="4f1aa739761606b64b34ab26d9f80cd55d54d0875297233ea342c2bb7693b988" exitCode=0
Sep 15 14:15:15.760528 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:15.760223    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-583e9a-7854fbc79-vx72w"
Sep 15 14:15:15.761510 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:15.761484    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0904f8e-14aa-41ea-9574-82d95df0a62d-kube-api-access-rbpqp" (OuterVolumeSpecName: "kube-api-access-rbpqp") pod "a0904f8e-14aa-41ea-9574-82d95df0a62d" (UID: "a0904f8e-14aa-41ea-9574-82d95df0a62d"). InnerVolumeSpecName "kube-api-access-rbpqp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 14:15:15.761808 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:15.761776    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5653541-7ead-45de-830a-5b29b2989925-kube-api-access-594cj" (OuterVolumeSpecName: "kube-api-access-594cj") pod "b5653541-7ead-45de-830a-5b29b2989925" (UID: "b5653541-7ead-45de-830a-5b29b2989925"). InnerVolumeSpecName "kube-api-access-594cj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 14:15:15.762817 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:15.762794    2578 generic.go:356] "Generic (PLEG): container finished" podID="b5653541-7ead-45de-830a-5b29b2989925" containerID="f342edd1c04d15d4c5d63c04c0f30408fec08bf2825fbeba80aef31613f67da6" exitCode=0
Sep 15 14:15:15.762929 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:15.762870    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-583e9a-798555686-8vmrc"
Sep 15 14:15:15.765265 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:15.765224    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5bf64b0b-19c7-4892-9408-edd6d9d16b03" path="/var/lib/kubelet/pods/5bf64b0b-19c7-4892-9408-edd6d9d16b03/volumes"
Sep 15 14:15:15.766015 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:15.765994    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-583e9a-7854fbc79-vx72w" event={"ID":"a0904f8e-14aa-41ea-9574-82d95df0a62d","Type":"ContainerDied","Data":"4f1aa739761606b64b34ab26d9f80cd55d54d0875297233ea342c2bb7693b988"}
Sep 15 14:15:15.770351 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:15.770326    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-583e9a-7854fbc79-vx72w" event={"ID":"a0904f8e-14aa-41ea-9574-82d95df0a62d","Type":"ContainerDied","Data":"dfea49843de06b98a829e9bdb2f099c83c37000a21660061c9b6ee6599a2e084"}
Sep 15 14:15:15.770455 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:15.770363    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-583e9a-798555686-8vmrc" event={"ID":"b5653541-7ead-45de-830a-5b29b2989925","Type":"ContainerDied","Data":"f342edd1c04d15d4c5d63c04c0f30408fec08bf2825fbeba80aef31613f67da6"}
Sep 15 14:15:15.770455 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:15.770390    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-583e9a-798555686-8vmrc" event={"ID":"b5653541-7ead-45de-830a-5b29b2989925","Type":"ContainerDied","Data":"a5d4760885dfb0a6f36614be7076eb31375a72e36b1df1d7ebe3fcf4cfda3ff4"}
Sep 15 14:15:15.770455 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:15.770397    2578 scope.go:117] "RemoveContainer" containerID="4f1aa739761606b64b34ab26d9f80cd55d54d0875297233ea342c2bb7693b988"
Sep 15 14:15:15.783453 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:15.783420    2578 scope.go:117] "RemoveContainer" containerID="4f1aa739761606b64b34ab26d9f80cd55d54d0875297233ea342c2bb7693b988"
Sep 15 14:15:15.783708 ip-10-0-128-41 kubenswrapper[2578]: E0915 14:15:15.783686    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f1aa739761606b64b34ab26d9f80cd55d54d0875297233ea342c2bb7693b988\": container with ID starting with 4f1aa739761606b64b34ab26d9f80cd55d54d0875297233ea342c2bb7693b988 not found: ID does not exist" containerID="4f1aa739761606b64b34ab26d9f80cd55d54d0875297233ea342c2bb7693b988"
Sep 15 14:15:15.783789 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:15.783711    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f1aa739761606b64b34ab26d9f80cd55d54d0875297233ea342c2bb7693b988"} err="failed to get container status \"4f1aa739761606b64b34ab26d9f80cd55d54d0875297233ea342c2bb7693b988\": rpc error: code = NotFound desc = could not find container \"4f1aa739761606b64b34ab26d9f80cd55d54d0875297233ea342c2bb7693b988\": container with ID starting with 4f1aa739761606b64b34ab26d9f80cd55d54d0875297233ea342c2bb7693b988 not found: ID does not exist"
Sep 15 14:15:15.783789 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:15.783728    2578 scope.go:117] "RemoveContainer" containerID="f342edd1c04d15d4c5d63c04c0f30408fec08bf2825fbeba80aef31613f67da6"
Sep 15 14:15:15.793199 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:15.793180    2578 scope.go:117] "RemoveContainer" containerID="f342edd1c04d15d4c5d63c04c0f30408fec08bf2825fbeba80aef31613f67da6"
Sep 15 14:15:15.793508 ip-10-0-128-41 kubenswrapper[2578]: E0915 14:15:15.793490    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f342edd1c04d15d4c5d63c04c0f30408fec08bf2825fbeba80aef31613f67da6\": container with ID starting with f342edd1c04d15d4c5d63c04c0f30408fec08bf2825fbeba80aef31613f67da6 not found: ID does not exist" containerID="f342edd1c04d15d4c5d63c04c0f30408fec08bf2825fbeba80aef31613f67da6"
Sep 15 14:15:15.793569 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:15.793514    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f342edd1c04d15d4c5d63c04c0f30408fec08bf2825fbeba80aef31613f67da6"} err="failed to get container status \"f342edd1c04d15d4c5d63c04c0f30408fec08bf2825fbeba80aef31613f67da6\": rpc error: code = NotFound desc = could not find container \"f342edd1c04d15d4c5d63c04c0f30408fec08bf2825fbeba80aef31613f67da6\": container with ID starting with f342edd1c04d15d4c5d63c04c0f30408fec08bf2825fbeba80aef31613f67da6 not found: ID does not exist"
Sep 15 14:15:15.860539 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:15.860511    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rbpqp\" (UniqueName: \"kubernetes.io/projected/a0904f8e-14aa-41ea-9574-82d95df0a62d-kube-api-access-rbpqp\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:15:15.860539 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:15.860536    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a0904f8e-14aa-41ea-9574-82d95df0a62d-plugins-config-volume\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:15:15.860752 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:15.860550    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b5653541-7ead-45de-830a-5b29b2989925-plugins-config-volume\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:15:15.860752 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:15.860564    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-594cj\" (UniqueName: \"kubernetes.io/projected/b5653541-7ead-45de-830a-5b29b2989925-kube-api-access-594cj\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:15:16.083013 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:16.082982    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-583e9a-7854fbc79-vx72w"]
Sep 15 14:15:16.085709 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:16.085686    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-583e9a-7854fbc79-vx72w"]
Sep 15 14:15:17.758377 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:17.758346    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a0904f8e-14aa-41ea-9574-82d95df0a62d" path="/var/lib/kubelet/pods/a0904f8e-14aa-41ea-9574-82d95df0a62d/volumes"
Sep 15 14:15:22.459012 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:22.458979    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-583e9a-openshift-default-5556fff988-9rrgj"]
Sep 15 14:15:22.459496 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:22.459246    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-583e9a-openshift-default-5556fff988-9rrgj" podUID="5df03f8b-f687-4a74-8784-082485d4807d" containerName="istio-proxy" containerID="cri-o://923ef4c9aeba475fc214940db26e2a397b76cc132689ac9a276efd6ebad5de0d" gracePeriod=30
Sep 15 14:15:22.823668 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:22.823627    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-4bb7b3-qdq2h"]
Sep 15 14:15:22.824012 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:22.823999    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbaac8ec-8147-4983-9c92-63efb4f1cd6f" containerName="cleanup"
Sep 15 14:15:22.824077 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:22.824013    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbaac8ec-8147-4983-9c92-63efb4f1cd6f" containerName="cleanup"
Sep 15 14:15:22.824077 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:22.824023    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ac73ffc-507f-4caf-9a81-14c5853978a3" containerName="cleanup"
Sep 15 14:15:22.824077 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:22.824028    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ac73ffc-507f-4caf-9a81-14c5853978a3" containerName="cleanup"
Sep 15 14:15:22.824077 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:22.824036    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5653541-7ead-45de-830a-5b29b2989925" containerName="payload-pre-processing"
Sep 15 14:15:22.824077 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:22.824042    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5653541-7ead-45de-830a-5b29b2989925" containerName="payload-pre-processing"
Sep 15 14:15:22.824077 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:22.824048    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9afc43e8-1aeb-415c-a911-4b688f58ffc3" containerName="istio-proxy"
Sep 15 14:15:22.824077 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:22.824053    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="9afc43e8-1aeb-415c-a911-4b688f58ffc3" containerName="istio-proxy"
Sep 15 14:15:22.824077 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:22.824060    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc908b90-c185-4e0b-9b5d-489c881a472d" containerName="cleanup"
Sep 15 14:15:22.824077 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:22.824064    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc908b90-c185-4e0b-9b5d-489c881a472d" containerName="cleanup"
Sep 15 14:15:22.824077 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:22.824075    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="482187c1-8b54-4748-96e7-2ae76a7a913e" containerName="cleanup"
Sep 15 14:15:22.824077 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:22.824080    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="482187c1-8b54-4748-96e7-2ae76a7a913e" containerName="cleanup"
Sep 15 14:15:22.824633 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:22.824087    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0904f8e-14aa-41ea-9574-82d95df0a62d" containerName="payload-processing"
Sep 15 14:15:22.824633 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:22.824092    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0904f8e-14aa-41ea-9574-82d95df0a62d" containerName="payload-processing"
Sep 15 14:15:22.824633 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:22.824098    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54576938-62ab-42da-b7df-e1d0a2126667" containerName="cleanup"
Sep 15 14:15:22.824633 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:22.824103    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="54576938-62ab-42da-b7df-e1d0a2126667" containerName="cleanup"
Sep 15 14:15:22.824633 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:22.824109    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9afc43e8-1aeb-415c-a911-4b688f58ffc3" containerName="istio-proxy"
Sep 15 14:15:22.824633 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:22.824114    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="9afc43e8-1aeb-415c-a911-4b688f58ffc3" containerName="istio-proxy"
Sep 15 14:15:22.824633 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:22.824137    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5bf64b0b-19c7-4892-9408-edd6d9d16b03" containerName="cleanup"
Sep 15 14:15:22.824633 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:22.824142    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5bf64b0b-19c7-4892-9408-edd6d9d16b03" containerName="cleanup"
Sep 15 14:15:22.824633 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:22.824199    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="54576938-62ab-42da-b7df-e1d0a2126667" containerName="cleanup"
Sep 15 14:15:22.824633 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:22.824208    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ac73ffc-507f-4caf-9a81-14c5853978a3" containerName="cleanup"
Sep 15 14:15:22.824633 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:22.824213    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="9afc43e8-1aeb-415c-a911-4b688f58ffc3" containerName="istio-proxy"
Sep 15 14:15:22.824633 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:22.824218    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="9afc43e8-1aeb-415c-a911-4b688f58ffc3" containerName="istio-proxy"
Sep 15 14:15:22.824633 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:22.824225    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="dbaac8ec-8147-4983-9c92-63efb4f1cd6f" containerName="cleanup"
Sep 15 14:15:22.824633 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:22.824230    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc908b90-c185-4e0b-9b5d-489c881a472d" containerName="cleanup"
Sep 15 14:15:22.824633 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:22.824236    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="5bf64b0b-19c7-4892-9408-edd6d9d16b03" containerName="cleanup"
Sep 15 14:15:22.824633 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:22.824241    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a0904f8e-14aa-41ea-9574-82d95df0a62d" containerName="payload-processing"
Sep 15 14:15:22.824633 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:22.824246    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5653541-7ead-45de-830a-5b29b2989925" containerName="payload-pre-processing"
Sep 15 14:15:22.824633 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:22.824251    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="482187c1-8b54-4748-96e7-2ae76a7a913e" containerName="cleanup"
Sep 15 14:15:22.827305 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:22.827289    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-4bb7b3-qdq2h"
Sep 15 14:15:22.831438 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:22.831414    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-4bb7b3-qdq2h"]
Sep 15 14:15:22.832270 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:22.832249    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 15 14:15:22.833146 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:22.833112    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qzmkv\""
Sep 15 14:15:22.833243 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:22.833207    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 14:15:22.923875 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:22.923835    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/22955483-5e9c-4985-af8a-6e6b45a301d1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-4bb7b3-qdq2h\" (UID: \"22955483-5e9c-4985-af8a-6e6b45a301d1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-4bb7b3-qdq2h"
Sep 15 14:15:22.924036 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:22.923884    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9wfc\" (UniqueName: \"kubernetes.io/projected/22955483-5e9c-4985-af8a-6e6b45a301d1-kube-api-access-x9wfc\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-4bb7b3-qdq2h\" (UID: \"22955483-5e9c-4985-af8a-6e6b45a301d1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-4bb7b3-qdq2h"
Sep 15 14:15:23.024819 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:23.024790    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/22955483-5e9c-4985-af8a-6e6b45a301d1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-4bb7b3-qdq2h\" (UID: \"22955483-5e9c-4985-af8a-6e6b45a301d1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-4bb7b3-qdq2h"
Sep 15 14:15:23.024981 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:23.024833    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9wfc\" (UniqueName: \"kubernetes.io/projected/22955483-5e9c-4985-af8a-6e6b45a301d1-kube-api-access-x9wfc\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-4bb7b3-qdq2h\" (UID: \"22955483-5e9c-4985-af8a-6e6b45a301d1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-4bb7b3-qdq2h"
Sep 15 14:15:23.025428 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:23.025404    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/22955483-5e9c-4985-af8a-6e6b45a301d1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-4bb7b3-qdq2h\" (UID: \"22955483-5e9c-4985-af8a-6e6b45a301d1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-4bb7b3-qdq2h"
Sep 15 14:15:23.034092 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:23.034072    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9wfc\" (UniqueName: \"kubernetes.io/projected/22955483-5e9c-4985-af8a-6e6b45a301d1-kube-api-access-x9wfc\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-4bb7b3-qdq2h\" (UID: \"22955483-5e9c-4985-af8a-6e6b45a301d1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-4bb7b3-qdq2h"
Sep 15 14:15:23.140887 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:23.140810    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-4bb7b3-qdq2h"
Sep 15 14:15:23.424705 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:23.424678    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-4bb7b3-qdq2h"]
Sep 15 14:15:23.426009 ip-10-0-128-41 kubenswrapper[2578]: W0915 14:15:23.425963    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22955483_5e9c_4985_af8a_6e6b45a301d1.slice/crio-40995ea455e6bf3846c1fd09432260fccea4d670865e6fa40477229f4ab43725 WatchSource:0}: Error finding container 40995ea455e6bf3846c1fd09432260fccea4d670865e6fa40477229f4ab43725: Status 404 returned error can't find the container with id 40995ea455e6bf3846c1fd09432260fccea4d670865e6fa40477229f4ab43725
Sep 15 14:15:23.813784 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:23.813743    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-4bb7b3-qdq2h" event={"ID":"22955483-5e9c-4985-af8a-6e6b45a301d1","Type":"ContainerStarted","Data":"afb25c7e7f70a871ff03e16555d8b0e2928536d5bf9476db111eba420fc5cc7b"}
Sep 15 14:15:23.814176 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:23.813806    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-4bb7b3-qdq2h" event={"ID":"22955483-5e9c-4985-af8a-6e6b45a301d1","Type":"ContainerStarted","Data":"40995ea455e6bf3846c1fd09432260fccea4d670865e6fa40477229f4ab43725"}
Sep 15 14:15:23.831453 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:23.831403    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-4bb7b3-qdq2h" podStartSLOduration=1.8313867350000002 podStartE2EDuration="1.831386735s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 14:15:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 14:15:23.829367506 +0000 UTC m=+2210.588493796" watchObservedRunningTime="2026-09-15 14:15:23.831386735 +0000 UTC m=+2210.590513018"
Sep 15 14:15:24.820948 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:24.820912    2578 generic.go:356] "Generic (PLEG): container finished" podID="22955483-5e9c-4985-af8a-6e6b45a301d1" containerID="afb25c7e7f70a871ff03e16555d8b0e2928536d5bf9476db111eba420fc5cc7b" exitCode=0
Sep 15 14:15:24.821357 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:24.820998    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-4bb7b3-qdq2h" event={"ID":"22955483-5e9c-4985-af8a-6e6b45a301d1","Type":"ContainerDied","Data":"afb25c7e7f70a871ff03e16555d8b0e2928536d5bf9476db111eba420fc5cc7b"}
Sep 15 14:15:25.956718 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:25.956691    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-4bb7b3-qdq2h"
Sep 15 14:15:26.057880 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:26.057846    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x9wfc\" (UniqueName: \"kubernetes.io/projected/22955483-5e9c-4985-af8a-6e6b45a301d1-kube-api-access-x9wfc\") pod \"22955483-5e9c-4985-af8a-6e6b45a301d1\" (UID: \"22955483-5e9c-4985-af8a-6e6b45a301d1\") "
Sep 15 14:15:26.058073 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:26.057941    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/22955483-5e9c-4985-af8a-6e6b45a301d1-maas-api-service-ca\") pod \"22955483-5e9c-4985-af8a-6e6b45a301d1\" (UID: \"22955483-5e9c-4985-af8a-6e6b45a301d1\") "
Sep 15 14:15:26.058330 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:26.058307    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/22955483-5e9c-4985-af8a-6e6b45a301d1-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "22955483-5e9c-4985-af8a-6e6b45a301d1" (UID: "22955483-5e9c-4985-af8a-6e6b45a301d1"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 14:15:26.060027 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:26.060007    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22955483-5e9c-4985-af8a-6e6b45a301d1-kube-api-access-x9wfc" (OuterVolumeSpecName: "kube-api-access-x9wfc") pod "22955483-5e9c-4985-af8a-6e6b45a301d1" (UID: "22955483-5e9c-4985-af8a-6e6b45a301d1"). InnerVolumeSpecName "kube-api-access-x9wfc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 14:15:26.159492 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:26.159415    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x9wfc\" (UniqueName: \"kubernetes.io/projected/22955483-5e9c-4985-af8a-6e6b45a301d1-kube-api-access-x9wfc\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:15:26.159492 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:26.159442    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/22955483-5e9c-4985-af8a-6e6b45a301d1-maas-api-service-ca\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:15:26.835383 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:26.835352    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-4bb7b3-qdq2h"
Sep 15 14:15:26.835556 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:26.835393    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-4bb7b3-qdq2h" event={"ID":"22955483-5e9c-4985-af8a-6e6b45a301d1","Type":"ContainerDied","Data":"40995ea455e6bf3846c1fd09432260fccea4d670865e6fa40477229f4ab43725"}
Sep 15 14:15:26.835556 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:26.835442    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="40995ea455e6bf3846c1fd09432260fccea4d670865e6fa40477229f4ab43725"
Sep 15 14:15:27.710258 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:27.710234    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-583e9a-openshift-default-5556fff988-9rrgj"
Sep 15 14:15:27.772967 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:27.772889    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5df03f8b-f687-4a74-8784-082485d4807d-istio-token\") pod \"5df03f8b-f687-4a74-8784-082485d4807d\" (UID: \"5df03f8b-f687-4a74-8784-082485d4807d\") "
Sep 15 14:15:27.772967 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:27.772931    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5df03f8b-f687-4a74-8784-082485d4807d-istio-podinfo\") pod \"5df03f8b-f687-4a74-8784-082485d4807d\" (UID: \"5df03f8b-f687-4a74-8784-082485d4807d\") "
Sep 15 14:15:27.773196 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:27.772974    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5df03f8b-f687-4a74-8784-082485d4807d-workload-socket\") pod \"5df03f8b-f687-4a74-8784-082485d4807d\" (UID: \"5df03f8b-f687-4a74-8784-082485d4807d\") "
Sep 15 14:15:27.773196 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:27.773004    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5df03f8b-f687-4a74-8784-082485d4807d-credential-socket\") pod \"5df03f8b-f687-4a74-8784-082485d4807d\" (UID: \"5df03f8b-f687-4a74-8784-082485d4807d\") "
Sep 15 14:15:27.773196 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:27.773031    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5df03f8b-f687-4a74-8784-082485d4807d-istio-data\") pod \"5df03f8b-f687-4a74-8784-082485d4807d\" (UID: \"5df03f8b-f687-4a74-8784-082485d4807d\") "
Sep 15 14:15:27.773196 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:27.773055    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5df03f8b-f687-4a74-8784-082485d4807d-istio-envoy\") pod \"5df03f8b-f687-4a74-8784-082485d4807d\" (UID: \"5df03f8b-f687-4a74-8784-082485d4807d\") "
Sep 15 14:15:27.773196 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:27.773164    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5df03f8b-f687-4a74-8784-082485d4807d-workload-certs\") pod \"5df03f8b-f687-4a74-8784-082485d4807d\" (UID: \"5df03f8b-f687-4a74-8784-082485d4807d\") "
Sep 15 14:15:27.773462 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:27.773208    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xbpwz\" (UniqueName: \"kubernetes.io/projected/5df03f8b-f687-4a74-8784-082485d4807d-kube-api-access-xbpwz\") pod \"5df03f8b-f687-4a74-8784-082485d4807d\" (UID: \"5df03f8b-f687-4a74-8784-082485d4807d\") "
Sep 15 14:15:27.773462 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:27.773240    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5df03f8b-f687-4a74-8784-082485d4807d-istiod-ca-cert\") pod \"5df03f8b-f687-4a74-8784-082485d4807d\" (UID: \"5df03f8b-f687-4a74-8784-082485d4807d\") "
Sep 15 14:15:27.773462 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:27.773323    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5df03f8b-f687-4a74-8784-082485d4807d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5df03f8b-f687-4a74-8784-082485d4807d" (UID: "5df03f8b-f687-4a74-8784-082485d4807d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 14:15:27.773462 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:27.773336    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5df03f8b-f687-4a74-8784-082485d4807d-istio-data" (OuterVolumeSpecName: "istio-data") pod "5df03f8b-f687-4a74-8784-082485d4807d" (UID: "5df03f8b-f687-4a74-8784-082485d4807d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 14:15:27.773462 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:27.773354    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5df03f8b-f687-4a74-8784-082485d4807d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5df03f8b-f687-4a74-8784-082485d4807d" (UID: "5df03f8b-f687-4a74-8784-082485d4807d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 14:15:27.773693 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:27.773628    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5df03f8b-f687-4a74-8784-082485d4807d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5df03f8b-f687-4a74-8784-082485d4807d" (UID: "5df03f8b-f687-4a74-8784-082485d4807d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 14:15:27.773693 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:27.773668    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5df03f8b-f687-4a74-8784-082485d4807d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5df03f8b-f687-4a74-8784-082485d4807d" (UID: "5df03f8b-f687-4a74-8784-082485d4807d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 14:15:27.773693 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:27.773674    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5df03f8b-f687-4a74-8784-082485d4807d-workload-socket\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:15:27.773815 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:27.773710    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5df03f8b-f687-4a74-8784-082485d4807d-credential-socket\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:15:27.773815 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:27.773726    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5df03f8b-f687-4a74-8784-082485d4807d-istio-data\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:15:27.775530 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:27.775504    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5df03f8b-f687-4a74-8784-082485d4807d-istio-token" (OuterVolumeSpecName: "istio-token") pod "5df03f8b-f687-4a74-8784-082485d4807d" (UID: "5df03f8b-f687-4a74-8784-082485d4807d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 14:15:27.775632 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:27.775531    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5df03f8b-f687-4a74-8784-082485d4807d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5df03f8b-f687-4a74-8784-082485d4807d" (UID: "5df03f8b-f687-4a74-8784-082485d4807d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 14:15:27.775976 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:27.775955    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5df03f8b-f687-4a74-8784-082485d4807d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5df03f8b-f687-4a74-8784-082485d4807d" (UID: "5df03f8b-f687-4a74-8784-082485d4807d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 14:15:27.776024 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:27.775965    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5df03f8b-f687-4a74-8784-082485d4807d-kube-api-access-xbpwz" (OuterVolumeSpecName: "kube-api-access-xbpwz") pod "5df03f8b-f687-4a74-8784-082485d4807d" (UID: "5df03f8b-f687-4a74-8784-082485d4807d"). InnerVolumeSpecName "kube-api-access-xbpwz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 14:15:27.843307 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:27.843276    2578 generic.go:356] "Generic (PLEG): container finished" podID="5df03f8b-f687-4a74-8784-082485d4807d" containerID="923ef4c9aeba475fc214940db26e2a397b76cc132689ac9a276efd6ebad5de0d" exitCode=0
Sep 15 14:15:27.843471 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:27.843337    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-583e9a-openshift-default-5556fff988-9rrgj" event={"ID":"5df03f8b-f687-4a74-8784-082485d4807d","Type":"ContainerDied","Data":"923ef4c9aeba475fc214940db26e2a397b76cc132689ac9a276efd6ebad5de0d"}
Sep 15 14:15:27.843471 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:27.843381    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-583e9a-openshift-default-5556fff988-9rrgj" event={"ID":"5df03f8b-f687-4a74-8784-082485d4807d","Type":"ContainerDied","Data":"e4e2cedba7e7f617797363947f6830e9e4f9629b3fe4d1f1428ddbbb92f31bdf"}
Sep 15 14:15:27.843471 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:27.843401    2578 scope.go:117] "RemoveContainer" containerID="923ef4c9aeba475fc214940db26e2a397b76cc132689ac9a276efd6ebad5de0d"
Sep 15 14:15:27.843471 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:27.843337    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-583e9a-openshift-default-5556fff988-9rrgj"
Sep 15 14:15:27.854228 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:27.854212    2578 scope.go:117] "RemoveContainer" containerID="7accb0ccc26f1b8368708e1335107b6c966ca7770667069507f7a65668198d0d"
Sep 15 14:15:27.863105 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:27.863086    2578 scope.go:117] "RemoveContainer" containerID="923ef4c9aeba475fc214940db26e2a397b76cc132689ac9a276efd6ebad5de0d"
Sep 15 14:15:27.863458 ip-10-0-128-41 kubenswrapper[2578]: E0915 14:15:27.863436    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"923ef4c9aeba475fc214940db26e2a397b76cc132689ac9a276efd6ebad5de0d\": container with ID starting with 923ef4c9aeba475fc214940db26e2a397b76cc132689ac9a276efd6ebad5de0d not found: ID does not exist" containerID="923ef4c9aeba475fc214940db26e2a397b76cc132689ac9a276efd6ebad5de0d"
Sep 15 14:15:27.863544 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:27.863465    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"923ef4c9aeba475fc214940db26e2a397b76cc132689ac9a276efd6ebad5de0d"} err="failed to get container status \"923ef4c9aeba475fc214940db26e2a397b76cc132689ac9a276efd6ebad5de0d\": rpc error: code = NotFound desc = could not find container \"923ef4c9aeba475fc214940db26e2a397b76cc132689ac9a276efd6ebad5de0d\": container with ID starting with 923ef4c9aeba475fc214940db26e2a397b76cc132689ac9a276efd6ebad5de0d not found: ID does not exist"
Sep 15 14:15:27.863544 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:27.863483    2578 scope.go:117] "RemoveContainer" containerID="7accb0ccc26f1b8368708e1335107b6c966ca7770667069507f7a65668198d0d"
Sep 15 14:15:27.863733 ip-10-0-128-41 kubenswrapper[2578]: E0915 14:15:27.863717    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7accb0ccc26f1b8368708e1335107b6c966ca7770667069507f7a65668198d0d\": container with ID starting with 7accb0ccc26f1b8368708e1335107b6c966ca7770667069507f7a65668198d0d not found: ID does not exist" containerID="7accb0ccc26f1b8368708e1335107b6c966ca7770667069507f7a65668198d0d"
Sep 15 14:15:27.863776 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:27.863737    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7accb0ccc26f1b8368708e1335107b6c966ca7770667069507f7a65668198d0d"} err="failed to get container status \"7accb0ccc26f1b8368708e1335107b6c966ca7770667069507f7a65668198d0d\": rpc error: code = NotFound desc = could not find container \"7accb0ccc26f1b8368708e1335107b6c966ca7770667069507f7a65668198d0d\": container with ID starting with 7accb0ccc26f1b8368708e1335107b6c966ca7770667069507f7a65668198d0d not found: ID does not exist"
Sep 15 14:15:27.866426 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:27.866406    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-583e9a-openshift-default-5556fff988-9rrgj"]
Sep 15 14:15:27.872353 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:27.872332    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-583e9a-openshift-default-5556fff988-9rrgj"]
Sep 15 14:15:27.874924 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:27.874898    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5df03f8b-f687-4a74-8784-082485d4807d-istio-podinfo\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:15:27.875027 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:27.874929    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5df03f8b-f687-4a74-8784-082485d4807d-istio-envoy\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:15:27.875027 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:27.874943    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5df03f8b-f687-4a74-8784-082485d4807d-workload-certs\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:15:27.875027 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:27.874962    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xbpwz\" (UniqueName: \"kubernetes.io/projected/5df03f8b-f687-4a74-8784-082485d4807d-kube-api-access-xbpwz\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:15:27.875027 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:27.874976    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5df03f8b-f687-4a74-8784-082485d4807d-istiod-ca-cert\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:15:27.875027 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:27.874990    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5df03f8b-f687-4a74-8784-082485d4807d-istio-token\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:15:29.758521 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:29.758489    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5df03f8b-f687-4a74-8784-082485d4807d" path="/var/lib/kubelet/pods/5df03f8b-f687-4a74-8784-082485d4807d/volumes"
Sep 15 14:15:33.564569 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:33.564535    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-4bb7b3-29824695-g2wt2"]
Sep 15 14:15:33.570112 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:33.570086    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-4bb7b3-29824695-g2wt2"]
Sep 15 14:15:33.760170 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:33.759274    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="482187c1-8b54-4748-96e7-2ae76a7a913e" path="/var/lib/kubelet/pods/482187c1-8b54-4748-96e7-2ae76a7a913e/volumes"
Sep 15 14:15:33.769359 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:33.769327    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-4bb7b3-qdq2h"]
Sep 15 14:15:33.771879 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:33.771855    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-4bb7b3-qdq2h"]
Sep 15 14:15:35.758250 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:35.758219    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="22955483-5e9c-4985-af8a-6e6b45a301d1" path="/var/lib/kubelet/pods/22955483-5e9c-4985-af8a-6e6b45a301d1/volumes"
Sep 15 14:15:40.875951 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:40.875917    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd-9cwtb"]
Sep 15 14:15:40.876455 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:40.876115    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd-9cwtb" podUID="2f52deba-0572-46ea-a401-4c8e1165767b" containerName="istio-proxy" containerID="cri-o://12153200d16a213d85c6aa1865deb47ddf3a97e0cc39f6fcb2474d2a46ab4a2c" gracePeriod=30
Sep 15 14:15:41.015216 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:41.015175    2578 patch_prober.go:28] interesting pod/e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd-9cwtb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 15 14:15:41.015372 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:41.015258    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd-9cwtb" podUID="2f52deba-0572-46ea-a401-4c8e1165767b" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 15 14:15:45.776426 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:45.776366    2578 pod_container_manager_linux.go:217] "Failed to delete cgroup paths" cgroupName=["kubepods","burstable","podb5653541-7ead-45de-830a-5b29b2989925"] err="unable to destroy cgroup paths for cgroup [kubepods burstable podb5653541-7ead-45de-830a-5b29b2989925] : Timed out while waiting for systemd to remove kubepods-burstable-podb5653541_7ead_45de_830a_5b29b2989925.slice"
Sep 15 14:15:45.776850 ip-10-0-128-41 kubenswrapper[2578]: E0915 14:15:45.776429    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to delete cgroup paths for [kubepods burstable podb5653541-7ead-45de-830a-5b29b2989925] : unable to destroy cgroup paths for cgroup [kubepods burstable podb5653541-7ead-45de-830a-5b29b2989925] : Timed out while waiting for systemd to remove kubepods-burstable-podb5653541_7ead_45de_830a_5b29b2989925.slice" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-583e9a-798555686-8vmrc" podUID="b5653541-7ead-45de-830a-5b29b2989925"
Sep 15 14:15:45.952373 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:45.952327    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-583e9a-798555686-8vmrc"
Sep 15 14:15:45.980455 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:45.980428    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-583e9a-798555686-8vmrc"]
Sep 15 14:15:45.985023 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:45.984988    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-583e9a-798555686-8vmrc"]
Sep 15 14:15:46.133574 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:46.133550    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd-9cwtb"
Sep 15 14:15:46.135628 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:46.135610    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f52deba-0572-46ea-a401-4c8e1165767b-workload-socket\") pod \"2f52deba-0572-46ea-a401-4c8e1165767b\" (UID: \"2f52deba-0572-46ea-a401-4c8e1165767b\") "
Sep 15 14:15:46.135689 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:46.135642    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mzcdd\" (UniqueName: \"kubernetes.io/projected/2f52deba-0572-46ea-a401-4c8e1165767b-kube-api-access-mzcdd\") pod \"2f52deba-0572-46ea-a401-4c8e1165767b\" (UID: \"2f52deba-0572-46ea-a401-4c8e1165767b\") "
Sep 15 14:15:46.135689 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:46.135676    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2f52deba-0572-46ea-a401-4c8e1165767b-istio-podinfo\") pod \"2f52deba-0572-46ea-a401-4c8e1165767b\" (UID: \"2f52deba-0572-46ea-a401-4c8e1165767b\") "
Sep 15 14:15:46.135790 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:46.135699    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2f52deba-0572-46ea-a401-4c8e1165767b-workload-certs\") pod \"2f52deba-0572-46ea-a401-4c8e1165767b\" (UID: \"2f52deba-0572-46ea-a401-4c8e1165767b\") "
Sep 15 14:15:46.135790 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:46.135745    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f52deba-0572-46ea-a401-4c8e1165767b-credential-socket\") pod \"2f52deba-0572-46ea-a401-4c8e1165767b\" (UID: \"2f52deba-0572-46ea-a401-4c8e1165767b\") "
Sep 15 14:15:46.135891 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:46.135790    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2f52deba-0572-46ea-a401-4c8e1165767b-istio-token\") pod \"2f52deba-0572-46ea-a401-4c8e1165767b\" (UID: \"2f52deba-0572-46ea-a401-4c8e1165767b\") "
Sep 15 14:15:46.135891 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:46.135829    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2f52deba-0572-46ea-a401-4c8e1165767b-istiod-ca-cert\") pod \"2f52deba-0572-46ea-a401-4c8e1165767b\" (UID: \"2f52deba-0572-46ea-a401-4c8e1165767b\") "
Sep 15 14:15:46.135891 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:46.135868    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2f52deba-0572-46ea-a401-4c8e1165767b-istio-envoy\") pod \"2f52deba-0572-46ea-a401-4c8e1165767b\" (UID: \"2f52deba-0572-46ea-a401-4c8e1165767b\") "
Sep 15 14:15:46.135891 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:46.135867    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f52deba-0572-46ea-a401-4c8e1165767b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2f52deba-0572-46ea-a401-4c8e1165767b" (UID: "2f52deba-0572-46ea-a401-4c8e1165767b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 14:15:46.136100 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:46.135903    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2f52deba-0572-46ea-a401-4c8e1165767b-istio-data\") pod \"2f52deba-0572-46ea-a401-4c8e1165767b\" (UID: \"2f52deba-0572-46ea-a401-4c8e1165767b\") "
Sep 15 14:15:46.136100 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:46.136021    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f52deba-0572-46ea-a401-4c8e1165767b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2f52deba-0572-46ea-a401-4c8e1165767b" (UID: "2f52deba-0572-46ea-a401-4c8e1165767b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 14:15:46.136245 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:46.136229    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f52deba-0572-46ea-a401-4c8e1165767b-istio-data" (OuterVolumeSpecName: "istio-data") pod "2f52deba-0572-46ea-a401-4c8e1165767b" (UID: "2f52deba-0572-46ea-a401-4c8e1165767b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 14:15:46.136309 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:46.136291    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f52deba-0572-46ea-a401-4c8e1165767b-workload-socket\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:15:46.136367 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:46.136312    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2f52deba-0572-46ea-a401-4c8e1165767b-workload-certs\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:15:46.136367 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:46.136358    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f52deba-0572-46ea-a401-4c8e1165767b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2f52deba-0572-46ea-a401-4c8e1165767b" (UID: "2f52deba-0572-46ea-a401-4c8e1165767b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 14:15:46.136478 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:46.136394    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f52deba-0572-46ea-a401-4c8e1165767b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2f52deba-0572-46ea-a401-4c8e1165767b" (UID: "2f52deba-0572-46ea-a401-4c8e1165767b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 14:15:46.138205 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:46.138174    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f52deba-0572-46ea-a401-4c8e1165767b-kube-api-access-mzcdd" (OuterVolumeSpecName: "kube-api-access-mzcdd") pod "2f52deba-0572-46ea-a401-4c8e1165767b" (UID: "2f52deba-0572-46ea-a401-4c8e1165767b"). InnerVolumeSpecName "kube-api-access-mzcdd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 14:15:46.138320 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:46.138277    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f52deba-0572-46ea-a401-4c8e1165767b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2f52deba-0572-46ea-a401-4c8e1165767b" (UID: "2f52deba-0572-46ea-a401-4c8e1165767b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 14:15:46.138374 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:46.138350    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2f52deba-0572-46ea-a401-4c8e1165767b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2f52deba-0572-46ea-a401-4c8e1165767b" (UID: "2f52deba-0572-46ea-a401-4c8e1165767b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 14:15:46.138470 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:46.138452    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f52deba-0572-46ea-a401-4c8e1165767b-istio-token" (OuterVolumeSpecName: "istio-token") pod "2f52deba-0572-46ea-a401-4c8e1165767b" (UID: "2f52deba-0572-46ea-a401-4c8e1165767b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 14:15:46.236755 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:46.236720    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2f52deba-0572-46ea-a401-4c8e1165767b-istio-podinfo\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:15:46.236755 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:46.236748    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f52deba-0572-46ea-a401-4c8e1165767b-credential-socket\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:15:46.236755 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:46.236761    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2f52deba-0572-46ea-a401-4c8e1165767b-istio-token\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:15:46.236989 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:46.236772    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2f52deba-0572-46ea-a401-4c8e1165767b-istiod-ca-cert\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:15:46.236989 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:46.236783    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2f52deba-0572-46ea-a401-4c8e1165767b-istio-envoy\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:15:46.236989 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:46.236793    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2f52deba-0572-46ea-a401-4c8e1165767b-istio-data\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:15:46.236989 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:46.236804    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mzcdd\" (UniqueName: \"kubernetes.io/projected/2f52deba-0572-46ea-a401-4c8e1165767b-kube-api-access-mzcdd\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:15:46.961390 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:46.961352    2578 generic.go:356] "Generic (PLEG): container finished" podID="2f52deba-0572-46ea-a401-4c8e1165767b" containerID="12153200d16a213d85c6aa1865deb47ddf3a97e0cc39f6fcb2474d2a46ab4a2c" exitCode=0
Sep 15 14:15:46.961809 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:46.961412    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd-9cwtb"
Sep 15 14:15:46.961809 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:46.961451    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd-9cwtb" event={"ID":"2f52deba-0572-46ea-a401-4c8e1165767b","Type":"ContainerDied","Data":"12153200d16a213d85c6aa1865deb47ddf3a97e0cc39f6fcb2474d2a46ab4a2c"}
Sep 15 14:15:46.961809 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:46.961509    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd-9cwtb" event={"ID":"2f52deba-0572-46ea-a401-4c8e1165767b","Type":"ContainerDied","Data":"d64be834ccc0912eb951344f18f31eb0888af0a8cce83f21eb14b73da0a188b5"}
Sep 15 14:15:46.961809 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:46.961539    2578 scope.go:117] "RemoveContainer" containerID="12153200d16a213d85c6aa1865deb47ddf3a97e0cc39f6fcb2474d2a46ab4a2c"
Sep 15 14:15:46.971633 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:46.971617    2578 scope.go:117] "RemoveContainer" containerID="e9bcb22ed6ff4c10325c40ac0beb040b036bb39674bea1ff974cf75f9062707a"
Sep 15 14:15:46.979852 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:46.979833    2578 scope.go:117] "RemoveContainer" containerID="12153200d16a213d85c6aa1865deb47ddf3a97e0cc39f6fcb2474d2a46ab4a2c"
Sep 15 14:15:46.980753 ip-10-0-128-41 kubenswrapper[2578]: E0915 14:15:46.980234    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"12153200d16a213d85c6aa1865deb47ddf3a97e0cc39f6fcb2474d2a46ab4a2c\": container with ID starting with 12153200d16a213d85c6aa1865deb47ddf3a97e0cc39f6fcb2474d2a46ab4a2c not found: ID does not exist" containerID="12153200d16a213d85c6aa1865deb47ddf3a97e0cc39f6fcb2474d2a46ab4a2c"
Sep 15 14:15:46.980849 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:46.980773    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12153200d16a213d85c6aa1865deb47ddf3a97e0cc39f6fcb2474d2a46ab4a2c"} err="failed to get container status \"12153200d16a213d85c6aa1865deb47ddf3a97e0cc39f6fcb2474d2a46ab4a2c\": rpc error: code = NotFound desc = could not find container \"12153200d16a213d85c6aa1865deb47ddf3a97e0cc39f6fcb2474d2a46ab4a2c\": container with ID starting with 12153200d16a213d85c6aa1865deb47ddf3a97e0cc39f6fcb2474d2a46ab4a2c not found: ID does not exist"
Sep 15 14:15:46.980849 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:46.980802    2578 scope.go:117] "RemoveContainer" containerID="e9bcb22ed6ff4c10325c40ac0beb040b036bb39674bea1ff974cf75f9062707a"
Sep 15 14:15:46.981112 ip-10-0-128-41 kubenswrapper[2578]: E0915 14:15:46.981094    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9bcb22ed6ff4c10325c40ac0beb040b036bb39674bea1ff974cf75f9062707a\": container with ID starting with e9bcb22ed6ff4c10325c40ac0beb040b036bb39674bea1ff974cf75f9062707a not found: ID does not exist" containerID="e9bcb22ed6ff4c10325c40ac0beb040b036bb39674bea1ff974cf75f9062707a"
Sep 15 14:15:46.981215 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:46.981190    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9bcb22ed6ff4c10325c40ac0beb040b036bb39674bea1ff974cf75f9062707a"} err="failed to get container status \"e9bcb22ed6ff4c10325c40ac0beb040b036bb39674bea1ff974cf75f9062707a\": rpc error: code = NotFound desc = could not find container \"e9bcb22ed6ff4c10325c40ac0beb040b036bb39674bea1ff974cf75f9062707a\": container with ID starting with e9bcb22ed6ff4c10325c40ac0beb040b036bb39674bea1ff974cf75f9062707a not found: ID does not exist"
Sep 15 14:15:46.983361 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:46.983344    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd-9cwtb"]
Sep 15 14:15:46.987857 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:46.987837    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd-9cwtb"]
Sep 15 14:15:47.759774 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:47.759739    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f52deba-0572-46ea-a401-4c8e1165767b" path="/var/lib/kubelet/pods/2f52deba-0572-46ea-a401-4c8e1165767b/volumes"
Sep 15 14:15:47.760111 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:15:47.760097    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b5653541-7ead-45de-830a-5b29b2989925" path="/var/lib/kubelet/pods/b5653541-7ead-45de-830a-5b29b2989925/volumes"
Sep 15 14:20:34.413444 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:20:34.413361    2578 scope.go:117] "RemoveContainer" containerID="6b68040f9a522a899471f97f7ae5a3b8515a78fd8ded9ec60d6a54e39e36911f"
Sep 15 14:21:34.435090 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:21:34.435054    2578 scope.go:117] "RemoveContainer" containerID="1ab9e6b4103b2224820c04edce692362a74a6e498eaed7aeb06ab45674adcbe7"
Sep 15 14:21:34.444138 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:21:34.444103    2578 scope.go:117] "RemoveContainer" containerID="afb25c7e7f70a871ff03e16555d8b0e2928536d5bf9476db111eba420fc5cc7b"
Sep 15 14:21:34.452172 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:21:34.452154    2578 scope.go:117] "RemoveContainer" containerID="14d4802cbc5f24e4ff80dfb79ab037ac1c0712d128b8fb970abad690b0408937"
Sep 15 14:21:34.459941 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:21:34.459919    2578 scope.go:117] "RemoveContainer" containerID="84d0797ff28fda652f4a8a622fa5159f718d3c917c4d538e5512bcb424d78721"
Sep 15 14:25:30.460006 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:30.459933    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-a090a0-pd6js"]
Sep 15 14:25:30.460483 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:30.460309    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5df03f8b-f687-4a74-8784-082485d4807d" containerName="istio-proxy"
Sep 15 14:25:30.460483 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:30.460321    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5df03f8b-f687-4a74-8784-082485d4807d" containerName="istio-proxy"
Sep 15 14:25:30.460483 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:30.460330    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5df03f8b-f687-4a74-8784-082485d4807d" containerName="istio-proxy"
Sep 15 14:25:30.460483 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:30.460336    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5df03f8b-f687-4a74-8784-082485d4807d" containerName="istio-proxy"
Sep 15 14:25:30.460483 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:30.460345    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f52deba-0572-46ea-a401-4c8e1165767b" containerName="istio-proxy"
Sep 15 14:25:30.460483 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:30.460351    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f52deba-0572-46ea-a401-4c8e1165767b" containerName="istio-proxy"
Sep 15 14:25:30.460483 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:30.460359    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f52deba-0572-46ea-a401-4c8e1165767b" containerName="istio-proxy"
Sep 15 14:25:30.460483 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:30.460364    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f52deba-0572-46ea-a401-4c8e1165767b" containerName="istio-proxy"
Sep 15 14:25:30.460483 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:30.460380    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22955483-5e9c-4985-af8a-6e6b45a301d1" containerName="revoke-keys"
Sep 15 14:25:30.460483 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:30.460385    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="22955483-5e9c-4985-af8a-6e6b45a301d1" containerName="revoke-keys"
Sep 15 14:25:30.460483 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:30.460454    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f52deba-0572-46ea-a401-4c8e1165767b" containerName="istio-proxy"
Sep 15 14:25:30.460483 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:30.460462    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="5df03f8b-f687-4a74-8784-082485d4807d" containerName="istio-proxy"
Sep 15 14:25:30.460483 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:30.460468    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="5df03f8b-f687-4a74-8784-082485d4807d" containerName="istio-proxy"
Sep 15 14:25:30.460483 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:30.460474    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f52deba-0572-46ea-a401-4c8e1165767b" containerName="istio-proxy"
Sep 15 14:25:30.460483 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:30.460480    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="22955483-5e9c-4985-af8a-6e6b45a301d1" containerName="revoke-keys"
Sep 15 14:25:30.463530 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:30.463515    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-a090a0-pd6js"
Sep 15 14:25:30.465589 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:30.465572    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qzmkv\""
Sep 15 14:25:30.465679 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:30.465600    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 15 14:25:30.466254 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:30.466235    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 14:25:30.470931 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:30.470908    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-a090a0-pd6js"]
Sep 15 14:25:30.558474 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:30.558440    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/290c3566-71d0-4e5d-8e68-a0071bacd1f4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-a090a0-pd6js\" (UID: \"290c3566-71d0-4e5d-8e68-a0071bacd1f4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-a090a0-pd6js"
Sep 15 14:25:30.558652 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:30.558536    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2x4bl\" (UniqueName: \"kubernetes.io/projected/290c3566-71d0-4e5d-8e68-a0071bacd1f4-kube-api-access-2x4bl\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-a090a0-pd6js\" (UID: \"290c3566-71d0-4e5d-8e68-a0071bacd1f4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-a090a0-pd6js"
Sep 15 14:25:30.659810 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:30.659774    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/290c3566-71d0-4e5d-8e68-a0071bacd1f4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-a090a0-pd6js\" (UID: \"290c3566-71d0-4e5d-8e68-a0071bacd1f4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-a090a0-pd6js"
Sep 15 14:25:30.659997 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:30.659835    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2x4bl\" (UniqueName: \"kubernetes.io/projected/290c3566-71d0-4e5d-8e68-a0071bacd1f4-kube-api-access-2x4bl\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-a090a0-pd6js\" (UID: \"290c3566-71d0-4e5d-8e68-a0071bacd1f4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-a090a0-pd6js"
Sep 15 14:25:30.660505 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:30.660480    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/290c3566-71d0-4e5d-8e68-a0071bacd1f4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-a090a0-pd6js\" (UID: \"290c3566-71d0-4e5d-8e68-a0071bacd1f4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-a090a0-pd6js"
Sep 15 14:25:30.668026 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:30.668002    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2x4bl\" (UniqueName: \"kubernetes.io/projected/290c3566-71d0-4e5d-8e68-a0071bacd1f4-kube-api-access-2x4bl\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-a090a0-pd6js\" (UID: \"290c3566-71d0-4e5d-8e68-a0071bacd1f4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-a090a0-pd6js"
Sep 15 14:25:30.776179 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:30.776157    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-a090a0-pd6js"
Sep 15 14:25:31.049276 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:31.049247    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-a090a0-pd6js"]
Sep 15 14:25:31.050941 ip-10-0-128-41 kubenswrapper[2578]: W0915 14:25:31.050916    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod290c3566_71d0_4e5d_8e68_a0071bacd1f4.slice/crio-f1e7c67a89b8145af33a26fcfdb997b5ca953e4d82bac9c34979a6c07f707eb6 WatchSource:0}: Error finding container f1e7c67a89b8145af33a26fcfdb997b5ca953e4d82bac9c34979a6c07f707eb6: Status 404 returned error can't find the container with id f1e7c67a89b8145af33a26fcfdb997b5ca953e4d82bac9c34979a6c07f707eb6
Sep 15 14:25:31.287700 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:31.287671    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-a090a0-pd6js" event={"ID":"290c3566-71d0-4e5d-8e68-a0071bacd1f4","Type":"ContainerStarted","Data":"f1e7c67a89b8145af33a26fcfdb997b5ca953e4d82bac9c34979a6c07f707eb6"}
Sep 15 14:25:32.294778 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:32.294741    2578 generic.go:356] "Generic (PLEG): container finished" podID="290c3566-71d0-4e5d-8e68-a0071bacd1f4" containerID="aa5aec9238a71bdd5c7ace2b942c7ffef558cec20d2efc1742f5692ad9c8fafd" exitCode=0
Sep 15 14:25:32.295173 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:32.294820    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-a090a0-pd6js" event={"ID":"290c3566-71d0-4e5d-8e68-a0071bacd1f4","Type":"ContainerDied","Data":"aa5aec9238a71bdd5c7ace2b942c7ffef558cec20d2efc1742f5692ad9c8fafd"}
Sep 15 14:25:33.430622 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:33.430599    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-a090a0-pd6js"
Sep 15 14:25:33.484562 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:33.484533    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/290c3566-71d0-4e5d-8e68-a0071bacd1f4-maas-api-service-ca\") pod \"290c3566-71d0-4e5d-8e68-a0071bacd1f4\" (UID: \"290c3566-71d0-4e5d-8e68-a0071bacd1f4\") "
Sep 15 14:25:33.484750 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:33.484656    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2x4bl\" (UniqueName: \"kubernetes.io/projected/290c3566-71d0-4e5d-8e68-a0071bacd1f4-kube-api-access-2x4bl\") pod \"290c3566-71d0-4e5d-8e68-a0071bacd1f4\" (UID: \"290c3566-71d0-4e5d-8e68-a0071bacd1f4\") "
Sep 15 14:25:33.484962 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:33.484915    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/290c3566-71d0-4e5d-8e68-a0071bacd1f4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "290c3566-71d0-4e5d-8e68-a0071bacd1f4" (UID: "290c3566-71d0-4e5d-8e68-a0071bacd1f4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 14:25:33.486981 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:33.486954    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/290c3566-71d0-4e5d-8e68-a0071bacd1f4-kube-api-access-2x4bl" (OuterVolumeSpecName: "kube-api-access-2x4bl") pod "290c3566-71d0-4e5d-8e68-a0071bacd1f4" (UID: "290c3566-71d0-4e5d-8e68-a0071bacd1f4"). InnerVolumeSpecName "kube-api-access-2x4bl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 14:25:33.585712 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:33.585635    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2x4bl\" (UniqueName: \"kubernetes.io/projected/290c3566-71d0-4e5d-8e68-a0071bacd1f4-kube-api-access-2x4bl\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:25:33.585712 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:33.585663    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/290c3566-71d0-4e5d-8e68-a0071bacd1f4-maas-api-service-ca\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:25:34.309607 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:34.309573    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-a090a0-pd6js"
Sep 15 14:25:34.309795 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:34.309605    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-a090a0-pd6js" event={"ID":"290c3566-71d0-4e5d-8e68-a0071bacd1f4","Type":"ContainerDied","Data":"f1e7c67a89b8145af33a26fcfdb997b5ca953e4d82bac9c34979a6c07f707eb6"}
Sep 15 14:25:34.309795 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:34.309652    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f1e7c67a89b8145af33a26fcfdb997b5ca953e4d82bac9c34979a6c07f707eb6"
Sep 15 14:25:40.941533 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:40.941501    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-a090a0-29824695-fhkh4"]
Sep 15 14:25:40.954146 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:40.949226    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-a090a0-29824695-fhkh4"]
Sep 15 14:25:40.965242 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:40.965209    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-a090a0-6b87cd4745-ckgzh"]
Sep 15 14:25:40.965562 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:40.965503    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-a090a0-6b87cd4745-ckgzh" podUID="ea660976-e44a-4417-a711-1a9ec206ebf5" containerName="payload-processing" containerID="cri-o://06d9abfd20b0d1630a0caafb6e43fcf2c49ec198130492bf9182cdd2eedcd8c4" gracePeriod=30
Sep 15 14:25:41.058274 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:41.058229    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-a090a0-6b87cd4745-ckgzh" podUID="ea660976-e44a-4417-a711-1a9ec206ebf5" containerName="payload-processing" probeResult="failure" output="dial tcp 10.133.0.104:9004: connect: connection refused"
Sep 15 14:25:41.151405 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:41.151376    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-a090a0-pd6js"]
Sep 15 14:25:41.155399 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:41.155369    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-a090a0-pd6js"]
Sep 15 14:25:41.222802 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:41.222771    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-a090a0-6b87cd4745-ckgzh"
Sep 15 14:25:41.351752 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:41.351720    2578 generic.go:356] "Generic (PLEG): container finished" podID="ea660976-e44a-4417-a711-1a9ec206ebf5" containerID="06d9abfd20b0d1630a0caafb6e43fcf2c49ec198130492bf9182cdd2eedcd8c4" exitCode=0
Sep 15 14:25:41.351932 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:41.351766    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-a090a0-6b87cd4745-ckgzh"
Sep 15 14:25:41.351932 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:41.351810    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-a090a0-6b87cd4745-ckgzh" event={"ID":"ea660976-e44a-4417-a711-1a9ec206ebf5","Type":"ContainerDied","Data":"06d9abfd20b0d1630a0caafb6e43fcf2c49ec198130492bf9182cdd2eedcd8c4"}
Sep 15 14:25:41.351932 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:41.351867    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-a090a0-6b87cd4745-ckgzh" event={"ID":"ea660976-e44a-4417-a711-1a9ec206ebf5","Type":"ContainerDied","Data":"d057ba9d88f4c988be1b62c50005796e42bc789657200484a30418038bc82843"}
Sep 15 14:25:41.351932 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:41.351894    2578 scope.go:117] "RemoveContainer" containerID="06d9abfd20b0d1630a0caafb6e43fcf2c49ec198130492bf9182cdd2eedcd8c4"
Sep 15 14:25:41.358791 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:41.358767    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6kk6k\" (UniqueName: \"kubernetes.io/projected/ea660976-e44a-4417-a711-1a9ec206ebf5-kube-api-access-6kk6k\") pod \"ea660976-e44a-4417-a711-1a9ec206ebf5\" (UID: \"ea660976-e44a-4417-a711-1a9ec206ebf5\") "
Sep 15 14:25:41.358925 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:41.358833    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ea660976-e44a-4417-a711-1a9ec206ebf5-plugins-config-volume\") pod \"ea660976-e44a-4417-a711-1a9ec206ebf5\" (UID: \"ea660976-e44a-4417-a711-1a9ec206ebf5\") "
Sep 15 14:25:41.359252 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:41.359222    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea660976-e44a-4417-a711-1a9ec206ebf5-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ea660976-e44a-4417-a711-1a9ec206ebf5" (UID: "ea660976-e44a-4417-a711-1a9ec206ebf5"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 14:25:41.360909 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:41.360894    2578 scope.go:117] "RemoveContainer" containerID="06d9abfd20b0d1630a0caafb6e43fcf2c49ec198130492bf9182cdd2eedcd8c4"
Sep 15 14:25:41.361034 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:41.361004    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea660976-e44a-4417-a711-1a9ec206ebf5-kube-api-access-6kk6k" (OuterVolumeSpecName: "kube-api-access-6kk6k") pod "ea660976-e44a-4417-a711-1a9ec206ebf5" (UID: "ea660976-e44a-4417-a711-1a9ec206ebf5"). InnerVolumeSpecName "kube-api-access-6kk6k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 14:25:41.361257 ip-10-0-128-41 kubenswrapper[2578]: E0915 14:25:41.361236    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"06d9abfd20b0d1630a0caafb6e43fcf2c49ec198130492bf9182cdd2eedcd8c4\": container with ID starting with 06d9abfd20b0d1630a0caafb6e43fcf2c49ec198130492bf9182cdd2eedcd8c4 not found: ID does not exist" containerID="06d9abfd20b0d1630a0caafb6e43fcf2c49ec198130492bf9182cdd2eedcd8c4"
Sep 15 14:25:41.361340 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:41.361265    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06d9abfd20b0d1630a0caafb6e43fcf2c49ec198130492bf9182cdd2eedcd8c4"} err="failed to get container status \"06d9abfd20b0d1630a0caafb6e43fcf2c49ec198130492bf9182cdd2eedcd8c4\": rpc error: code = NotFound desc = could not find container \"06d9abfd20b0d1630a0caafb6e43fcf2c49ec198130492bf9182cdd2eedcd8c4\": container with ID starting with 06d9abfd20b0d1630a0caafb6e43fcf2c49ec198130492bf9182cdd2eedcd8c4 not found: ID does not exist"
Sep 15 14:25:41.459708 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:41.459624    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ea660976-e44a-4417-a711-1a9ec206ebf5-plugins-config-volume\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:25:41.459708 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:41.459653    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6kk6k\" (UniqueName: \"kubernetes.io/projected/ea660976-e44a-4417-a711-1a9ec206ebf5-kube-api-access-6kk6k\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:25:41.673780 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:41.673745    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-a090a0-6b87cd4745-ckgzh"]
Sep 15 14:25:41.680311 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:41.680287    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-a090a0-6b87cd4745-ckgzh"]
Sep 15 14:25:41.757514 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:41.757425    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="290c3566-71d0-4e5d-8e68-a0071bacd1f4" path="/var/lib/kubelet/pods/290c3566-71d0-4e5d-8e68-a0071bacd1f4/volumes"
Sep 15 14:25:41.757793 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:41.757777    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="54576938-62ab-42da-b7df-e1d0a2126667" path="/var/lib/kubelet/pods/54576938-62ab-42da-b7df-e1d0a2126667/volumes"
Sep 15 14:25:41.758093 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:41.758081    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea660976-e44a-4417-a711-1a9ec206ebf5" path="/var/lib/kubelet/pods/ea660976-e44a-4417-a711-1a9ec206ebf5/volumes"
Sep 15 14:25:47.974937 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:47.974899    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-d418fd-9t4h8"]
Sep 15 14:25:47.975345 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:47.975268    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="290c3566-71d0-4e5d-8e68-a0071bacd1f4" containerName="revoke-keys"
Sep 15 14:25:47.975345 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:47.975279    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="290c3566-71d0-4e5d-8e68-a0071bacd1f4" containerName="revoke-keys"
Sep 15 14:25:47.975345 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:47.975291    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea660976-e44a-4417-a711-1a9ec206ebf5" containerName="payload-processing"
Sep 15 14:25:47.975345 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:47.975298    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea660976-e44a-4417-a711-1a9ec206ebf5" containerName="payload-processing"
Sep 15 14:25:47.975494 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:47.975356    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea660976-e44a-4417-a711-1a9ec206ebf5" containerName="payload-processing"
Sep 15 14:25:47.975494 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:47.975366    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="290c3566-71d0-4e5d-8e68-a0071bacd1f4" containerName="revoke-keys"
Sep 15 14:25:47.978495 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:47.978478    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-d418fd-9t4h8"
Sep 15 14:25:47.980685 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:47.980663    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qzmkv\""
Sep 15 14:25:47.981464 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:47.981447    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 15 14:25:47.981538 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:47.981507    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 14:25:47.986007 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:47.985985    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-d418fd-9t4h8"]
Sep 15 14:25:48.119503 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:48.119469    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f65b3fde-c240-4714-828c-76af4a7916cc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-d418fd-9t4h8\" (UID: \"f65b3fde-c240-4714-828c-76af4a7916cc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-d418fd-9t4h8"
Sep 15 14:25:48.119651 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:48.119549    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkjbw\" (UniqueName: \"kubernetes.io/projected/f65b3fde-c240-4714-828c-76af4a7916cc-kube-api-access-pkjbw\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-d418fd-9t4h8\" (UID: \"f65b3fde-c240-4714-828c-76af4a7916cc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-d418fd-9t4h8"
Sep 15 14:25:48.220709 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:48.220660    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f65b3fde-c240-4714-828c-76af4a7916cc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-d418fd-9t4h8\" (UID: \"f65b3fde-c240-4714-828c-76af4a7916cc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-d418fd-9t4h8"
Sep 15 14:25:48.220929 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:48.220761    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkjbw\" (UniqueName: \"kubernetes.io/projected/f65b3fde-c240-4714-828c-76af4a7916cc-kube-api-access-pkjbw\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-d418fd-9t4h8\" (UID: \"f65b3fde-c240-4714-828c-76af4a7916cc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-d418fd-9t4h8"
Sep 15 14:25:48.221377 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:48.221354    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f65b3fde-c240-4714-828c-76af4a7916cc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-d418fd-9t4h8\" (UID: \"f65b3fde-c240-4714-828c-76af4a7916cc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-d418fd-9t4h8"
Sep 15 14:25:48.229769 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:48.229707    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkjbw\" (UniqueName: \"kubernetes.io/projected/f65b3fde-c240-4714-828c-76af4a7916cc-kube-api-access-pkjbw\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-d418fd-9t4h8\" (UID: \"f65b3fde-c240-4714-828c-76af4a7916cc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-d418fd-9t4h8"
Sep 15 14:25:48.290728 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:48.290700    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-d418fd-9t4h8"
Sep 15 14:25:48.561715 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:48.561690    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-d418fd-9t4h8"]
Sep 15 14:25:48.563930 ip-10-0-128-41 kubenswrapper[2578]: W0915 14:25:48.563905    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf65b3fde_c240_4714_828c_76af4a7916cc.slice/crio-63ac7b059abce26ea540c496fa88403a6c862ffa9f8122bba5b1676b1741faae WatchSource:0}: Error finding container 63ac7b059abce26ea540c496fa88403a6c862ffa9f8122bba5b1676b1741faae: Status 404 returned error can't find the container with id 63ac7b059abce26ea540c496fa88403a6c862ffa9f8122bba5b1676b1741faae
Sep 15 14:25:49.399969 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:49.399942    2578 generic.go:356] "Generic (PLEG): container finished" podID="f65b3fde-c240-4714-828c-76af4a7916cc" containerID="28414fef6e69266e93ce2a8099817d6da7307a65c2c17c5e4f4be02224a85349" exitCode=0
Sep 15 14:25:49.400310 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:49.400016    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-d418fd-9t4h8" event={"ID":"f65b3fde-c240-4714-828c-76af4a7916cc","Type":"ContainerDied","Data":"28414fef6e69266e93ce2a8099817d6da7307a65c2c17c5e4f4be02224a85349"}
Sep 15 14:25:49.400310 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:49.400065    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-d418fd-9t4h8" event={"ID":"f65b3fde-c240-4714-828c-76af4a7916cc","Type":"ContainerStarted","Data":"63ac7b059abce26ea540c496fa88403a6c862ffa9f8122bba5b1676b1741faae"}
Sep 15 14:25:50.539351 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:50.539324    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-d418fd-9t4h8"
Sep 15 14:25:50.643752 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:50.643721    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f65b3fde-c240-4714-828c-76af4a7916cc-maas-api-service-ca\") pod \"f65b3fde-c240-4714-828c-76af4a7916cc\" (UID: \"f65b3fde-c240-4714-828c-76af4a7916cc\") "
Sep 15 14:25:50.643903 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:50.643813    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pkjbw\" (UniqueName: \"kubernetes.io/projected/f65b3fde-c240-4714-828c-76af4a7916cc-kube-api-access-pkjbw\") pod \"f65b3fde-c240-4714-828c-76af4a7916cc\" (UID: \"f65b3fde-c240-4714-828c-76af4a7916cc\") "
Sep 15 14:25:50.644192 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:50.644165    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f65b3fde-c240-4714-828c-76af4a7916cc-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f65b3fde-c240-4714-828c-76af4a7916cc" (UID: "f65b3fde-c240-4714-828c-76af4a7916cc"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 14:25:50.645987 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:50.645960    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f65b3fde-c240-4714-828c-76af4a7916cc-kube-api-access-pkjbw" (OuterVolumeSpecName: "kube-api-access-pkjbw") pod "f65b3fde-c240-4714-828c-76af4a7916cc" (UID: "f65b3fde-c240-4714-828c-76af4a7916cc"). InnerVolumeSpecName "kube-api-access-pkjbw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 14:25:50.745265 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:50.745184    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f65b3fde-c240-4714-828c-76af4a7916cc-maas-api-service-ca\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:25:50.745265 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:50.745211    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pkjbw\" (UniqueName: \"kubernetes.io/projected/f65b3fde-c240-4714-828c-76af4a7916cc-kube-api-access-pkjbw\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:25:51.412996 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:51.412967    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-d418fd-9t4h8"
Sep 15 14:25:51.412996 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:51.412976    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-d418fd-9t4h8" event={"ID":"f65b3fde-c240-4714-828c-76af4a7916cc","Type":"ContainerDied","Data":"63ac7b059abce26ea540c496fa88403a6c862ffa9f8122bba5b1676b1741faae"}
Sep 15 14:25:51.413234 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:51.413018    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="63ac7b059abce26ea540c496fa88403a6c862ffa9f8122bba5b1676b1741faae"
Sep 15 14:25:58.541058 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:58.541024    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-d418fd-29824695-2qwp8"]
Sep 15 14:25:58.545770 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:58.545744    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-d418fd-29824695-2qwp8"]
Sep 15 14:25:58.569934 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:58.569902    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-d418fd-5b7847d9f-vdqwp"]
Sep 15 14:25:58.570190 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:58.570162    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-d418fd-5b7847d9f-vdqwp" podUID="6f9f8be5-896d-447b-9a8f-7643cdc485c8" containerName="payload-processing" containerID="cri-o://12a4a5d459f690a72371f79d9f4728fb0e7dd23fd63b37c4e10ac3e44addcccd" gracePeriod=30
Sep 15 14:25:58.579007 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:58.578985    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-d418fd-6774d98678-87fgz"]
Sep 15 14:25:58.579231 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:58.579206    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-d418fd-6774d98678-87fgz" podUID="76303c83-e12a-441b-b368-99a72c8bff7c" containerName="payload-pre-processing" containerID="cri-o://bb47ec2ae2f561e12b1440b86760f0988d8fd3b88f5fd44b3cae7cebd7d6690a" gracePeriod=30
Sep 15 14:25:58.748978 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:58.748925    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-d418fd-9t4h8"]
Sep 15 14:25:58.751351 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:58.751329    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-d418fd-9t4h8"]
Sep 15 14:25:58.848539 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:58.848517    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-d418fd-5b7847d9f-vdqwp"
Sep 15 14:25:58.851276 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:58.851256    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-d418fd-6774d98678-87fgz"
Sep 15 14:25:58.910760 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:58.910722    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6f9f8be5-896d-447b-9a8f-7643cdc485c8-plugins-config-volume\") pod \"6f9f8be5-896d-447b-9a8f-7643cdc485c8\" (UID: \"6f9f8be5-896d-447b-9a8f-7643cdc485c8\") "
Sep 15 14:25:58.910952 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:58.910768    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sm5jv\" (UniqueName: \"kubernetes.io/projected/76303c83-e12a-441b-b368-99a72c8bff7c-kube-api-access-sm5jv\") pod \"76303c83-e12a-441b-b368-99a72c8bff7c\" (UID: \"76303c83-e12a-441b-b368-99a72c8bff7c\") "
Sep 15 14:25:58.910952 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:58.910786    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pvtr6\" (UniqueName: \"kubernetes.io/projected/6f9f8be5-896d-447b-9a8f-7643cdc485c8-kube-api-access-pvtr6\") pod \"6f9f8be5-896d-447b-9a8f-7643cdc485c8\" (UID: \"6f9f8be5-896d-447b-9a8f-7643cdc485c8\") "
Sep 15 14:25:58.910952 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:58.910824    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/76303c83-e12a-441b-b368-99a72c8bff7c-plugins-config-volume\") pod \"76303c83-e12a-441b-b368-99a72c8bff7c\" (UID: \"76303c83-e12a-441b-b368-99a72c8bff7c\") "
Sep 15 14:25:58.911243 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:58.911197    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f9f8be5-896d-447b-9a8f-7643cdc485c8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6f9f8be5-896d-447b-9a8f-7643cdc485c8" (UID: "6f9f8be5-896d-447b-9a8f-7643cdc485c8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 14:25:58.911367 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:58.911261    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/76303c83-e12a-441b-b368-99a72c8bff7c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "76303c83-e12a-441b-b368-99a72c8bff7c" (UID: "76303c83-e12a-441b-b368-99a72c8bff7c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 14:25:58.913016 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:58.912990    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76303c83-e12a-441b-b368-99a72c8bff7c-kube-api-access-sm5jv" (OuterVolumeSpecName: "kube-api-access-sm5jv") pod "76303c83-e12a-441b-b368-99a72c8bff7c" (UID: "76303c83-e12a-441b-b368-99a72c8bff7c"). InnerVolumeSpecName "kube-api-access-sm5jv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 14:25:58.913364 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:58.913347    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f9f8be5-896d-447b-9a8f-7643cdc485c8-kube-api-access-pvtr6" (OuterVolumeSpecName: "kube-api-access-pvtr6") pod "6f9f8be5-896d-447b-9a8f-7643cdc485c8" (UID: "6f9f8be5-896d-447b-9a8f-7643cdc485c8"). InnerVolumeSpecName "kube-api-access-pvtr6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 14:25:59.011620 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:59.011589    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6f9f8be5-896d-447b-9a8f-7643cdc485c8-plugins-config-volume\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:25:59.011620 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:59.011617    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sm5jv\" (UniqueName: \"kubernetes.io/projected/76303c83-e12a-441b-b368-99a72c8bff7c-kube-api-access-sm5jv\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:25:59.011620 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:59.011626    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pvtr6\" (UniqueName: \"kubernetes.io/projected/6f9f8be5-896d-447b-9a8f-7643cdc485c8-kube-api-access-pvtr6\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:25:59.011850 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:59.011635    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/76303c83-e12a-441b-b368-99a72c8bff7c-plugins-config-volume\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:25:59.459416 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:59.459372    2578 generic.go:356] "Generic (PLEG): container finished" podID="76303c83-e12a-441b-b368-99a72c8bff7c" containerID="bb47ec2ae2f561e12b1440b86760f0988d8fd3b88f5fd44b3cae7cebd7d6690a" exitCode=0
Sep 15 14:25:59.459620 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:59.459432    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-d418fd-6774d98678-87fgz"
Sep 15 14:25:59.459620 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:59.459464    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-d418fd-6774d98678-87fgz" event={"ID":"76303c83-e12a-441b-b368-99a72c8bff7c","Type":"ContainerDied","Data":"bb47ec2ae2f561e12b1440b86760f0988d8fd3b88f5fd44b3cae7cebd7d6690a"}
Sep 15 14:25:59.459620 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:59.459517    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-d418fd-6774d98678-87fgz" event={"ID":"76303c83-e12a-441b-b368-99a72c8bff7c","Type":"ContainerDied","Data":"25928e62f6c8b32ee973b5dfd133a349e10db043ff9de1767390d341d122e3e8"}
Sep 15 14:25:59.459620 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:59.459541    2578 scope.go:117] "RemoveContainer" containerID="bb47ec2ae2f561e12b1440b86760f0988d8fd3b88f5fd44b3cae7cebd7d6690a"
Sep 15 14:25:59.460786 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:59.460764    2578 generic.go:356] "Generic (PLEG): container finished" podID="6f9f8be5-896d-447b-9a8f-7643cdc485c8" containerID="12a4a5d459f690a72371f79d9f4728fb0e7dd23fd63b37c4e10ac3e44addcccd" exitCode=0
Sep 15 14:25:59.460868 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:59.460821    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-d418fd-5b7847d9f-vdqwp"
Sep 15 14:25:59.460868 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:59.460856    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-d418fd-5b7847d9f-vdqwp" event={"ID":"6f9f8be5-896d-447b-9a8f-7643cdc485c8","Type":"ContainerDied","Data":"12a4a5d459f690a72371f79d9f4728fb0e7dd23fd63b37c4e10ac3e44addcccd"}
Sep 15 14:25:59.460979 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:59.460891    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-d418fd-5b7847d9f-vdqwp" event={"ID":"6f9f8be5-896d-447b-9a8f-7643cdc485c8","Type":"ContainerDied","Data":"8971ed9e45e085a0fab8966852a787a6d3471e084b5bb3a656bc5cc3b53c321e"}
Sep 15 14:25:59.469473 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:59.469456    2578 scope.go:117] "RemoveContainer" containerID="bb47ec2ae2f561e12b1440b86760f0988d8fd3b88f5fd44b3cae7cebd7d6690a"
Sep 15 14:25:59.469779 ip-10-0-128-41 kubenswrapper[2578]: E0915 14:25:59.469754    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb47ec2ae2f561e12b1440b86760f0988d8fd3b88f5fd44b3cae7cebd7d6690a\": container with ID starting with bb47ec2ae2f561e12b1440b86760f0988d8fd3b88f5fd44b3cae7cebd7d6690a not found: ID does not exist" containerID="bb47ec2ae2f561e12b1440b86760f0988d8fd3b88f5fd44b3cae7cebd7d6690a"
Sep 15 14:25:59.469926 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:59.469897    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb47ec2ae2f561e12b1440b86760f0988d8fd3b88f5fd44b3cae7cebd7d6690a"} err="failed to get container status \"bb47ec2ae2f561e12b1440b86760f0988d8fd3b88f5fd44b3cae7cebd7d6690a\": rpc error: code = NotFound desc = could not find container \"bb47ec2ae2f561e12b1440b86760f0988d8fd3b88f5fd44b3cae7cebd7d6690a\": container with ID starting with bb47ec2ae2f561e12b1440b86760f0988d8fd3b88f5fd44b3cae7cebd7d6690a not found: ID does not exist"
Sep 15 14:25:59.470020 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:59.469929    2578 scope.go:117] "RemoveContainer" containerID="12a4a5d459f690a72371f79d9f4728fb0e7dd23fd63b37c4e10ac3e44addcccd"
Sep 15 14:25:59.480677 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:59.480659    2578 scope.go:117] "RemoveContainer" containerID="12a4a5d459f690a72371f79d9f4728fb0e7dd23fd63b37c4e10ac3e44addcccd"
Sep 15 14:25:59.481022 ip-10-0-128-41 kubenswrapper[2578]: E0915 14:25:59.480995    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"12a4a5d459f690a72371f79d9f4728fb0e7dd23fd63b37c4e10ac3e44addcccd\": container with ID starting with 12a4a5d459f690a72371f79d9f4728fb0e7dd23fd63b37c4e10ac3e44addcccd not found: ID does not exist" containerID="12a4a5d459f690a72371f79d9f4728fb0e7dd23fd63b37c4e10ac3e44addcccd"
Sep 15 14:25:59.481087 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:59.481032    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12a4a5d459f690a72371f79d9f4728fb0e7dd23fd63b37c4e10ac3e44addcccd"} err="failed to get container status \"12a4a5d459f690a72371f79d9f4728fb0e7dd23fd63b37c4e10ac3e44addcccd\": rpc error: code = NotFound desc = could not find container \"12a4a5d459f690a72371f79d9f4728fb0e7dd23fd63b37c4e10ac3e44addcccd\": container with ID starting with 12a4a5d459f690a72371f79d9f4728fb0e7dd23fd63b37c4e10ac3e44addcccd not found: ID does not exist"
Sep 15 14:25:59.484550 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:59.484527    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-d418fd-5b7847d9f-vdqwp"]
Sep 15 14:25:59.488344 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:59.488320    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-d418fd-5b7847d9f-vdqwp"]
Sep 15 14:25:59.500390 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:59.500364    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-d418fd-6774d98678-87fgz"]
Sep 15 14:25:59.504305 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:59.504284    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-d418fd-6774d98678-87fgz"]
Sep 15 14:25:59.758383 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:59.758304    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f9f8be5-896d-447b-9a8f-7643cdc485c8" path="/var/lib/kubelet/pods/6f9f8be5-896d-447b-9a8f-7643cdc485c8/volumes"
Sep 15 14:25:59.758728 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:59.758674    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="76303c83-e12a-441b-b368-99a72c8bff7c" path="/var/lib/kubelet/pods/76303c83-e12a-441b-b368-99a72c8bff7c/volumes"
Sep 15 14:25:59.758952 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:59.758939    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dbaac8ec-8147-4983-9c92-63efb4f1cd6f" path="/var/lib/kubelet/pods/dbaac8ec-8147-4983-9c92-63efb4f1cd6f/volumes"
Sep 15 14:25:59.759326 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:25:59.759312    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f65b3fde-c240-4714-828c-76af4a7916cc" path="/var/lib/kubelet/pods/f65b3fde-c240-4714-828c-76af4a7916cc/volumes"
Sep 15 14:26:34.525606 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:26:34.525533    2578 scope.go:117] "RemoveContainer" containerID="ced2f9dbce3cdbb9010ee4a56390636c2c719cdd276b9197fdd95387c806793b"
Sep 15 14:26:34.534273 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:26:34.534252    2578 scope.go:117] "RemoveContainer" containerID="818aff19cbb81879a16a32714aadfd6577b3162f02691db8bd277100440788df"
Sep 15 14:27:42.592730 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:27:42.592698    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5745f64bd7-7jmln"]
Sep 15 14:27:42.593278 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:27:42.593208    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76303c83-e12a-441b-b368-99a72c8bff7c" containerName="payload-pre-processing"
Sep 15 14:27:42.593278 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:27:42.593224    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="76303c83-e12a-441b-b368-99a72c8bff7c" containerName="payload-pre-processing"
Sep 15 14:27:42.593278 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:27:42.593233    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f9f8be5-896d-447b-9a8f-7643cdc485c8" containerName="payload-processing"
Sep 15 14:27:42.593278 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:27:42.593239    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f9f8be5-896d-447b-9a8f-7643cdc485c8" containerName="payload-processing"
Sep 15 14:27:42.593278 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:27:42.593255    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f65b3fde-c240-4714-828c-76af4a7916cc" containerName="revoke-keys"
Sep 15 14:27:42.593278 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:27:42.593262    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f65b3fde-c240-4714-828c-76af4a7916cc" containerName="revoke-keys"
Sep 15 14:27:42.593484 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:27:42.593322    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="76303c83-e12a-441b-b368-99a72c8bff7c" containerName="payload-pre-processing"
Sep 15 14:27:42.593484 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:27:42.593334    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f65b3fde-c240-4714-828c-76af4a7916cc" containerName="revoke-keys"
Sep 15 14:27:42.593484 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:27:42.593341    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f9f8be5-896d-447b-9a8f-7643cdc485c8" containerName="payload-processing"
Sep 15 14:27:42.596305 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:27:42.596290    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5745f64bd7-7jmln"
Sep 15 14:27:42.598325 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:27:42.598301    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-lb8r8\""
Sep 15 14:27:42.599085 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:27:42.599065    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 15 14:27:42.599085 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:27:42.599077    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 15 14:27:42.599308 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:27:42.599118    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 15 14:27:42.606872 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:27:42.606852    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5745f64bd7-7jmln"]
Sep 15 14:27:42.719022 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:27:42.718988    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmh55\" (UniqueName: \"kubernetes.io/projected/136db435-6675-498f-bab0-8439261597ec-kube-api-access-qmh55\") pod \"maas-controller-5745f64bd7-7jmln\" (UID: \"136db435-6675-498f-bab0-8439261597ec\") " pod="opendatahub/maas-controller-5745f64bd7-7jmln"
Sep 15 14:27:42.719022 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:27:42.719023    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/136db435-6675-498f-bab0-8439261597ec-webhook-cert\") pod \"maas-controller-5745f64bd7-7jmln\" (UID: \"136db435-6675-498f-bab0-8439261597ec\") " pod="opendatahub/maas-controller-5745f64bd7-7jmln"
Sep 15 14:27:42.719303 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:27:42.719053    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/136db435-6675-498f-bab0-8439261597ec-metrics-certs\") pod \"maas-controller-5745f64bd7-7jmln\" (UID: \"136db435-6675-498f-bab0-8439261597ec\") " pod="opendatahub/maas-controller-5745f64bd7-7jmln"
Sep 15 14:27:42.820003 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:27:42.819967    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/136db435-6675-498f-bab0-8439261597ec-metrics-certs\") pod \"maas-controller-5745f64bd7-7jmln\" (UID: \"136db435-6675-498f-bab0-8439261597ec\") " pod="opendatahub/maas-controller-5745f64bd7-7jmln"
Sep 15 14:27:42.820236 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:27:42.820068    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmh55\" (UniqueName: \"kubernetes.io/projected/136db435-6675-498f-bab0-8439261597ec-kube-api-access-qmh55\") pod \"maas-controller-5745f64bd7-7jmln\" (UID: \"136db435-6675-498f-bab0-8439261597ec\") " pod="opendatahub/maas-controller-5745f64bd7-7jmln"
Sep 15 14:27:42.820236 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:27:42.820091    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/136db435-6675-498f-bab0-8439261597ec-webhook-cert\") pod \"maas-controller-5745f64bd7-7jmln\" (UID: \"136db435-6675-498f-bab0-8439261597ec\") " pod="opendatahub/maas-controller-5745f64bd7-7jmln"
Sep 15 14:27:42.822764 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:27:42.822735    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/136db435-6675-498f-bab0-8439261597ec-webhook-cert\") pod \"maas-controller-5745f64bd7-7jmln\" (UID: \"136db435-6675-498f-bab0-8439261597ec\") " pod="opendatahub/maas-controller-5745f64bd7-7jmln"
Sep 15 14:27:42.822874 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:27:42.822789    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/136db435-6675-498f-bab0-8439261597ec-metrics-certs\") pod \"maas-controller-5745f64bd7-7jmln\" (UID: \"136db435-6675-498f-bab0-8439261597ec\") " pod="opendatahub/maas-controller-5745f64bd7-7jmln"
Sep 15 14:27:42.827844 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:27:42.827826    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmh55\" (UniqueName: \"kubernetes.io/projected/136db435-6675-498f-bab0-8439261597ec-kube-api-access-qmh55\") pod \"maas-controller-5745f64bd7-7jmln\" (UID: \"136db435-6675-498f-bab0-8439261597ec\") " pod="opendatahub/maas-controller-5745f64bd7-7jmln"
Sep 15 14:27:42.907004 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:27:42.906929    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5745f64bd7-7jmln"
Sep 15 14:27:43.179937 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:27:43.179908    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5745f64bd7-7jmln"]
Sep 15 14:27:43.180943 ip-10-0-128-41 kubenswrapper[2578]: W0915 14:27:43.180916    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod136db435_6675_498f_bab0_8439261597ec.slice/crio-1bc957e0fea03b94d47f8cbd43028340fe357f8cff20905e5bc57b3e545db242 WatchSource:0}: Error finding container 1bc957e0fea03b94d47f8cbd43028340fe357f8cff20905e5bc57b3e545db242: Status 404 returned error can't find the container with id 1bc957e0fea03b94d47f8cbd43028340fe357f8cff20905e5bc57b3e545db242
Sep 15 14:27:43.182252 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:27:43.182234    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 14:27:44.034476 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:27:44.034433    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5745f64bd7-7jmln" event={"ID":"136db435-6675-498f-bab0-8439261597ec","Type":"ContainerStarted","Data":"1bc957e0fea03b94d47f8cbd43028340fe357f8cff20905e5bc57b3e545db242"}
Sep 15 14:27:46.048444 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:27:46.048414    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5745f64bd7-7jmln" event={"ID":"136db435-6675-498f-bab0-8439261597ec","Type":"ContainerStarted","Data":"34766d9a30b48d29d076f5ce45643755ceed90c9848767b49839598847f9632f"}
Sep 15 14:27:46.048896 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:27:46.048580    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5745f64bd7-7jmln"
Sep 15 14:27:46.068373 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:27:46.068326    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5745f64bd7-7jmln" podStartSLOduration=1.6501019179999998 podStartE2EDuration="4.0683001s" totalImagesPullingTime="2.418198182s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 14:27:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 14:27:46.066768318 +0000 UTC m=+2952.825894604" watchObservedRunningTime="2026-09-15 14:27:46.0683001 +0000 UTC m=+2952.827426386"
Sep 15 14:27:57.056580 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:27:57.056504    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5745f64bd7-7jmln"
Sep 15 14:30:00.147759 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:30:00.147711    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29824710-tpwpx"]
Sep 15 14:30:00.151215 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:30:00.151194    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-66261e-29824710-d9t4h"]
Sep 15 14:30:00.151354 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:30:00.151319    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824710-tpwpx"
Sep 15 14:30:00.153523 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:30:00.153471    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qzmkv\""
Sep 15 14:30:00.153523 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:30:00.153471    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 14:30:00.153702 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:30:00.153578    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 15 14:30:00.154582 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:30:00.154569    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-4441a1-29824710-85g6x"]
Sep 15 14:30:00.154687 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:30:00.154672    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-66261e-29824710-d9t4h"
Sep 15 14:30:00.157558 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:30:00.157539    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-4441a1-29824710-85g6x"
Sep 15 14:30:00.171016 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:30:00.170993    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-4441a1-29824710-85g6x"]
Sep 15 14:30:00.174603 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:30:00.174575    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29824710-tpwpx"]
Sep 15 14:30:00.177667 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:30:00.177648    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-66261e-29824710-d9t4h"]
Sep 15 14:30:00.224917 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:30:00.224886    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrs5d\" (UniqueName: \"kubernetes.io/projected/660efb95-fd51-4968-b01d-6751a9085416-kube-api-access-qrs5d\") pod \"maas-api-key-cleanup-29824710-tpwpx\" (UID: \"660efb95-fd51-4968-b01d-6751a9085416\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824710-tpwpx"
Sep 15 14:30:00.225105 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:30:00.224936    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xpkn\" (UniqueName: \"kubernetes.io/projected/5ccaceda-1cf9-4494-a002-cd80d2c926c4-kube-api-access-7xpkn\") pod \"maas-api-key-cleanup-e2e-worker-w4-66261e-29824710-d9t4h\" (UID: \"5ccaceda-1cf9-4494-a002-cd80d2c926c4\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-66261e-29824710-d9t4h"
Sep 15 14:30:00.225105 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:30:00.224955    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzbj9\" (UniqueName: \"kubernetes.io/projected/f498e5de-bd0c-4e29-bffd-93a82ede37ff-kube-api-access-tzbj9\") pod \"maas-api-key-cleanup-e2e-inf-a-4441a1-29824710-85g6x\" (UID: \"f498e5de-bd0c-4e29-bffd-93a82ede37ff\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-4441a1-29824710-85g6x"
Sep 15 14:30:00.326248 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:30:00.326208    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrs5d\" (UniqueName: \"kubernetes.io/projected/660efb95-fd51-4968-b01d-6751a9085416-kube-api-access-qrs5d\") pod \"maas-api-key-cleanup-29824710-tpwpx\" (UID: \"660efb95-fd51-4968-b01d-6751a9085416\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824710-tpwpx"
Sep 15 14:30:00.326419 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:30:00.326265    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xpkn\" (UniqueName: \"kubernetes.io/projected/5ccaceda-1cf9-4494-a002-cd80d2c926c4-kube-api-access-7xpkn\") pod \"maas-api-key-cleanup-e2e-worker-w4-66261e-29824710-d9t4h\" (UID: \"5ccaceda-1cf9-4494-a002-cd80d2c926c4\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-66261e-29824710-d9t4h"
Sep 15 14:30:00.326419 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:30:00.326371    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzbj9\" (UniqueName: \"kubernetes.io/projected/f498e5de-bd0c-4e29-bffd-93a82ede37ff-kube-api-access-tzbj9\") pod \"maas-api-key-cleanup-e2e-inf-a-4441a1-29824710-85g6x\" (UID: \"f498e5de-bd0c-4e29-bffd-93a82ede37ff\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-4441a1-29824710-85g6x"
Sep 15 14:30:00.334372 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:30:00.334345    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzbj9\" (UniqueName: \"kubernetes.io/projected/f498e5de-bd0c-4e29-bffd-93a82ede37ff-kube-api-access-tzbj9\") pod \"maas-api-key-cleanup-e2e-inf-a-4441a1-29824710-85g6x\" (UID: \"f498e5de-bd0c-4e29-bffd-93a82ede37ff\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-4441a1-29824710-85g6x"
Sep 15 14:30:00.334491 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:30:00.334450    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xpkn\" (UniqueName: \"kubernetes.io/projected/5ccaceda-1cf9-4494-a002-cd80d2c926c4-kube-api-access-7xpkn\") pod \"maas-api-key-cleanup-e2e-worker-w4-66261e-29824710-d9t4h\" (UID: \"5ccaceda-1cf9-4494-a002-cd80d2c926c4\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-66261e-29824710-d9t4h"
Sep 15 14:30:00.334491 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:30:00.334457    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrs5d\" (UniqueName: \"kubernetes.io/projected/660efb95-fd51-4968-b01d-6751a9085416-kube-api-access-qrs5d\") pod \"maas-api-key-cleanup-29824710-tpwpx\" (UID: \"660efb95-fd51-4968-b01d-6751a9085416\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824710-tpwpx"
Sep 15 14:30:00.462355 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:30:00.462253    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824710-tpwpx"
Sep 15 14:30:00.470387 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:30:00.470365    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-66261e-29824710-d9t4h"
Sep 15 14:30:00.479176 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:30:00.479152    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-4441a1-29824710-85g6x"
Sep 15 14:30:00.739869 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:30:00.739832    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29824710-tpwpx"]
Sep 15 14:30:00.741176 ip-10-0-128-41 kubenswrapper[2578]: W0915 14:30:00.741152    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod660efb95_fd51_4968_b01d_6751a9085416.slice/crio-99943c2bf693109d3ae7476e401578e8bccd54bb30655cd9148c0c14ea27e90c WatchSource:0}: Error finding container 99943c2bf693109d3ae7476e401578e8bccd54bb30655cd9148c0c14ea27e90c: Status 404 returned error can't find the container with id 99943c2bf693109d3ae7476e401578e8bccd54bb30655cd9148c0c14ea27e90c
Sep 15 14:30:00.756162 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:30:00.756099    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-66261e-29824710-d9t4h"]
Sep 15 14:30:00.757735 ip-10-0-128-41 kubenswrapper[2578]: W0915 14:30:00.757625    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ccaceda_1cf9_4494_a002_cd80d2c926c4.slice/crio-f65eae0b594c1a5c2558b5aaf420ce5400bec8017b8f89c06759a8ff8f245596 WatchSource:0}: Error finding container f65eae0b594c1a5c2558b5aaf420ce5400bec8017b8f89c06759a8ff8f245596: Status 404 returned error can't find the container with id f65eae0b594c1a5c2558b5aaf420ce5400bec8017b8f89c06759a8ff8f245596
Sep 15 14:30:00.768829 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:30:00.768808    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-4441a1-29824710-85g6x"]
Sep 15 14:30:00.771921 ip-10-0-128-41 kubenswrapper[2578]: W0915 14:30:00.771900    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf498e5de_bd0c_4e29_bffd_93a82ede37ff.slice/crio-1215d6abc72b328029faed4cc4bc2b2dc1696f62cc19a08904b16d609628fba1 WatchSource:0}: Error finding container 1215d6abc72b328029faed4cc4bc2b2dc1696f62cc19a08904b16d609628fba1: Status 404 returned error can't find the container with id 1215d6abc72b328029faed4cc4bc2b2dc1696f62cc19a08904b16d609628fba1
Sep 15 14:30:00.787931 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:30:00.787902    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-4441a1-29824710-85g6x" event={"ID":"f498e5de-bd0c-4e29-bffd-93a82ede37ff","Type":"ContainerStarted","Data":"1215d6abc72b328029faed4cc4bc2b2dc1696f62cc19a08904b16d609628fba1"}
Sep 15 14:30:00.789178 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:30:00.789154    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824710-tpwpx" event={"ID":"660efb95-fd51-4968-b01d-6751a9085416","Type":"ContainerStarted","Data":"99943c2bf693109d3ae7476e401578e8bccd54bb30655cd9148c0c14ea27e90c"}
Sep 15 14:30:00.790475 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:30:00.790456    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-66261e-29824710-d9t4h" event={"ID":"5ccaceda-1cf9-4494-a002-cd80d2c926c4","Type":"ContainerStarted","Data":"f65eae0b594c1a5c2558b5aaf420ce5400bec8017b8f89c06759a8ff8f245596"}
Sep 15 14:30:01.797435 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:30:01.797407    2578 generic.go:356] "Generic (PLEG): container finished" podID="f498e5de-bd0c-4e29-bffd-93a82ede37ff" containerID="de76ee5cd42e020641da21360c820f23e6118cfcf610965259485f85a3a841c0" exitCode=0
Sep 15 14:30:01.797771 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:30:01.797488    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-4441a1-29824710-85g6x" event={"ID":"f498e5de-bd0c-4e29-bffd-93a82ede37ff","Type":"ContainerDied","Data":"de76ee5cd42e020641da21360c820f23e6118cfcf610965259485f85a3a841c0"}
Sep 15 14:30:01.798953 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:30:01.798931    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824710-tpwpx" event={"ID":"660efb95-fd51-4968-b01d-6751a9085416","Type":"ContainerStarted","Data":"da31ab9f3ba19cc207ec687bf6cce7492d4a0df4bdb5904a7579aea7ed063ecc"}
Sep 15 14:30:01.800406 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:30:01.800388    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-66261e-29824710-d9t4h" event={"ID":"5ccaceda-1cf9-4494-a002-cd80d2c926c4","Type":"ContainerStarted","Data":"d0f86215bc4cf9b425ebabfeb290e430cac6a765e64c2eb9a1d21e4d1104917d"}
Sep 15 14:30:01.830088 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:30:01.830050    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-66261e-29824710-d9t4h" podStartSLOduration=1.830038799 podStartE2EDuration="1.830038799s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 14:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 14:30:01.826994646 +0000 UTC m=+3088.586120933" watchObservedRunningTime="2026-09-15 14:30:01.830038799 +0000 UTC m=+3088.589165084"
Sep 15 14:30:01.842007 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:30:01.841975    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824710-tpwpx" podStartSLOduration=1.841966222 podStartE2EDuration="1.841966222s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 14:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 14:30:01.841084788 +0000 UTC m=+3088.600211077" watchObservedRunningTime="2026-09-15 14:30:01.841966222 +0000 UTC m=+3088.601092508"
Sep 15 14:30:02.807789 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:30:02.807758    2578 generic.go:356] "Generic (PLEG): container finished" podID="660efb95-fd51-4968-b01d-6751a9085416" containerID="da31ab9f3ba19cc207ec687bf6cce7492d4a0df4bdb5904a7579aea7ed063ecc" exitCode=0
Sep 15 14:30:02.808264 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:30:02.807835    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824710-tpwpx" event={"ID":"660efb95-fd51-4968-b01d-6751a9085416","Type":"ContainerDied","Data":"da31ab9f3ba19cc207ec687bf6cce7492d4a0df4bdb5904a7579aea7ed063ecc"}
Sep 15 14:30:02.809371 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:30:02.809345    2578 generic.go:356] "Generic (PLEG): container finished" podID="5ccaceda-1cf9-4494-a002-cd80d2c926c4" containerID="d0f86215bc4cf9b425ebabfeb290e430cac6a765e64c2eb9a1d21e4d1104917d" exitCode=0
Sep 15 14:30:02.809496 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:30:02.809418    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-66261e-29824710-d9t4h" event={"ID":"5ccaceda-1cf9-4494-a002-cd80d2c926c4","Type":"ContainerDied","Data":"d0f86215bc4cf9b425ebabfeb290e430cac6a765e64c2eb9a1d21e4d1104917d"}
Sep 15 14:30:02.941295 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:30:02.941273    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-4441a1-29824710-85g6x"
Sep 15 14:30:03.050897 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:30:03.050858    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tzbj9\" (UniqueName: \"kubernetes.io/projected/f498e5de-bd0c-4e29-bffd-93a82ede37ff-kube-api-access-tzbj9\") pod \"f498e5de-bd0c-4e29-bffd-93a82ede37ff\" (UID: \"f498e5de-bd0c-4e29-bffd-93a82ede37ff\") "
Sep 15 14:30:03.053104 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:30:03.053078    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f498e5de-bd0c-4e29-bffd-93a82ede37ff-kube-api-access-tzbj9" (OuterVolumeSpecName: "kube-api-access-tzbj9") pod "f498e5de-bd0c-4e29-bffd-93a82ede37ff" (UID: "f498e5de-bd0c-4e29-bffd-93a82ede37ff"). InnerVolumeSpecName "kube-api-access-tzbj9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 14:30:03.152106 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:30:03.152070    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tzbj9\" (UniqueName: \"kubernetes.io/projected/f498e5de-bd0c-4e29-bffd-93a82ede37ff-kube-api-access-tzbj9\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:30:03.816396 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:30:03.816358    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-4441a1-29824710-85g6x"
Sep 15 14:30:03.816396 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:30:03.816385    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-4441a1-29824710-85g6x" event={"ID":"f498e5de-bd0c-4e29-bffd-93a82ede37ff","Type":"ContainerDied","Data":"1215d6abc72b328029faed4cc4bc2b2dc1696f62cc19a08904b16d609628fba1"}
Sep 15 14:30:03.816904 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:30:03.816441    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1215d6abc72b328029faed4cc4bc2b2dc1696f62cc19a08904b16d609628fba1"
Sep 15 14:30:03.944462 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:30:03.944437    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824710-tpwpx"
Sep 15 14:30:03.969757 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:30:03.969733    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-66261e-29824710-d9t4h"
Sep 15 14:30:04.059608 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:30:04.059579    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qrs5d\" (UniqueName: \"kubernetes.io/projected/660efb95-fd51-4968-b01d-6751a9085416-kube-api-access-qrs5d\") pod \"660efb95-fd51-4968-b01d-6751a9085416\" (UID: \"660efb95-fd51-4968-b01d-6751a9085416\") "
Sep 15 14:30:04.059786 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:30:04.059643    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7xpkn\" (UniqueName: \"kubernetes.io/projected/5ccaceda-1cf9-4494-a002-cd80d2c926c4-kube-api-access-7xpkn\") pod \"5ccaceda-1cf9-4494-a002-cd80d2c926c4\" (UID: \"5ccaceda-1cf9-4494-a002-cd80d2c926c4\") "
Sep 15 14:30:04.061943 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:30:04.061904    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/660efb95-fd51-4968-b01d-6751a9085416-kube-api-access-qrs5d" (OuterVolumeSpecName: "kube-api-access-qrs5d") pod "660efb95-fd51-4968-b01d-6751a9085416" (UID: "660efb95-fd51-4968-b01d-6751a9085416"). InnerVolumeSpecName "kube-api-access-qrs5d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 14:30:04.062060 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:30:04.061984    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ccaceda-1cf9-4494-a002-cd80d2c926c4-kube-api-access-7xpkn" (OuterVolumeSpecName: "kube-api-access-7xpkn") pod "5ccaceda-1cf9-4494-a002-cd80d2c926c4" (UID: "5ccaceda-1cf9-4494-a002-cd80d2c926c4"). InnerVolumeSpecName "kube-api-access-7xpkn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 14:30:04.160283 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:30:04.160251    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7xpkn\" (UniqueName: \"kubernetes.io/projected/5ccaceda-1cf9-4494-a002-cd80d2c926c4-kube-api-access-7xpkn\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:30:04.160283 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:30:04.160276    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qrs5d\" (UniqueName: \"kubernetes.io/projected/660efb95-fd51-4968-b01d-6751a9085416-kube-api-access-qrs5d\") on node \"ip-10-0-128-41.ec2.internal\" DevicePath \"\""
Sep 15 14:30:04.823543 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:30:04.823513    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824710-tpwpx"
Sep 15 14:30:04.823543 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:30:04.823521    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824710-tpwpx" event={"ID":"660efb95-fd51-4968-b01d-6751a9085416","Type":"ContainerDied","Data":"99943c2bf693109d3ae7476e401578e8bccd54bb30655cd9148c0c14ea27e90c"}
Sep 15 14:30:04.824067 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:30:04.823571    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="99943c2bf693109d3ae7476e401578e8bccd54bb30655cd9148c0c14ea27e90c"
Sep 15 14:30:04.824918 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:30:04.824899    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-66261e-29824710-d9t4h" event={"ID":"5ccaceda-1cf9-4494-a002-cd80d2c926c4","Type":"ContainerDied","Data":"f65eae0b594c1a5c2558b5aaf420ce5400bec8017b8f89c06759a8ff8f245596"}
Sep 15 14:30:04.825037 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:30:04.824940    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f65eae0b594c1a5c2558b5aaf420ce5400bec8017b8f89c06759a8ff8f245596"
Sep 15 14:30:04.825037 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:30:04.824906    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-66261e-29824710-d9t4h"
Sep 15 14:31:34.607032 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:31:34.606999    2578 scope.go:117] "RemoveContainer" containerID="aa5aec9238a71bdd5c7ace2b942c7ffef558cec20d2efc1742f5692ad9c8fafd"
Sep 15 14:32:34.629641 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:32:34.629566    2578 scope.go:117] "RemoveContainer" containerID="28414fef6e69266e93ce2a8099817d6da7307a65c2c17c5e4f4be02224a85349"
Sep 15 14:34:15.366658 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:15.366583    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-686679fc85-dg5w9_d90b63db-0b97-4168-be57-977b7a8b93da/authorino/0.log"
Sep 15 14:34:20.649288 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:20.649251    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5745f64bd7-7jmln_136db435-6675-498f-bab0-8439261597ec/manager/0.log"
Sep 15 14:34:20.754815 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:20.754789    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-78hrh_0f80514d-701e-4963-a345-48c7d8796057/server/0.log"
Sep 15 14:34:20.867292 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:20.867268    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-5r2sc_116b8837-faa3-4205-a545-74d5d324da96/manager/0.log"
Sep 15 14:34:21.232794 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:21.232759    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79c64c4b4d-m7x76_9930f089-375a-4f00-beaf-58065e7a9856/manager/0.log"
Sep 15 14:34:21.238418 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:21.238392    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79c64c4b4d-m7x76_9930f089-375a-4f00-beaf-58065e7a9856/copy-manifests/0.log"
Sep 15 14:34:22.183233 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:22.183208    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29824680-s9fdj_19766772-6ae9-4d82-8768-cac7f2dfea80/cleanup/0.log"
Sep 15 14:34:22.390469 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:22.390444    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29824710-tpwpx_660efb95-fd51-4968-b01d-6751a9085416/cleanup/0.log"
Sep 15 14:34:22.496956 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:22.496882    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-e2e-inf-a-4441a1-29824680-5hlnr_2d17f181-77aa-4775-9613-f7fdc04ce7a7/cleanup/0.log"
Sep 15 14:34:22.708609 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:22.708580    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-e2e-inf-a-4441a1-29824710-85g6x_f498e5de-bd0c-4e29-bffd-93a82ede37ff/cleanup/0.log"
Sep 15 14:34:22.816573 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:22.816545    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-e2e-inf-b-2aa332-29824680-n647m_0b733285-2d1c-4ad2-8551-94c8d89cd1a3/cleanup/0.log"
Sep 15 14:34:22.919365 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:22.919341    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-e2e-inf-b-2aa332-29824695-qf6cc_cc908b90-c185-4e0b-9b5d-489c881a472d/cleanup/0.log"
Sep 15 14:34:23.553368 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:23.553340    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-e2e-worker-w4-66261e-29824695-n48jq_8ac73ffc-507f-4caf-9a81-14c5853978a3/cleanup/0.log"
Sep 15 14:34:23.658874 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:23.658842    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-e2e-worker-w4-66261e-29824710-d9t4h_5ccaceda-1cf9-4494-a002-cd80d2c926c4/cleanup/0.log"
Sep 15 14:34:24.505647 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:24.505612    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-686679fc85-dg5w9_d90b63db-0b97-4168-be57-977b7a8b93da/authorino/0.log"
Sep 15 14:34:25.508250 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:25.508219    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cn944f_c36a0b6f-a495-4981-a50c-116c85318be0/istio-proxy/0.log"
Sep 15 14:34:25.835922 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:25.835893    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-698b9db946-nq62k_d3daa183-93c9-4594-ac13-c48a9432b956/kube-auth-proxy/0.log"
Sep 15 14:34:26.272883 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:26.272802    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-e2e-inf-b-2aa332-59b4cfbf86-4lt9q_00a7d446-8d28-4465-a461-350f03c78426/payload-pre-processing/0.log"
Sep 15 14:34:27.140965 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:27.140930    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-55fc4dcbd8-x64q6_cc6f77f9-a7c4-4a0f-8f5b-46459356b060/router/0.log"
Sep 15 14:34:27.569980 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:27.569953    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-gxtfg_7aad3aa3-c750-4d41-bc78-9069c4b04a83/main/0.log"
Sep 15 14:34:28.103235 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:28.103210    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-4jbgx_d2caea43-db92-4736-a8ae-5253f944fbeb/main/0.log"
Sep 15 14:34:33.279465 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:33.279432    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-dnzfz/must-gather-4mgps"]
Sep 15 14:34:33.279847 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:33.279782    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f498e5de-bd0c-4e29-bffd-93a82ede37ff" containerName="cleanup"
Sep 15 14:34:33.279847 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:33.279796    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f498e5de-bd0c-4e29-bffd-93a82ede37ff" containerName="cleanup"
Sep 15 14:34:33.279847 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:33.279815    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="660efb95-fd51-4968-b01d-6751a9085416" containerName="cleanup"
Sep 15 14:34:33.279847 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:33.279824    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="660efb95-fd51-4968-b01d-6751a9085416" containerName="cleanup"
Sep 15 14:34:33.279847 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:33.279836    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ccaceda-1cf9-4494-a002-cd80d2c926c4" containerName="cleanup"
Sep 15 14:34:33.279847 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:33.279841    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ccaceda-1cf9-4494-a002-cd80d2c926c4" containerName="cleanup"
Sep 15 14:34:33.280046 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:33.279897    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="660efb95-fd51-4968-b01d-6751a9085416" containerName="cleanup"
Sep 15 14:34:33.280046 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:33.279907    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ccaceda-1cf9-4494-a002-cd80d2c926c4" containerName="cleanup"
Sep 15 14:34:33.280046 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:33.279913    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f498e5de-bd0c-4e29-bffd-93a82ede37ff" containerName="cleanup"
Sep 15 14:34:33.283266 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:33.283245    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dnzfz/must-gather-4mgps"
Sep 15 14:34:33.286168 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:33.286150    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dnzfz\"/\"openshift-service-ca.crt\""
Sep 15 14:34:33.288324 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:33.288308    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dnzfz\"/\"kube-root-ca.crt\""
Sep 15 14:34:33.300701 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:33.300679    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dnzfz/must-gather-4mgps"]
Sep 15 14:34:33.352053 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:33.352023    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbbdd\" (UniqueName: \"kubernetes.io/projected/b825cd56-5bd9-468a-9f85-93fe8ac65be1-kube-api-access-tbbdd\") pod \"must-gather-4mgps\" (UID: \"b825cd56-5bd9-468a-9f85-93fe8ac65be1\") " pod="openshift-must-gather-dnzfz/must-gather-4mgps"
Sep 15 14:34:33.352227 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:33.352079    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b825cd56-5bd9-468a-9f85-93fe8ac65be1-must-gather-output\") pod \"must-gather-4mgps\" (UID: \"b825cd56-5bd9-468a-9f85-93fe8ac65be1\") " pod="openshift-must-gather-dnzfz/must-gather-4mgps"
Sep 15 14:34:33.452559 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:33.452524    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbbdd\" (UniqueName: \"kubernetes.io/projected/b825cd56-5bd9-468a-9f85-93fe8ac65be1-kube-api-access-tbbdd\") pod \"must-gather-4mgps\" (UID: \"b825cd56-5bd9-468a-9f85-93fe8ac65be1\") " pod="openshift-must-gather-dnzfz/must-gather-4mgps"
Sep 15 14:34:33.452727 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:33.452582    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b825cd56-5bd9-468a-9f85-93fe8ac65be1-must-gather-output\") pod \"must-gather-4mgps\" (UID: \"b825cd56-5bd9-468a-9f85-93fe8ac65be1\") " pod="openshift-must-gather-dnzfz/must-gather-4mgps"
Sep 15 14:34:33.452926 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:33.452911    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b825cd56-5bd9-468a-9f85-93fe8ac65be1-must-gather-output\") pod \"must-gather-4mgps\" (UID: \"b825cd56-5bd9-468a-9f85-93fe8ac65be1\") " pod="openshift-must-gather-dnzfz/must-gather-4mgps"
Sep 15 14:34:33.461006 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:33.460975    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbbdd\" (UniqueName: \"kubernetes.io/projected/b825cd56-5bd9-468a-9f85-93fe8ac65be1-kube-api-access-tbbdd\") pod \"must-gather-4mgps\" (UID: \"b825cd56-5bd9-468a-9f85-93fe8ac65be1\") " pod="openshift-must-gather-dnzfz/must-gather-4mgps"
Sep 15 14:34:33.592446 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:33.592369    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dnzfz/must-gather-4mgps"
Sep 15 14:34:33.862297 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:33.862268    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dnzfz/must-gather-4mgps"]
Sep 15 14:34:33.863475 ip-10-0-128-41 kubenswrapper[2578]: W0915 14:34:33.863451    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb825cd56_5bd9_468a_9f85_93fe8ac65be1.slice/crio-3103e29ed1edb553fa7c2f52cfce3274efd82bafff6c8ef46953fc9b819f6f41 WatchSource:0}: Error finding container 3103e29ed1edb553fa7c2f52cfce3274efd82bafff6c8ef46953fc9b819f6f41: Status 404 returned error can't find the container with id 3103e29ed1edb553fa7c2f52cfce3274efd82bafff6c8ef46953fc9b819f6f41
Sep 15 14:34:33.865229 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:33.865212    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 14:34:34.317401 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:34.317360    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dnzfz/must-gather-4mgps" event={"ID":"b825cd56-5bd9-468a-9f85-93fe8ac65be1","Type":"ContainerStarted","Data":"3103e29ed1edb553fa7c2f52cfce3274efd82bafff6c8ef46953fc9b819f6f41"}
Sep 15 14:34:35.330805 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:35.330768    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dnzfz/must-gather-4mgps" event={"ID":"b825cd56-5bd9-468a-9f85-93fe8ac65be1","Type":"ContainerStarted","Data":"c867f738890a6f81c5c405b425463d1039f8fbc801d44fdeef4dc05c08ead40a"}
Sep 15 14:34:35.331306 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:35.330815    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dnzfz/must-gather-4mgps" event={"ID":"b825cd56-5bd9-468a-9f85-93fe8ac65be1","Type":"ContainerStarted","Data":"52db1f43f46ead811c26aadb5f79301b4175c5253c41db422294617bd12f969b"}
Sep 15 14:34:35.347526 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:35.347467    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-dnzfz/must-gather-4mgps" podStartSLOduration=1.344955617 podStartE2EDuration="2.347446606s" totalImagesPullingTime="1.002490989s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 14:34:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 14:34:35.346255039 +0000 UTC m=+3362.105381328" watchObservedRunningTime="2026-09-15 14:34:35.347446606 +0000 UTC m=+3362.106572893"
Sep 15 14:34:36.412571 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:36.412544    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-f54mn_a1307640-dec4-44a3-a888-f8b1b097f902/global-pull-secret-syncer/0.log"
Sep 15 14:34:36.520354 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:36.520313    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-bq5dg_cf80e34c-17f8-4fb2-98c0-c9a5a6faf53f/konnectivity-agent/0.log"
Sep 15 14:34:36.586395 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:36.586366    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-41.ec2.internal_05a0e38cdf2b9f115ed4af66ef9f8f2f/haproxy/0.log"
Sep 15 14:34:41.318686 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:41.318455    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-686679fc85-dg5w9_d90b63db-0b97-4168-be57-977b7a8b93da/authorino/0.log"
Sep 15 14:34:43.213176 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:43.213140    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cd954b897-tw8sw_e149b61b-8b51-4602-8fdf-b81c7a7b20ec/cluster-monitoring-operator/0.log"
Sep 15 14:34:43.354145 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:43.354105    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4p6mg_2d23b647-7f2e-4c14-997a-6c3c42cf592c/node-exporter/0.log"
Sep 15 14:34:43.379273 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:43.379247    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4p6mg_2d23b647-7f2e-4c14-997a-6c3c42cf592c/kube-rbac-proxy/0.log"
Sep 15 14:34:43.398805 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:43.398758    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4p6mg_2d23b647-7f2e-4c14-997a-6c3c42cf592c/init-textfile/0.log"
Sep 15 14:34:43.923691 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:43.923655    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5864cd99d7-hr4q2_bf47f264-6165-46dd-9192-2d68ffdc9ebf/prometheus-operator-admission-webhook/0.log"
Sep 15 14:34:43.960795 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:43.960751    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6655b69fc9-wmb2j_1993b823-2d2f-44b5-a062-64a4de750365/telemeter-client/0.log"
Sep 15 14:34:43.981520 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:43.981487    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6655b69fc9-wmb2j_1993b823-2d2f-44b5-a062-64a4de750365/reload/0.log"
Sep 15 14:34:44.001588 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:44.001561    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6655b69fc9-wmb2j_1993b823-2d2f-44b5-a062-64a4de750365/kube-rbac-proxy/0.log"
Sep 15 14:34:46.804720 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:46.804693    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-c4867564f-4zxcl_1906bdeb-6fdb-480f-b891-711dc2a5d8d3/console/0.log"
Sep 15 14:34:46.835863 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:46.835833    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-dnzfz/perf-node-gather-daemonset-5h5td"]
Sep 15 14:34:46.840500 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:46.840476    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dnzfz/perf-node-gather-daemonset-5h5td"
Sep 15 14:34:46.842621 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:46.842597    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-dnzfz\"/\"default-dockercfg-kqx7l\""
Sep 15 14:34:46.849222 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:46.849198    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dnzfz/perf-node-gather-daemonset-5h5td"]
Sep 15 14:34:46.903660 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:46.903613    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/828b6f7e-5a1e-4d05-a94a-accb01134f19-podres\") pod \"perf-node-gather-daemonset-5h5td\" (UID: \"828b6f7e-5a1e-4d05-a94a-accb01134f19\") " pod="openshift-must-gather-dnzfz/perf-node-gather-daemonset-5h5td"
Sep 15 14:34:46.903859 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:46.903739    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/828b6f7e-5a1e-4d05-a94a-accb01134f19-lib-modules\") pod \"perf-node-gather-daemonset-5h5td\" (UID: \"828b6f7e-5a1e-4d05-a94a-accb01134f19\") " pod="openshift-must-gather-dnzfz/perf-node-gather-daemonset-5h5td"
Sep 15 14:34:46.903934 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:46.903850    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/828b6f7e-5a1e-4d05-a94a-accb01134f19-proc\") pod \"perf-node-gather-daemonset-5h5td\" (UID: \"828b6f7e-5a1e-4d05-a94a-accb01134f19\") " pod="openshift-must-gather-dnzfz/perf-node-gather-daemonset-5h5td"
Sep 15 14:34:46.903934 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:46.903908    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vw6g\" (UniqueName: \"kubernetes.io/projected/828b6f7e-5a1e-4d05-a94a-accb01134f19-kube-api-access-7vw6g\") pod \"perf-node-gather-daemonset-5h5td\" (UID: \"828b6f7e-5a1e-4d05-a94a-accb01134f19\") " pod="openshift-must-gather-dnzfz/perf-node-gather-daemonset-5h5td"
Sep 15 14:34:46.904045 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:46.903958    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/828b6f7e-5a1e-4d05-a94a-accb01134f19-sys\") pod \"perf-node-gather-daemonset-5h5td\" (UID: \"828b6f7e-5a1e-4d05-a94a-accb01134f19\") " pod="openshift-must-gather-dnzfz/perf-node-gather-daemonset-5h5td"
Sep 15 14:34:47.005287 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:47.005247    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/828b6f7e-5a1e-4d05-a94a-accb01134f19-sys\") pod \"perf-node-gather-daemonset-5h5td\" (UID: \"828b6f7e-5a1e-4d05-a94a-accb01134f19\") " pod="openshift-must-gather-dnzfz/perf-node-gather-daemonset-5h5td"
Sep 15 14:34:47.005534 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:47.005504    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/828b6f7e-5a1e-4d05-a94a-accb01134f19-sys\") pod \"perf-node-gather-daemonset-5h5td\" (UID: \"828b6f7e-5a1e-4d05-a94a-accb01134f19\") " pod="openshift-must-gather-dnzfz/perf-node-gather-daemonset-5h5td"
Sep 15 14:34:47.005650 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:47.005629    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/828b6f7e-5a1e-4d05-a94a-accb01134f19-podres\") pod \"perf-node-gather-daemonset-5h5td\" (UID: \"828b6f7e-5a1e-4d05-a94a-accb01134f19\") " pod="openshift-must-gather-dnzfz/perf-node-gather-daemonset-5h5td"
Sep 15 14:34:47.005814 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:47.005798    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/828b6f7e-5a1e-4d05-a94a-accb01134f19-lib-modules\") pod \"perf-node-gather-daemonset-5h5td\" (UID: \"828b6f7e-5a1e-4d05-a94a-accb01134f19\") " pod="openshift-must-gather-dnzfz/perf-node-gather-daemonset-5h5td"
Sep 15 14:34:47.005953 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:47.005941    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/828b6f7e-5a1e-4d05-a94a-accb01134f19-proc\") pod \"perf-node-gather-daemonset-5h5td\" (UID: \"828b6f7e-5a1e-4d05-a94a-accb01134f19\") " pod="openshift-must-gather-dnzfz/perf-node-gather-daemonset-5h5td"
Sep 15 14:34:47.006065 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:47.006052    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vw6g\" (UniqueName: \"kubernetes.io/projected/828b6f7e-5a1e-4d05-a94a-accb01134f19-kube-api-access-7vw6g\") pod \"perf-node-gather-daemonset-5h5td\" (UID: \"828b6f7e-5a1e-4d05-a94a-accb01134f19\") " pod="openshift-must-gather-dnzfz/perf-node-gather-daemonset-5h5td"
Sep 15 14:34:47.006698 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:47.006664    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/828b6f7e-5a1e-4d05-a94a-accb01134f19-podres\") pod \"perf-node-gather-daemonset-5h5td\" (UID: \"828b6f7e-5a1e-4d05-a94a-accb01134f19\") " pod="openshift-must-gather-dnzfz/perf-node-gather-daemonset-5h5td"
Sep 15 14:34:47.006698 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:47.006686    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/828b6f7e-5a1e-4d05-a94a-accb01134f19-lib-modules\") pod \"perf-node-gather-daemonset-5h5td\" (UID: \"828b6f7e-5a1e-4d05-a94a-accb01134f19\") " pod="openshift-must-gather-dnzfz/perf-node-gather-daemonset-5h5td"
Sep 15 14:34:47.006855 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:47.006684    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/828b6f7e-5a1e-4d05-a94a-accb01134f19-proc\") pod \"perf-node-gather-daemonset-5h5td\" (UID: \"828b6f7e-5a1e-4d05-a94a-accb01134f19\") " pod="openshift-must-gather-dnzfz/perf-node-gather-daemonset-5h5td"
Sep 15 14:34:47.014790 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:47.014764    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vw6g\" (UniqueName: \"kubernetes.io/projected/828b6f7e-5a1e-4d05-a94a-accb01134f19-kube-api-access-7vw6g\") pod \"perf-node-gather-daemonset-5h5td\" (UID: \"828b6f7e-5a1e-4d05-a94a-accb01134f19\") " pod="openshift-must-gather-dnzfz/perf-node-gather-daemonset-5h5td"
Sep 15 14:34:47.154093 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:47.154018    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dnzfz/perf-node-gather-daemonset-5h5td"
Sep 15 14:34:47.454421 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:47.454389    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dnzfz/perf-node-gather-daemonset-5h5td"]
Sep 15 14:34:47.457072 ip-10-0-128-41 kubenswrapper[2578]: W0915 14:34:47.457040    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod828b6f7e_5a1e_4d05_a94a_accb01134f19.slice/crio-b5361d7b198f3dc1a06301c73f0615d2453864c30afdea02ee440afab23cf80f WatchSource:0}: Error finding container b5361d7b198f3dc1a06301c73f0615d2453864c30afdea02ee440afab23cf80f: Status 404 returned error can't find the container with id b5361d7b198f3dc1a06301c73f0615d2453864c30afdea02ee440afab23cf80f
Sep 15 14:34:47.543922 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:47.543893    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-86695b7cc7-mxjg9_4a3b4228-587e-4134-b561-79f80de47185/volume-data-source-validator/0.log"
Sep 15 14:34:48.435752 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:48.435717    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dnzfz/perf-node-gather-daemonset-5h5td" event={"ID":"828b6f7e-5a1e-4d05-a94a-accb01134f19","Type":"ContainerStarted","Data":"0ebe9127f56f3ee28793deeb949b859ac5e0ed564a6c8048e9334a287dc60dee"}
Sep 15 14:34:48.436262 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:48.435773    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dnzfz/perf-node-gather-daemonset-5h5td" event={"ID":"828b6f7e-5a1e-4d05-a94a-accb01134f19","Type":"ContainerStarted","Data":"b5361d7b198f3dc1a06301c73f0615d2453864c30afdea02ee440afab23cf80f"}
Sep 15 14:34:48.436262 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:48.435934    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-dnzfz/perf-node-gather-daemonset-5h5td"
Sep 15 14:34:48.452745 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:48.452690    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-dnzfz/perf-node-gather-daemonset-5h5td" podStartSLOduration=2.452671417 podStartE2EDuration="2.452671417s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 14:34:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 14:34:48.449637776 +0000 UTC m=+3375.208764063" watchObservedRunningTime="2026-09-15 14:34:48.452671417 +0000 UTC m=+3375.211797704"
Sep 15 14:34:48.694647 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:48.694581    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6gzxz_1f0ca597-861a-4320-b16c-f87fa68dcf0b/dns/0.log"
Sep 15 14:34:48.712462 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:48.712436    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6gzxz_1f0ca597-861a-4320-b16c-f87fa68dcf0b/kube-rbac-proxy/0.log"
Sep 15 14:34:48.815759 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:48.815724    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-425qw_b469b218-cbd7-4873-836f-99ac075ab6ec/dns-node-resolver/0.log"
Sep 15 14:34:49.377651 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:49.377617    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-556c8d5f67-cj9zw_492ebd98-bb7b-4ac7-8cd6-c5471e55b93f/registry/0.log"
Sep 15 14:34:49.398976 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:49.398945    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8tcrg_c6e7d350-b090-4857-a0ce-a608bdcfb099/node-ca/0.log"
Sep 15 14:34:50.351293 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:50.351258    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cn944f_c36a0b6f-a495-4981-a50c-116c85318be0/istio-proxy/0.log"
Sep 15 14:34:51.039691 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:51.039664    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-698b9db946-nq62k_d3daa183-93c9-4594-ac13-c48a9432b956/kube-auth-proxy/0.log"
Sep 15 14:34:51.144837 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:51.144803    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-e2e-inf-b-2aa332-59b4cfbf86-4lt9q_00a7d446-8d28-4465-a461-350f03c78426/payload-pre-processing/0.log"
Sep 15 14:34:51.350081 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:51.349967    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-55fc4dcbd8-x64q6_cc6f77f9-a7c4-4a0f-8f5b-46459356b060/router/0.log"
Sep 15 14:34:52.315233 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:52.315207    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-s9sjm_190df695-604e-4d5c-8807-e2095d95564b/serve-healthcheck-canary/0.log"
Sep 15 14:34:52.782411 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:52.782384    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5844b856db-tkwx9_ffcd10ba-e428-40f8-875a-64439cf04619/insights-operator/0.log"
Sep 15 14:34:52.941608 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:52.941580    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vflrz_a1710f54-b8e1-4e6e-aebd-d54e6eb4217a/kube-rbac-proxy/0.log"
Sep 15 14:34:52.959434 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:52.959383    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vflrz_a1710f54-b8e1-4e6e-aebd-d54e6eb4217a/exporter/0.log"
Sep 15 14:34:52.978886 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:52.978858    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vflrz_a1710f54-b8e1-4e6e-aebd-d54e6eb4217a/extractor/0.log"
Sep 15 14:34:54.456938 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:54.456905    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-dnzfz/perf-node-gather-daemonset-5h5td"
Sep 15 14:34:55.295350 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:55.295320    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5745f64bd7-7jmln_136db435-6675-498f-bab0-8439261597ec/manager/0.log"
Sep 15 14:34:55.322691 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:55.322660    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-78hrh_0f80514d-701e-4963-a345-48c7d8796057/server/0.log"
Sep 15 14:34:55.426572 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:55.426534    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-5r2sc_116b8837-faa3-4205-a545-74d5d324da96/manager/0.log"
Sep 15 14:34:55.660086 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:55.660003    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79c64c4b4d-m7x76_9930f089-375a-4f00-beaf-58065e7a9856/manager/0.log"
Sep 15 14:34:55.688960 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:55.688928    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79c64c4b4d-m7x76_9930f089-375a-4f00-beaf-58065e7a9856/copy-manifests/0.log"
Sep 15 14:34:56.797971 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:56.797943    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cn944f_c36a0b6f-a495-4981-a50c-116c85318be0/istio-proxy/0.log"
Sep 15 14:34:57.166172 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:57.166136    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6445fb96b-7t5vn_28bf48a5-85e3-471e-be49-742bee0e1b7a/manager/0.log"
Sep 15 14:34:57.212508 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:57.212478    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-trdd7_53d0c35e-831f-4a49-aa66-53a4e6457363/openshift-lws-operator/0.log"
Sep 15 14:34:57.465645 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:57.465618    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-698b9db946-nq62k_d3daa183-93c9-4594-ac13-c48a9432b956/kube-auth-proxy/0.log"
Sep 15 14:34:57.537718 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:57.537691    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-e2e-inf-b-2aa332-59b4cfbf86-4lt9q_00a7d446-8d28-4465-a461-350f03c78426/payload-pre-processing/0.log"
Sep 15 14:34:57.664866 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:57.664827    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-55fc4dcbd8-x64q6_cc6f77f9-a7c4-4a0f-8f5b-46459356b060/router/0.log"
Sep 15 14:34:59.212257 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:59.212225    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cn944f_c36a0b6f-a495-4981-a50c-116c85318be0/istio-proxy/0.log"
Sep 15 14:34:59.889066 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:59.889036    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-698b9db946-nq62k_d3daa183-93c9-4594-ac13-c48a9432b956/kube-auth-proxy/0.log"
Sep 15 14:34:59.968245 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:34:59.968216    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-e2e-inf-b-2aa332-59b4cfbf86-4lt9q_00a7d446-8d28-4465-a461-350f03c78426/payload-pre-processing/0.log"
Sep 15 14:35:00.113461 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:35:00.113423    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-55fc4dcbd8-x64q6_cc6f77f9-a7c4-4a0f-8f5b-46459356b060/router/0.log"
Sep 15 14:35:02.424993 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:35:02.424966    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-zpmzg_39befdfe-8c59-4d05-9da7-5bb64f8ce5a7/kube-storage-version-migrator-operator/0.log"
Sep 15 14:35:03.623097 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:35:03.623062    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tgmg6_41073b32-ff62-4ae9-a4e8-aec2b819dd57/kube-multus-additional-cni-plugins/0.log"
Sep 15 14:35:03.641390 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:35:03.641366    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tgmg6_41073b32-ff62-4ae9-a4e8-aec2b819dd57/egress-router-binary-copy/0.log"
Sep 15 14:35:03.659560 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:35:03.659535    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tgmg6_41073b32-ff62-4ae9-a4e8-aec2b819dd57/cni-plugins/0.log"
Sep 15 14:35:03.678084 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:35:03.678056    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tgmg6_41073b32-ff62-4ae9-a4e8-aec2b819dd57/bond-cni-plugin/0.log"
Sep 15 14:35:03.696085 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:35:03.696063    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tgmg6_41073b32-ff62-4ae9-a4e8-aec2b819dd57/routeoverride-cni/0.log"
Sep 15 14:35:03.714516 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:35:03.714492    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tgmg6_41073b32-ff62-4ae9-a4e8-aec2b819dd57/whereabouts-cni-bincopy/0.log"
Sep 15 14:35:03.732238 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:35:03.732209    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tgmg6_41073b32-ff62-4ae9-a4e8-aec2b819dd57/whereabouts-cni/0.log"
Sep 15 14:35:03.979934 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:35:03.979901    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-kjvpd_fa66793f-19a0-4e87-9a7e-f2c1491c261f/kube-multus/0.log"
Sep 15 14:35:04.186253 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:35:04.186221    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-fsnbc_525d9c79-829f-45ae-9cd5-af323bc737ef/network-metrics-daemon/0.log"
Sep 15 14:35:04.205102 ip-10-0-128-41 kubenswrapper[2578]: I0915 14:35:04.205075    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-fsnbc_525d9c79-829f-45ae-9cd5-af323bc737ef/kube-rbac-proxy/0.log"